Limits...
True and Perceived Synchrony are Preferentially Associated With Particular Sensory Pairings.

Noel JP, Wallace MT, Orchard-Mills E, Alais D, Van der Burg E - Sci Rep (2015)

Bottom Line: We demonstrate that TBWs correlate within individuals and across multisensory pairings, but PSSs do not.Further, we reveal that while the audiotactile and audiovisual pairings show tightly related TBWs, they also exhibit a differential relationship with respect to true and perceived multisensory synchrony.Thus, audiotactile and audiovisual temporal processing share mechanistic features yet are respectively functionally linked to objective and subjective synchrony.

View Article: PubMed Central - PubMed

Affiliation: Neuroscience Graduate Program, Vanderbilt University Medical Center, Nashville, TN 37240, USA.

ABSTRACT
Perception and behavior are fundamentally shaped by the integration of different sensory modalities into unique multisensory representations, a process governed by spatio-temporal correspondence. Prior work has characterized temporal perception using the point in time at which subjects are most likely to judge multisensory stimuli to be simultaneous (PSS) and the temporal binding window (TBW) over which participants are likely to do so. Here we examine the relationship between the PSS and the TBW within and between individuals, and within and between three sensory combinations: audiovisual, audiotactile and visuotactile. We demonstrate that TBWs correlate within individuals and across multisensory pairings, but PSSs do not. Further, we reveal that while the audiotactile and audiovisual pairings show tightly related TBWs, they also exhibit a differential relationship with respect to true and perceived multisensory synchrony. Thus, audiotactile and audiovisual temporal processing share mechanistic features yet are respectively functionally linked to objective and subjective synchrony.

No MeSH data available.


Simultaneity judgments for audio-visual, audio-tactile, and visuo-tactile pairs.Proportion of synchrony reports are plotted as a function of Stimulus Onset Asynchrony (SAO) and stimulus pair, audio-visual (blue), audio-tactile (red), and visuo-tactile (black). Gaussian curves are fitted to raw data and represented as solid lines. Point of subjective simultaneity (PSS) and temporal binding window (TBW) are represented by the distribution’s mean and standard deviation parameters, respectively, as illustrated for the audio-visual pair. Error bars represent ± 1 SEM.
© Copyright Policy - open-access
Related In: Results  -  Collection

License
getmorefigures.php?uid=PMC4664927&req=5

f1: Simultaneity judgments for audio-visual, audio-tactile, and visuo-tactile pairs.Proportion of synchrony reports are plotted as a function of Stimulus Onset Asynchrony (SAO) and stimulus pair, audio-visual (blue), audio-tactile (red), and visuo-tactile (black). Gaussian curves are fitted to raw data and represented as solid lines. Point of subjective simultaneity (PSS) and temporal binding window (TBW) are represented by the distribution’s mean and standard deviation parameters, respectively, as illustrated for the audio-visual pair. Error bars represent ± 1 SEM.

Mentions: As shown in Fig. 1, a within-subjects one-way ANOVA revealed that the mean distance between true and perceived simultaneity (i.e., distance between SOA = 0 and SOA = PSS) across the AV, AT, and VT pairs were significantly different (F (2, 34) = 89.26, p < 0.001, partial η2 = 0.84). Whereas the perceived synchrony of VT pairings was furthest in time from objective simultaneity (M = 73.41 ms, S.E.M = 5.25 ms), the mean PSS for AT pairs was at an intermediate distance (M = 51.71 ms, S.E.M = 9.25 ms), and the mean PSS for AV pairings was judged closest to (and not statistically different from) objective synchrony (M = 9.06 ms, S.E.M = 9.34 ms; p = 0.34). Comparisons across all combinations of sensory pairs (AV-AT, AV-VT, and AT-VT) revealed them to be statistically different from each other (AV-AT p < 0.001, AV-VT p < 0.001, AT-VT p = 0.014). To the best of our knowledge, this relationship (/ AVpss / < /ATpss/ < /VTpss/) has not been previously reported in the literature and points to a different relationship between true and perceived synchrony across the different sensory pairings. It must be noted, however, that as previously mentioned, PSS-values are known to vary as a function of stimuli characteristics, and thus one must be cautious of drawing conclusions based on this single measure (i.e., PSS).


True and Perceived Synchrony are Preferentially Associated With Particular Sensory Pairings.

Noel JP, Wallace MT, Orchard-Mills E, Alais D, Van der Burg E - Sci Rep (2015)

Simultaneity judgments for audio-visual, audio-tactile, and visuo-tactile pairs.Proportion of synchrony reports are plotted as a function of Stimulus Onset Asynchrony (SAO) and stimulus pair, audio-visual (blue), audio-tactile (red), and visuo-tactile (black). Gaussian curves are fitted to raw data and represented as solid lines. Point of subjective simultaneity (PSS) and temporal binding window (TBW) are represented by the distribution’s mean and standard deviation parameters, respectively, as illustrated for the audio-visual pair. Error bars represent ± 1 SEM.
© Copyright Policy - open-access
Related In: Results  -  Collection

License
Show All Figures
getmorefigures.php?uid=PMC4664927&req=5

f1: Simultaneity judgments for audio-visual, audio-tactile, and visuo-tactile pairs.Proportion of synchrony reports are plotted as a function of Stimulus Onset Asynchrony (SAO) and stimulus pair, audio-visual (blue), audio-tactile (red), and visuo-tactile (black). Gaussian curves are fitted to raw data and represented as solid lines. Point of subjective simultaneity (PSS) and temporal binding window (TBW) are represented by the distribution’s mean and standard deviation parameters, respectively, as illustrated for the audio-visual pair. Error bars represent ± 1 SEM.
Mentions: As shown in Fig. 1, a within-subjects one-way ANOVA revealed that the mean distance between true and perceived simultaneity (i.e., distance between SOA = 0 and SOA = PSS) across the AV, AT, and VT pairs were significantly different (F (2, 34) = 89.26, p < 0.001, partial η2 = 0.84). Whereas the perceived synchrony of VT pairings was furthest in time from objective simultaneity (M = 73.41 ms, S.E.M = 5.25 ms), the mean PSS for AT pairs was at an intermediate distance (M = 51.71 ms, S.E.M = 9.25 ms), and the mean PSS for AV pairings was judged closest to (and not statistically different from) objective synchrony (M = 9.06 ms, S.E.M = 9.34 ms; p = 0.34). Comparisons across all combinations of sensory pairs (AV-AT, AV-VT, and AT-VT) revealed them to be statistically different from each other (AV-AT p < 0.001, AV-VT p < 0.001, AT-VT p = 0.014). To the best of our knowledge, this relationship (/ AVpss / < /ATpss/ < /VTpss/) has not been previously reported in the literature and points to a different relationship between true and perceived synchrony across the different sensory pairings. It must be noted, however, that as previously mentioned, PSS-values are known to vary as a function of stimuli characteristics, and thus one must be cautious of drawing conclusions based on this single measure (i.e., PSS).

Bottom Line: We demonstrate that TBWs correlate within individuals and across multisensory pairings, but PSSs do not.Further, we reveal that while the audiotactile and audiovisual pairings show tightly related TBWs, they also exhibit a differential relationship with respect to true and perceived multisensory synchrony.Thus, audiotactile and audiovisual temporal processing share mechanistic features yet are respectively functionally linked to objective and subjective synchrony.

View Article: PubMed Central - PubMed

Affiliation: Neuroscience Graduate Program, Vanderbilt University Medical Center, Nashville, TN 37240, USA.

ABSTRACT
Perception and behavior are fundamentally shaped by the integration of different sensory modalities into unique multisensory representations, a process governed by spatio-temporal correspondence. Prior work has characterized temporal perception using the point in time at which subjects are most likely to judge multisensory stimuli to be simultaneous (PSS) and the temporal binding window (TBW) over which participants are likely to do so. Here we examine the relationship between the PSS and the TBW within and between individuals, and within and between three sensory combinations: audiovisual, audiotactile and visuotactile. We demonstrate that TBWs correlate within individuals and across multisensory pairings, but PSSs do not. Further, we reveal that while the audiotactile and audiovisual pairings show tightly related TBWs, they also exhibit a differential relationship with respect to true and perceived multisensory synchrony. Thus, audiotactile and audiovisual temporal processing share mechanistic features yet are respectively functionally linked to objective and subjective synchrony.

No MeSH data available.