Limits...
Using eye movement analysis to study auditory effects on visual memory recall.

Marandi RZ, Sabzpoushan SH - Basic Clin Neurosci (2014)

Bottom Line: The method was validated with eight different participants.Recognition rate in "with sound" stage was significantly reduced as compared with "without sound" stage.The result demonstrated that the familiarity of visual-auditory stimuli can be detected from EOG signals and the auditory input potentially improves the visual recall process.

View Article: PubMed Central - PubMed

Affiliation: Department of Biomedical Engineering, Iran University of Science and Technology, Narmak, Tehran, Iran.

ABSTRACT
Recent studies in affective computing are focused on sensing human cognitive context using biosignals. In this study, electrooculography (EOG) was utilized to investigate memory recall accessibility via eye movement patterns. 12 subjects were participated in our experiment wherein pictures from four categories were presented. Each category contained nine pictures of which three were presented twice and the rest were presented once only. Each picture presentation took five seconds with an adjoining three seconds interval. Similarly, this task was performed with new pictures together with related sounds. The task was free viewing and participants were not informed about the task's purpose. Using pattern recognition techniques, participants' EOG signals in response to repeated and non-repeated pictures were classified for with and without sound stages. The method was validated with eight different participants. Recognition rate in "with sound" stage was significantly reduced as compared with "without sound" stage. The result demonstrated that the familiarity of visual-auditory stimuli can be detected from EOG signals and the auditory input potentially improves the visual recall process.

No MeSH data available.


Overall recognition performance for each picture category and each part of the experiment (including with and without sound) for all subjects.
© Copyright Policy - open-access
Related In: Results  -  Collection

License
getmorefigures.php?uid=PMC4202595&req=5

Figure 0004: Overall recognition performance for each picture category and each part of the experiment (including with and without sound) for all subjects.

Mentions: Based on the data recorded in the main study, Figure 4 summarizes the overall recognition performance using person-independent parameters and training for each picture category and each part of the experiment including picture presentation with and without sounds. The bars contrast true positive rate (TPR) to false positive rate (FPR). Figure 4 demonstrates a considerable improvement in recognition performance for the second part of the experiment where pictures presented with their related sounds compared with the first part of the experiment wherein pictures were presented without sound. This improvement is re-demonstrated through ROC space in Figure 5. Recognition performance reduces if the points in ROC spaces of Figure 5 get closer to the up-left side.


Using eye movement analysis to study auditory effects on visual memory recall.

Marandi RZ, Sabzpoushan SH - Basic Clin Neurosci (2014)

Overall recognition performance for each picture category and each part of the experiment (including with and without sound) for all subjects.
© Copyright Policy - open-access
Related In: Results  -  Collection

License
Show All Figures
getmorefigures.php?uid=PMC4202595&req=5

Figure 0004: Overall recognition performance for each picture category and each part of the experiment (including with and without sound) for all subjects.
Mentions: Based on the data recorded in the main study, Figure 4 summarizes the overall recognition performance using person-independent parameters and training for each picture category and each part of the experiment including picture presentation with and without sounds. The bars contrast true positive rate (TPR) to false positive rate (FPR). Figure 4 demonstrates a considerable improvement in recognition performance for the second part of the experiment where pictures presented with their related sounds compared with the first part of the experiment wherein pictures were presented without sound. This improvement is re-demonstrated through ROC space in Figure 5. Recognition performance reduces if the points in ROC spaces of Figure 5 get closer to the up-left side.

Bottom Line: The method was validated with eight different participants.Recognition rate in "with sound" stage was significantly reduced as compared with "without sound" stage.The result demonstrated that the familiarity of visual-auditory stimuli can be detected from EOG signals and the auditory input potentially improves the visual recall process.

View Article: PubMed Central - PubMed

Affiliation: Department of Biomedical Engineering, Iran University of Science and Technology, Narmak, Tehran, Iran.

ABSTRACT
Recent studies in affective computing are focused on sensing human cognitive context using biosignals. In this study, electrooculography (EOG) was utilized to investigate memory recall accessibility via eye movement patterns. 12 subjects were participated in our experiment wherein pictures from four categories were presented. Each category contained nine pictures of which three were presented twice and the rest were presented once only. Each picture presentation took five seconds with an adjoining three seconds interval. Similarly, this task was performed with new pictures together with related sounds. The task was free viewing and participants were not informed about the task's purpose. Using pattern recognition techniques, participants' EOG signals in response to repeated and non-repeated pictures were classified for with and without sound stages. The method was validated with eight different participants. Recognition rate in "with sound" stage was significantly reduced as compared with "without sound" stage. The result demonstrated that the familiarity of visual-auditory stimuli can be detected from EOG signals and the auditory input potentially improves the visual recall process.

No MeSH data available.