Limits...
Augmented Robotics Dialog System for Enhancing Human-Robot Interaction.

Alonso-Martín F, Castro-González A, Luengo FJ, Salichs MÁ - Sensors (Basel) (2015)

Bottom Line: This enriched information helps users better understand such events, at the same time providing a more satisfactory experience.For instance, it can enhance the robot's pro-activeness during a human-robot dialog (the enriched information can be used to propose new topics during the dialog, while ensuring a coherent interaction).Another possibility is to display additional multimedia content related to the enriched information on a visual device.

View Article: PubMed Central - PubMed

Affiliation: Robotics Lab, Universidad Carlos III de Madrid, Av. de la Universidad 30, Leganés, Madrid 28911, Spain. fernando.alonso@uc3m.es.

ABSTRACT
Augmented reality, augmented television and second screen are cutting edge technologies that provide end users extra and enhanced information related to certain events in real time. This enriched information helps users better understand such events, at the same time providing a more satisfactory experience. In the present paper, we apply this main idea to human-robot interaction (HRI), to how users and robots interchange information. The ultimate goal of this paper is to improve the quality of HRI, developing a new dialog manager system that incorporates enriched information from the semantic web. This work presents the augmented robotic dialog system (ARDS), which uses natural language understanding mechanisms to provide two features: (i) a non-grammar multimodal input (verbal and/or written) text; and (ii) a contextualization of the information conveyed in the interaction. This contextualization is achieved by information enrichment techniques that link the extracted information from the dialog with extra information about the world available in semantic knowledge bases. This enriched or contextualized information (information enrichment, semantic enhancement or contextualized information are used interchangeably in the rest of this paper) offers many possibilities in terms of HRI. For instance, it can enhance the robot's pro-activeness during a human-robot dialog (the enriched information can be used to propose new topics during the dialog, while ensuring a coherent interaction). Another possibility is to display additional multimedia content related to the enriched information on a visual device. This paper describes the ARDS and shows a proof of concept of its applications.

No MeSH data available.


Related in: MedlinePlus

Entity cards shown on the tablet to the user. (a) Messi; (b) Football World Cup; (c) Argentina; (d) transitions between entity cards.
© Copyright Policy
Related In: Results  -  Collection

License
getmorefigures.php?uid=PMC4541855&req=5

f11-sensors-15-15799: Entity cards shown on the tablet to the user. (a) Messi; (b) Football World Cup; (c) Argentina; (d) transitions between entity cards.

Mentions: In the present case, the dialog just makes an echo or confirmation of what has been detected and shows the enriched information on the external screen. This is made by sending an expressive communicative act to the multimodal fission module. This module takes charge of synchronizing the expression in the different modalities: gestures, speech and the visual mode in the external screen. Thus, the dialog is designed in such a way that when an information slot in the dialog is filled, the robot communicates additional information about the entity detected. The multimodal fission module decides how to communicate this additional information. In this case, it uses the verbal mode to verbalize the description of the entities and the visual mode to show the related obtained cards in the screen of the external tablet (Figure 11).


Augmented Robotics Dialog System for Enhancing Human-Robot Interaction.

Alonso-Martín F, Castro-González A, Luengo FJ, Salichs MÁ - Sensors (Basel) (2015)

Entity cards shown on the tablet to the user. (a) Messi; (b) Football World Cup; (c) Argentina; (d) transitions between entity cards.
© Copyright Policy
Related In: Results  -  Collection

License
Show All Figures
getmorefigures.php?uid=PMC4541855&req=5

f11-sensors-15-15799: Entity cards shown on the tablet to the user. (a) Messi; (b) Football World Cup; (c) Argentina; (d) transitions between entity cards.
Mentions: In the present case, the dialog just makes an echo or confirmation of what has been detected and shows the enriched information on the external screen. This is made by sending an expressive communicative act to the multimodal fission module. This module takes charge of synchronizing the expression in the different modalities: gestures, speech and the visual mode in the external screen. Thus, the dialog is designed in such a way that when an information slot in the dialog is filled, the robot communicates additional information about the entity detected. The multimodal fission module decides how to communicate this additional information. In this case, it uses the verbal mode to verbalize the description of the entities and the visual mode to show the related obtained cards in the screen of the external tablet (Figure 11).

Bottom Line: This enriched information helps users better understand such events, at the same time providing a more satisfactory experience.For instance, it can enhance the robot's pro-activeness during a human-robot dialog (the enriched information can be used to propose new topics during the dialog, while ensuring a coherent interaction).Another possibility is to display additional multimedia content related to the enriched information on a visual device.

View Article: PubMed Central - PubMed

Affiliation: Robotics Lab, Universidad Carlos III de Madrid, Av. de la Universidad 30, Leganés, Madrid 28911, Spain. fernando.alonso@uc3m.es.

ABSTRACT
Augmented reality, augmented television and second screen are cutting edge technologies that provide end users extra and enhanced information related to certain events in real time. This enriched information helps users better understand such events, at the same time providing a more satisfactory experience. In the present paper, we apply this main idea to human-robot interaction (HRI), to how users and robots interchange information. The ultimate goal of this paper is to improve the quality of HRI, developing a new dialog manager system that incorporates enriched information from the semantic web. This work presents the augmented robotic dialog system (ARDS), which uses natural language understanding mechanisms to provide two features: (i) a non-grammar multimodal input (verbal and/or written) text; and (ii) a contextualization of the information conveyed in the interaction. This contextualization is achieved by information enrichment techniques that link the extracted information from the dialog with extra information about the world available in semantic knowledge bases. This enriched or contextualized information (information enrichment, semantic enhancement or contextualized information are used interchangeably in the rest of this paper) offers many possibilities in terms of HRI. For instance, it can enhance the robot's pro-activeness during a human-robot dialog (the enriched information can be used to propose new topics during the dialog, while ensuring a coherent interaction). Another possibility is to display additional multimedia content related to the enriched information on a visual device. This paper describes the ARDS and shows a proof of concept of its applications.

No MeSH data available.


Related in: MedlinePlus