Limits...
Augmented Robotics Dialog System for Enhancing Human-Robot Interaction.

Alonso-Martín F, Castro-González A, Luengo FJ, Salichs MÁ - Sensors (Basel) (2015)

Bottom Line: This enriched information helps users better understand such events, at the same time providing a more satisfactory experience.For instance, it can enhance the robot's pro-activeness during a human-robot dialog (the enriched information can be used to propose new topics during the dialog, while ensuring a coherent interaction).Another possibility is to display additional multimedia content related to the enriched information on a visual device.

View Article: PubMed Central - PubMed

Affiliation: Robotics Lab, Universidad Carlos III de Madrid, Av. de la Universidad 30, Leganés, Madrid 28911, Spain. fernando.alonso@uc3m.es.

ABSTRACT
Augmented reality, augmented television and second screen are cutting edge technologies that provide end users extra and enhanced information related to certain events in real time. This enriched information helps users better understand such events, at the same time providing a more satisfactory experience. In the present paper, we apply this main idea to human-robot interaction (HRI), to how users and robots interchange information. The ultimate goal of this paper is to improve the quality of HRI, developing a new dialog manager system that incorporates enriched information from the semantic web. This work presents the augmented robotic dialog system (ARDS), which uses natural language understanding mechanisms to provide two features: (i) a non-grammar multimodal input (verbal and/or written) text; and (ii) a contextualization of the information conveyed in the interaction. This contextualization is achieved by information enrichment techniques that link the extracted information from the dialog with extra information about the world available in semantic knowledge bases. This enriched or contextualized information (information enrichment, semantic enhancement or contextualized information are used interchangeably in the rest of this paper) offers many possibilities in terms of HRI. For instance, it can enhance the robot's pro-activeness during a human-robot dialog (the enriched information can be used to propose new topics during the dialog, while ensuring a coherent interaction). Another possibility is to display additional multimedia content related to the enriched information on a visual device. This paper describes the ARDS and shows a proof of concept of its applications.

No MeSH data available.


Related in: MedlinePlus

Sketch of the augmented robotic dialog system (ARDS). The system includes new components not in the RDS, information extraction and information enrichment, and a new component for managing a screen as a communicative mode. Below the text recognition component (OCR) and the speech recognition (ASR) component are represented. ASR can work in two different modes: a statistical language model (no grammatical restrictions) or a grammar-based mode.
© Copyright Policy
Related In: Results  -  Collection

License
getmorefigures.php?uid=PMC4541855&req=5

f3-sensors-15-15799: Sketch of the augmented robotic dialog system (ARDS). The system includes new components not in the RDS, information extraction and information enrichment, and a new component for managing a screen as a communicative mode. Below the text recognition component (OCR) and the speech recognition (ASR) component are represented. ASR can work in two different modes: a statistical language model (no grammatical restrictions) or a grammar-based mode.

Mentions: Figure 3 depicts the different components of the ARDS. The new input functionality is presented as the following input modules: OCR and non-grammar ASR. The other new functionality is presented in the NLU module. This component takes the information extracted from the OCR and ASR modules and extracts some of its semantic content. Another new component finds, from some knowledge bases, related enriched information, such as pictures, videos and related links, which is fused into multimodal input information and sent to the component responsible for managing the dialog flow, the DMS. The current dialog may use that enriched information to express a multimodal message that includes it.


Augmented Robotics Dialog System for Enhancing Human-Robot Interaction.

Alonso-Martín F, Castro-González A, Luengo FJ, Salichs MÁ - Sensors (Basel) (2015)

Sketch of the augmented robotic dialog system (ARDS). The system includes new components not in the RDS, information extraction and information enrichment, and a new component for managing a screen as a communicative mode. Below the text recognition component (OCR) and the speech recognition (ASR) component are represented. ASR can work in two different modes: a statistical language model (no grammatical restrictions) or a grammar-based mode.
© Copyright Policy
Related In: Results  -  Collection

License
Show All Figures
getmorefigures.php?uid=PMC4541855&req=5

f3-sensors-15-15799: Sketch of the augmented robotic dialog system (ARDS). The system includes new components not in the RDS, information extraction and information enrichment, and a new component for managing a screen as a communicative mode. Below the text recognition component (OCR) and the speech recognition (ASR) component are represented. ASR can work in two different modes: a statistical language model (no grammatical restrictions) or a grammar-based mode.
Mentions: Figure 3 depicts the different components of the ARDS. The new input functionality is presented as the following input modules: OCR and non-grammar ASR. The other new functionality is presented in the NLU module. This component takes the information extracted from the OCR and ASR modules and extracts some of its semantic content. Another new component finds, from some knowledge bases, related enriched information, such as pictures, videos and related links, which is fused into multimodal input information and sent to the component responsible for managing the dialog flow, the DMS. The current dialog may use that enriched information to express a multimodal message that includes it.

Bottom Line: This enriched information helps users better understand such events, at the same time providing a more satisfactory experience.For instance, it can enhance the robot's pro-activeness during a human-robot dialog (the enriched information can be used to propose new topics during the dialog, while ensuring a coherent interaction).Another possibility is to display additional multimedia content related to the enriched information on a visual device.

View Article: PubMed Central - PubMed

Affiliation: Robotics Lab, Universidad Carlos III de Madrid, Av. de la Universidad 30, Leganés, Madrid 28911, Spain. fernando.alonso@uc3m.es.

ABSTRACT
Augmented reality, augmented television and second screen are cutting edge technologies that provide end users extra and enhanced information related to certain events in real time. This enriched information helps users better understand such events, at the same time providing a more satisfactory experience. In the present paper, we apply this main idea to human-robot interaction (HRI), to how users and robots interchange information. The ultimate goal of this paper is to improve the quality of HRI, developing a new dialog manager system that incorporates enriched information from the semantic web. This work presents the augmented robotic dialog system (ARDS), which uses natural language understanding mechanisms to provide two features: (i) a non-grammar multimodal input (verbal and/or written) text; and (ii) a contextualization of the information conveyed in the interaction. This contextualization is achieved by information enrichment techniques that link the extracted information from the dialog with extra information about the world available in semantic knowledge bases. This enriched or contextualized information (information enrichment, semantic enhancement or contextualized information are used interchangeably in the rest of this paper) offers many possibilities in terms of HRI. For instance, it can enhance the robot's pro-activeness during a human-robot dialog (the enriched information can be used to propose new topics during the dialog, while ensuring a coherent interaction). Another possibility is to display additional multimedia content related to the enriched information on a visual device. This paper describes the ARDS and shows a proof of concept of its applications.

No MeSH data available.


Related in: MedlinePlus