Object schemas for responsive robotic language use

The use of natural language should be added to a robot system without sacrificing responsiveness to the environment. In this paper, we present a robot that manipulates objects on a tabletop in response to verbal interaction. Reactivity is maintained by using concurrent interaction processes, such as...

Full description

Bibliographic Details
Main Authors: Vosoughi, Soroush (Contributor), Kubat, Rony Daniel (Contributor), Roy, Deb K. (Contributor), Hsiao, Kai-yuh 1977- (Author), Tellex, Stefanie 1980- (Author)
Other Authors: Program in Media Arts and Sciences (Massachusetts Institute of Technology) (Contributor), Hsiao, Kai-yuh (Contributor), Tellex, Stefanie (Contributor)
Format: Article
Language:English
Published: Association for Computing Machinery, 2014-05-08T18:49:21Z.
Subjects:
Online Access:Get fulltext
LEADER 01906 am a22002893u 4500
001 86878
042 |a dc 
100 1 0 |a Vosoughi, Soroush  |e author 
100 1 0 |a Program in Media Arts and Sciences   |q  (Massachusetts Institute of Technology)   |e contributor 
100 1 0 |a Vosoughi, Soroush  |e contributor 
100 1 0 |a Roy, Deb K.  |e contributor 
100 1 0 |a Hsiao, Kai-yuh  |e contributor 
100 1 0 |a Vosoughi, Soroush  |e contributor 
100 1 0 |a Tellex, Stefanie  |e contributor 
100 1 0 |a Kubat, Rony Daniel  |e contributor 
700 1 0 |a Kubat, Rony Daniel  |e author 
700 1 0 |a Roy, Deb K.  |e author 
700 1 0 |a Hsiao, Kai-yuh  |d 1977-.   |e author 
700 1 0 |a Tellex, Stefanie  |d 1980-.   |e author 
245 0 0 |a Object schemas for responsive robotic language use 
260 |b Association for Computing Machinery,   |c 2014-05-08T18:49:21Z. 
856 |z Get fulltext  |u http://hdl.handle.net/1721.1/86878 
520 |a The use of natural language should be added to a robot system without sacrificing responsiveness to the environment. In this paper, we present a robot that manipulates objects on a tabletop in response to verbal interaction. Reactivity is maintained by using concurrent interaction processes, such as visual trackers and collision detection processes. The interaction processes and their associated data are organized into object schemas, each representing a physical object in the environment, based on the target of each process. The object schemas then serve as discrete structures of coordination between reactivity, planning, and language use, permitting rapid integration of information from multiple sources. 
520 |a National Science Foundation (U.S.) (Graduate Research Fellowship) 
546 |a en_US 
655 7 |a Article 
773 |t Proceedings of the 3rd international conference on Human robot interaction (HRI '08)