research product . Other ORP type . 2017

Natural Language Acquisition and Grounding for Embodied Robotic Systems

Al-Omari, M; Duckworth, P; Hogg, DC; Cohn, AG;
Closed Access English
  • Published: 13 Feb 2017
  • Publisher: AAAI Press
  • Country: United Kingdom
Abstract
We present a cognitively plausible novel framework capable of learning the grounding in visual semantics and the grammar of natural language commands given to a robot in a table top environment. The input to the system consists of video clips of a manually controlled robot arm, paired with natural language commands describing the action. No prior knowledge is assumed about the meaning of words, or the structure of the language, except that there are different classes of words (corresponding to observable actions, spatial relations, and objects and their observable properties). The learning process automatically clusters the continuous perceptual spaces into conc...
Download from
Powered by OpenAIRE Open Research Graph
Any information missing or wrong?Report an Issue