Active Learning for Autonomous Intelligent Agents: Exploration, Curiosity, and Interaction

Preprint English OPEN
Lopes, Manuel ; Montesano, Luis (2014)
  • Subject: Computer Science - Artificial Intelligence

In this survey we present different approaches that allow an intelligent agent to explore autonomous its environment to gather information and learn multiple tasks. Different communities proposed different solutions, that are in many cases, similar and/or complementary. These solutions include active learning, exploration/exploitation, online-learning and social learning. The common aspect of all these approaches is that it is the agent to selects and decides what information to gather next. Applications for these approaches already include tutoring systems, autonomous grasping learning, navigation and mapping and human-robot interaction. We discuss how these approaches are related, explaining their similarities and their differences in terms of problem assumptions and metrics of success. We consider that such an integrated discussion will improve inter-disciplinary research and applications.
  • References (141)
    141 references, page 1 of 15

    Aloimonos, J., Weiss, I., and Bandyopadhyay, A. (1988). Active vision. Inter. Journal of Computer Vision, 1(4):333{356.

    Angluin, D. (1988). Queries and concept learning. Machine Learning, 2:319{342.

    Baram, Y., El-Yaniv, R., and Luz, K. (2004). Online choice of active learning algorithms. The Journal of Machine Learning Research, 5:255{291.

    Baranes, A. and Oudeyer, P. (2010). Intrinsically motivated goal exploration for active motor learning in robots: A case study. In Intelligent Robots and Systems (IROS), 2010 IEEE/RSJ Inter. Conf. on, pages 1766{1773.

    Baranes, A. and Oudeyer, P. (2011). The interaction of maturational constraints and intrinsic motivations in active motor development. In Inter. Conf. on Development and Learning (ICDL'11).

    Baranes, A. and Oudeyer, P. (2012). Active learning of inverse models with intrinsically motivated goal exploration in robots. Robotics and Autonomous Systems.

    Baranes, A. and Oudeyer, P.-Y. (2009). R-iac: Robust intrinsically motivated exploration and active learning. Autonomous Mental Development, IEEE Transactions on, 1(3):155{169.

    Barto, A. and Mahadevan, S. (2003). Recent advances in hierarchical reinforcement learning. Discrete Event Dynamic Systems, 13(4):341{379.

    Asada, M., MacDorman, K., Ishiguro, H., and Kuniyoshi, Y. (2001). Cognitive developmental robotics as a new paradigm for the design of humanoid robots. Robotics and Automation, 37:185{193.

    Berglund, E. and Sitte, J. (2005). Sound source localisation through active audition. In Intelligent Robots and Systems, 2005.(IROS 2005). 2005 IEEE/RSJ Inter. Conf. on, pages 653{658.

  • Metrics
    No metrics available
Share - Bookmark