REPLAB: A Reproducible Low-Cost Arm Benchmark Platform for Robotic Learning

Preprint English OPEN
Yang, Brian; Zhang, Jesse; Pong, Vitchyr; Levine, Sergey; Jayaraman, Dinesh;
  • Subject: Computer Science - Computer Vision and Pattern Recognition | Computer Science - Machine Learning | Computer Science - Robotics

Standardized evaluation measures have aided in the progress of machine learning approaches in disciplines such as computer vision and machine translation. In this paper, we make the case that robotic learning would also benefit from benchmarking, and present the "REPLAB... View more
  • References (38)
    38 references, page 1 of 4

    [1] V. C. Mu¨ller, “Measuring progress in robotics: Benchmarking and the measure-target confusion,” in Metrics of sensory motor coordination and integration in robots and animals, 2018.

    [2] A. Torralba and A. A. Efros, “Unbiased look at dataset bias,” in Computer Vision and Pattern Recognition (CVPR), 2011 IEEE Conference on. IEEE, 2011, pp. 1521-1528.

    [3] J. Deng, W. Dong, R. Socher, L.-J. Li, K. Li, and L. Fei-Fei, “Imagenet: A large-scale hierarchical image database,” in CVPR, 2009.

    [4] V. Zue, S. Seneff, and J. Glass, “Speech database development at mit: Timit and beyond,” Speech communication, 1990.

    [5] D. D. Lewis, Y. Yang, T. G. Rose, and F. Li, “RCV1: A new benchmark collection for text categorization research,” JMLR, 2004.

    [6] I. Lenz, H. Lee, and A. Saxena, “Deep learning for detecting robotic grasps,” IJRR, 2015.

    [7] S. Levine, P. Pastor, A. Krizhevsky, J. Ibarz, and D. Quillen, “Learning hand-eye coordination for robotic grasping with deep learning and large-scale data collection,” IJRR, 2018.

    [8] L. Pinto and A. Gupta, “Supersizing self-supervision: Learning to grasp from 50k tries and 700 robot hours,” in ICRA, 2016.

    [9] M. Gualtieri, A. ten Pas, K. Saenko, and R. Platt, “High precision grasp pose detection in dense clutter,” in IROS, 2016.

    [10] U. Viereck, A. Pas, K. Saenko, and R. Platt, “Learning a visuomotor controller for real world robotic grasping using simulated depth images,” in CORL, 2017.

  • Related Research Results (1)
  • Metrics
Share - Bookmark