Hand Gesture Recognition with Leap Motion

Preprint English OPEN
Du, Youchen ; Liu, Shenglan ; Feng, Lin ; Chen, Menghui ; Wu, Jie (2017)
  • Subject: Computer Science - Computer Vision and Pattern Recognition

The recent introduction of depth cameras like Leap Motion Controller allows researchers to exploit the depth information to recognize hand gesture more robustly. This paper proposes a novel hand gesture recognition system with Leap Motion Controller. A series of features are extracted from Leap Motion tracking data, we feed these features along with HOG feature extracted from sensor images into a multi-class SVM classifier to recognize performed gesture, dimension reduction and feature weighted fusion are also discussed. Our results show that our model is much more accurate than previous work.
  • References (12)
    12 references, page 1 of 2

    [5] William T Freeman, Ken-ichi Tanaka, Jun Ohta, and Kazuo Kyuma. Computer vision for computer games. In Automatic Face and Gesture Recognition, 1996., Proceedings of the Second International Conference on, pages 100{105. IEEE, 1996.

    [6] Zhou Ren, Junsong Yuan, Jingjing Meng, and Zhengyou Zhang. Robust part-based hand gesture recognition using kinect sensor. IEEE transactions on multimedia, 15(5):1110{1120, 2013.

    [7] Jesus Suarez and Robin R Murphy. Hand gesture recognition with depth images: A review. In Roman, 2012 IEEE, pages 411{417. IEEE, 2012.

    [8] Poonam Suryanarayan, Anbumani Subramanian, and Dinesh Mandalapu. Dynamic hand pose recognition using depth data. In Pattern Recognition (ICPR), 2010 20th International Conference on, pages 3105{3108. IEEE, 2010.

    [9] Fabio Dominio, Mauro Donadeo, and Pietro Zanuttigh. Combining multiple depth-based descriptors for hand gesture recognition. Pattern Recognition Letters, 50:101{111, 2014.

    [10] Yuan Yao and Yun Fu. Contour model-based hand-gesture recognition using the kinect sensor. IEEE Transactions on Circuits and Systems for Video Technology, 24(11):1935{1944, 2014.

    [11] Zhi-hua Chen, Jung-Tae Kim, Jianning Liang, Jing Zhang, and Yu-Bo Yuan. Real-time hand gesture recognition using nger segmentation. The Scienti c World Journal, 2014, 2014.

    [12] Kai-ping Feng and Fang Yuan. Static hand gesture recognition based on hog characters and support vector machines. In Instrumentation and Measurement, Sensor Network and Automation (IMSNA), 2013 2nd International Symposium on, pages 936{938. IEEE, 2013.

    [13] Frank Weichert, Daniel Bachmann, Bartholomaus Rudak, and Denis Fisseler. Analysis of the accuracy and robustness of the leap motion controller. Sensors, 13(5):6380{ 6393, 2013.

    [14] Safa Ameur, Anouar Ben Khalifa, and Mohamed Salim Bouhlel. A comprehensive leap motion database for hand gesture recognition. In Information and Digital Technologies (IDT), 2017 International Conference on, pages 514{ 519. IEEE, 2017.

  • Metrics
    views in OpenAIRE
    views in local repository
    downloads in local repository
Share - Bookmark