publication . Preprint . Conference object . 2018

Efficient Pose Tracking from Natural Features in Standard Web Browsers

Fabian Göttl; Philipp Gagel; Jens Grubert;
Open Access English
  • Published: 23 Apr 2018
Abstract
Computer Vision-based natural feature tracking is at the core of modern Augmented Reality applications. Still, Web-based Augmented Reality typically relies on location-based sensing (using GPS and orientation sensors) or marker-based approaches to solve the pose estimation problem. We present an implementation and evaluation of an efficient natural feature tracking pipeline for standard Web browsers using HTML5 and WebAssembly. Our system can track image targets at real-time frame rates tablet PCs (up to 60 Hz) and smartphones (up to 25 Hz).
Subjects
free text keywords: Computer Science - Computer Vision and Pattern Recognition, Computer Science - Multimedia, Computer Science - Networking and Internet Architecture, Computer vision, Pose, Global Positioning System, business.industry, business, HTML5, Computer science, Pose tracking, Natural feature tracking, Augmented reality, Frame rate, Artificial intelligence, Web browser
26 references, page 1 of 2

Sangchul Ahn, Heedong Ko, and Steven Feiner. 2013. Webizing mobile AR contents. In Virtual Reality (VR), 2013 IEEE. IEEE, 131-132.

Sangchul Ahn, Heedong Ko, and Byounghyun Yoo. 2014. Webizing mobile augmented reality content. New Review of Hypermedia and Multimedia 20, 1 (2014), 79-100. [OpenAIRE]

Awe.media. 2017. Bring your images to life. https://awe.media/blog/ bring-your-images-to-life. (2017). Accessed: 2018-03-02.

Jerome Etienne. 2017. AR.js - Eficient Augmented Reality for the Web. https://github. com/jeromeetienne/AR.js. (2017). Accessed: 2018-03-02.

Google. 2017a. Quickstart for AR on the Web. https://developers.google.com/ar/ develop/web/quickstart. (2017). Accessed: 2018-03-02.

Google. 2017b. WebARonARKit. https://github.com/google-ar/WebARonARKit. (2017). Accessed: 2018-04-22.

Immersive Web Community Group. 2018. WebXR Device API. https://immersive-web. github.io/webxr/. (2018). Accessed: 2018-04-22.

Jens Grubert, Eyal Ofek, Michel Pahud, Matthias Kranz, and Dieter Schmalstieg. 2016. Glasshands: Interaction around unmodified mobile devices using sunglasses. In Proceedings of the 2016 ACM on Interactive Surfaces and Spaces. ACM, 215-224. [OpenAIRE]

Andreas Hartl, Jens Grubert, Dieter Schmalstieg, and Gerhard Reitmayr. 2013. Mobile interactive hologram verification. In Mixed and Augmented Reality (ISMAR), 2013 IEEE International Symposium on. IEEE, 75-82.

Alex Hill, Blair MacIntyre, Maribeth Gandy, Brian Davidson, and Hafez Rouzati. 2010. Kharma: An open kml/html architecture for mobile augmented reality applications. In Mixed and Augmented Reality (ISMAR), 2010 9th IEEE International Symposium on. IEEE, 233-234.

Rob Kooper and Blair MacIntyre. 2003. Browsing the real-world wide web: Maintaining awareness of virtual information in an AR information space. International Journal of Human-Computer Interaction 16, 3 (2003), 425-446. [OpenAIRE]

Tobias Langlotz, Jens Grubert, and Raphael Grasset. 2013. Augmented reality browsers: essential products or only gadgets? Commun. ACM 56, 11 (2013), 34-36.

Tobias Langlotz, Thanh Nguyen, Dieter Schmalstieg, and Raphael Grasset. 2014. Nextgeneration augmented reality browsers: rich, seamless, and adaptive. Proc. IEEE 102, 2 (2014), 155-169.

Martin Lechner. 2013. ARML 2.0 in the context of existing AR data formats. In Software Engineering and Architectures for Realtime Interactive Systems (SEARIS), 2013 6th Workshop on. IEEE, 41-47.

Martin Lechner and Markus Tripp. 2010. ARMLâĂŤan augmented reality standard. coordinates 13, 47.797222 (2010), 432-440.

26 references, page 1 of 2
Abstract
Computer Vision-based natural feature tracking is at the core of modern Augmented Reality applications. Still, Web-based Augmented Reality typically relies on location-based sensing (using GPS and orientation sensors) or marker-based approaches to solve the pose estimation problem. We present an implementation and evaluation of an efficient natural feature tracking pipeline for standard Web browsers using HTML5 and WebAssembly. Our system can track image targets at real-time frame rates tablet PCs (up to 60 Hz) and smartphones (up to 25 Hz).
Subjects
free text keywords: Computer Science - Computer Vision and Pattern Recognition, Computer Science - Multimedia, Computer Science - Networking and Internet Architecture, Computer vision, Pose, Global Positioning System, business.industry, business, HTML5, Computer science, Pose tracking, Natural feature tracking, Augmented reality, Frame rate, Artificial intelligence, Web browser
26 references, page 1 of 2

Sangchul Ahn, Heedong Ko, and Steven Feiner. 2013. Webizing mobile AR contents. In Virtual Reality (VR), 2013 IEEE. IEEE, 131-132.

Sangchul Ahn, Heedong Ko, and Byounghyun Yoo. 2014. Webizing mobile augmented reality content. New Review of Hypermedia and Multimedia 20, 1 (2014), 79-100. [OpenAIRE]

Awe.media. 2017. Bring your images to life. https://awe.media/blog/ bring-your-images-to-life. (2017). Accessed: 2018-03-02.

Jerome Etienne. 2017. AR.js - Eficient Augmented Reality for the Web. https://github. com/jeromeetienne/AR.js. (2017). Accessed: 2018-03-02.

Google. 2017a. Quickstart for AR on the Web. https://developers.google.com/ar/ develop/web/quickstart. (2017). Accessed: 2018-03-02.

Google. 2017b. WebARonARKit. https://github.com/google-ar/WebARonARKit. (2017). Accessed: 2018-04-22.

Immersive Web Community Group. 2018. WebXR Device API. https://immersive-web. github.io/webxr/. (2018). Accessed: 2018-04-22.

Jens Grubert, Eyal Ofek, Michel Pahud, Matthias Kranz, and Dieter Schmalstieg. 2016. Glasshands: Interaction around unmodified mobile devices using sunglasses. In Proceedings of the 2016 ACM on Interactive Surfaces and Spaces. ACM, 215-224. [OpenAIRE]

Andreas Hartl, Jens Grubert, Dieter Schmalstieg, and Gerhard Reitmayr. 2013. Mobile interactive hologram verification. In Mixed and Augmented Reality (ISMAR), 2013 IEEE International Symposium on. IEEE, 75-82.

Alex Hill, Blair MacIntyre, Maribeth Gandy, Brian Davidson, and Hafez Rouzati. 2010. Kharma: An open kml/html architecture for mobile augmented reality applications. In Mixed and Augmented Reality (ISMAR), 2010 9th IEEE International Symposium on. IEEE, 233-234.

Rob Kooper and Blair MacIntyre. 2003. Browsing the real-world wide web: Maintaining awareness of virtual information in an AR information space. International Journal of Human-Computer Interaction 16, 3 (2003), 425-446. [OpenAIRE]

Tobias Langlotz, Jens Grubert, and Raphael Grasset. 2013. Augmented reality browsers: essential products or only gadgets? Commun. ACM 56, 11 (2013), 34-36.

Tobias Langlotz, Thanh Nguyen, Dieter Schmalstieg, and Raphael Grasset. 2014. Nextgeneration augmented reality browsers: rich, seamless, and adaptive. Proc. IEEE 102, 2 (2014), 155-169.

Martin Lechner. 2013. ARML 2.0 in the context of existing AR data formats. In Software Engineering and Architectures for Realtime Interactive Systems (SEARIS), 2013 6th Workshop on. IEEE, 41-47.

Martin Lechner and Markus Tripp. 2010. ARMLâĂŤan augmented reality standard. coordinates 13, 47.797222 (2010), 432-440.

26 references, page 1 of 2
Powered by OpenAIRE Open Research Graph
Any information missing or wrong?Report an Issue
publication . Preprint . Conference object . 2018

Efficient Pose Tracking from Natural Features in Standard Web Browsers

Fabian Göttl; Philipp Gagel; Jens Grubert;