Powered by OpenAIRE graph
Found an issue? Give us feedback
ZENODOarrow_drop_down
ZENODO
Article . 2026
License: CC BY
Data sources: Datacite
ZENODO
Article . 2026
License: CC BY
Data sources: Datacite
addClaim

Gesture-Driven Remote Robot Mission Activation through Smart Glasses: An XR Interaction Pipeline for Industrial Assistance

Authors: Antonio, Zanesco; Pietro, Russo; Gianluigi, Spinelli; Martínez Sarriegui, Iñaki; Aguirrezabal, Pablo; del Río Ponce, Alberto;

Gesture-Driven Remote Robot Mission Activation through Smart Glasses: An XR Interaction Pipeline for Industrial Assistance

Abstract

This paper presents the design and early validation of an end-to-end interaction pipeline enabling industrial operators to trigger robotic missions through hand gestures captured by wearable extended reality smart glasses. Developed within the MOTIVATE XR project, the proposed approach integrates on-device visual sensing, embedded machine learning inference, semantic gesture mapping within a Unity application, and secure remote command transmission toward a mobile industrial robot executing real-world tasks. The system was experimentally evaluated in an industrial pilot environment where gestures performed by the operator were detected through the smart glasses’ cameras, interpreted locally, and translated into mission commands transmitted to a robotic platform. The study investigates recognition reliability, end-to-end latency propagation, execution consistency, and robustness across distributed system layers. To assess portability beyond the primary deployment, the gesture interaction layer was additionally integrated into an OpenXR-based XR application running on a standalone headset platform. This secondary scenario evaluates usability for interface navigation and workflow interaction, providing insight into cross-platform applicability of the gesture abstraction layer. Results provide initial evidence of the feasibility of gesture-driven control pipelines in distributed XR-robotics environments, while highlighting design trade-offs, integration constraints, and lessons learned relevant to industrial XR adoption.

Keywords

Distributed Systems, Gesture Recognition, Smart Glasses, Extended Reality, Human-Robot Interaction, Industrial Robotics

  • BIP!
    Impact byBIP!
    selected citations
    These citations are derived from selected sources.
    This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
    0
    popularity
    This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network.
    Average
    influence
    This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
    Average
    impulse
    This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network.
    Average
Powered by OpenAIRE graph
Found an issue? Give us feedback
selected citations
These citations are derived from selected sources.
This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
BIP!Citations provided by BIP!
popularity
This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network.
BIP!Popularity provided by BIP!
influence
This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
BIP!Influence provided by BIP!
impulse
This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network.
BIP!Impulse provided by BIP!
0
Average
Average
Average
Upload OA version
Are you the author of this publication? Upload your Open Access version to Zenodo!
It’s fast and easy, just two clicks!