Powered by OpenAIRE graph
Found an issue? Give us feedback
ZENODOarrow_drop_down
ZENODO
Software . 2026
License: CC BY
Data sources: Datacite
ZENODO
Software . 2026
License: CC BY
Data sources: Datacite
versions View all 2 versions
addClaim

AI-Driven Video-Based Emotion Classification Algorithm for Maintenance Workers (DESDEMONA PRIN 2022 PNRR)

Authors: Human-Systems Symbiosis Laboratory (USS Lab);

AI-Driven Video-Based Emotion Classification Algorithm for Maintenance Workers (DESDEMONA PRIN 2022 PNRR)

Abstract

This repository contains the beta-version of an AI-driven algorithm developed within the DESDEMONA project for the automatic identification of emotional states of maintenance workers during task execution. The algorithm processes video recordings of operators performing maintenance activities and applies a multi-stage deep learning pipeline to detect faces, classify facial expressions, and extract time-dependent emotional indicators. The system performs frame-by-frame analysis of video data using a multi-backend face detection strategy combined with deep learning–based emotion recognition. For each processed frame, the algorithm estimates the probability of seven basic emotions (neutral, happiness, sadness, anger, fear, disgust, and surprise). These emotion scores are then aggregated over time to generate dynamic emotional indicators describing the evolution of workers’ emotional states during task execution. To improve robustness in realistic industrial environments, the algorithm integrates multiple face detection frameworks and implements temporal downsampling strategies to optimize computational efficiency. The extracted emotional indicators can be mapped to psychological dimensions such as valence and arousal, enabling the analysis of emotional stability, transitions, and intensity throughout the task. The algorithm is implemented in Python and designed to support offline video analysis while remaining compatible with real-time emotion recognition systems and decision support platforms. In the DESDEMONA architecture, the extracted emotional indicators are intended to complement other human-centered metrics such as cognitive workload and operator performance, enabling more adaptive and context-aware maintenance decision support.

Related Organizations
Keywords

Facial expression analysis, industry 5.0, Computer vision, Deep learning, Emotion recognition, Human factors

  • BIP!
    Impact byBIP!
    selected citations
    These citations are derived from selected sources.
    This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
    0
    popularity
    This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network.
    Average
    influence
    This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
    Average
    impulse
    This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network.
    Average
Powered by OpenAIRE graph
Found an issue? Give us feedback
selected citations
These citations are derived from selected sources.
This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
BIP!Citations provided by BIP!
popularity
This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network.
BIP!Popularity provided by BIP!
influence
This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
BIP!Influence provided by BIP!
impulse
This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network.
BIP!Impulse provided by BIP!
0
Average
Average
Average