
In this paper, we present an automatic approach for facial expression recognition from 3-D video sequences. In the proposed solution, the 3-D faces are represented by collections of radial curves and a Riemannian shape analysis is applied to effectively quantify the deformations induced by the facial expressions in a given subsequence of 3-D frames. This is obtained from the dense scalar field, which denotes the shooting directions of the geodesic paths constructed between pairs of corresponding radial curves of two faces. As the resulting dense scalar fields show a high dimensionality, Linear Discriminant Analysis (LDA) transformation is applied to the dense feature space. Two methods are then used for classification: 1) 3-D motion extraction with temporal Hidden Markov model (HMM) and 2) mean deformation capturing with random forest. While a dynamic HMM on the features is trained in the first approach, the second one computes mean deformations under a window and applies multiclass random forest. Both of the proposed classification schemes on the scalar fields showed comparable results and outperformed earlier studies on facial expression recognition from 3-D video sequences.
ACM: I.: Computing Methodologies/I.5: PATTERN RECOGNITION, Biometry, ACM: I.: Computing Methodologies/I.4: IMAGE PROCESSING AND COMPUTER VISION, Video Recording, [INFO.INFO-CV]Computer Science [cs]/Computer Vision and Pattern Recognition [cs.CV], 4-D data; expression recognition; Hidden Markov model; random forest; Riemannian geometry; temporal analysis, Reproducibility of Results, Image Enhancement, Sensitivity and Specificity, 004, 620, Pattern Recognition, Automated, ACM: I.: Computing Methodologies/I.2: ARTIFICIAL INTELLIGENCE, Facial Expression, Imaging, Three-Dimensional, [INFO.INFO-LG]Computer Science [cs]/Machine Learning [cs.LG], Artificial Intelligence, Face, Image Interpretation, Computer-Assisted, Algorithms
ACM: I.: Computing Methodologies/I.5: PATTERN RECOGNITION, Biometry, ACM: I.: Computing Methodologies/I.4: IMAGE PROCESSING AND COMPUTER VISION, Video Recording, [INFO.INFO-CV]Computer Science [cs]/Computer Vision and Pattern Recognition [cs.CV], 4-D data; expression recognition; Hidden Markov model; random forest; Riemannian geometry; temporal analysis, Reproducibility of Results, Image Enhancement, Sensitivity and Specificity, 004, 620, Pattern Recognition, Automated, ACM: I.: Computing Methodologies/I.2: ARTIFICIAL INTELLIGENCE, Facial Expression, Imaging, Three-Dimensional, [INFO.INFO-LG]Computer Science [cs]/Machine Learning [cs.LG], Artificial Intelligence, Face, Image Interpretation, Computer-Assisted, Algorithms
| selected citations These citations are derived from selected sources. This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | 61 | |
| popularity This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network. | Top 10% | |
| influence This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | Top 10% | |
| impulse This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network. | Top 10% |
