Powered by OpenAIRE graph
Found an issue? Give us feedback
addClaim

Optoelectronic measurement of orofacial motions during speech production

Authors: Eric Vatikiotis-Bateson; Kevin Munhall; David Ostry;

Optoelectronic measurement of orofacial motions during speech production

Abstract

Optoelectronic position sensing devices have been important in the study of speech articulation. While limited to the kinematics of externally visible structures such as the lips and the jaw, such systems can be used easily with a wide range of subjects. This video shows how an innovative marker-tracking system, OPTOTRAK (Northern Digital, Inc.), is currently being used in three areas of experimentation: (1) rigid body analysis in which 3-D motion of the jaw is decomposed into its three orientation and three translation components; (2) modeling of the relation between muscle activity (EMG) and 3-D motion of the lips and jaw using artificial neural networks; and (3) mapping facial motions for possible use in orofacial modeling and audiovisual recognition. The first experiment shows how technical developments, resulting in accurate measurement of 3-D motion, now make it possible to calculate all orientation angles and positions necessary to fully describe structures such as the jaw. The second area demonstrates a more traditional paradigm in which several types of data must be acquired simultaneously. The third area illustrates the growing interest in mapping speech events to facial motion as well as to changes in vocal tract shape.

Related Organizations
  • BIP!
    Impact byBIP!
    selected citations
    These citations are derived from selected sources.
    This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
    2
    popularity
    This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network.
    Average
    influence
    This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
    Average
    impulse
    This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network.
    Average
Powered by OpenAIRE graph
Found an issue? Give us feedback
selected citations
These citations are derived from selected sources.
This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
BIP!Citations provided by BIP!
popularity
This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network.
BIP!Popularity provided by BIP!
influence
This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
BIP!Influence provided by BIP!
impulse
This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network.
BIP!Impulse provided by BIP!
2
Average
Average
Average
Related to Research communities
Upload OA version
Are you the author of this publication? Upload your Open Access version to Zenodo!
It’s fast and easy, just two clicks!