Downloads provided by UsageCounts
This repository contains the Unity Package, the javascript algorithm, and the scientific paper of ThreeLS. ThreeLS is a very simplistic lipsyncing that takes a very short time to set up. It uses three blend shapes for the lips: kiss, lips closed or mouth open. In terms of Facial Action Units: AU22, AU24, and AU27. It works in real-time using speech audio files or an audio stream (no need to transcribe text or phonemes). The technology is based on the differences between the spectrum of vowels and consonants. A technical explanation and demos of it can be seen in this video (link starting at the demos): https://youtu.be/89pBiGKXpZI?t=43s. A video tutorial on how to set it up in Unity is included in the package. The video tutorial can also be seen here: https://youtu.be/wV8UIoUWIc8 Github repository (javascript only): https://github.com/gerardllorach/threelipsync More info and live demos: https://gerardllorach.weebly.com/ References: Llorach, G., Evans, A., Blat, J., Grimm, G. and Hohmann, V., 2016, September. Web-based live speech-driven lip-sync. In 2016 8th International Conference on Games and Virtual Worlds for Serious Applications (VS-GAMES) (pp. 1-4). IEEE.
lip-sync, speech synthesis, lipsync, real-time, speech-driven, unity
lip-sync, speech synthesis, lipsync, real-time, speech-driven, unity
| selected citations These citations are derived from selected sources. This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | 0 | |
| popularity This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network. | Average | |
| influence This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | Average | |
| impulse This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network. | Average |
| views | 311 | |
| downloads | 67 |

Views provided by UsageCounts
Downloads provided by UsageCounts