A Novel Face-tracking Mouth Controller and its Application to Interacting with Bioacoustic Models

October 07, 2020 Β· Declared Dead Β· πŸ› New Interfaces for Musical Expression

πŸ‘» CAUSE OF DEATH: Ghosted
No code link whatsoever

"No code URL or promise found in abstract"

Evidence collected by the PWNC Scanner

Authors Gamhewage C. de Silva, Tamara Smyth, Michael J. Lyons arXiv ID 2010.03265 Category cs.HC: Human-Computer Interaction Cross-listed cs.CV, cs.SD, eess.AS Citations 24 Venue New Interfaces for Musical Expression Last Checked 4 months ago
Abstract
We describe a simple, computationally light, real-time system for tracking the lower face and extracting information about the shape of the open mouth from a video sequence. The system allows unencumbered control of audio synthesis modules by the action of the mouth. We report work in progress to use the mouth controller to interact with a physical model of sound production by the avian syrinx.
Community shame:
Not yet rated
Community Contributions

Found the code? Know the venue? Think something is wrong? Let us know!

πŸ“œ Similar Papers

In the same crypt β€” Human-Computer Interaction

Died the same way β€” πŸ‘» Ghosted