Towards Accessible and Embodied Control of Telematic Sonic Space Through Browser-Based Facial Tracking

This paper presents in-progress research on a browser-based solution for unique sonic perspectives in telematic musical performance via facial tracking. Angular rotation of the face is calculated for the direction of focus in relation to a webcam, changing the virtual orientation of the user within a shared virtual acoustics environment. This sonic perspective is relayed back to the player, allowing for personal embodied control of spatial audio. Current outcomes, limitations, and future research goals of the system are addressed.