Using Mobile Technology in Live Musical Performance

Explore the innovative fusion of mobile technology and live musical performance in this 33-minute conference talk from JSConf's Reject.JS 2015 event in Berlin. Discover how pianists Jocelyn Ho and Drew Petersen break the fourth wall by extending the performer's gestures to the audience through mobile devices. Learn about their unique musical experience that uses a Kinect to trigger sounds on audience members' phones, creating an interactive and immersive performance. Gain insights into the technical aspects of this project, including the use of JavaScript, Web Audio, and audience participation to augment and distort sounds. Experience a meta-demonstration of the piece itself, showcasing the intersection of auditory and visual senses in modern musical performances.

Jocelyn Ho & Drew Petersen – Using mobile technology in live musical perfomance