The development and experience of gesture and brainwave interaction in audiovisual performances

Software and hardware developments in the 21st century have greatly expanded the realm of possibilities for interactive media. These developments have fueled an increased interest in using unconventional methods to translate a performer’s intentions to music and visuals. And at the heart of every computer mediated performance is the question of what human action causes what audiovisual effect. This research explores this question and others by examining two performances that I created; performances featuring audiovisual media that respond to a performer’s gestures and brainwaves. The aim is to improve our understanding of what factors influence interaction design within and across the performing arts. I argue that technology, collaborators and transparency have a decisive impact on a performer’s actions and interactive media. Furthermore, my findings suggest that synchronicity, elegance and visual feedback are important characteristics that can enhance the bond between the performer and audiovisual content. Lastly, I explain how universities and companies can improve research and development by together creating a live show.