This Honors Thesis is a continuation of Prof. Lauren Hayes’s and Dr. Xin Luo’s research initiative, Haptic Electronic Audio Research into Musical Experience (HEAR-ME), which investigates how to enhance the musical listening experience for CI users using a wearable haptic system. The goals of this Honors Thesis are to adapt Prof. Hayes’s system code from the Max visual programming language into the C++ object-oriented programming language and to study the results of the developed C++ codes. This adaptation allows the system to operate in real-time and independently of a computer.
Towards these goals, two signal processing algorithms were developed and programmed in C++. The first algorithm is a thresholding method, which outputs a pulse of a predefined width when the input signal falls below some threshold in amplitude. The second algorithm is a root-mean-square (RMS) method, which outputs a pulse-width modulation signal with a fixed period and with a duty cycle dependent on the RMS of the input signal. The thresholding method was found to work best with speech, and the RMS method was found to work best with music. Future work entails the design of adaptive signal processing algorithms to allow the system to work more effectively on speech in a noisy environment and to emphasize a variety of elements in music.
In this paper, I propose that taking an embodied approach to music performance can allow for better gestural control over the live sound produced and greater connection between the performer and their audience. I examine the many possibilities of live electronic manipulation of the voice such as those employed by past and current vocalists who specialize in live electronic sound manipulation and improvisation. Through extensive research and instrument design, I have sought to produce something that will benefit me in my performances as a vocalist and help me step out from the boundaries of traditional music performance. I will discuss the techniques used for the creation of my gestural instrument through the lens of my experiences as a performer using these tools. I believe that, through use of movement and gesture in the creation and control of sound, it is more than possible to step away from conventional ideas of live vocal performance and create something new and unique, especially through the inclusion of improvisation.