Michaella Moon

School of Music, Music Technology, MFA1

Words Trigger

This project connects RunwayML, Processing, MaxMsp and TouchDesigner to create an audio and visual rich performance. The audio and visuals are all triggered by the text typed into the program. Depending on the number of words typed in, Processing will grab the same amount of colour values from random points of the collaged image created by RunwayML's AttnGAN. These colour values will be converted first into MIDI notes then turned into a readable score the Cellist can play in real-time. MaxMsp is programmed to pitch detect 36 notes ranging from C2-B4. As the Cellist plays, her notes will cause the TouchDesigner particle system to change shapes, colour and positions.

Collaborators: Mike Leisz, Christine Meinders

https://michaellamoon.github.io/expo21/index.html