MASOM: Musical Agent based on Self-Organizing Maps
Can we use Artificial Intelligence (AI) to create super-human musicians? Can we create an AI that listens to more music than a human could? Can we train AI on the compositions of dead composers and play with them on stage?
Musical agents are AI software making music. Musical Agent based on Self-Organizing Maps (MASOM) is a musical software agent for live performance. MASOM plays experimental music and free improvisation. It learns by listening to audio files such as recordings of performances or compositions. We can train a MASOM agent on a set of music that is so big that it would take more than one human life to listen. Similarly, we can train MASOM agents on dead composers and convert their fixed media piece to interactive musical agents.
MASOM also extracts higher level features such as eventfulness, pleasantness, and timbre to understand the musical form of what it hears. MASOM is limited to the style of what is has listened to and reacts in real-time to what he is hearing. The agent can listen to itself and other performers to decide what to play next.
MASOM-Factor v1.03
MASOM joins two media art companies from Istanbul, Ouchhh and AudioFil for a performance at the Ars Electronica Festival 2017 Artificial Intelligence in Linz, Austria.
https://www.facebook.com/Ouchhh.tv/videos/1492873787455600/
and for a projection mapping piece on the Facade of Romanian Parliament at the IMapp 2017 Bucharest, Romania:
https://www.facebook.com/watch/?v=1948136815404683
MASOM version 0.06
This is the current version of MASOM. We released the complete system design in Proceedings of the 5th International Workshop on Musical Metacreation.
Patar @Barely Constrained by CoCreaTive
Patar is an experimental electronic music project featuring Kıvanç Tatar, Philippe Pasquier, and MASOM. MASOM is a musical agent, an artificial intelligence (AI) architecture, making music. Together, three entities produce a live performance of experimental electronic music, live electroacoustic music, musique concrète, soundscape compositions, through structured improvisation.
Patar’s performances experiments with a wide range of electronic music styles within the performance. The performances of Patar oscillate between ambient and noise while exploring the frontiers of the rhythmic and tonal, and using both electronic and acoustic textures.
This performance includes three piece. Each piece includes a different MASOM agent. MASOMs trained on Bernard Parmegiani, David Tudor, and Ryoji Ikeda, respectively.
Comparing MASOM's output to random segment playback
Here, we provide two recordings of MASOM's output in solo performance mode so that the listeners can decide on MASOM's performance.
MASOM's output
This track is a recording of the output of MASOM trained on Ryoji Ikeda's Test Pattern album.
This track is a recording of the output of MASOM trained on Bernard Parmegiani's De Natura Sonorum album.
Random segment playback:
This following track is a recoding of random audio segments from the same album, Bernard Parmegiani's De Natura Sonorum. We let our readers to decide MASOM's performance by comparing the random segment playback to the MASOM's output.
Exploring MASOM's memory
In this video, we explore the memory of a MASOM trained on Bernhard Parmegiani's De Natura Sonorum.
MASOM version 0.05
Patar Studio Session II
Patar is an experimental electronic music project featuring Kıvanç Tatar, Philippe Pasquier, and MASOM. MASOM is a musical agent, an artificial intelligence (AI) architecture, making music. Together, three entities produce a live performance of experimental electronic music, live electroacoustic music, musique concrète, soundscape compositions, through structured improvisation.
Patar’s performances experiments with a wide range of electronic music styles within the performance. The performances of Patar oscillate between ambient and noise while exploring the frontiers of the rhythmic and tonal, and using both electronic and acoustic textures.
MASOM version 0.04
A Big MASOM Family, as a part of the Co.Crea.Tive April Concert
Here is is an excerpt from the rehearsals with two MASOM agents. One MASOM agent is on the left channel, the other MASOM agent is on the right, and I am on both channels. The MASOMs are trained on this album: kivanctatar.bandcamp.com/album/self-distruption.
MASOM version 0.03
TATAR and MASOM Take the AID Train. This track is an excerpt from the rehearsals for Take The AID Train (Dec 25, 2016) at Kaset Mitanni, İstanbul. It is a trio of me and 2 MASOM agents. One MASOM agent is on the left channel, the other MASOM agent is on the right, and I am on both channels. The MASOMs are trained on this album: kivanctatar.bandcamp.com/album/self-distruption
MASOM version 0.02
Patar Studio Session I
Patar is an experimental electronic music group of 2.5 entities including Kıvanç Tatar, Philippe Pasquier, and MASOM.
MASOM @madMethod by NOW Society, Vancouver, BC, Canada
The NOW Society presents madMethod, featuring Stefan Smulovitz’s Mad Scientist Machine, visuals by Sammy Chien and performances by MASOM and the NOW ensemble. Layers of memory and experience combine light, images and sound, remembered, manipulated and instantly created. Audience members look down upon the stage a story below and see images on the floor, the Mad Scientist Machine LED lights and listen to the sounds of the musicians as they respond to and inspire imagery.
To pay tribute to the visionary composer and virtuosic listener Pauline Oliveros, the NOW Society performs six of her graphic graffiti scores. When the NOW Society first performed Stefan Smulovitz’s Mad Scientist Machine in November of 2010, Smulovitz requested that Oliveros send imagery for her conduction of the program. Oliveros sent six photos of graffiti for the Society’s use. The NOW ensemble, with guest artists Smulovitz, Sammy Chien and MASOM, proudly present these scores, honoring the legacy and and generosity of Pauline Oliveros.
Lisa Cay Miller’s work Aventures I and III, originally performed in 2014 by the NOW ensemble, are rearranged and performed by a little big band, which in parts be joined by MASOM, the software agent trained to react with the original live recording. Sammy Chien will provide live video responding to the ensemble on December 2. On December 3, the NOW ensemble and guests respond to the recorded imagery of the previous evening. And the Mad Scientist Machine use color and intensity to cue the ensembles and visuals, Miller and Smulovitz conducting instant compositions.
MASOM version 0.01
Performance @Open to Enter, Vancouver, BC, Canada
Curtosy of Vandocument: http://vandocument.com/2016/11/a-conversation-with-artificial-intelligence/
Credits to
AI system design: Kıvanç Tatar and Philippe Pasquier
Performer: Kıvanç Tatar
Video: Ash Tanasiychuk
Mastering: Kıvanç Tatar
This performance is a duo with MASOM. The human performer is on the left channel and the musical agent is on the right channel. For this performance, MASOM is trained on a 30 minute experimental music recording, available here: https://ktatar.bandcamp.com/track/self-distruption. The system design is yet to be published. Please check https://kivanctatar.wordpress.com/research/ in a couple of months.
See info about the event
Members
Kıvanç Tatar and Philippe Pasquier
Research paper
Tatar, K. & Pasquier, P. (2017). MASOM: A Musical Agent Architecture based on Self-Organizing Maps, Affective Computing, and Variable Markov Models. In Proceedings of the 5th International Workshop on Musical Metacreation (MuMe 2017).