Automatic Sound Design

According to the International Organization for Standardization, a soundscape is “an acoustic environment as perceived or experienced and/or understood by a person or people, in context.” The concept of soundscape was proposed initially by Simon Fraser University (SFU) professor, R. Murray Schafer, in the 1960s. Schafer, along with SFU Professor, Barry Truax, and their student, Hildegard Westerkamp, formed the famous World Soundscape Project through their  groundbreaking work in sound studies. From then on, SFU has been a leader in soundscape studies.

soundscape studies

At the Metacreation Lab, we are focusing on automatic sound design. The goal is to build a system that automatically retrieves, analyzes, selects, processes, and mixes soundscape recordings to compose emotional, artificial soundscapes for video games, movies, virtual reality environments, and sound arts. Our papers and artworks can be found at the following links:

Jianyu Fan is currently a Ph.D. candidate in the Metacreation Lab at Simon Fraser University. Previously, he worked as a research assistant at Bregman Media Laboratory at Dartmouth College.  His research interests lie in the field of Affective Computing, Machine Listening, Human-Computer Interaction and Computational Creativity. In particular, he builds intelligent systems to model human perception and cognition of sound design and video editing practice to better understand the motivation and intention of the creative process.  As an artist, he has been playing the piano for over 23 years. His piano works have been presented at international conferences and art festivals.

Leave a Reply