AI-driven Soundscapes Design for Immersive Environments

Recently, machine learning, or machine listening has been applied to sound and music production, automatic mixing and processing of audio signals but little as yet in the context of sound design. This EPSRC ICASE PhD will extend these methodologies to more creative contexts, suitable for radio, TV and film soundtracks, with a view to automating part of the sound design process for immersive, interactive and object-based audio content. Perceptual testing will be used to test the ecological validity of the result. These results will be used to train an AI-based approach to soundtrack design capable of dealing with the significant additional demands of open, non-linear, interactive and immersive sound worlds.

The project is part of the on-going relationship between the University of York and the BBC including the Audio Research Partnershipand Digital Creativity Labs. The successful candidate will be supervised by Professor Damian Murphy and study in the Department of Electronic Engineering AudioLab at the University of York, spending short periods of time with BBC R&D leading to a full one-year placement in the third year of this research project.

The project will consider both research and development, as well as practice-based approaches, and user studies with colleagues from the BBC. The successful applicant should have a strong interest in sound, music and immersive audio technology, excellent programming skills and an understanding of DSP and sound design practice. Some background in Machine Learning would also be an advantage.