The goal of the PhD is to explore the relationship between text, image, and video media through machine learning to enable a computer to create storyboards and generate new unseen pictures simply from text written by a human. You will be supervised by experts in Machine learning, Dr Andrew Gilbert and Dr Armin Mustafa in the Centre for Vision, Speech and Signal Processing (CVSSP), in conjunction with an industrial partner BBC R&D, who will provide access to their vast dataset of relevant BBC archive programming.
This project will explore using text to generate new images and scenes, converting sentences from a tv or film director into realistic image-based film storyboards and film backgrounds for virtual production using Artificial intelligence (AI). The research will aid the creative process in film and tv production and saving production teams time and money. Together with longer-term benefits of improving the accessibility of film and tv by generating automatic scene descriptions for partially sighted viewers described only by text. This project will be the ultimate test of spatial, visual, and semantic world knowledge used for automatic storyboard generation.
Experts in Machine learning will supervise you, Dr Andrew Gilbert and Dr Armin Mustafa in CVSSP, in conjunction with an industrial partner BBC R&D, who will provide access to their vast dataset of relevant BBC archive programming. You’ll also be able to make extensive use of the machine learning facilities at the University of Surrey, including the sizeable AI@Surrey GPU cluster and other GPU servers.
Prior knowledge in machine learning and computer vision is essential to apply for this fully funded position. Interest in generative or graph networks should be highlighted. We are looking for a student with strong mathematical and programming skills, willing to learn, hardworking and looking forward to working together in a team to solve these challenges.
This is a 3-year project starting in October 2021.
Entry requirements
A first-class or 2:1 honours degree (or equivalent overseas qualification) in an appropriate discipline (e.g. engineering, computer science, signal processing, applied mathematics, and physics)
You should be able to demonstrate excellent mathematical, analytic, programming skills
Previous experience in computer vision and machine/deep learning would be advantageous English language requirements: IELTS Academic 6.5 or above (or equivalent) with 6.0 in each individual category.
How to apply
Applications should be submitted via the Digital Media Arts PhD programme page on the "Apply" tab.
Please state clearly the studentship project at you would like to apply for.
You must also attach a CV, certified copies of degree certificates and transcripts, a personal statement describing relevant experience (maximum two pages), two references, and proof of eligibility (e.g. passport or residence permit). Shortlisted applicants will be contacted directly to arrange a suitable time for an interview.
For informal enquiries, please contact Dr Andrew Gilbert ([Email Address Removed]) in the first instance.