Learning to Generate Avatars based on Speech
The University of Bath is inviting applications for the following PhD project to be supervised by Dr Vinay Namboodiri in the Department of Computer Science https://vinaypn.github.io/.
Realistic 3D based Avatar generation is a crucial requirement for many use cases ranging from movies to gaming and other use-cases outside the entertainment industry. This project will be building on our past work on “Automatic Face-to-Face translation” that demonstrated effective translation of a talking face in one language into another language.
In order to obtain high quality renderings, it is important to integrate aspects related to high quality canonical meshes that can be captured using the CAMERA (www.camera.ac.uk) studio. The challenge would be to appropriately synchronise audio embeddings with 3D mesh-based controls. The project will explore two aspects. First, using the reference mesh to enhance the realism of an image based video representation and second, to obtain direct high quality mesh deformations based on the audio embeddings.
The project will be utilizing data driven deep learning-based techniques and offers scope for innovating through techniques that allow for interpretability of the proposed models.
Applicants should hold, or expect to receive, a First Class or good Upper Second Class Honours degree (or the equivalent). A master’s level qualification would also be advantageous. Appropriate mathematical and programming ability will also be required.
Enquiries and applications:
Informal enquiries are welcomed and should be directed to Dr Vinay Namboodiri, [Email Address Removed].
Formal applications should be made via the University of Bath’s online application form for a PhD in Computer Science:
More information about applying for a PhD at Bath may be found here:
Anticipated start date: 28 September 2020.
Research Council funding is available for an excellent UK or EU student who has been ordinarily resident in the UK since September 2017. For more information on eligibility: https://www.epsrc.ac.uk/skills/students/help/eligibility/.
Funding will cover UK/EU tuition fees, maintenance at the UKRI doctoral stipend rate (£15,285 per annum tax-free in 2020/21, increasing annually in line with the GDP inflator) and a training support grant (£1,000 per annum) for a period of up to 3.5 years.
We also welcome all-year-round applications from self-funded candidates and candidates who can source their own funding.
“Towards Automatic Face-to-Face Translation”, Prajwal Renukanand*, Rudrabha Mukhopadhyay*, Jerin Philip, Abhishek Jha, Vinay P. Namboodiri and C.V. Jawahar
ACM Multimedia, 2019.
How good is research at University of Bath in Computer Science and Informatics?
FTE Category A staff submitted: 24.00
Research output data provided by the Research Excellence Framework (REF)
Click here to see the results for all UK universities