The goal of this project is to develop a real-time robotic perception framework that captures visual information from real-world environments, and is further reconstructed and converted into editable geometric models with semantic contexts.
A typical robotic perception in the task of scene understanding may involve information capture and analysis at geometric and semantic levels. The former focus on extraction of geometric entities/primitives from a scene, as well as interactions between them. The latter is mainly to learn the dense semantic labels for each of the geometric primitive obtained from a scene. Properly understanding a scene is an important prerequisite for richer industrial applications, including autonomous systems, navigation, mapping, and localisation. The ability to understand a scene depicted in a set of static images with other multi-sensory information has been an essential computer vision problem in practice. However, this level of understanding is rather inadequate since the real-world scene is often dynamic and noisy where unknown objects might be moving independently, as well as visual properties like illumination and texture might change by time.
The aim of this project is to develop a real-time robotic perception framework using explainable deep learning techniques that
· enable real-time estimation of both geometric and semantic information from a real-world scene;
· create 3D editable contents using geometric and semantic information we obtained from a scene.
· provide human-understandable explanation and visualisation for the learning process.
In particular, the outcome of the project is supposed to achieve a certain level of transparency of a deep learning based perception system and further fill the gap between them and human understanding. This should comprise real-time 3D reconstruction for a real-world scene including a series of real-world challenges e.g. dynamic objects, illumination changes, large textureless regions etc. In addition, a set of high quality labels should be achieved for such a raw 3D model, e.g. semantic labels and information about the shape and pose of objects and layouts of the real-world scene. So that the raw model is then turned into a proper representation that can be further edited by an average user in a visual interactive environment. The successful candidate is expected to work closely with the experts from Electronic Engineering, as well as external collaborators from Facebook Oculus, Lambda labs, Kujiale.com and Imperial College London.
This project is associated with the UKRI Centre for Doctoral Training (CDT) in Accountable, Responsible and Transparent AI (ART-AI). We value people from different life experiences with a passion for research. The CDT's mission is to graduate diverse specialists with perspectives who can go out in the world and make a difference.
Applicants should hold, or expect to receive, a first or upper-second class honours degree in computer science, electrical engineering, mechanical engineering or a closely related discipline. A master level qualification or publication history would be advantageous.
Informal enquiries about the research should be directed to Dr Li.
Formal applications should be accompanied by a research proposal and made via the University of Bath’s online application form. Enquiries about the application process should be sent to [Email Address Removed].
Start date: 3 October 2022.
Continue with Facebook
