Seeing the Future: Predicting Video

The estimated rate that information enters the human eye is a staggering 72GB/s. Using very sluggish neurons and a power budget of a few watts the human brain processes this information, creates a percept of a stable world and detects important events occurring within the world, significantly outperforming conventional computer vision methods. How does the brain achieve such efficient and fast processing? Predictive coding is a term used by brain scientists to describe an idea that has its roots in the earliest days of psychology, and had a later echo in the field of cybernetics. The theory proposes that in order to drastically reduce the inherent data processing requirements, and thus achieve efficiency, the brain tries to predict incoming sensory information. It does this for two reasons. First, the processing demands for testing a prediction of what something is are considerably lower than for deducing what something is. Second, prediction failures indicate sensory input that merits extra processing resources, where something is changing or incongruent.

We have recently completed an EPSRC funded project to build the first artificial predictive vision system, which we now wish to build upon. The potential applications of this technology are broad (e.g. healthcare, security, ubiquitous computing), and the technology could be used as part of a standalone computer-based system, or to help or augment a human operator.

In order to predict scenes, an understanding of the scene captured in the current and previous frames is required. For this purpose, we propose to utilise off-the-shelf publicly available research code (in-house, standard toolboxes etc.). For example, methods that can analyse basic motion in the scene (optical) and from this high level physics based motion (e.g. moving car) or human activity (e.g. walking pedestrian) are required. The student will evaluate current available methods on our newly acquired data set.

A variety of PhD projects set around this area of research are available:

·      Predicting the next frame in 2D video

·      Predicting the next frame in 3D video --- using a 3D (RGBD) camera to gather data.

·      Comparing and contrasting deep learning versus predictive coding methods.

·      Various levels of image analysis: Motion compensation, Motion analysis – physics based motion and human activity.

·      Tracking people and objects in the scene

·    3D modelling of the scene

 For more information about the project, please contact [Email Address Removed]

Academic criteria: A 2:1 Honours undergraduate degree or a master's degree, in computing or a related subject. Applicants with appropriate professional experience are also considered. Degree-level mathematics (or equivalent) is required for research in some project areas.

Applicants for whom English is not their first language must demonstrate proficiency by obtaining an IELTS score of at least 6.5 overall, with a minimum of 6.0 in each skills component.

How to apply:

Please contact the supervisors of the project prior to submitting your application to discuss and develop an individual research proposal that builds on the information provided in this advert. Once you have developed the proposal with support from the supervisors, please submit your application following the instructions provided below

Please submit your application before the application deadline 29th April 2022 via Computer Science and Informatics - Study - Cardiff University

In order to be considered candidates must submit the following information: 

• Supporting statement 
• CV 
• In the ‘Research Proposal’ section of the application enter the name of the project you are applying to and upload your Individual research proposal, as mentioned above in BOLD
• In the funding field of your application, insert “I am applying for 2022 PhD Scholarship in Computer Science and Informatics”, and specify the project title and supervisors of this project in the text box provided.
• Qualification certificates and Transcripts
• References x 2 
• Proof of English language (if applicable)

Interview - If the application meets the entrance requirements, you will be invited to an interview. 

If you have any questions or need more information, please contact [Email Address Removed]