Don't miss our weekly PhD newsletter | Sign up now Don't miss our weekly PhD newsletter | Sign up now

  General probability distributions for structured machine learning


   Centre for Accountable, Responsible and Transparent AI

This project is no longer listed on FindAPhD.com and may not be available.

Click here to search FindAPhD.com for PhD studentship opportunities
  Dr Tom Fincham Haines  No more applications being accepted  Self-Funded PhD Students Only

About the Project

Supervised machine learning models, such as artificial neural networks, are unstructured. They can be trained from data, but there is no possibility to include any additional knowledge, e.g. that two features are independent conditioned on knowing a third. To give a specific scenario, you know that air pressure affects rain which causes your weather station to measure rainfall. But air pressure has no direct affect on the rain measurement, and the two are independent if you know if it is raining or not. This cannot be included in traditional supervised machine learning.

Structure can be modelled using probabilistic graphical models. These are however limited by the inference algorithms (primarily belief propagation, Gibbs sampling and mean field variational methods), which require the use of simple probability distributions that are a poor fit to reality.

This PhD is about exploring more general representations, specifically arbitrary density estimates, that can represent any distribution. Prior work has almost entirely been particle based [1,2,3], and has approximations and/or inefficient search that compromises performance. There are many possible improvements that can be made to the particle approaches; additionally new alternatives can be explored.

Graphical models are a kind of explainable AI, as the structure can be human understandable. Unfortunately their underperformance relative to other models limits their usage, particularly in industry. Generalising their representative capabilities, to match better known models, is one step towards wider usage. Given the 'right to an explanation' requirement of the GDPR this may become legally necessary. Additionally, a graphical model introduces a modular structure that can be debugged. As AI makes it way into safety critical scenarios, such as self driving cars, graphical models may prove necessary for quality assurance.

Candidates should normally have a good first degree or a Master’s degree in computer science, maths, or a related discipline. A strong mathematical background is essential; good programming skill and previous machine learning experience highly desirable.

Informal enquiries about the project should be directed to Dr Tom Fincham Haines.

Formal applications should be accompanied by a research proposal and made via the University of Bath’s online application form. Further information about the application process can be found here.

Start date: Between 8 January and 30 September 2024.


Computer Science (8) Mathematics (25)

Funding Notes

We welcome applications from candidates who can source their own funding. Tuition fees for 2023/4 academic year are £4,700 (full-time) for Home students and £26,600 (full-time) for International students. For information about eligibility for Home fee status: https://www.bath.ac.uk/guides/understanding-your-tuition-fee-status/.

References

[1] "Nonparametric Belief Propagation", by Sudderth et al., 2003.
[2] "Proteins, Particles, and Pseudo-Max-Marginals: A Submodular Approach", by Pacheco & Sudderth, 2015.
[3] "Stein Variational Message Passing for Continuous Graphical Models", by Wang et al., 2017.

How good is research at University of Bath in Computer Science and Informatics?


Research output data provided by the Research Excellence Framework (REF)

Click here to see the results for all UK universities

Where will I study?

Search Suggestions
Search suggestions

Based on your current searches we recommend the following search filters.