Don't miss our weekly PhD newsletter | Sign up now Don't miss our weekly PhD newsletter | Sign up now

  Engineering Networked Machine Learning via Meta-Free Energy Minimisation


   Department of Engineering

This project is no longer listed on FindAPhD.com and may not be available.

Click here to search FindAPhD.com for PhD studentship opportunities
  Prof Osvaldo Simeone  Applications accepted all year round  Funded PhD Project (Students Worldwide)

About the Project

Inspired by neuroscience, informed by information-theoretic principles, and motivated by modern wireless systems architectures integrating artificial intelligence (AI) and communications, this project sets out to develop a paradigm-shifting framework for networked machine learning (ML) that is centred on the following ideas.

1. Free energy minimisation: According to the free energy principle, agents optimise internal models so as to minimise their information-theoretic surprise vis-a-vis the available data and prior information. This principle offers a basis to reason about epistemic uncertainty ("know when you don't know") in AI agents that is grounded in information-theoretic analyses of out-of-sample generalisation - away from the current narrow focus on point-wise accuracy, towards uncertainty quantification and calibration. A well-calibrated agent can make informed decisions about when to refrain from acting, about when and how to collect or request more data from the environment or other agents, and about how to guard against anomalies or malicious agents.

2. Networked meta-learning: In meta-learning, agents do not share an ML model in full as in conventional, centralised, solutions. Rather, only a meta-model is shared as a means to transfer knowledge across agents, while enabling the optimisation of personalised local models. Meta-models can naturally implement the engineering principle of modularity by encompassing a common repository of functions that can be combined to suit the cognitive needs of each agent. This framework bridges the gap between the dominant centralised or joint learning approaches - including also federated learning - and the individual learning baseline, by means of limited model sharing, while still enabling meaningful cooperation with a controlled privacy loss.

3. Native integration of wireless communication and learning: Conventional wireless systems are based on the principle of separation between computing and communications. In contrast, a native integration of communications and learning embeds wireless communication primitives as part of the data generating and processing model. Like state-of-the-art integrated solutions, the proposed approach aims at fully utilizing radio channel capacity by avoiding inefficiencies due to separate processing. Unlike existing methods, however, the framework moves away from the standard problem of communicating under uncertainty (on the communication channel) to the novel problem of communicating uncertainty (on the solution of the cognitive task) under uncertainty (on the communication channel) in order to support networked meta-learning.

Overall, this project sets out to study a novel, theoretically principled, paradigm for ML that moves away from the current centralised, accuracy-focused, state of the art in ML to embrace decentralization via wireless connectivity, uncertainty quantification, personalisation, modularity, privacy preservation, and the right to erasure.

Application Procedure:

To be considered for the position candidates must apply via King’s Apply online application system. Details are available at:

https://www.kcl.ac.uk/engineering/postgraduate/research-degrees

Please indicate Osvaldo Simeone as your desired supervisor in your application and all correspondence.

The selection process will involve a pre-selection on documents, if selected this will be followed by an invitation to an interview. If successful at the interview, an offer will be provided in due time.

https://www.kcl.ac.uk/study/postgraduate-research/how-to-apply

Computer Science (8) Engineering (12)

Funding Notes

Funding is available for 3.5 years (covering Tuition fees, Stipend plus London Allowance, Bench Fees/Research Training & Support Grant). It covers tuition fees for UK or International students and a tax-free stipend of approximately £19,668 p.a. with possible inflationary increases after the first year.
Search Suggestions
Search suggestions

Based on your current searches we recommend the following search filters.