European Molecular Biology Laboratory (Heidelberg) Featured PhD Programmes
University of Glasgow Featured PhD Programmes
King’s College London Featured PhD Programmes
Catalysis Hub Featured PhD Programmes
University of Sheffield Featured PhD Programmes

Skill discovery in reinforcement learning motivated by human behaviour

  • Full or part time
  • Application Deadline
    Monday, April 01, 2019
  • Competition Funded PhD Project (European/UK Students Only)
    Competition Funded PhD Project (European/UK Students Only)

Project Description

A fundamental problem in AI is how to endow artificial agents with the ability to autonomously form useful high-level behaviours (for example, grasping) from available behavioural units (for example, primitive sensory and motor actions available to a robot). This ability allows a developmental process during which an agent can learn to display behaviours of increasing complexity through continuously building on its existing set of skills to acquire new ones. For example, grasping may be followed by manipulating objects in different ways, which may be followed by using a key to unlock the door to an adjacent room, and so on, forming a continuously growing hierarchy of behaviours.

This project aims to understand how people form an action hierarchy in an environment that is new to them as they interact with this environment to achieve a desired outcome.

The ultimate goal of the project is to use our understanding of human behaviour to develop algorithms that artificial agents can use. The methodology and the domain of study will depend on the background and interests of the student. One possibility is to study people as they learn how to play a new game. The results from the project will inform reinforcement learning applications in engineering and robotics.

The project will be supervised by Dr Özgür Şimşek at the Department of Computer Science at the University of Bath. The University is located in the UNESCO World Heritage city of Bath, providing a vibrant research environment in one of the most beautiful areas in the UK.

This project is associated with the UKRI CDT in Accountable, Responsible and Transparent AI (ART-AI), which is looking for its first cohort of at least 10 students to start in September 2019. Students will be fully funded for 4 years (stipend, UK/EU tuition fees and research support budget). Further details can be found at: http://www.bath.ac.uk/research-centres/ukri-centre-for-doctoral-training-in-accountable-responsible-and-transparent-ai/.

Desirable qualities in candidates include intellectual curiosity, a strong background in maths and programming experience.

Applicants should hold, or expect to receive, a First Class or good Upper Second Class Honours degree. A master’s level qualification would also be advantageous.

Informal enquiries about the project should be directed to Dr Özgür Şimşek ().

Enquiries about the application process should be sent to .

Formal applications should be made via the University of Bath’s online application form for a PhD in Computer Science: https://samis.bath.ac.uk/urd/sits.urd/run/siw_ipp_lgn.login?process=siw_ipp_app&code1=RDUCM-FP01&code2=0013

Start date: 23 September 2019.

Funding Notes

ART-AI CDT studentships are available on a competition basis for UK and EU students for up to 4 years. Funding will cover UK/EU tuition fees as well as providing maintenance at the UKRI doctoral stipend rate (£15,009 per annum for 2019/20) and a training support fee of £1,000 per annum.

We also welcome all-year-round applications from self-funded candidates and candidates who can source their own funding.

We also welcome all-year-round applications from self-funded candidates and candidates who can source their own funding.

How good is research at University of Bath in Computer Science and Informatics?

FTE Category A staff submitted: 24.00

Research output data provided by the Research Excellence Framework (REF)

Click here to see the results for all UK universities

Email Now

Insert previous message below for editing? 
You haven’t included a message. Providing a specific message means universities will take your enquiry more seriously and helps them provide the information you need.
Why not add a message here
* required field
Send a copy to me for my own records.

Your enquiry has been emailed successfully





FindAPhD. Copyright 2005-2019
All rights reserved.