The University of Bath is inviting applications for the following PhD project commencing in October 2023.
Overview of the Research:
Large language models such as GPT and FLAN are increasingly being used. In this project, the aim is to obtain, develop and analyse large language models. Further, we want to obtain an improved understanding of these models and their limitations and effectiveness. The project will then aim at understanding ideas related to the long-tail behaviour, compositionality, and challenges in training these models with limited resources. We will also investigate learning curves. These models can be used for diverse tasks such as comprehension, summarization, and translation. For the development we will use open-source tools such as fairseq library and data. The student would gain direct exposure to those tools, that literature, and to general concepts and methods in machine learning. The idea is to move past the use of pre-trained, and experiment with the training as well, albeit on a smaller scale.
Project keywords: Large language models, NLP, summarization, machine learning, learning representations.
Candidate Requirements:
Applicants should hold, or expect to receive, a First Class or good Upper Second Class UK Honours degree (or the equivalent). A master’s level qualification would also be advantageous.
In addition, applicants should have expertise in python programming and an ability to work with large textual datasets. They should have a good mathematical background and general programming expertise.
Non-UK applicants must meet our English language entry requirement.
Enquiries and Applications:
Informal enquiries are encouraged and should be directed to Prof Nello Cristianini on email address [Email Address Removed].
Formal applications should be submitted via the University of Bath’s online application form for a PhD in Computer Science.
More information about applying for a PhD at Bath may be found on our website.
Note: Applications may close earlier than the advertised deadline if a suitable candidate is found. We therefore recommend that you contact the lead supervisor prior to applying and submit your formal application as early as possible.
Funding Eligibility:
To be eligible for funding, you must qualify as a Home student. The eligibility criteria for Home fee status are detailed and too complex to be summarised here in full; however, as a general guide, the following applicants will normally qualify subject to meeting residency requirements: UK and Irish nationals (living in the UK or EEA/Switzerland), those with Indefinite Leave to Remain and EU nationals with pre-settled or settled status in the UK under the EU Settlement Scheme. This is not intended to be an exhaustive list. Additional information may be found on our fee status guidance webpage, on the GOV.UK website and on the UKCISA website.
Equality, Diversity and Inclusion:
We value a diverse research environment and aim to be an inclusive university, where difference is celebrated and respected. We welcome and encourage applications from under-represented groups.
If you have circumstances that you feel we should be aware of that have affected your educational attainment, then please feel free to tell us about it in your application form. The best way to do this is a short paragraph at the end of your personal statement.