About the Project
This scholarship is funded by the EPSRC CDT iCASE with Microsoft.
Start date: October 2021
- Professor Matt Jones, Dr Jen Pearson, Dr Simon Robinson (Computational Foundry, Swansea University)
- Dr Cecily Morrison (Microsoft Research, Cambridge)
- Dr Ed Cutrell (Microsoft Research)
Microsoft has invested heavily in Responsible AI, considering the ways that AI models and the data that drives them impacts people and society. One significant issue that has been raised and is being considered across the company is the lack of representation of people with disabilities in the datasets that power our AI-systems (R1). As a result, AI systems have difficulty recognising people with physical anomalies or recognising images taken by people who are blind.
One investment Microsoft has made is the ORBIT project (R2). A collaboration between MSRC and City University (funded by Microsoft AI4Accessibility), it aims to produce a dataset of videos of personal objects taken by people who are blind or low vision. This open-source dataset will be used to drive new methods in the emerging machine learning field of meta-learning which enables personalisation to a specific user when algorithms are given a small number of examples from the user themselves.
As part of this work, we have considered how we might extend our data collection to low and medium resource countries. Initial explorations suggest potential value tensions that we must consider before collecting data with these communities. This PhD will contribute to understanding how best to engage people with disabilities in low-resource settings in participating in data collection for creating assistive AI technologies that will work for them.
It is well established that the data-sets used to build and train AI systems heavily influence the usefulness and usability of the resulting systems; these concerns are amplified when considering systems for special-case user groups (R3). Furthermore, regardless of application, system development that excludes or marginalises direct user engagement will likely lead to failure or suboptimal systems. Recently, the HCI community has argued for humans at the centre of AI development and use (R4). The supervisory team’s recent work also demonstrates how user-based data-set generation with resource-constrained communities might inform and shape AI systems (R5). Furthermore, work – by the team and others – has shown the need to adapt methods to effectively engage with users in low and medium resource countries (R6).
This project will use co-creation methods, probes and prototypes to effectively engage with people who are blind or low vision in resource-constrained contexts to consider appropriate approaches to collecting data-sets that drive machine learning research and assistive systems. The probes and prototype will become a platform for contextual data capture as well as enabling novel insights into interactions with AI assistive technologies.
The successful applicant will be based at the Computational Foundry, a £32.5 million world-class facility and a beacon for research collaborations opened in 2018. The Foundry has state-of-the-art labs including machine vision and biometrics; maker labs; interaction-technologies user studies suite; visualisation lab; and IoT lab. The Foundry houses the Computer Science Department (founded over 40 years ago); in the most recent UK REF assessment (2014), the Department was deemed to be leading in many respects with for instance 100% of its “research environment” judged as world-leading or internationally leading.
The PhD Researcher will benefit from existing strong research collaborations with leading labs globally including the Industrial Design Centre in IIT-B (Mumbai) which has expertise in accessibility in the Indian context. Further, they will be affiliated with the EPSRC Centre for Doctoral Training in Enhancing Interactions and Collaborations with Data and Intelligence-Driven Systems.
1. Guo A, Kamar E, Vaughan JW, Wallach H, Morris MR. (2019). Toward Fairness in AI for People with Disabilities: A Research Roadmap.
4. Shneiderman, B. (2020). Human-Centered Artificial Intelligence: Three Fresh Ideas. AIS Trans on Hum-Comput Inter, 12(3).
5. Reitmaier T, Robinson S, Pearson J, Raju DK, and Jones M. (2020). An Honest Conversation: Transparently Combining Machine and Human Speech Assistance in Public Spaces. CHI '20
6. Pearson J, Robinson S, Reitmaier T, Jones M, and Joshi A. (2019). Diversifying Future-Making Through Iterative Design. ACM Trans. Comput.-Hum. Interact. 26(5)
Candidates should hold a minimum of upper second class (2:1) honours degree (or its equivalent) in Computer Science, Engineering or Mathematics. We are building a community that aspires to have a high degree of diversity of perspective so you are encouraged to apply if you have a background in Arts and Humanities, Social Sciences, Law, Management, etc.
Candidates should have an aptitude and ability in computational thinking and methods including the ability to write software or enthusiasm to learn how to do so.
For non-native English language speakers, an IELTS average score of 6.5 with no less than 6.0 in any element is required. For details on the University’s English Language entry requirements, please visit – http://www.swansea.ac.uk/admissions/english-language-requirements/
This scholarship is open to UK and international candidates (including EU and EEA).
Based on your current searches we recommend the following search filters.
Based on your current search criteria we thought you might be interested in these.