Coventry University Featured PhD Programmes
Xi’an Jiaotong-Liverpool University Featured PhD Programmes
Peter MacCallum Cancer Centre Featured PhD Programmes

About the Project

Machine Learning (ML) is becoming more and more important with its increasing integration in various domains such as self-driving cars, machine translation, medical systems, many of these being safety-critical applications. Naturally, trustworthiness concerns arise, regarding the decisions or predictions obtained, and also the need for systematic testing of ML software. Compared with testing traditional software, machine learning testing comes with additional challenges, regarding input generation, overcoming the ‘test Oracle problem’ (the challenge of distinguishing the corresponding desired, correct behaviour from potentially incorrect behaviour), test assessment criteria, bug detection in training data or learning program.

The current practice includes adversarial ML testing (finding inputs that, when changed minimally from their original versions, get classified differently), fuzz and search-based test input generation. For solving the ‘Oracle problem’ metamorphic relations have been studied – these are transformations of the test data that are expected to yield the same output, or to generate expected changes in the predictive result.

This project will focus on automating ML testing for autonomous driving, but there are other applications areas, including medical image analysis and machine translation for which collaboration opportunities are possible.

Eligibility:

Candidates are expected to hold (or be about to obtain) a minimum 2:1 honours degree (or equivalent) in a related area / subject, e.g. Computer Science, Software Engineering, Mathematics, Machine Learning, etc. MSc, MA or relevant experience in a related discipline is highly desirable.

References

Raja Ben Abdessalem, Shiva Nejati, Lionel C. Briand, Thomas Stifter: Testing advanced driver assistance systems using multi-objective search and neural networks. ASE 2016: 63-74

Sergio Segura, Gordon Fraser, Ana B. Sánchez, Antonio Ruiz Cortés: A Survey on Metamorphic Testing. IEEE Trans. Software Eng. 42(9): 805-824 (2016)

Yuchi Tian, Kexin Pei, Suman Jana, Baishakhi Ray: DeepTest: automated testing of deep-neural-network-driven autonomous cars. ICSE 2018: 303-314

Jie M. Zhang, Mark Harman, Lei Ma, Yang Liu: Machine Learning Testing: Survey, Landscapes and Horizons. In IEEE Transactions on Software Engineering, doi: 10.1109/TSE.2019.2962027.

Mengshi Zhang, Yuqun Zhang, Lingming Zhang, Cong Liu, Sarfraz Khurshid: DeepRoad: GAN-based metamorphic testing and input validation framework for autonomous driving systems. ASE 2018: 132-142

Zhi Quan Zhou, Liqun Sun: Metamorphic testing of driverless cars. Commun. ACM 62(3): 61-67 (2019)

Email Now

Insert previous message below for editing? 
You haven’t included a message. Providing a specific message means universities will take your enquiry more seriously and helps them provide the information you need.
Why not add a message here

The information you submit to University of Bradford will only be used by them or their data partners to deal with your enquiry, according to their privacy notice. For more information on how we use and store your data, please read our privacy statement.

* required field

Your enquiry has been emailed successfully



Search Suggestions

Search Suggestions

Based on your current searches we recommend the following search filters.



FindAPhD. Copyright 2005-2020
All rights reserved.