Don't miss our weekly PhD newsletter | Sign up now Don't miss our weekly PhD newsletter | Sign up now

  Developing a new learning algorithm for biologically inspired spiking neural networks


   School of Science & Technology

This project is no longer listed on FindAPhD.com and may not be available.

Click here to search FindAPhD.com for PhD studentship opportunities
  Dr Aboozar Taherkhani, Prof TM McGinnity, Dr G Cosma  Applications accepted all year round  Self-Funded PhD Students Only

About the Project

The brain’s processing ability to solve complex problems has inspired many researchers to investigate how the brain processes information, reasons and its learning mechanisms. Inspired by the biological brain, Artificial neural networks (ANNs) have emerged as a machine learning tool to process information. In recent years, deep neural networks have achieved impressive results, especially in computer vision. The convolutional neural network (CNN) is a famous deep neural network, and it usually applies a supervised learning method using backpropagation approaches. Although, it needs a large volume of labelled data, its classification accuracy is impressive. In the convolutional neural network, each neuron has a continuous output value. However, biological neurons generate spikes to process and transmit information. This has resulted in a new area of artificial neural networks, where the focus is placed on more biologically plausible neuronal models known as Spiking Neural Networks (SNNs). Thanks to their ability to capture the rich dynamics of biological neurons and to represent and integrate different information dimensions such as time, frequency, phase etc., SNNs offer a promising computing paradigm more aligned to biological signal processing and their underlying computational models are potentially capable of modelling complex information processing in the brain [1] [2].

Training a deep spiking neural network is considerably more challenging as compared to a classical deep neural network [1][2][3]. The non-continuous nature of spiking neuron activities makes it difficult to use usual backpropagation method to train SNNs. A bio-inspired local learning rule, like Spike Timing Dependent Plasticity (STDP), can be used to overcome the training difficulty of a multilayer spiking neural network. This project, which is based on our previous published works, [1] [4] [5], seeks to develop a new learning algorithm for SNNs.

The aim of this project is to design novel biologically plausible algorithms for deep SNNs using existing computational models. The designed approaches will be evaluated on a range of benchmark datasets and real world information processing applications. To achieve this aim the following objectives are required:
• To investigate and evaluate representative biologically plausible SNN learning algorithms.
• To explore synaptic plasticity features such as short term plasticity and dynamic synapses along with Spike Time-Dependent Plasticity (STDP) to design new supervised and unsupervised learning algorithms for SNNs.
• To explore convolutional SNNs.
• To develop new learning method for deep SNNs.

A suitable candidate should have a background in Machine learning, and Artificial Neural Networks. It is essential that the candidate has good programming skills. The ability to code with Python is an advantage.

Funding Notes

This is a self-funded PhD opportunity.

References

[1] A. Taherkhani, A. Belatreche, Y. Li, S. Member, and L. P. Maguire, “A Supervised Learning Algorithm for Learning Precise Timing of Multiple Spikes in Multilayer,” pp. 1–14, 2018.

[2] N. Kasabov, K. Dhoble, N. Nuntalid, and G. Indiveri, “Dynamic evolving spiking neural networks for on-line spatio- and spectro-temporal pattern recognition,” Neural Networks, vol. 41, no. 1995, pp. 188–201, 2013.

[3] A. Tavanaei, M. Ghodrati, S. R. Kheradpisheh, T. Masquelier, and A. Maida, “Deep learning in spiking neural networks,” Neural Networks, Dec. 2018.

[4] A. Taherkhani, A. Belatreche, Y. Li, and L. P. Maguire, “DL-ReSuMe: A delay learning-based remote supervised method for spiking neurons,” IEEE Trans. Neural Networks Learn. Syst., vol. 26, no. 12, pp. 3137–3149, 2015.

[5] D. Kerr, S. Coleman, and M. T. McGinnity, “Biologically inspired intensity and depth image edge extraction,” IEEE Trans. Neural Networks Learn. Syst., vol. 29, no. 11, pp. 5356–5365, 2018.

Where will I study?