Maryam Parsa, Shruti R. Kulkarni, Mark Coletti, Jeffrey Bassett, J. Parker Mitchell and Catherine D. Schuman

June, 2021

IEEE Congress on Evolutionary Computation (CEC)

https://doi.org/10.1109/CEC45853.2021.9504897

PDF not available yet, or is only available from the conference/journal publisher.

Abstract

Neuroevolution has had significant success over recent years, but there has been relatively little work applying neuroevolution approaches to spiking neural networks (SNNs). SNNs are a type of neural networks that include temporal processing component, are not easily trained using other methods because of their lack of differentiable activation functions, and can be deployed into energy-efficient neuromorphic hardware. In this work, we investigate two evolutionary approaches for training SNNs. We explore the impact of the hyperparameters of the evolutionary approaches, including tournament size, population size, and representation type, on the performance of the algorithms. We present a multi-objective Bayesian-based hyperparameter optimization approach to tune the hyperparameters to produce the most accurate and smallest SNNs. We show that the hyperparameters can significantly affect the performance of these algorithms. We also perform sensitivity analysis and demonstrate that every hyperparameter value has the potential to perform well, assuming other hyperparameter values are set correctly.

Citation Information

Text

author      M. Parsa and S. R. Kulkarni and M. Coletti and J. Bassett and J. P. Mitchell and C. D. Schuman
title       Multi-Objective Hyperparameter Optimization for Spiking Neural Network Neuroevolution
booktitle   IEEE Congress on Evolutionary Computation (CEC)
publisher   IEEE
pages       1225-1232
year        2021
url         https://doi.org/10.1109/CEC45853.2021.9504897
doi         10.1109/CEC45853.2021.9504897

Bibtex

@INPROCEEDINGS{pkc:21:moh,
    author = "M. Parsa and S. R. Kulkarni and M. Coletti and J. Bassett and J. P. Mitchell and C. D. Schuman",
    title = "Multi-Objective Hyperparameter Optimization for Spiking Neural Network Neuroevolution",
    booktitle = "IEEE Congress on Evolutionary Computation (CEC)",
    publisher = "IEEE",
    pages = "1225-1232",
    year = "2021",
    url = "https://doi.org/10.1109/CEC45853.2021.9504897",
    doi = "10.1109/CEC45853.2021.9504897"
}