Maryam Parsa, Catherine D. Schuman, Prasanna Date, Derek C. Rose, Bill Kay, J. Parker Mitchell, Steven R. Young, Ryan Dellana, William Severa, Thomas E. Potok and Kaushik Roy

July, 2020

IJCNN: The International Joint Conference on Neural Networks

https://www.ijcnn.org/

View Article

Abstract

Training neural networks for neuromorphic deployment is non-trivial. There have been a variety of approaches proposed to adapt back-propagation or back-propagation-like algorithms appropriate for training. Considering that these networks often have very different performance characteristics than traditional neural networks, it is often unclear how to set either the network topology or the hyperparameters to achieve optimal performance. In this work, we introduce a Bayesian approach for optimizing the hyperparameters of an algorithm for training binary communication networks that can be deployed to neuromorphic hardware. We show that by optimizing the hyperparameters on this algorithm for each dataset, we can achieve improvements in accuracy over the previous state-of-theart for this algorithm on each dataset (by up to 15 percent). This jump in performance continues to emphasize the potential when converting traditional neural networks to binary communication applicable to neuromorphic hardware.

Citation Information

Text

author      M. Parsa and C. D. Schuman and P. Date and D. C. Rose and B. Kay and 
            J. P. Mitchell and S. R. Young and R. Dellana and W. Severa and 
            T. E. Potok and K. Roy
title       Hyperparameter Optimization in Binary Communication Networks for 
            Neuromorphic Deployment
booktitle   IJCNN: The International Joint Conference on Neural Networks
year        2020

Bibtex

@INPROCEEDINGS{smj:20:rrs,
    author = "M. Parsa and C. D. Schuman and P. Date and D. C. Rose and B. Kay and 
                J. P. Mitchell and S. R. Young and R. Dellana and W. Severa and 
                T. E. Potok and K. Roy",
    title = "Hyperparameter Optimization in Binary Communication Networks for 
                Neuromorphic Deployment",
    booktitle = "IJCNN: The International Joint Conference on Neural Networks",
    year = "2020"
}