Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Inference-Scale Complexity in ANN-SNN Conversion for High-Performance and Low-Power Applications

About

Spiking Neural Networks (SNNs) have emerged as a promising substitute for Artificial Neural Networks (ANNs) due to their advantages of fast inference and low power consumption. However, the lack of efficient training algorithms has hindered their widespread adoption. Even efficient ANN-SNN conversion methods necessitate quantized training of ANNs to enhance the effectiveness of the conversion, incurring additional training costs. To address these challenges, we propose an efficient ANN-SNN conversion framework with only inference scale complexity. The conversion framework includes a local threshold balancing algorithm, which enables efficient calculation of the optimal thresholds and fine-grained adjustment of the threshold value by channel-wise scaling. We also introduce an effective delayed evaluation strategy to mitigate the influence of the spike propagation delays. We demonstrate the scalability of our framework in typical computer vision tasks: image classification, semantic segmentation, object detection, and video classification. Our algorithm outperforms existing methods, highlighting its practical applicability and efficiency. Moreover, we have evaluated the energy consumption of the converted SNNs, demonstrating their superior low-power advantage compared to conventional ANNs. This approach simplifies the deployment of SNNs by leveraging open-source pre-trained ANN models, enabling fast, low-power inference with negligible performance reduction. Code is available at https://github.com/putshua/Inference-scale-ANN-SNN.

Tong Bu, Maohua Li, Zhaofei Yu• 2024

Related benchmarks

TaskDatasetResultRank
Semantic segmentationPascal VOC augmented 2012 (val)
mIoU58.68
162
Semantic segmentationCOCO 2017 (val)
mIoU62.61
55
Reinforcement LearningHopper v4
Average Return3.10e+6
13
Reinforcement LearningWalker2d v4
Avg Return4.24e+6
13
Video ClassificationS-Kinetics-400 1.0 (test)
Accuracy62.73
10
Image ClassificationImageNet (test)
ANN Accuracy73.31
9
Reinforcement LearningIDP v4
Average Return3.86e+7
8
Showing 7 of 7 rows

Other info

Follow for update