When Spiking neural networks meet temporal attention image decoding and adaptive spiking neuron

June 05, 2024 Β· Entered Twilight Β· πŸ› Tiny Papers @ ICLR

πŸ’€ TWILIGHT: Eternal Rest
Repo abandoned since publication

Repo contents: Classification, Generation, LICENSE, README.md, network.png, result.png

Authors Xuerui Qiu, Zheng Luan, Zhaorui Wang, Rui-Jie Zhu arXiv ID 2406.03046 Category cs.NE: Neural & Evolutionary Citations 5 Venue Tiny Papers @ ICLR Repository https://github.com/bollossom/ICLR_TINY_SNN ⭐ 66 Last Checked 2 months ago
Abstract
Spiking Neural Networks (SNNs) are capable of encoding and processing temporal information in a biologically plausible way. However, most existing SNN-based methods for image tasks do not fully exploit this feature. Moreover, they often overlook the role of adaptive threshold in spiking neurons, which can enhance their dynamic behavior and learning ability. To address these issues, we propose a novel method for image decoding based on temporal attention (TAID) and an adaptive Leaky-Integrate-and-Fire (ALIF) neuron model. Our method leverages the temporal information of SNN outputs to generate high-quality images that surpass the state-of-the-art (SOTA) in terms of Inception score, FrΓ©chet Inception Distance, and FrΓ©chet Autoencoder Distance. Furthermore, our ALIF neuron model achieves remarkable classification accuracy on MNIST (99.78\%) and CIFAR-10 (93.89\%) datasets, demonstrating the effectiveness of learning adaptive thresholds for spiking neurons. The code is available at https://github.com/bollossom/ICLR_TINY_SNN.
Community shame:
Not yet rated
Community Contributions

Found the code? Know the venue? Think something is wrong? Let us know!

πŸ“œ Similar Papers

In the same crypt β€” Neural & Evolutionary

R.I.P. πŸ‘» Ghosted

LSTM: A Search Space Odyssey

Klaus Greff, Rupesh Kumar Srivastava, ... (+3 more)

cs.NE πŸ› IEEE TNNLS πŸ“š 6.0K cites 11 years ago