Alert button

Wearable-based Human Activity Recognition with Spatio-Temporal Spiking Neural Networks

Nov 14, 2022
Yuhang Li, Ruokai Yin, Hyoungseob Park, Youngeun Kim, Priyadarshini Panda

Figure 1 for Wearable-based Human Activity Recognition with Spatio-Temporal Spiking Neural Networks
Figure 2 for Wearable-based Human Activity Recognition with Spatio-Temporal Spiking Neural Networks
Figure 3 for Wearable-based Human Activity Recognition with Spatio-Temporal Spiking Neural Networks
Figure 4 for Wearable-based Human Activity Recognition with Spatio-Temporal Spiking Neural Networks

Share this with someone who'll enjoy it:

We study the Human Activity Recognition (HAR) task, which predicts user daily activity based on time series data from wearable sensors. Recently, researchers use end-to-end Artificial Neural Networks (ANNs) to extract the features and perform classification in HAR. However, ANNs pose a huge computation burden on wearable devices and lack temporal feature extraction. In this work, we leverage Spiking Neural Networks (SNNs)--an architecture inspired by biological neurons--to HAR tasks. SNNs allow spatio-temporal extraction of features and enjoy low-power computation with binary spikes. We conduct extensive experiments on three HAR datasets with SNNs, demonstrating that SNNs are on par with ANNs in terms of accuracy while reducing up to 94% energy consumption. The code is publicly available in https://github.com/Intelligent-Computing-Lab-Yale/SNN_HAR

* Workshop on Learning from Time Series for Health  
View paper onarxiv iconopen_review iconOpenReview

Share this with someone who'll enjoy it: