Enhancing FMCW Radar-Based Human Activity Recognition using DI-ResNet
Abstract
This paper proposes a method to enhance the quality of Human Activity Recognition (HAR) based on Frequency Modulated Continuous Wave (FMCW) radar. The method utilizes a Dual Input-ResNet (DI-ResNet) model to address the limitations associated with relying solely on isolated range or micro-Doppler (m-D) features for activity classification. Specifically, two parallel ResNet-18 backbones are employed to extract deep semantic features from two distinct data domains: the Range-Time (RT) spectrogram and the Doppler-Time (DT) spectrogram. These features are subsequently fused via a concatenation layer to synthesize global context, thereby generating a more comprehensive representation of the performed activities. Experimental results demonstrate that the proposed method achieves superior recognition performance compared to single-stream baseline networks. Notably, the proposed model effectively mitigates confusion among activities exhibiting kinematic similarity, improving the Recall metric for the “SitDown” activity by 42.1% compared to traditional single-input methods. Furthermore, the accuracy for complex hand gestures such as "Drink" significantly increased by 19.8%, substantially minimizing the high misclassification rate associated with "Grab." Finally, the model achieves near-ideal reliability for safety-critical activities, attaining a recognition accuracy of 99.5% in fall detection, thereby confirming its potential for practical deployment.
References
H. Li, A. Shrestha, H. Heidari, J. Le Kernec, and F. Fioranelli, “Activities recognition and fall detection in continuous data streams using radar sensor,” in 2019 IEEE MTT-S International Microwave Biomedical Conference (IMBioC), vol. 1. IEEE, 2019, pp. 1–4.
T. R. Bennett, J. Wu, N. Kehtarnavaz, and R. Jafari, “Inertial measurement unit-based wearable computers for assisted living applications: A signal processing perspective,” IEEE Signal Processing Magazine, vol. 33, no. 2, pp. 28–35, 2016.
D. T. Nguyen, H. G. Hong, K. W. Kim, and K. R. Park, “Person recognition system based on a combination of body images from visible light and thermal cameras,” Sensors, vol. 17, no. 3, p. 605, 2017.
R. Igual, C. Medrano, and I. Plaza, “Challenges, issues and trends in fall detection systems,” Biomedical engineering online, vol. 12, no. 1, p. 66, 2013.
G. Li, R. Zhang, M. Ritchie, and H. Griffiths, “Sparsity-driven micro-doppler feature extraction for dynamic hand gesture recognition,” IEEE Transactions on Aerospace and Electronic Systems, vol. 54, no. 2, pp. 655–665, 2017.
M. Chakraborty, H. C. Kumawat, S. V. Dhavale et al., “Diat-radharnet: A lightweight DCNN for radar based classification of human suspicious activities,” IEEE Transactions on Instrumentation and Measurement, vol. 71, pp. 1–10, 2022.
W. Taylor, K. Dashtipour, S. A. Shah, A. Hussain, Q. H. Abbasi, and M. A. Imran, “Radar sensing for activity classification in elderly people exploiting micro-doppler signatures using machine learning,” Sensors, vol. 21, no. 11, p. 3881, 2021.
Y. Kim and H. Ling, “Human activity classification based on micro-doppler signatures using a support vector machine,” IEEE Transactions on Geoscience and Remote Sensing, vol. 47, no. 5, pp. 1328–1337, 2009.
V. C. L. Ho and H. Wechsler, “Micro-doppler effect in radar: Phenomenon model and simulation study,” IEEE Trans. Aerosp. Electron. Syst., vol. 42, no. 1, pp. 2–21, 2006.
Z. Li, F. Fioranelli, S. Yang, L. Zhang, O. Romain, Q. He, G. Cui, and J. Le Kernec, “Multi-domains based human activity classification in radar,” in IET International Radar Conference (IET IRC 2020), vol. 2020. IET, 2020, pp. 1744–1749.
U. Saeed, S. Y. Shah, S. A. Shah, J. Ahmad, A. A. Alotaibi, T. Althobaiti, N. Ramzan, A. Alomainy, and Q. H. Abbasi, “Discrete human activity recognition and fall detection by combining FMCW radar data of heterogeneous environments for independent assistive living,” Electronics, vol. 10, no. 18, p. 2237, 2021.
J. Zhu, H. Chen, and W. Ye, “A hybrid cnn–lstm network for the classification of human activities based on microdoppler radar,” IEEE Access, vol. 8, pp. 24 713–24 720, 2020.
S. A. Shah and F. Fioranelli, “Human activity recognition: Preliminary results for dataset portability using FMCW radar,” in 2019 International Radar Conference (RADAR). IEEE, 2019, pp. 1–4.
M. S. Seyfio˘glu, S. Z. Gürbüz, A. M. Özbayo˘glu, and M. Yüksel, “Deep learning of micro-doppler features for aided and unaided gait recognition,” in 2017 IEEE Radar Conference (RadarConf). IEEE, 2017, pp. 1125–1130.
B. Jokanovic, M. Amin, and F. Ahmad, “Radar fall motion detection using deep learning,” in 2016 IEEE Radar Conference (RadarConf). IEEE, 2016, pp. 1–6.
N. Nguyen, M. Pham, V. Le, D. DuongQuoc, and V.-S.Doan, “Micro-doppler signatures based human activity classification using dense-inception neural network,” in 2022 International Conference on Advanced Technologies for Communications (ATC). IEEE, 2022, pp. 268–273.
N. Nguyen, V.-S. Doan, M. Pham, and V. Le, “SRCNN: Stacked-residual convolutional neural network for improving human activity classification based on microdoppler signatures of FMCW radar,” Journal of Electromagnetic Engineering and Science, vol. 24, no. 4, pp. 358–369, 2024.
N. Nguyen, M. Pham, V.-S. Doan, and V. Le, “Improving human activity classification based on micro-doppler signatures of FMCW radar with the effect of noise,” PloSone, vol. 19, no. 8, p. e0308045, 2024.
W. Ding, X. Guo, and G. Wang, “Radar-based human activity recognition using hybrid neural network model with multidomain fusion,” IEEE Transactions on Aerospace and Electronic Systems, vol. 57, no. 5, pp. 2889–2898, 2021.
X. Wang, S. Guo, J. Chen, P. Chen, and G. Cui, “GCN-enhanced multidomain fusion network for through-wall human activity recognition,” IEEE Geoscience and Remote Sensing Letters, vol. 19, pp. 1–5, 2022.
J. Allen, “Short term spectral analysis, synthesis, and modification by discrete Fourier transform,” in IEEE Trans. on Acoust., Speech, and Sig. Proc., vol. 4, 1997, pp. 21–24.
D. F. Fioranelli, D. S. A. Shah, H. Li1, A. Shrestha, D. S.Yang, and D. J. L. Kernec, “Radar sensing for healthcare: Associate editor francesco fioranelli on the applications of radar in monitoring vital signs and recognising human activity patterns,” Electronics Letters, vol. 55, no. 19, pp. 1022–1024, 2019.
K. He, X. Zhang, S. Ren, and J. Sun, “Deep residual learning for image recognition,” in Proceedings of the IEEE conference on computer vision and pattern recognition, 2016, pp. 770–778.
DOI: http://dx.doi.org/10.21553/rev-jec.433
Copyright (c) 2026 REV Journal on Electronics and Communications
ISSN: 1859-378X Copyright © 2011-2026 |
|
