An Optimization Method of Human Vital Signs Detection During the Non-Steady States

Qiu Jiefan; Xu Yifan; Xu Ruiji; Zhou Dongli; Chi Kaikai

doi:10.7544/issn1000-1239.202220774

Journal of Computer Research and Development > 2024 > 61(2): 481-493. > DOI: 10.7544/issn1000-1239.202220774 CSTR: 32373.14.issn1000-1239.202220774

Qiu Jiefan, Xu Yifan, Xu Ruiji, Zhou Dongli, Chi Kaikai. An Optimization Method of Human Vital Signs Detection During the Non-Steady States[J]. Journal of Computer Research and Development, 2024, 61(2): 481-493. DOI: 10.7544/issn1000-1239.202220774

Citation:

PDF (2507 KB)

An Optimization Method of Human Vital Signs Detection During the Non-Steady States

College of Computer Science and Technology, Zhejiang University of Technology, Hangzhou 310023

More Information

Author Bio:
Qiu Jiefan: born in 1984. PhD, assistant professor. Member of CCF. His main research interests include embedded operation system, IoT, and artificial intelligence

Xu Yifan: born in 1996. Master. Member of CCF. His main research interests include IoT, wireless sensing, and artificial intelligence

Xu Ruiji: born in 1995. PhD. Member of CCF. His main research interests include wireless sensing, artificial intelligence, and intelligent computing

Zhou Dongli: born in 1997. Mater. Member of CCF. His main research interest includes drone vision

Chi Kaikai: born in 1980. PhD, professor. Member of CCF. His main research interests include wireless powered communication networks and edge computing
Received Date: August 31, 2022
Revised Date: March 21, 2023
Available Online: November 13, 2023

Graphical Abstract

Abstract

Abstract

Because the millimeter-wave radar based on frequency-modulated continuous wave (FMCW) owns the advantages of non-contact, privacy protection, high resolution, and anti-interference, applying it in monitoring vital signs gradually becomes a trend. However, most researchers focus on how to improve the detection performance under the steady-state state and give little consideration to the detection under the non-steady state with physical disturbance. We propose a method to detect vital signs in a best-effort way. This method recognizes the steady state and non-steady state, and the type of motion obtains the vital signs without physical disturbance. For this end, we first compute feature spectrograms with range-main velocity information from motion features. And then, employ slide windows sampling to construct datasets, and train the ResNet-18 network to identify the motion state and the motion type. Finally, based on the result of the motion state, we extract the phase signal during exercise rest and use the variational mode decomposition (VMD) algorithm to analyze the respiration rate and heart rate. Experiment results show that using the trained network model, the recognition accuracy of the motion state and motion type is close to 97%, and the recognition delay is less than 1.1 s. Meanwhile, after motion recognition, the mean absolute deviation (MAD) of the detection respiration and heart rate drops to 1.7 bpm and 3.4 bpm respectively.
- millimeter-wave radar,
- vital signs detection,
- movement state recognition,
- slide windows sampling,
- residual network,
- variational mode decomposition

FullText(HTML)

References (33)

References

[1]	Xia Weijie, Li Yi, Dong Shiqi. Radar-based high-accuracy cardiac activity sensing[J]. IEEE Transactions on Instrumentation and Measurement, 2021, 70: 1−13
[2]	Kiokes G, Vossou C, Chatzistamatis P, et al. Performance evaluation of a communication protocol for vital signs sensors used for the monitoring of athletes[J]. International Journal of Distributed Sensor Networks, 2014, 10(6): 453182 doi: 10.1155/2014/453182
[3]	Singh A, Rehman S, Yongchareon S, et al. Multi-resident non-contact vital sign monitoring using radar: A review[J]. IEEE Sensors Journal, 2020, 21(4): 4061−4084
[4]	Churkin S, Anishchenko L. Millimeter-wave radar for vital signs monitoring[C/OL]//Proc of Int Conf on Microwaves, Communications, Antennas and Electronic Systems (COMCAS). Piscataway, NJ: IEEE, 2015[2022-05-10].https://ieeexplore.ieee.org/abstract/document/7360366
[5]	Shi Juyin, Wang Fukang. Quadrature cosine transform with varying window length technique for noncontact vital sign monitoring using a continuous-wave radar[J]. IEEE Transactions on Microwave Theory and Techniques, 2021, 70(3): 1639−1650
[6]	Khan F, Cho S H. A detailed algorithm for vital sign monitoring of a stationary/non-stationary human through IR-UWB radar[J]. Sensors, 2017, 17(2): 290: 1−290: 15
[7]	Alizadeh M, Shaker G, De Almeida J C M, et al. Remote monitoring of human vital signs using mm-wave FMCW radar[J]. IEEE Access, 2019, 7: 54958−54968 doi: 10.1109/ACCESS.2019.2912956
[8]	Ahmad A, Roh J, Wang Dan, et al. Vital signs monitoring of multiple people using a FMCW millimeter-wave sensor[C] //Proc of Radar Conf. Piscataway, NJ: IEEE, 2018: 1450−1455
[9]	Hu Yaokun, Sato S, Toda T. Multi-directional vital signs monitoring on improved complete ensemble empirical mode decomposition with adaptive noise using mm-wave FMCW radar[J/OL]. IEICE Proceedings Series, 2020 [2022-04-07].https://www.ieice.org/publications/proceedings/summary.php?expandable=7&iconf=ICETC&session_num=A2&number=A2-5&year=2020
[10]	Lv Qinyi, Chen Lei, An Kang, et al. Doppler vital signs detection in the presence of large-scale random body movements[J]. IEEE Transactions on Microwave Theory and Techniques, 2018, 66(9): 4261−4270 doi: 10.1109/TMTT.2018.2852625
[11]	Chen Zhe, Zheng Tianyue, Cai Chao, et al. MoVi-Fi: Motion-robust vital signs waveform recovery via deep interpreted RF sensing[C] //Proc of the 27th Annual Int Conf on Mobile Computing and Networking. New York : ACM, 2021: 392−405
[12]	Zheng Tianyue, Chen Zhen, Zhang Shujie, et al. MoRe-Fi: Motion-robust and fine-grained respiration monitoring via deep-learning UWB radar[C] //Proc of the 19th ACM Conf on Embedded Networked Sensor Systems. New York : ACM, 2021: 111−124
[13]	Muñoz-Ferreras J M, Peng Z, Gómez-García R, et al. Random body movement mitigation for FMCW-radar-based vital-sign monitoring[C] // Proc of the Topical Conf on Biomedical Wireless Technologies, Networks, and Sensing Systems. Piscataway, NJ: IEEE, 2016: 22−24
[14]	Song M, Lim J, Shin D J. The velocity and range detection using the 2D-FFT scheme for automotive radars[C] //Proc of the 4th Int Conf on Network Infrastructure and Digital Content. Piscataway, NJ: IEEE, 2014: 507−510
[15]	Han K, Hong S. Phase-extraction method with multiple frequencies of FMCW radar for human body motion tracking[J]. IEEE Microwave and Wireless Components Letters, 2020, 30(9): 927−930 doi: 10.1109/LMWC.2020.3010262
[16]	Alujaim I, Park I, Kim Y. Human motion detection using planar array FMCW Radar through 3D point clouds[C/OL] //Proc of the 14th European Conf on Antennas and Propagation. Piscataway, NJ: IEEE, 2020[2022-05-11].https://ieeexplore.ieee.org/abstract/document/9135381
[17]	Zhao Peijun, Lu Xiaoxuan, Wang Jianan, et al. mid: Tracking and identifying people with millimeter wave radar[C] //Proc of the 15th Int Conf on Distributed Computing in Sensor Systems. Piscataway, NJ: IEEE, 2019: 33−40
[18]	Will C, Vaishnav P, Chakraborty A, et al. Human target detection, tracking, and classification using 24-GHz FMCW radar[J]. IEEE Sensors Journal, 2019, 19(17): 7283−7299 doi: 10.1109/JSEN.2019.2914365
[19]	Ludwig M, Hoffmann K, Endler S, et al. Measurement, prediction, and control of individual heart rate responses to exercise—Basics and options for wearable devices[J]. Frontiers in Physiology, 2018, 9: 778 doi: 10.3389/fphys.2018.00778
[20]	Wang Xuyu, Yang Chao, Mao Shiwen. On CSI-based vital sign monitoring using commodity WiFi[J]. ACM Transactions on Computing for Healthcare, 2020, 1(3): 1−27
[21]	Liu Jian, Chen Yingying, Wang Yan, et al. Monitoring vital signs and postures during sleep using WiFi signals[J]. IEEE Internet of Things Journal, 2018, 5(3): 2071−2084 doi: 10.1109/JIOT.2018.2822818
[22]	Qiu Jiefan, Zheng Pan, Chi Kaikai, et al. Respiration monitoring in high-dynamic environments via combining multiple WiFi channels based on wire direct connection between RX/TX[J]. IEEE Internet of Things Journal, 2022, 10(2): 1558−1573
[23]	Singh A, Sandha S, Garcia L, et al. RadHAR: Human activity recognition from point clouds generated through a millimeter-wave radar[C] //Proc of the 3rd ACM Workshop on Millimeter-wave Networks and Sensing Systems. New York: ACM, 2019: 51−56
[24]	Wang Yuheng, Liu Haipeng , Cui Kening , et al. m-Activity: Accurate and real-time human activity recognition via millimeter wave radar[C] //Proc of Int Conf on Acoustics, Speech and Signal Processing. Piscataway, NJ: IEEE, 2021: 8298−8302
[25]	Krizhevsky A , Sutskever I , Hinton G . ImageNet classification with deep convolutional neural networks[J]. Advances in Neural Information Processing Systems, 2012, 25(2): 84−90
[26]	Szegedy C, Liu Wei, Jia Yangqing, et al. Going deeper with convolutions[C/OL]//Proc of conf computer vision and pattern recognition. Piscataway, NJ: IEEE, 2015 [2022-04-01].https://www.cv-foundation.org/openaccess/content_cvpr_2015/html/Szegedy_Going_Deeper_With_2015_CVPR_paper.html
[27]	He Kaiming, Zhang Xiangyu, Ren Shaoqin , et al. Deep residual learning for image recognition[C] //Proc of Conf on Computer Vision and Pattern Recognition. Piscataway, NJ: IEEE, 2016: 770−778
[28]	安东港. 基于毫米波雷达的生命体征信号监测研究[D]. 杭州:杭州电子科技大学,2020 An Donggang. Research on detection of vital signs signal based on millimeter wave radar[D]. Hangzhou: Hangzhou Dianzi University, 2020 (in Chinese)
[29]	Spoorthi G, Gorthi R, Gorthi S. PhaseNet 2.0: Phase unwrapping of noisy data based on deep learning approach[J]. IEEE Transactions on Image Processing, 2020, 29: 4862−4872 doi: 10.1109/TIP.2020.2977213
[30]	Yin Qingbo, Shen Liran, Lu Mingyu, et al. Selection of optimal window length using STFT for quantitative SNR analysis of LFM signal[J]. Journal of Systems Engineering and Electronics, 2013, 24(1): 26−35 doi: 10.1109/JSEE.2013.00004
[31]	Huang N , Shen Zhen , Long S , et al. The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysis[J]. Proceedings of the Royal Society A-Mathematical Physical & Engineering Sciences, 1998, 454(1971): 903−995
[32]	Dragomiretskiy K, Zosso D. Variational mode decomposition[J]. IEEE Transactions on Signal Processing, 2014, 62(3): 531−544
[33]	北京卡路里信息技术有限公司. 健身课程_跑步训练_瑜伽冥想_增肌瘦身[EB/OL]. [2022-04-10].https://www.gotokeep.com/training Beijing Calorie Information Technology Co Ltd. Fitness courses running training yoga meditation muscle gain and lose weight[EB/OL]. [2022-04-10].https://www.gotokeep.com/training (in Chinese)

[1]	Zhou Junzuo, Yi Jiangyan, Tao Jianhua, Ren Yong, Wang Tao. Mel Spectrogram and Squeeze-Excitation-Weighted Quantization for Neural Speech Codec[J]. Journal of Computer Research and Development. DOI: 10.7544/issn1000-1239.202440329
[2]	Wu Jinjin, Liu Quan, Chen Song, Yan Yan. Averaged Weighted Double Deep Q-Network[J]. Journal of Computer Research and Development, 2020, 57(3): 576-589. DOI: 10.7544/issn1000-1239.2020.20190159
[3]	Fan Zhengguang, Qu Dan, Yan Honggang, Zhang Wenlin. Joint Acoustic Modeling of Multi-Features Based on Deep Neural Networks[J]. Journal of Computer Research and Development, 2017, 54(5): 1036-1044. DOI: 10.7544/issn1000-1239.2017.20160031
[4]	Wang Liang, Wang Weiping, Meng Dan. Privacy Preserving Data Publishing via Weighted Bayesian Networks[J]. Journal of Computer Research and Development, 2016, 53(10): 2343-2353. DOI: 10.7544/issn1000-1239.2016.20160465
[5]	Ding Zhaoyun, Zhou Bin, Jia Yan, Wang Xiang. Detecting Spammers with a Bidirectional Vote Algorithm Based on Statistical Features in Microblogs[J]. Journal of Computer Research and Development, 2013, 50(11): 2336-2348.
[6]	Zhang Xiang, Deng Zhaohong, Wang Shitong, Choi Kupsze. Maximum Entropy Relief Feature Weighting[J]. Journal of Computer Research and Development, 2011, 48(6): 1038-1048.
[7]	Shen Derong, Ma Ye, Nie Tiezheng, Kou Yue, and Yu Ge. A Query Relaxation Strategy Applied in a Deep Web Data Integration System[J]. Journal of Computer Research and Development, 2010, 47(1): 88-95.
[8]	Liu He, Liu Dayou, Pei Zhili, Gao Ying. A Feature Weighting Scheme for Text Categorization Based on Feature Importance[J]. Journal of Computer Research and Development, 2009, 46(10): 1693-1703.
[9]	Fu Yunqing, Wang Songjian, and Wu Zhongfu. A Routing Protocol of Wireless Mesh Network Based on Weighted Link State[J]. Journal of Computer Research and Development, 2009, 46(1): 137-143.
[10]	Huang Dongping, Liu Duo, and Dai Yiqi. Weighted Threshold Secret Sharing[J]. Journal of Computer Research and Development, 2007, 44(8): 1378-1382.