{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,18]],"date-time":"2026-07-18T14:27:08Z","timestamp":1784384828125,"version":"3.55.0"},"reference-count":58,"publisher":"MDPI AG","issue":"14","license":[{"start":{"date-parts":[[2019,7,12]],"date-time":"2019-07-12T00:00:00Z","timestamp":1562889600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Photoplethysmography (PPG)-based continuous heart rate monitoring is essential in a number of domains, e.g., for healthcare or fitness applications. Recently, methods based on time-frequency spectra emerged to address the challenges of motion artefact compensation. However, existing approaches are highly parametrised and optimised for specific scenarios of small, public datasets. We address this fragmentation by contributing research into the robustness and generalisation capabilities of PPG-based heart rate estimation approaches. First, we introduce a novel large-scale dataset (called PPG-DaLiA), including a wide range of activities performed under close to real-life conditions. Second, we extend a state-of-the-art algorithm, significantly improving its performance on several datasets. Third, we introduce deep learning to this domain, and investigate various convolutional neural network architectures. Our end-to-end learning approach takes the time-frequency spectra of synchronised PPG- and accelerometer-signals as input, and provides the estimated heart rate as output. Finally, we compare the novel deep learning approach to classical methods, performing evaluation on four public datasets. We show that on large datasets the deep learning model significantly outperforms other methods: The mean absolute error could be reduced by     31 %     on the new dataset PPG-DaLiA, and by     21 %     on the dataset WESAD.<\/jats:p>","DOI":"10.3390\/s19143079","type":"journal-article","created":{"date-parts":[[2019,7,12]],"date-time":"2019-07-12T11:49:38Z","timestamp":1562932178000},"page":"3079","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":323,"title":["Deep PPG: Large-Scale Heart Rate Estimation with Convolutional Neural Networks"],"prefix":"10.3390","volume":"19","author":[{"given":"Attila","family":"Reiss","sequence":"first","affiliation":[{"name":"Robert Bosch GmbH, Robert-Bosch-Campus 1, 71272 Renningen, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ina","family":"Indlekofer","sequence":"additional","affiliation":[{"name":"Bosch Sensortec GmbH, Gerhard-Kindler-Stra\u00dfe 9, 72770 Reutlingen, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Philip","family":"Schmidt","sequence":"additional","affiliation":[{"name":"Robert Bosch GmbH, Robert-Bosch-Campus 1, 71272 Renningen, Germany"},{"name":"Ubiquitous Computing, University of Siegen, H\u00f6lderlinstr. 3, 57076 Siegen, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5296-5347","authenticated-orcid":false,"given":"Kristof","family":"Van Laerhoven","sequence":"additional","affiliation":[{"name":"Ubiquitous Computing, University of Siegen, H\u00f6lderlinstr. 3, 57076 Siegen, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2019,7,12]]},"reference":[{"key":"ref_1","unstructured":"Apple (2019, May 21). Apple Watch Series Official Website. Available online: https:\/\/www.apple.com\/lae\/watch\/."},{"key":"ref_2","unstructured":"Fitbit (2019, May 21). Fitbit Charge 3. Available online: https:\/\/www.fitbit.com\/charge3."},{"key":"ref_3","unstructured":"Samsung (2019, May 21). Samsung Simband Official Website. Available online: https:\/\/www.simband.io\/."},{"key":"ref_4","unstructured":"Cup, I.S.P. (2019, May 21). Heart Rate Monitoring During Physical Exercise using Wrist-Type Photoplethysmographic (PPG) Signals. Available online: https:\/\/sites.google.com\/site\/researchbyzhang\/ieeespcup2015."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1902","DOI":"10.1109\/TBME.2015.2406332","article-title":"Photoplethysmography-based Heart Rate Monitoring in Physical Activities via Joint Sparse Spectrum Reconstruction","volume":"62","author":"Zhang","year":"2015","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Jarchi, D., and Casson, A. (2017). Description of a Database Containing Wrist PPG Signals Recorded during Physical Exercise with Both Accelerometer and Gyroscope Measures of Motion. Data, 2.","DOI":"10.3390\/data2010001"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Schmidt, P., Reiss, A., Duerichen, R., and Van Laerhoven, K. (2018, January 16\u201320). Introducing WESAD, a multimodal dataset for WEarable Stress and Affect Detection. Proceedings of the 20th ACM International Conference on Multimodal Interaction, Boulder, CO, USA.","DOI":"10.1145\/3242969.3242985"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Biswas, D., Sim\u00f5es-Capela, N., Van Hoof, C., and Van Helleputte, N. (2019). Heart Rate Estimation From Wrist-Worn Photoplethysmography: A Review. IEEE Sens.","DOI":"10.1109\/JSEN.2019.2914166"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1585","DOI":"10.1088\/0967-3334\/31\/12\/003","article-title":"Improved Elimination of Motion Artifacts from a Photoplethysmographic Signal using a Kalman Smoother with Simultaneous Accelerometry","volume":"31","author":"Lee","year":"2010","journal-title":"Physiol. Meas."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1445","DOI":"10.1109\/TIM.2011.2175832","article-title":"A Novel Approach for Motion Artifact Reduction in PPG Signals Based on AS-LMS Adaptive Filter","volume":"61","author":"Ram","year":"2012","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"566","DOI":"10.1109\/TBME.2005.869784","article-title":"Motion Artifact Reduction in Photoplethysmography using Independent Component Analysis","volume":"53","author":"Kim","year":"2006","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_12","unstructured":"Sun, X., Yang, P., Li, Y., Gao, Z., and Zhang, Y.T. (2012, January 5\u20137). Robust Heart Rate Beat Detection from Photoplethysmography Interlaced with Motion Artifacts based on Empirical Mode Decomposition. Proceedings of the International Conference on Biomedical and Health Informatics (BHI), Hong Kong, China."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Jaafar, R., and Rozali, M.A.A. (2017, January 25\u201327). Estimation of Breathing Rate and Heart Rate from Photoplethysmogram. Proceedings of the 6th International Conference on Electrical Engineering and Informatics (ICEEI), Langkawi, Malaysia.","DOI":"10.1109\/ICEEI.2017.8312414"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"227","DOI":"10.1109\/LSP.2015.2509868","article-title":"Heart Rate Tracking using Wrist-Type Photoplethysmographic (PPG) Signals during Physical Exercise with Simultaneous Accelerometry","volume":"23","author":"Mashhadi","year":"2016","journal-title":"IEEE Signal Process. Lett."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Salehizadeh, S., Dao, D., Bolkhovsky, J., Cho, C., Mendelson, Y., and Chon, K. (2016). A Novel Time-varying Spectral Filtering Algorithm for Reconstruction of Motion Artifact Corrupted Heart Rate Signals During Intense Physical Activities using a Wearable Photoplethysmogram Sensor. Sensors, 16.","DOI":"10.3390\/s16010010"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Temko, A. (2015, January 25\u201329). Estimation of Heart Rate from Photoplethysmography during Physical Exercise using Wiener Filtering and the Phase Vocoder. Proceedings of the IEEE EMBS International Conference on Engineering in Medicine and Biology, Milan, Italy.","DOI":"10.1109\/EMBC.2015.7318655"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"3076","DOI":"10.1109\/ACCESS.2016.2580594","article-title":"Spectral Matrix Decomposition-Based Motion Artifacts Removal in Multi-Channel PPG Sensor Signals","volume":"23","author":"Xiong","year":"2016","journal-title":"IEEE Access"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"7161","DOI":"10.1109\/JSEN.2015.2473697","article-title":"Photoplethysmography-Based Heart Rate Monitoring Using Asymmetric Least Squares Spectrum Subtraction and Bayesian Decision Theory","volume":"15","author":"Sun","year":"2015","journal-title":"IEEE Sens. J."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"2016","DOI":"10.1109\/TBME.2017.2676243","article-title":"Accurate Heart Rate Monitoring During Physical Exercises Using PPG","volume":"64","author":"Temko","year":"2017","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_20","first-page":"147:1","article-title":"An LSTM Based System for Prediction of Human Activities with Durations","volume":"1","author":"Krishna","year":"2017","journal-title":"Proc. ACM Interact. Mob. Wearable Ubiquitous Technol."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Muenzner, S., Schmidt, P., Reiss, A., Hanselmann, M., Stiefelhagen, R., and Duerichen, R. (2017, January 11\u201315). CNN-based Sensor Fusion Techniques for Multimodal Human Activity Recognition. Proceedings of the International Symposium on Wearable Computers (ISWC), Maui, HI, USA.","DOI":"10.1145\/3123021.3123046"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Zeng, M., Gao, H., Yu, T., Mengshoel, O.J., Langseth, H., Lane, I., and Liu, X. (2018, January 8\u201312). Understanding and Improving Recurrent Networks for Human Activity Recognition by Continuous Attention. Proceedings of the International Symposium on Wearable Computers (ISWC), Singapore.","DOI":"10.1145\/3267242.3267286"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"85","DOI":"10.1109\/JBHI.2016.2636456","article-title":"Sensor-Based Gait Parameter Extraction With Deep Convolutional Neural Networks","volume":"21","author":"Hannink","year":"2017","journal-title":"IEEE J. Biomed. Health Inform."},{"key":"ref_24","unstructured":"Gjoreski, H., Bizjak, J., Gjoreski, M., and Gams, M. (2016, January 10). Comparing Deep and Classical Machine Learning Methods for Human Activity Recognition using Wrist Accelerometer. Proceedings of the IJCAI-16 Workshop on Deep Learning for Artificial Intelligence (DLAI), New York, NY, USA."},{"key":"ref_25","unstructured":"Hammerla, N.Y., Halloran, S., and Ploetz, T. (2016, January 10). Deep, Convolutional, and Recurrent Models for Human Activity Recognition using Wearables. Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI), New York, NY, USA."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Shashikumar, S.P., Shah, A.J., Li, Q., Clifford, G.D., and Nemati, S. (2017, January 16\u201319). A Deep Learning Approach to Monitoring and Detecting Atrial Fibrillation using Wearable Technology. Proceedings of the IEEE EMBS International Conference on Biomedical & Health Informatics (BHI), Orlando, FL, USA.","DOI":"10.1109\/BHI.2017.7897225"},{"key":"ref_27","unstructured":"Voisin, M., Shen, Y., Aliamiri, A., Avati, A., Hannun, A., and Ng, A. (2018). Ambulatory Atrial Fibrillation Monitoring Using Wearable Photoplethysmography with Deep Learning. arXiv."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Jindal, V., Birjandtalab, J., Baran Pouyan, M., and Nourani, M. (2016, January 16\u201320). An Adaptive Deep Learning Approach for PPG-Based Identification. Proceedings of the IEEE EMBS International Conference on Engineering in Medicine and Biology, Orlando, FL, USA.","DOI":"10.1109\/EMBC.2016.7592193"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"282","DOI":"10.1109\/TBCAS.2019.2892297","article-title":"CorNET: Deep Learning Framework for PPG-Based Heart Rate Estimation and Biometric Identification in Ambulant Environment","volume":"13","author":"Biswas","year":"2019","journal-title":"IEEE Trans. Biomed. Circuits Syst."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Reiss, A., Schmidt, P., Indlekofer, I., and Van Laerhoven, K. (2018, January 8\u201312). PPG-based Heart Rate Estimation with Time-Frequency Spectra: A Deep Learning Approach. Proceedings of the UbiComp Workshop on Combining Physical and Data-Driven Knowledge in Ubiquitous Computing, Singapore.","DOI":"10.1145\/3267305.3274176"},{"key":"ref_31","unstructured":"Schaeck, T., Muma, M., and Zoubir, A.M. (September, January 28). Computationally Efficient Heart Rate Estimation During Physical Exercise using Photoplethysmographic Signals. Proceedings of the 25th European Signal Processing Conference (EUSIPCO), Kos, Greece."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"522","DOI":"10.1109\/TBME.2014.2359372","article-title":"TROIKA: A General Framework for Heart Rate Monitoring using Wrist-type Photoplethysmographic Signals During Intensive Physical Exercise","volume":"62","author":"Zhang","year":"2015","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1166","DOI":"10.1109\/JSEN.2018.2879970","article-title":"Motion Artifact Cancellation in Wearable Photoplethysmography Using Gyroscope","volume":"19","author":"Lee","year":"2019","journal-title":"IEEE Sens."},{"key":"ref_34","unstructured":"BiosignalsPLUX (2019, May 21). RespiBAN Professional. Available online: http:\/\/www.biosignalsplux.com\/en\/respiban-professional."},{"key":"ref_35","unstructured":"Empatica (2019, May 21). E4 Wristband. Available online: https:\/\/www.empatica.com\/research\/e4\/."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"2423","DOI":"10.1109\/JSEN.2012.2192260","article-title":"Miniaturized One-Point Detectable Electrocardiography Sensor for Portable Physiological Monitoring Systems","volume":"12","author":"Kim","year":"2012","journal-title":"IEEE Sens. J."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"159","DOI":"10.1016\/j.jbi.2017.08.006","article-title":"Monitoring Stress with a Wrist Device Using Context","volume":"73","author":"Gjoreski","year":"2017","journal-title":"J. Biomed. Inform."},{"key":"ref_38","first-page":"103:1","article-title":"Unobtrusive Assessment of Students\u2019 Emotional Engagement During Lectures Using Electrodermal Activity Sensors","volume":"2","author":"Gashi","year":"2018","journal-title":"Proc. ACM Interactive Mob. Wearable Ubiquitous Technol."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"869","DOI":"10.1001\/archderm.1988.01670060015008","article-title":"The validity and practicality of sun-reactive skin types I through VI","volume":"124","author":"Fitzpatrick","year":"1988","journal-title":"Arch. Dermatol."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"101","DOI":"10.1109\/CIC.2002.1166717","article-title":"Open source ECG analysis","volume":"29","author":"Hamilton","year":"2002","journal-title":"Comput. Cardiol."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Reiss, A., and Stricker, D. (2012, January 6\u20138). Creating and benchmarking a new dataset for physical activity monitoring. Proceedings of the 5th Workshop on Affect and Behaviour Related Assistance (ABRA), Crete, Greece.","DOI":"10.1145\/2413097.2413148"},{"key":"ref_42","first-page":"157:1","article-title":"Multimodal Deep Learning for Activity and Context Recognition","volume":"1","author":"Radu","year":"2017","journal-title":"Proc. ACM Interactive Mob. Wearable Ubiquitous Technol."},{"key":"ref_43","unstructured":"Clevert, D.A., Unterthiner, T., and Hochreiter, S. (2015). Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs). arXiv."},{"key":"ref_44","unstructured":"Kingma, D.P., and Ba, J. (2014). Adam: A Method for Stochastic Optimization. arXiv."},{"key":"ref_45","unstructured":"Simonyan, K., and Zisserman, A. (2015, January 7\u20139). Very Deep Convolutional Networks for Large-scale Image Recognition. Proceedings of the International Conference on Learning Representations (ICLR), San Diego, CA, USA."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep Residual Learning for Image Recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Huang, G., Liu, Z., Van Der Maaten, L., and Weinberger, K.Q. (2017, January 21\u201326). Densely Connected Convolutional Networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.243"},{"key":"ref_48","unstructured":"Abadi, M.Y., Barham, P., Chen, J., Chen, Z., Davis, A., Dean, J., Devin, M., Ghemawat, S., Irving, G., and Isard, M. (2016, January 2\u20134). TensorFlow: A System for Large-scale Machine Learning. Proceedings of the 12th USENIX conference on Operating Systems Design and Implementation (OSDI), Savannah, GA, USA."},{"key":"ref_49","first-page":"11:1","article-title":"Ensembles of Deep LSTM Learners for Activity Recognition using Wearables","volume":"1","author":"Guan","year":"2017","journal-title":"Proc. ACM Interactive Mob. Wearable Ubiquitous Technol."},{"key":"ref_50","unstructured":"Ioffe, S., and Szegedy, C. (2015). Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift. arXiv."},{"key":"ref_51","unstructured":"Canziani, A., Paszke, A., and Culurciello, E. (2017). An Analysis of Deep Neural Network Models for Practical Applications. arXiv."},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Qiu, J., Wang, J., Yao, S., Guo, K., Li, B., Zhou, E., Yu, J., Tang, T., Xu, N., and Song, S. (2016, January 21\u201323). Going Deeper with Embedded FPGA Platform for Convolutional Neural Network. Proceedings of the 2016 ACM\/SIGDA International Symposium on Field-Programmable Gate Arrays, Monterey, CA, USA.","DOI":"10.1145\/2847263.2847265"},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"82","DOI":"10.1109\/MPRV.2017.2940968","article-title":"Squeezing Deep Learning into Mobile and Embedded Devices","volume":"16","author":"Lane","year":"2017","journal-title":"IEEE Pervasive Comput."},{"key":"ref_54","unstructured":"Han, S., Pool, J., Tran, J., and Dally, W.J. (2015, January 7\u201312). Learning both Weights and Connections for Efficient Neural Networks. Proceedings of the Advances in Neural Information Processing Systems (NIPS), Montreal, QC, Canada."},{"key":"ref_55","unstructured":"Han, S., Mao, H., and Dally, W.J. (2016, January 2\u20134). Deep Compression: Compressing Deep Neural Networks with Pruning, Trained Quantization and Huffman Coding. Proceedings of the International Conference on Learning Representations (ICLR), San Juan, PR, USA."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"313","DOI":"10.1007\/s10877-013-9436-7","article-title":"Influence of Skin Type and Wavelength on Light Wave Reflectance","volume":"27","author":"Fallow","year":"2013","journal-title":"J. Clin. Monit. Comput."},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"50","DOI":"10.1109\/MC.2018.2381112","article-title":"Deep Learning for Human Activity Recognition in Mobile Computing","volume":"51","author":"Ploetz","year":"2018","journal-title":"Computer"},{"key":"ref_58","doi-asserted-by":"crossref","unstructured":"Vinciguerra, V., Ambra, E., Maddiona, L., Romeo, M., Mazzillo, M., Rundo, F., Fallica, G., di Pompeo, F., Chiarelli, A.M., and Zappasodi, F. (2018, January 21\u201323). PPG\/ECG Multisite Combo System Based on SiPM Technology. Proceedings of the Fourth National Conference on Sensors, Catania, Italy.","DOI":"10.1007\/978-3-030-04324-7_44"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/14\/3079\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T13:05:02Z","timestamp":1760187902000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/14\/3079"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,7,12]]},"references-count":58,"journal-issue":{"issue":"14","published-online":{"date-parts":[[2019,7]]}},"alternative-id":["s19143079"],"URL":"https:\/\/doi.org\/10.3390\/s19143079","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,7,12]]}}}