{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,25]],"date-time":"2026-04-25T15:29:54Z","timestamp":1777130994898,"version":"3.51.4"},"reference-count":32,"publisher":"MDPI AG","issue":"23","license":[{"start":{"date-parts":[[2020,12,4]],"date-time":"2020-12-04T00:00:00Z","timestamp":1607040000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>The desire to remain living in one\u2019s own home rather than a care home by those in need of 24\/7 care is one that requires a level of understanding for the actions of an environment\u2019s inhabitants. This can potentially be accomplished with the ability to recognise Activities of Daily Living (ADLs); however, this research focuses first on producing an unobtrusive solution for pose recognition where the preservation of privacy is a primary aim. With an accurate manner of predicting an inhabitant\u2019s poses, their interactions with objects within the environment and, therefore, the activities they are performing, can begin to be understood. This research implements a Convolutional Neural Network (CNN), which has been designed with an original architecture derived from the popular AlexNet, to predict poses from thermal imagery that have been captured using thermopile infrared sensors (TISs). Five TISs have been deployed within the smart kitchen in Ulster University where each provides input to a corresponding trained CNN. The approach is evaluated using an original dataset and an F1-score of 0.9920 was achieved with all five TISs. The limitations of utilising a ceiling-based TIS are investigated and each possible permutation of corner-based TISs is evaluated to satisfy a trade-off between the number of TISs, the total sensor cost and the performances. These tests are also promising as F1-scores of 0.9266, 0.9149 and 0.8468 were achieved with the isolated use of four, three, and two corner TISs, respectively.<\/jats:p>","DOI":"10.3390\/s20236932","type":"journal-article","created":{"date-parts":[[2020,12,4]],"date-time":"2020-12-04T11:59:00Z","timestamp":1607083140000},"page":"6932","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["Using Convolutional Neural Networks with Multiple Thermal Sensors for Unobtrusive Pose Recognition"],"prefix":"10.3390","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8931-2454","authenticated-orcid":false,"given":"Matthew","family":"Burns","sequence":"first","affiliation":[{"name":"School of Computing, Ulster University, Belfast BT37 0QB, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1870-0203","authenticated-orcid":false,"given":"Federico","family":"Cruciani","sequence":"additional","affiliation":[{"name":"School of Computing, Ulster University, Belfast BT37 0QB, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2373-4758","authenticated-orcid":false,"given":"Philip","family":"Morrow","sequence":"additional","affiliation":[{"name":"School of Computing, Ulster University, Belfast BT37 0QB, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0882-7902","authenticated-orcid":false,"given":"Chris","family":"Nugent","sequence":"additional","affiliation":[{"name":"School of Computing, Ulster University, Belfast BT37 0QB, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sally","family":"McClean","sequence":"additional","affiliation":[{"name":"School of Computing, Ulster University, Belfast BT37 0QB, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2020,12,4]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1016\/j.pmcj.2006.12.001","article-title":"How smart are our environments? An updated look at the state of the art","volume":"3","author":"Cook","year":"2007","journal-title":"Pervasive Mob. Comput."},{"key":"ref_2","unstructured":"United Nations, Department of Economic and Social Affairs, Population Division (2019). World Population Prospects, United Nations."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"357","DOI":"10.1093\/geront\/gnr098","article-title":"The Meaning of \u201cAging in Place\u201d to Older People","volume":"52","author":"Wiles","year":"2012","journal-title":"Gerontologist"},{"key":"ref_4","unstructured":"Abowd, G., Bobick, A., Essa, I., Mynatt, E., and Rogers, W. (2002). The Aware Home: A living laboratory for technologies for successful aging. Automation as Caregiver: The Role of Intelligent Technology in Elder Care, Proceedings of the AAAI-02 Workshop on Edmonton, Alberta, Canada, 29 July 2002, AAAI."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"386","DOI":"10.1016\/j.jamda.2013.02.018","article-title":"Sensor Technology to support Aging in Place","volume":"14","author":"Rantz","year":"2013","journal-title":"J. Am. Med. Dir. Assoc."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"103401","DOI":"10.1016\/j.engappai.2019.103401","article-title":"Detecting indicators of cognitive impairment via Graph Convolutional Networks","volume":"89","author":"Arifoglu","year":"2020","journal-title":"Eng. Appl. Artif. Intell."},{"key":"ref_7","first-page":"93","article-title":"Katz Index of Independence in Activities of Daily Living (ADL) Katz Index of Independence in Activities of Daily Living","volume":"27","author":"Wallace","year":"2008","journal-title":"Urol. Nurs."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Zubair, M., Song, K., and Yoon, C. (2017, January 26\u201328). Human activity recognition using wearable accelerometer sensors. Proceedings of the IEEE International Conference on Consumer Electronics-Asia, Seoul, Korea.","DOI":"10.1109\/ICCE-Asia.2016.7804737"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Kartsch, V., Benatti, S., Mancini, M., Magno, M., and Benini, L. (2018, January 27\u201330). Smart Wearable Wristband for EMG based Gesture Recognition Powered by Solar Energy Harvester. Proceedings of the IEEE International Symposium on Circuits and Systems, Florence, Italy.","DOI":"10.1109\/ISCAS.2018.8351727"},{"key":"ref_10","first-page":"65","article-title":"Tracking systems for multiple smart home residents","volume":"Volume 9","author":"Crandall","year":"2011","journal-title":"Human Behaviour Recognition Technologies"},{"key":"ref_11","first-page":"87","article-title":"Older adults\u2019 attitudes towards and perceptions of \u2019smart home\u2019 technologies: A pilot study","volume":"29","author":"Demiris","year":"2004","journal-title":"Inform. Health. Soc. Care"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"790","DOI":"10.1109\/TSMCC.2012.2198883","article-title":"Sensor-based activity recognition","volume":"42","author":"Chen","year":"2012","journal-title":"IEEE Trans. Syst. Man Cybern. Part C Appl. Rev."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Liciotti, D., Frontoni, E., Zingaretti, P., Bellotto, N., and Duckett, T. (2017, January 24\u201326). HMM-based Activity Recognition with a Ceiling RGB-D Camera. Proceedings of the International Conference on Pattern Recognition Applications and Methods, Porto, Portugal.","DOI":"10.5220\/0006202305670574"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"586","DOI":"10.1109\/THMS.2014.2377111","article-title":"Human Activity Recognition Process Using 3-D Posture Data","volume":"45","author":"Gaglio","year":"2015","journal-title":"IEEE Trans. Hum.-Mach. Syst."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"149","DOI":"10.1007\/978-0-387-21579-2_9","article-title":"The Boosting Approach to Machine Learning: An Overview","volume":"Volume 171","author":"Schapire","year":"2003","journal-title":"Nonlinear Estimation and Classification"},{"key":"ref_16","unstructured":"Goodfellow, I., Bengio, Y., and Courville, A. (2016). Deep Learning, The MIT Press."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Su, H., Maji, S., Kalogerakis, E., and Learned-Miller, E. (2015, January 11\u201318). Multi-view Convolutional Neural Networks for 3D Shape Recognition. Proceedings of the IEEE International Conference on Computer Vision, Las Condes, Chile.","DOI":"10.1109\/ICCV.2015.114"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Deng, J., Dong, W., Socher, R., Li, L.-J., Kai, L., and Li, F.-F. (2010, January 20\u201325). ImageNet: A large-scale hierarchical image database. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA.","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"ref_19","unstructured":"Wu, Z., Song, S., Khosla, A., Yu, F., Zhang, L., Tang, X., and Xiao, J. (2015, January 7\u201312). 3D ShapeNets: A Deep Representation for Volumetric Shapes. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Boston, MA, USA."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Pittaluga, F., Zivkovic, A., and Koppal, S.J. (2016, January 13\u201315). Sensor-level privacy for thermal cameras. Proceedings of the IEEE International Conference on Computational Photography, Evanston, IL, USA.","DOI":"10.1109\/ICCPHOT.2016.7492877"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3161198","article-title":"Privacy-preserving Image Processing with Binocular Thermal Cameras","volume":"1","author":"Griffiths","year":"2018","journal-title":"Proc. ACM Interact. Mob. Wearable Ubiquitous Technol."},{"key":"ref_22","unstructured":"(2019, September 17). Capgo\u2014Sensor Glossary. Available online: http:\/\/www.capgo.com\/Resources\/Sensors\/SensorGlossary.html."},{"key":"ref_23","unstructured":"(2018, May 28). Heimann Welcome to Heimann Sensor\u2019s Website. Available online: http:\/\/www.heimannsensor.com\/thermopile-arrays."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Quero, J., Burns, M., Razzaq, M., Nugent, C., and Espinilla, M. (2018). Detection of Falls from Non-Invasive Thermal Vision Sensors Using Convolutional Neural Networks. Proceedings, 2.","DOI":"10.3390\/proceedings2191236"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Burns, M., Morrow, P., Nugent, C., and McClean, S. (2019). Fusing thermopile infrared sensor data for single component activity recognition within a smart environment. J. Sens. Actuator Netw., 8.","DOI":"10.3390\/jsan8010010"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"319","DOI":"10.1504\/IJBET.2009.027796","article-title":"Experiences in the development of a Smart Lab","volume":"2","author":"Nugent","year":"2009","journal-title":"Int. J. Biomed. Eng. Technol."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"97","DOI":"10.1007\/978-3-319-67585-5_11","article-title":"SensorCentral: A research oriented, device agnostic, sensor data platform","volume":"Volume 10586","author":"Rafferty","year":"2017","journal-title":"Ubiquitous Computing and Ambient Intelligence"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"84","DOI":"10.1145\/3065386","article-title":"ImageNet Classification with Deep Convolutional Neural Networks","volume":"60","author":"Krizhevsky","year":"2017","journal-title":"Commun. ACM"},{"key":"ref_29","unstructured":"Ioffe, S., and Szegedy, C. (2015, January 6\u201311). Batch normalization: Accelerating deep network training by reducing internal covariate shift. Proceedings of the International Conference on Machine Learning, Lille, France."},{"key":"ref_30","unstructured":"Sermanet, P., Eigen, D., Zhang, X., Mathieu, M., Fergus, R., and LeCun, Y. (2014, January 14\u201316). Overfeat: Integrated recognition, localization and detection using convolutional networks. Proceedings of the International Conference on Learning Representations, Banff, AB, Canada."},{"key":"ref_31","unstructured":"(2020, April 20). EnsembleVoteClassifier\u2014Mlxtend. Available online: http:\/\/rasbt.github.io\/mlxtend\/user_guide\/classifier\/EnsembleVoteClassifier\/."},{"key":"ref_32","unstructured":"Raschka, S. (2020, April 18). Implementing a Weighted Majority Rule Ensemble Classifier. Available online: https:\/\/sebastianraschka.com\/Articles\/2014_ensemble_classifier.html."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/23\/6932\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T10:41:25Z","timestamp":1760179285000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/23\/6932"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,12,4]]},"references-count":32,"journal-issue":{"issue":"23","published-online":{"date-parts":[[2020,12]]}},"alternative-id":["s20236932"],"URL":"https:\/\/doi.org\/10.3390\/s20236932","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,12,4]]}}}