{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,30]],"date-time":"2026-06-30T16:01:08Z","timestamp":1782835268652,"version":"3.54.5"},"reference-count":44,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2024,2,1]],"date-time":"2024-02-01T00:00:00Z","timestamp":1706745600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Natural Science Foundation of China (NSFC)","award":["52278001"],"award-info":[{"award-number":["52278001"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Deep learning technology can improve sensing efficiency and has the ability to discover potential patterns in data; the efficiency of user behavior recognition in the field of smart homes has been further improved, making the recognition process more intelligent and humanized. This paper analyzes the optical sensors commonly used in smart homes and their working principles through case studies and explores the technical framework of user behavior recognition based on optical sensors. At the same time, CiteSpace (Basic version 6.2.R6) software is used to visualize and analyze the related literature, elaborate the main research hotspots and evolutionary changes of optical sensor-based smart home user behavior recognition, and summarize the future research trends. Finally, fully utilizing the advantages of cloud computing technology, such as scalability and on-demand services, combining typical life situations and the requirements of smart home users, a smart home data collection and processing technology framework based on elderly fall monitoring scenarios is designed. Based on the comprehensive research results, the application and positive impact of optical sensors in smart home user behavior recognition were analyzed, and inspiration was provided for future smart home user experience research.<\/jats:p>","DOI":"10.3390\/s24030953","type":"journal-article","created":{"date-parts":[[2024,2,1]],"date-time":"2024-02-01T09:43:22Z","timestamp":1706780602000},"page":"953","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":15,"title":["Application of Deep Learning and Intelligent Sensing Analysis in Smart Home"],"prefix":"10.3390","volume":"24","author":[{"given":"Yi","family":"Lu","sequence":"first","affiliation":[{"name":"College of Art and Design, Beijing University of Technology, Beijing 100124, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lejia","family":"Zhou","sequence":"additional","affiliation":[{"name":"College of Art and Design, Beijing University of Technology, Beijing 100124, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Aili","family":"Zhang","sequence":"additional","affiliation":[{"name":"College of Art and Design, Beijing University of Technology, Beijing 100124, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Siyu","family":"Zha","sequence":"additional","affiliation":[{"name":"The Future Laboratory, Tsinghua University, Beijing 100084, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xiaojie","family":"Zhuo","sequence":"additional","affiliation":[{"name":"Faculty of Innovation and Design, City University of Macau, Macau 999078, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sen","family":"Ge","sequence":"additional","affiliation":[{"name":"College of Art and Design, Beijing University of Technology, Beijing 100124, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2024,2,1]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"799","DOI":"10.1166\/jno.2020.2806","article-title":"Tracking System and Its Application in Unmanned Automobile Navigation Based on Sparse Photoelectric Sensor Network","volume":"15","author":"Xue","year":"2020","journal-title":"J. Nanoelectron. Optoelectron."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1858","DOI":"10.1109\/JLT.2022.3227186","article-title":"Flexible Wearable Optical Sensor Based on Optical Microfiber Bragg Grating","volume":"41","author":"Xu","year":"2023","journal-title":"J. Light. Technol."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Badarch, L., Gochoo, M., Batnasan, G., Alnajjar, F., and Tan, T.-H. (2021, January 23\u201326). Ultra-Low Resolution Infrared Sensor-Based Wireless Sensor Network for Privacy-Preserved Recognition of Daily Activities of Living. Proceedings of the IEEE 20th International Symposium on Network Computing and Applications (NCA), Boston, MA, USA.","DOI":"10.1109\/NCA53618.2021.9685466"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Chen, C. (2018, January 11\u201315). Visualizing and Exploring Scientific Literature with CiteSpace. Proceedings of the Chiir\u201918: 2018 Conference on Human Information Interaction and Retrieval, New Brunswick, NJ, USA.","DOI":"10.1145\/3176349.3176897"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"620","DOI":"10.1016\/j.measurement.2010.12.002","article-title":"A two-layered subgoal based mobile robot navigation algorithm with vision system and IR sensors","volume":"44","author":"Singh","year":"2011","journal-title":"Measurement"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Mehr, H.D., and Polat, H. (2019, January 25\u201326). Human activity recognition in smart home with deep learning approach. Proceedings of the IEEE 2019 7th International Istanbul Smart Grids and Cities Congress and Fair (ICSG), Istanbul, Turkey.","DOI":"10.1109\/SGCF.2019.8782290"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"2567","DOI":"10.1007\/s42835-019-00278-8","article-title":"Vision-based human activity recognition system using depth silhouettes: A smart home system for monitoring the residents","volume":"14","author":"Kim","year":"2019","journal-title":"J. Electr. Eng. Technol."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"672","DOI":"10.1016\/j.procs.2016.08.249","article-title":"Activity detection in smart home environment","volume":"96","author":"Skocir","year":"2016","journal-title":"Procedia Comput. Sci."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"735","DOI":"10.1007\/s11468-023-01803-2","article-title":"Recent advances in optical biosensors for sensing applications: A review","volume":"18","author":"Uniyal","year":"2023","journal-title":"Plasmonics"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1311","DOI":"10.1109\/TCE.2006.273150","article-title":"A pyroelectric infrared sensor-based indoor location-aware system for the smart home","volume":"52","author":"Lee","year":"2006","journal-title":"IEEE Trans. Consum. Electron."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Kobiyama, Y., Zhao, Q., Ota, R., and Ichimura, S. (2017, January 21\u201323). Recognition of frequently appeared locations\/activities based on infrared sensor array. Proceedings of the 2017 3rd IEEE International Conference on Cybernetics (CYBCONF), Exeter, UK.","DOI":"10.1109\/CYBConf.2017.7985801"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Radu, V., Lane, N.D., Bhattacharya, S., Mascolo, C., Marina, M.K., and Kawsar, F. (2016, January 12\u201316). Towards multimodal deep learning for activity recognition on mobile devices. Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct, Heidelberg, Germany.","DOI":"10.1145\/2968219.2971461"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Islam, M.M., Siddiqua, S., and Afnan, J. (2017, January 13\u201314). Real Time Hand Gesture Recognition Using Different Algorithms Based on American Sign Language. Proceedings of the IEEE International Conference on Imaging, Vision & Pattern Recognition (ICIVPR), Dhaka, Bangladesh.","DOI":"10.1109\/ICIVPR.2017.7890854"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1659","DOI":"10.1109\/TCSVT.2015.2469551","article-title":"Survey on 3D Hand Gesture Recognition","volume":"26","author":"Cheng","year":"2015","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Trubin, P., Savchenko, E., and Velichko, E. (2018, January 22\u201323). Development of Polarimetric Sensor for Identification System. Proceedings of the 2018 IEEE International Conference on Electrical Engineering and Photonics (EExPolytech), St. Petersburg, Russia.","DOI":"10.1109\/EExPolytech.2018.8564427"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Mehrabani, M., Bangalore, S., and Stern, B. (2015, January 14\u201316). Personalized speech recognition for Internet of Things. Proceedings of the IEEE 2nd World Forum on Internet of Things (WF-IoT), Milan, Italy.","DOI":"10.1109\/WF-IoT.2015.7389082"},{"key":"ref_17","first-page":"149","article-title":"Noise Cancellation Based on Voice Activity Detection Using Spectra Variation for Speech recognition in Smart Home Devices","volume":"26","author":"Park","year":"2020","journal-title":"Intell. Autom. Soft Comput."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Kim, S., and Metze, F. (2018, January 18\u201321). Dialog-context aware end-to-end speech recognition. Proceedings of the 2018 IEEE Spoken Language Technology Workshop (SLT), Athens, Greece.","DOI":"10.1109\/SLT.2018.8639044"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Ban, S., Lee, Y.J., Kim, K.R., Kim, J.H., and Yeo, W.H. (2022). Advances in Materials, Sensors, and Integrated Systems for Monitoring Eye Movements. Biosensors, 12.","DOI":"10.3390\/bios12111039"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Dang, B., Dicarlo, J., Lukashov, S., Hinds, N., Reinen, J., Wen, B., Hao, T., Bilal, E., and Rogers, J. (2021, January 1\u20135). Development of a Smart Sleep Mask with Multiple Sensors. Proceedings of the 43rd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC), Guadalajara, Mexico.","DOI":"10.1109\/EMBC46164.2021.9630086"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Masai, K., Kunze, K., Sakamoto, D., Sugiura, Y., and Sugimoto, M. (2020, January 9\u201313). Face commands-user-defined facial gestures for smart glasses. Proceedings of the 2020 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), Porto de Galinhas, Brazil.","DOI":"10.1109\/ISMAR50242.2020.00064"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Thakur, N., and Han, C. (2018, January 8\u201310). A Complex Activity Based Emotion Recognition Algorithm for Affect Aware Systems. Proceedings of the IEEE 8th Annual Computing and Communication Workshop and Conference (CCWC), Las Vegas, NV, USA.","DOI":"10.1109\/CCWC.2018.8301717"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Yang, J., Liu, M., Wei, Z., Han, C., Li, W., and Miao, Y. (2018, January 25\u201329). RoCoSense: Integrating Robotics, Smart Clothing and Big Data Clouds for Emotion Sensing. Proceedings of the 14th International Wireless Communications & Mobile Computing Conference (IWCMC), Limassol, Cyprus.","DOI":"10.1109\/IWCMC.2018.8450363"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Zolfaghari, S., Massa, S.M., and Riboni, D. (2023). Activity Recognition in Smart Homes via Feature-Rich Visual Extraction of Locomotion Traces. Electronics, 12.","DOI":"10.3390\/electronics12091969"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Nan, M., Trascau, M., Florea, A.M., and Iacob, C.C. (2021). Comparison between Recurrent Networks and Temporal Convolutional Networks Approaches for Skeleton-Based Action Recognition. Sensors, 21.","DOI":"10.3390\/s21062051"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Mashiyama, S., Hong, J., and Ohtsuki, T. (2014, January 2\u20135). A Fall Detection System Using Low Resolution Infrared Array Sensor. Proceedings of the IEEE 25th Annual International Symposium on Personal, Indoor, and Mobile Radio Communication (PIMRC), Washington, DC, USA.","DOI":"10.1109\/PIMRC.2014.7136520"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Ranieri, C.M., MacLeod, S., Dragone, M., Vargas, P.A., and Romero, R.A.F. (2021). Activity Recognition for Ambient Assisted Living with Videos, Inertial Units and Ambient Sensors. Sensors, 21.","DOI":"10.3390\/s21030768"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"368","DOI":"10.1016\/j.enbuild.2016.12.069","article-title":"Development of a prototype smart home intelligent lighting control architecture using sensors onboard a mobile computing system","volume":"138","author":"Tang","year":"2017","journal-title":"Energy Build."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Chaccour, K., Eid, J., Darazi, R., el Hassani, A.H., and Andres, E. (2015, January 16\u201318). Multisensor guided walker for visually impaired elderly people. Proceedings of the 2015 International Conference on Advances in Biomedical Engineering (ICABME), Beirut, Lebanon.","DOI":"10.1109\/ICABME.2015.7323276"},{"key":"ref_30","unstructured":"Berghmans, F., Brichard, B., Fernandez, A.F., Gusarov, A., Van Uffelen, M., and Girard, S. (2008). Optical Waveguide Sensing and Imaging, Springer."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"122005","DOI":"10.35848\/1882-0786\/aca23b","article-title":"Potential of high-sensitivity tactile sensing using polymer optical fiber gratings","volume":"15","author":"Noda","year":"2022","journal-title":"Appl. Phys. Express"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1482","DOI":"10.1109\/JSEN.2013.2296601","article-title":"Detecting direction of movement using pyroelectric infrared sensors","volume":"14","author":"Yun","year":"2014","journal-title":"IEEE Sens. J."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"833","DOI":"10.1007\/s11760-023-02776-9","article-title":"Fall detection based on LCNN and fusion model of weights using human skeleton and optical flow","volume":"18","author":"Cao","year":"2023","journal-title":"Signal Image Video Process."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"295","DOI":"10.1016\/j.patcog.2016.08.003","article-title":"Robust human activity recognition from depth video using spatiotemporal multi-fused features","volume":"61","author":"Jalal","year":"2017","journal-title":"Pattern Recognit."},{"key":"ref_35","first-page":"1356","article-title":"Binarized Neural Network for Edge Intelligence of Sensor-Based Human Activity Recognition","volume":"22","author":"Luo","year":"2023","journal-title":"IEEE Trans. Mob. Comput."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"11983","DOI":"10.1109\/JSEN.2021.3066037","article-title":"Pattern recognition for distributed optical fiber vibration sensing: A review","volume":"21","author":"Li","year":"2021","journal-title":"IEEE Sens. J."},{"key":"ref_37","unstructured":"Chen, Z., Liu, H., and Wang, Y. (2019). Dynamics of Civil Structures, Volume 2: Proceedings of the 36th IMAC, A Conference and Exposition on Structural Dynamics 2018, Orlando, FL, USA, 12\u201315 February 2018, Springer."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Patel, C.T., Mistry, V.J., Desai, L.S., and Meghrajani, Y.K. (2018, January 14\u201315). Multisensor-based object detection in indoor environment for visually impaired people. Proceedings of the 2018 Second International Conference on Intelligent Computing and Control Systems (ICICCS), Madurai, India.","DOI":"10.1109\/ICCONS.2018.8663016"},{"key":"ref_39","first-page":"5306491","article-title":"Research on furniture design integrating ming-style furniture modeling elements and image sensor data: Taking suitable old furniture as an example","volume":"2022","author":"Chen","year":"2022","journal-title":"J. Sens."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"312","DOI":"10.4028\/www.scientific.net\/AMM.614.312","article-title":"Modeling and analysis on optical path of infrared reflective photoelectric sensor","volume":"614","author":"Qiu","year":"2014","journal-title":"Appl. Mech. Mater."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"6039","DOI":"10.1109\/LRA.2021.3089999","article-title":"Multi-sensor guided hand gesture recognition for a teleoperated robot using a recurrent neural network","volume":"6","author":"Qi","year":"2021","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Kobiyama, Y., Zhao, Q., and Omomo, K. (2016, January 9\u201312). Privacy preserving infrared sensor array based indoor location awareness. Proceedings of the 2016 IEEE International Conference on Systems, Man, and Cybernetics (SMC), Budapest, Hungary.","DOI":"10.1109\/SMC.2016.7844426"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"22097","DOI":"10.1007\/s11042-021-10635-3","article-title":"Modeling elderly behavioral patterns in single-person households","volume":"80","author":"Soussa","year":"2021","journal-title":"Multimed. Tools Appl."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"103445","DOI":"10.1016\/j.ergon.2023.103445","article-title":"A systematic review of global research on natural user interface for smart home system","volume":"95","author":"Liao","year":"2023","journal-title":"Int. J. Ind. Ergon."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/3\/953\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T13:53:05Z","timestamp":1760104385000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/3\/953"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,2,1]]},"references-count":44,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2024,2]]}},"alternative-id":["s24030953"],"URL":"https:\/\/doi.org\/10.3390\/s24030953","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,2,1]]}}}