{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,18]],"date-time":"2026-03-18T10:59:47Z","timestamp":1773831587223,"version":"3.50.1"},"reference-count":50,"publisher":"MDPI AG","issue":"12","license":[{"start":{"date-parts":[[2021,12,2]],"date-time":"2021-12-02T00:00:00Z","timestamp":1638403200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100000038","name":"Natural Sciences and Engineering Research Council","doi-asserted-by":"publisher","award":["RGPIN-2019-04106"],"award-info":[{"award-number":["RGPIN-2019-04106"]}],"id":[{"id":"10.13039\/501100000038","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Computation"],"abstract":"<jats:p>New artificial intelligence- (AI) based marker-less motion capture models provide a basis for quantitative movement analysis within healthcare and eldercare institutions, increasing clinician access to quantitative movement data and improving decision making. This research modelled, simulated, designed, and implemented a novel marker-less AI motion-analysis approach for institutional hallways, a Smart Hallway. Computer simulations were used to develop a system configuration with four ceiling-mounted cameras. After implementing camera synchronization and calibration methods, OpenPose was used to generate body keypoints for each frame. OpenPose BODY25 generated 2D keypoints, and 3D keypoints were calculated and postprocessed to extract outcome measures. The system was validated by comparing ground-truth body-segment length measurements to calculated body-segment lengths and ground-truth foot events to foot events detected using the system. Body-segment length measurements were within 1.56 (SD = 2.77) cm and foot-event detection was within four frames (67 ms), with an absolute error of three frames (50 ms) from ground-truth foot event labels. This Smart Hallway delivers stride parameters, limb angles, and limb measurements to aid in clinical decision making, providing relevant information without user intervention for data extraction, thereby increasing access to high-quality gait analysis for healthcare and eldercare institutions.<\/jats:p>","DOI":"10.3390\/computation9120130","type":"journal-article","created":{"date-parts":[[2021,12,2]],"date-time":"2021-12-02T21:19:08Z","timestamp":1638479948000},"page":"130","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":8,"title":["Video-Based Deep Learning Approach for 3D Human Movement Analysis in Institutional Hallways: A Smart Hallway"],"prefix":"10.3390","volume":"9","author":[{"given":"Connor J. C.","family":"McGuirk","sequence":"first","affiliation":[{"name":"Department of Mechanical Engineering, University of Ottawa, Ottawa, ON K1N 6N5, Canada"},{"name":"The Ottawa Hospital Research Institute, Ottawa, ON K1H 8M2, Canada"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7025-7501","authenticated-orcid":false,"given":"Natalie","family":"Baddour","sequence":"additional","affiliation":[{"name":"Department of Mechanical Engineering, University of Ottawa, Ottawa, ON K1N 6N5, Canada"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4693-2623","authenticated-orcid":false,"given":"Edward D.","family":"Lemaire","sequence":"additional","affiliation":[{"name":"The Ottawa Hospital Research Institute, Ottawa, ON K1H 8M2, Canada"},{"name":"Faculty of Medicine, University of Ottawa, Ottawa, ON K1H 8M5, Canada"}]}],"member":"1968","published-online":{"date-parts":[[2021,12,2]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Anishchenko, L. (2018). Machine learning in video surveillance for fall detection. Ural Symposium on Biomedical Engineering, Radioelectronics and Information Technology (USBEREIT), IEEE.","DOI":"10.1109\/USBEREIT.2018.8384560"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Jenpoomjai, P., Wosri, P., Ruengittinun, S., Hu, C.-L., and Chootong, C. (2019, January 6\u20139). VA Algorithm for Elderly\u2019s Falling Detection with 2D-Pose-Estimation. Proceedings of the 2019 Twelfth International Conference on Ubi-Media Computing (Ubi-Media), Bali, Indonesia.","DOI":"10.1109\/Ubi-Media.2019.00053"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"126","DOI":"10.1016\/j.gaitpost.2012.06.024","article-title":"Gait parameter risk factors for falls under simple and dual task conditions in cognitively impaired older people","volume":"37","author":"Taylor","year":"2013","journal-title":"Gait Posture"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"2255","DOI":"10.3390\/s120202255","article-title":"Gait Analysis Using Wearable Sensors","volume":"12","author":"Tao","year":"2012","journal-title":"Sensors"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Viswakumar, A., Rajagopalan, V., Ray, T., and Parimi, C. (2019, January 15\u201317). Human Gait Analysis Using OpenPose. Proceedings of the IEEE International Conference Image Information Processing, Shimla, India.","DOI":"10.1109\/ICIIP47207.2019.8985781"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"469","DOI":"10.1016\/j.gaitpost.2006.05.016","article-title":"Automatic detection of gait events using kinematic data","volume":"25","author":"Thorpe","year":"2007","journal-title":"Gait Posture"},{"key":"ref_7","unstructured":"Gutta, V. (2021, February 16). Development and Validation of a Smart Hallway for Human Stride Analysis Using Marker-Less 3D Depth Sensors. Available online: https:\/\/ruor.uottawa.ca\/handle\/10393\/40266."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Solichah, U., Purnomo, M.H., and Yuniarno, E.M. (2021, January 21\u201322). Marker-less Motion Capture Based on Openpose Model Using Triangulation. Proceedings of the 2020 International Seminar on Intelligent Technology and Its Applications (ISITIA), Surabaya, Indonesia.","DOI":"10.1109\/ISITIA49792.2020.9163662"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Labuguen, R.T., Negrete, S.B., Kogami, T., Ingco, W.E.M., and Shibata, T. (2020, January 1\u201315). Performance Evaluation of Markerless 3D Skeleton Pose Estimates with Pop Dance Motion Sequence. Proceedings of the 2020 Joint 9th International Conference on Informatics, Electronics & Vision (ICIEV) and 2020 4th International Conference on Imaging, Vision & Pattern Recognition (icIVPR), Shiga, Japan.","DOI":"10.1109\/ICIEVicIVPR48672.2020.9306581"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Rodrigues, T.B., Cath\u00e1in, C., Devine, D., Moran, K., O\u2019Connor, N., and Murray, N. (2019, January 18\u201321). An evaluation of a 3D multimodal marker-less motion analysis system. Proceedings of the 10th ACM Multimedia Systems Conference, Amherst, MA, USA.","DOI":"10.1145\/3304109.3306236"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"50","DOI":"10.3389\/fspor.2020.00050","article-title":"Evaluation of 3D Markerless Motion Capture Accuracy Using OpenPose With Multiple Video Cameras","volume":"2","author":"Nakano","year":"2020","journal-title":"Front. Sports Act. Living"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"109929","DOI":"10.1016\/j.jbiomech.2020.109929","article-title":"Reliability of a markerless motion capture system to measure the trunk, hip and knee angle during walking on a flatland and a treadmill","volume":"109","author":"Tamura","year":"2020","journal-title":"J. Biomech."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Stenum, J., Rossi, C., and Roemmich, R.T. (2021). Two-dimensional video-based analysis of human gait using pose estimation. PLoS Comput. Biol., 17.","DOI":"10.1371\/journal.pcbi.1008935"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Albert, J.A., Owolabi, V., Gebel, A., Brahms, C.M., Granacher, U., and Arnrich, B. (2020). Evaluation of the Pose Tracking Performance of the Azure Kinect and Kinect v2 for Gait Analysis in Comparison with a Gold Standard: A Pilot Study. Sensors, 20.","DOI":"10.3390\/s20185104"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Pasinetti, S., Nuzzi, C., Covre, N., Luchetti, A., Maule, L., Serpelloni, M., and Lancini, M. (2020). Validation of Marker-Less System for the Assessment of Upper Joints Reaction Forces in Exoskeleton Users. Sensors, 20.","DOI":"10.3390\/s20143899"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Zhang, F., Juneau, P., McGuirk, C., Tu, A., Cheung, K., Baddour, N., and Lemaire, E. (2021, January 23\u201325). Comparison of OpenPose and HyperPose artificial intelligence models for analysis of hand-held smartphone videos. Proceedings of the 2021 IEEE International Symposium on Medical Measurements and Applications (MeMeA), Neuch\u00e2tel, Switzerland.","DOI":"10.1109\/MeMeA52024.2021.9478740"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"163","DOI":"10.1177\/1937586717733149","article-title":"Everything Happens in the Hallways: Exploring User Activity in the Corridors at Two Rehabilitation Units","volume":"11","author":"Colley","year":"2017","journal-title":"HERD Health Environ. Res. Des. J."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Kang, Y.-S., and Ho, Y.-S. (2008, January 9\u201313). Geometrical Compensation Algorithm of Multiview Image for Arc Multi-camera Arrays. Proceedings of the Pacific-Rim Conference on Multimedia, Tainan, Taiwan.","DOI":"10.1007\/978-3-540-89796-5_56"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Wolf, T., Babaee, M., and Rigoll, G. (2016, January 25\u201328). Multi-view gait recognition using 3D convolutional neural networks. Proceedings of the 2016 IEEE International Conference on Image Processing, Phoenix, AZ, USA.","DOI":"10.1109\/ICIP.2016.7533144"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Sato, T., Ikeda, S., and Yokoya, N. (2004, January 11\u201314). Extrinsic Camera Parameter Recovery from Multiple Image Sequences Captured by an Omni-Directional Multi-camera System. Proceedings of the European Conference on Computer Vision, Prague, Czech Republic.","DOI":"10.1007\/978-3-540-24671-8_26"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Takahashi, K., Mikami, D., Isogawa, M., and Kimata, H. (2018, January 18\u201322). Human Pose as Calibration Pattern: 3D Human Pose Estimation with Multiple Unsynchronized and Uncalibrated Cameras. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops 2018, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPRW.2018.00230"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"172","DOI":"10.1109\/TPAMI.2019.2929257","article-title":"OpenPose: Realtime Multi-Person 2D Pose Estimation Using Part Affinity Fields","volume":"43","author":"Cao","year":"2021","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1089","DOI":"10.1109\/TNSRE.2016.2533492","article-title":"MIT-Skywalker: A Novel Gait Neurorehabilitation Robot for Stroke and Cerebral Palsy","volume":"24","author":"Susko","year":"2016","journal-title":"IEEE Trans. Neural Syst. Rehabil. Eng."},{"key":"ref_24","unstructured":"Zhao, G., Liu, G., Li, H., and Pietikainen, M. (2006, January 10\u201312). 3D Gait Recognition Using Multiple Cameras. Proceedings of the 7th International Conference on Automatic Face and Gesture Recognition (FGR06), Southampton, UK."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"722","DOI":"10.1016\/j.gaitpost.2014.08.006","article-title":"Detection of gait cycles in treadmill walking using a Kinect","volume":"41","author":"Auvinet","year":"2014","journal-title":"Gait Posture"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1330","DOI":"10.1109\/34.888718","article-title":"A flexible new technique for camera calibration","volume":"22","author":"Zhang","year":"2000","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Vo, M., Narasimhan, S.G., and Sheikh, Y. (2016, January 27\u201330). Spatiotemporal Bundle Adjustment for Dynamic 3D Reconstruction. Proceedings of the the IEEE Conference on Computer Vision and Pattern Recognition 2016, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.189"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"416","DOI":"10.1016\/j.cviu.2005.06.001","article-title":"Structure-from-motion using lines: Representation, triangulation, and bundle adjustment","volume":"100","author":"Bartoli","year":"2005","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"290","DOI":"10.1016\/j.gaitpost.2021.02.006","article-title":"Verification of validity of gait analysis systems during treadmill walking and running using human pose tracking algorithm","volume":"85","author":"Ota","year":"2021","journal-title":"Gait Posture"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"710","DOI":"10.1016\/j.gaitpost.2007.07.007","article-title":"Two simple methods for determining gait events during treadmill and overground walking using kinematic data","volume":"27","author":"Zeni","year":"2008","journal-title":"Gait Posture"},{"key":"ref_31","unstructured":"(2021, May 09). Scipy.Signal.Find_Peaks\u2014SciPy v1.6.3 Reference Guide. Available online: https:\/\/docs.scipy.org\/doc\/scipy\/reference\/generated\/scipy.signal.find_peaks.html."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s12984-015-0013-9","article-title":"Novel algorithm for a smartphone-based 6-minute walk test application: Algorithm, application development, and evaluation","volume":"12","author":"Capela","year":"2015","journal-title":"J. Neuroeng. Rehabil."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Capela, N.A., Lemaire, E.D., and Baddour, N.C. (2014, January 26\u201330). A smartphone approach for the 2 and 6-minute walk test. Proceedings of the 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Chicago, IL, USA.","DOI":"10.1109\/EMBC.2014.6943751"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"568","DOI":"10.1016\/j.gaitpost.2014.12.016","article-title":"Fixed and self-paced treadmill walking for able-bodied and transtibial amputees in a multi-terrain virtual environment","volume":"41","author":"Sinitski","year":"2015","journal-title":"Gait Posture"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Khamis, S., Danino, B., Springer, S., Ovadia, D., and Carmeli, E. (2017). Detecting Anatomical Leg Length Discrepancy Using the Plug-in-Gait Model. Appl. Sci., 7.","DOI":"10.3390\/app7090926"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"435","DOI":"10.3389\/fnagi.2018.00435","article-title":"Less Is More\u2013Estimation of the Number of Strides Required to Assess Gait Variability in Spatially Confined Settings","volume":"10","author":"Kroneberg","year":"2019","journal-title":"Front. Aging Neurosci."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"646","DOI":"10.1097\/01.mph.0000165139.68615.e4","article-title":"Reliability and Validity of Visual Assessments of Gait Using a Modified Physician Rating Scale for Crouch and Foot Contact","volume":"25","author":"Wren","year":"2005","journal-title":"J. Pediatr. Orthop."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"454","DOI":"10.1016\/j.gaitpost.2008.11.005","article-title":"Observational gait analysis in traumatic brain injury: Accuracy of clinical judgment","volume":"29","author":"Williams","year":"2009","journal-title":"Gait Posture"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"279","DOI":"10.1016\/j.gaitpost.2014.04.187","article-title":"Observational gait assessment tools in paediatrics\u2013A systematic review","volume":"40","author":"Rathinam","year":"2014","journal-title":"Gait Posture"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3407659","article-title":"MotioNet: 3D human motion reconstruction from monocular video with skeleton consistency","volume":"40","author":"Shi","year":"2021","journal-title":"ACM Trans. Graph."},{"key":"ref_41","unstructured":"(2021, May 06). Pose Classification Options |ML Kit| Google Developers. Available online: https:\/\/developers.google.com\/ml-kit\/vision\/pose-detection."},{"key":"ref_42","unstructured":"(2021, February 21). Security Lenses|Fujifilm Global. Available online: https:\/\/www.fujifilm.com\/products\/optical_devices\/cctv\/."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"927","DOI":"10.1016\/S0031-3203(01)00076-0","article-title":"Optimal camera placement for accurate reconstruction","volume":"35","author":"Olague","year":"2002","journal-title":"Pattern Recognit."},{"key":"ref_44","unstructured":"(2021, February 22). GPIO Electrical Characteristics BFS-U3-16S2. Available online: http:\/\/softwareservices.flir.com\/BFS-U3-16S2\/latest\/Family\/ElectricalGPIO.htm?Highlight=BFS-U3-16S2electrical."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"38","DOI":"10.1016\/j.imavis.2018.05.004","article-title":"Speeded up detection of squared fiducial markers","volume":"76","year":"2018","journal-title":"Image Vis. Comput."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"481","DOI":"10.1016\/j.patcog.2015.09.023","article-title":"Generation of fiducial marker dictionaries using Mixed Integer Linear Programming","volume":"51","year":"2016","journal-title":"Pattern Recognit."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"1472","DOI":"10.1109\/TPAMI.2007.70787","article-title":"Optimal Randomized RANSAC","volume":"30","author":"Chum","year":"2008","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_48","unstructured":"Agarwal, S., and Mierle, K. (2021, May 06). Ceres Solver\u2014A Large Scale Non-Linear Optimization Library. Available online: http:\/\/ceres-solver.org\/."},{"key":"ref_49","unstructured":"Moore, D.D., Walker, J.D., MacLean, J.N., and Hatsopoulos, N.G. (2020). Anipose: A Toolkit for Robust Marker-Less 3D Pose Estimation. bioRxiv."},{"key":"ref_50","unstructured":"(2021, May 09). Aniposelib\/Aniposelib at Master, Lambdaloop\/Aniposelib, GitHub. Available online: https:\/\/github.com\/lambdaloop\/aniposelib\/tree\/master\/aniposelib."}],"container-title":["Computation"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2079-3197\/9\/12\/130\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T07:39:04Z","timestamp":1760168344000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2079-3197\/9\/12\/130"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,12,2]]},"references-count":50,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2021,12]]}},"alternative-id":["computation9120130"],"URL":"https:\/\/doi.org\/10.3390\/computation9120130","relation":{},"ISSN":["2079-3197"],"issn-type":[{"value":"2079-3197","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,12,2]]}}}