{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,23]],"date-time":"2026-03-23T16:23:28Z","timestamp":1774283008808,"version":"3.50.1"},"reference-count":48,"publisher":"MDPI AG","issue":"12","license":[{"start":{"date-parts":[[2021,12,14]],"date-time":"2021-12-14T00:00:00Z","timestamp":1639440000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Ministry of Education and Science of the Russian Federation within the framework of scientific projects carried out by teams of research laboratories of educational institutions of higher education subordinate to the Ministry of Science and Higher Educati","award":["FEWM-2020-0042 (\u0410\u0410\u0410\u0410-\u041020-120111190016-9)"],"award-info":[{"award-number":["FEWM-2020-0042 (\u0410\u0410\u0410\u0410-\u041020-120111190016-9)"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Future Internet"],"abstract":"<jats:p>Reconstructed 3D foot models can be used for 3D printing and further manufacturing of individual orthopedic shoes, as well as in medical research and for online shoe shopping. This study presents a technique based on the approach and algorithms of photogrammetry. The presented technique was used to reconstruct a 3D model of the foot shape, including the lower arch, using smartphone images. The technique is based on modern computer vision and artificial intelligence algorithms designed for image processing, obtaining sparse and dense point clouds, depth maps, and a final 3D model. For the segmentation of foot images, the Mask R-CNN neural network was used, which was trained on foot data from a set of 40 people. The obtained accuracy was 97.88%. The result of the study was a high-quality reconstructed 3D model. The standard deviation of linear indicators in length and width was 0.95 mm, with an average creation time of 1 min 35 s recorded. Integration of this technique into the business models of orthopedic enterprises, Internet stores, and medical organizations will allow basic manufacturing and shoe-fitting services to be carried out and will help medical research to be performed via the Internet.<\/jats:p>","DOI":"10.3390\/fi13120315","type":"journal-article","created":{"date-parts":[[2021,12,14]],"date-time":"2021-12-14T09:34:25Z","timestamp":1639474465000},"page":"315","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":11,"title":["Reconstruction of a 3D Human Foot Shape Model Based on a Video Stream Using Photogrammetry and Deep Neural Networks"],"prefix":"10.3390","volume":"13","author":[{"given":"Lev","family":"Shilov","sequence":"first","affiliation":[{"name":"Department of Security, Tomsk State University of Control Systems and Radioelectronics, 634050 Tomsk, Russia"}]},{"given":"Semen","family":"Shanshin","sequence":"additional","affiliation":[{"name":"Department of Security, Tomsk State University of Control Systems and Radioelectronics, 634050 Tomsk, Russia"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2587-2222","authenticated-orcid":false,"given":"Aleksandr","family":"Romanov","sequence":"additional","affiliation":[{"name":"Department of Security, Tomsk State University of Control Systems and Radioelectronics, 634050 Tomsk, Russia"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7844-4363","authenticated-orcid":false,"given":"Anastasia","family":"Fedotova","sequence":"additional","affiliation":[{"name":"Department of Security, Tomsk State University of Control Systems and Radioelectronics, 634050 Tomsk, Russia"}]},{"given":"Anna","family":"Kurtukova","sequence":"additional","affiliation":[{"name":"Department of Security, Tomsk State University of Control Systems and Radioelectronics, 634050 Tomsk, Russia"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8000-2716","authenticated-orcid":false,"given":"Evgeny","family":"Kostyuchenko","sequence":"additional","affiliation":[{"name":"Department of Security, Tomsk State University of Control Systems and Radioelectronics, 634050 Tomsk, Russia"}]},{"given":"Ivan","family":"Sidorov","sequence":"additional","affiliation":[{"name":"Irkutsk Supercomputer Center of SB RAS, 134 Lermontova, 664033 Irkutsk, Russia"}]}],"member":"1968","published-online":{"date-parts":[[2021,12,14]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"2006","DOI":"10.1016\/S0140-6736(20)32340-0","article-title":"Global estimates of the need for rehabilitation based on the Global Burden of Disease study 2019: A systematic analysis for the Global Burden of Disease Study 2019","volume":"396","author":"Cieza","year":"2021","journal-title":"Lancet"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Kulikajevas, A., Maskeliunas, R., Damasevicius, R., and Scherer, R. (2021). HUMANNET\u2014A Two-Tiered Deep Neural Network Architecture for Self-Occluding Humanoid Pose Reconstruction. Sensors, 21.","DOI":"10.3390\/s21123945"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Kulikajevas, A., Maskeli\u016bnas, R., Dama\u0161evi\u010dius, R., and Wlodarczyk-Sielicka, M. (2021). Auto-Refining Reconstruction Algorithm for Recreation of Limited Angle Humanoid Depth Data. Sensors, 21.","DOI":"10.3390\/s21113702"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Kulikajevas, A., Maskeliunas, R., and Damasevicius, R. (2021). Adversarial 3D Human Pointcloud Completion from Limited Angle Depth Data. IEEE Sens. J.","DOI":"10.1109\/JSEN.2021.3124451"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"S26","DOI":"10.1080\/19424280.2015.1038308","article-title":"Low-cost 3D foot scanner using a mobile app","volume":"7","author":"Parrilla","year":"2015","journal-title":"Footwear Sci."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"217","DOI":"10.1007\/s11633-008-0217-6","article-title":"Pca-based 3d shape reconstruction of human foot using multiple viewpoint cameras","volume":"5","author":"Amstutz","year":"2008","journal-title":"Int. J. Autom. Comput."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Revkov, A., and Kanin, D. (2020, January 17\u201318). FITTINTM-Online 3D Shoe Try-on. Proceedings of the 3DBODY.TECH 2020\u201411th International Conference and Exhibition on 3D Body Scanning and Processing Technologies, Online\/Virtual. Available online: http:\/\/www.3dbodyscanning.org\/cap\/papers\/2020\/2058revkov.pdf.","DOI":"10.15221\/20.58"},{"key":"ref_8","unstructured":"Chuyko, G., Shedrin, I., Revkov, E., Grishko, N., Posmetev, V., Kanin, D., and Buhtojarov, L. (2020). Method and Device for Measuring the Shape, Dimensions and Flexibility of Shoes. (United States Patent 10782124)."},{"key":"ref_9","unstructured":"(2021, November 08). DomeScan\/IBV. Available online: https:\/\/www.ibv.org\/en\/domescan\/."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Ballester, A., Pi\u00e9rola, A., Parrilla, E., Izquierdo, M., Uriel, J., N\u00e1cher, B., and Alemany, S. (2017, January 11\u201312). Fast, portable and low-cost 3D foot digitizers: Validity and reliability of measurements. Proceedings of the 3DBODY, TECH 2017 8th International Conference and Exhibition on 3D Body Scanning and Processing Technologies, Montreal, QC, Canada.","DOI":"10.15221\/17.218"},{"key":"ref_11","unstructured":"Volumental (2021, November 09). Fit-Tech. Available online: https:\/\/volumental.com."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1186\/s13640-018-0368-5","article-title":"A 3D foot shape feature parameter measurement algorithm based on Kinect","volume":"2018","author":"Wang","year":"2018","journal-title":"EURASIP J. Image Video Process."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"97","DOI":"10.1504\/IJDH.2018.096279","article-title":"Low cost 3D foot scan with Kinect","volume":"2","author":"Zhao","year":"2018","journal-title":"Int. J. Digit. Hum."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"46","DOI":"10.1186\/s13047-019-0357-7","article-title":"Validation of a novel Kinect-based device for 3D scanning of the foot plantar surface in weight-bearing","volume":"12","author":"Rogati","year":"2019","journal-title":"J. Foot Ankle Res."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"239","DOI":"10.1109\/34.121791","article-title":"A method for registration of 3-D shapes","volume":"14","author":"Besl","year":"1992","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"22773","DOI":"10.1007\/s11042-020-09839-w","article-title":"3D foot scanning using multiple RealSense cameras","volume":"80","author":"Yuan","year":"2021","journal-title":"Multimed. Tools Appl."},{"key":"ref_17","unstructured":"(2021, November 10). Novel Use of the IntelRealsense SR300 Camera for Foot 3D Reconstruction. Available online: https:\/\/www.proquest.com\/openview\/24c68afef1be76b5cb04180006933a52\/."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"37","DOI":"10.20473\/jisebi.6.1.37-45","article-title":"Foot 3D Reconstruction and Measurement using Depth Data","volume":"6","author":"Pambudi","year":"2020","journal-title":"J. Inf. Syst. Eng. Bus. Intellegence"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"996","DOI":"10.2493\/jjspe.84.996","article-title":"A simple 3D scanning system of the human foot using a smartphone with depth camera","volume":"84","author":"Kobayashi","year":"2018","journal-title":"J. Jpn. Soc. Precis. Eng."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Zhang, H., Chen, Z., Guo, S., Lin, J., Shi, Y., and Liu, X. (April, January 25). Sensock: 3D Foot Reconstruction with Flexible Sensors. Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, Honolulu, HI, USA.","DOI":"10.1145\/3313831.3376387"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Niu, L., Xiong, G., Shang, X., Guo, C., Chen, X., and Wu, H. (2021). 3D Foot Reconstruction Based on Mobile Phone Photographing. Appl. Sci., 11.","DOI":"10.3390\/app11094040"},{"key":"ref_22","first-page":"383","article-title":"Photogrammetric 3D scanning of physical objects: Tools and workflow","volume":"8","author":"Seljan","year":"2019","journal-title":"TEM J."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Grazioso, S., Caporaso, T., Selvaggio, M., Panariello, D., Ruggiero, R., and Di Gironimo, G. (2019, January 4\u20136). Using photogrammetric 3D body reconstruction for the design of patient\u2013tailored assistive devices. Proceedings of the IEEE 2019 II Workshop on Metrology for Industry 4.0 and IoT (MetroInd4.0 & IoT), Naples, Italy.","DOI":"10.1109\/METROI4.2019.8792894"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Rey-Otero, I., Morel, J.M., and Delbracio, M. (2015). An analysis of the factors affecting keypoint stability in scale-space. arXiv.","DOI":"10.1007\/s10851-016-0657-5"},{"key":"ref_25","unstructured":"Shan, Q., Adams, R., Curless, B., Furukawa, Y., and Seitz, S.M. (July, January 29). The Visual Turing Test for Scene Reconstruction. Proceedings of the IEEE International Conference on 3D Vision-3DV, Seattle, WA, USA."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"760","DOI":"10.1109\/TCSVT.2016.2596118","article-title":"Video-Based Outdoor Human Reconstruction","volume":"27","author":"Zhu","year":"2016","journal-title":"IEEE Trans. Circ. Syst. Vid. Tech."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Moulon, P., Monasse, P., Perrot, R., and Marlet, R. (2016, January 4). OpenMVG: Open Multiple View Geometry. Proceedings of the Workshop on Reproducible Research in Pattern Recognition, Canc\u00fan, Mexico.","DOI":"10.1007\/978-3-319-56414-2_5"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Ravi, T., Ranganathan, R., Ramesh, S.P., and Dandotiya, D.S. (2021). 3D Printed Personalized Orthotic Inserts Using Photogrammetry and FDM Technology. Fused Deposition Modeling Based 3D Printing, Springer.","DOI":"10.1007\/978-3-030-68024-4_18"},{"key":"ref_29","unstructured":"(2021, November 11). Real Time Segmentation of Feet on Smartphone. Available online: http:\/\/urn.kb.se\/resolve?urn=urn:nbn:se:kth:diva-231779."},{"key":"ref_30","unstructured":"Paszke, A., Chaurasia, A., Kim, S., and Culurciello, E. (2016). ENet: Deep Neural Network Architecture for Real-Time Semantic Segmentation. arXiv."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Chaurasia, A., and Culurciello, E. (2017). LinkNet: Exploiting Encoder Representations for Efficient Semantic Segmentation. arXiv.","DOI":"10.1109\/VCIP.2017.8305148"},{"key":"ref_32","unstructured":"Howard, A.G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., and Adam, H. (2017). MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications. arXiv."},{"key":"ref_33","unstructured":"Kok, F., Charles, J., and Cipolla, R. (2021). FootNet: An Efficient Convolutional Network for Multiview 3D Foot Reconstruction. Proceedings of the Asian Conference on Computer Vision, Springer. Available online: https:\/\/link.springer.com\/chapter\/10.1007%2F978-3-030-69544-6_3."},{"key":"ref_34","first-page":"424","article-title":"3D U-net: Learning dense volumetric segmentation from sparse annotation","volume":"Volume 9901","author":"Abdulkadir","year":"2016","journal-title":"Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Zelek, J., and Lunscher, N. (2017, January 22\u201329). Point cloud completion of foot shape from a single depth map for fit matching using deep learning view synthesis. Proceedings of the 2017 IEEE International Conference on Computer Vision Workshop (ICCVW), Venice, Italy.","DOI":"10.1109\/ICCVW.2017.271"},{"key":"ref_36","unstructured":"Robinette, K.M., Daanen, H., and Paquet, E. (1999, January 4\u20138). The CAESAR project: A 3-D surface anthropometry survey. Proceedings of the Second International Conference on 3-D Digital Imaging and Modeling, Ottawa, ON, Canada."},{"key":"ref_37","first-page":"1281","article-title":"Fast explicit diffusion for accelerated features in nonlinear scale spaces","volume":"34","author":"Alcantarilla","year":"2011","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_38","unstructured":"Nister, D., and Stewenius, H. (2006, January 17\u201322). Scalable recognition with a vocabulary tree. Proceedings of the IEEE CVPR 2006, New York, NY, USA."},{"key":"ref_39","unstructured":"(2021, November 12). Detectron2. Available online: https:\/\/github.com\/facebookresearch\/detectron2."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Girshick, R. (2015, January 7\u201313). Fast R-CNN. Proceedings of the International Conference on Computer Vision, Santiago, Chile.","DOI":"10.1109\/ICCV.2015.169"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"G\u00faler, R.A., Neverova, N., and Kokkinos, I. (2018). DensePose: Dense Human Pose Estimation in the Wild. arXiv.","DOI":"10.1109\/CVPR.2018.00762"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Cai, Z., and Vasconcelos, N. (2018, January 18\u201322). Cascade R-CNN: Delving Into High Quality Object Detection. Proceedings of the Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00644"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"He, K., Gkioxari, G., Doll\u00e1r, P., and Girshick, R. (2017, January 22\u201329). Mask r-cnn. Proceedings of the 2017 IEEE International Conference on Computer Vision (ICCV), Venice, Italy.","DOI":"10.1109\/ICCV.2017.322"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"2129","DOI":"10.1016\/j.patrec.2005.03.022","article-title":"ZNCC-based template matching using bounded partial correlation","volume":"26","author":"Mattoccia","year":"2005","journal-title":"Pattern Recognit. Lett."},{"key":"ref_45","unstructured":"AliceVision (2021, November 15). Photogrammetric Computer Vision Framework. Available online: https:\/\/alicevision.org\/."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"297","DOI":"10.2307\/1932409","article-title":"Measures of the amount of ecologic association between species","volume":"26","author":"Dice","year":"1945","journal-title":"Ecology"},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Rezatofighi, S.H., Tsoi, N., Gwak, J., Sadeghian, A., Reid, I.D., and Savarese, S. (2019). Generalized Intersection over Union: A Metric and A Loss for Bounding Box Regression. arXiv.","DOI":"10.1109\/CVPR.2019.00075"},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Arteaga-Marrero, N., Hern\u00e1ndez, A., Villa, E., Gonz\u00e1lez-P\u00e9rez, S., Luque, C., and Ruiz-Alzola, J. (2021). Segmentation Approaches for Diabetic Foot Disorders. Sensors, 21.","DOI":"10.3390\/s21030934"}],"container-title":["Future Internet"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-5903\/13\/12\/315\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T07:47:52Z","timestamp":1760168872000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-5903\/13\/12\/315"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,12,14]]},"references-count":48,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2021,12]]}},"alternative-id":["fi13120315"],"URL":"https:\/\/doi.org\/10.3390\/fi13120315","relation":{},"ISSN":["1999-5903"],"issn-type":[{"value":"1999-5903","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,12,14]]}}}