{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,22]],"date-time":"2026-09-22T16:05:27Z","timestamp":1790093127966,"version":"4.0.1"},"reference-count":33,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2023,5,25]],"date-time":"2023-05-25T00:00:00Z","timestamp":1684972800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Key Research and Development Project of Shaanxi Province, China","award":["2021GXLH-Z-030"],"award-info":[{"award-number":["2021GXLH-Z-030"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Diagnostics"],"abstract":"<jats:p>Background: Three-dimensional facial soft tissue landmark prediction is an important tool in dentistry, for which several methods have been developed in recent years, including a deep learning algorithm which relies on converting 3D models into 2D maps, which results in the loss of information and precision. Methods: This study proposes a neural network architecture capable of directly predicting landmarks from a 3D facial soft tissue model. Firstly, the range of each organ is obtained by an object detection network. Secondly, the prediction networks obtain landmarks from the 3D models of different organs. Results: The mean error of this method in local experiments is 2.62\u00b12.39, which is lower than that in other machine learning algorithms or geometric information algorithms. Additionally, over 72% of the mean error of test data falls within \u00b12.5 mm, and 100% falls within 3 mm. Moreover, this method can predict 32 landmarks, which is higher than any other machine learning-based algorithm. Conclusions: According to the results, the proposed method can precisely predict a large number of 3D facial soft tissue landmarks, which gives the feasibility of directly using 3D models for prediction.<\/jats:p>","DOI":"10.3390\/diagnostics13111853","type":"journal-article","created":{"date-parts":[[2023,5,26]],"date-time":"2023-05-26T01:52:43Z","timestamp":1685065963000},"page":"1853","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":18,"title":["An Automated Method of 3D Facial Soft Tissue Landmark Prediction Based on Object Detection and Deep Learning"],"prefix":"10.3390","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0009-0003-6855-9775","authenticated-orcid":false,"given":"Yuchen","family":"Zhang","sequence":"first","affiliation":[{"name":"Key Laboratory of Shaanxi Province for Craniofacial Precision Medicine Research, College of Stomatology, Xi\u2019an Jiaotong University, 98 XiWu Road, Xi\u2019an 710004, China"},{"name":"Shaanxi Provincial Key Laboratory of Big Data Knowledge Engineering, School of Computer Science and Technology, Xi\u2019an Jiaotong University, Xi\u2019an 710049, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yifei","family":"Xu","sequence":"additional","affiliation":[{"name":"Department of Oral Anatomy and Physiology and TMD, School of Stomatology, The Fourth Military Medical University, Xi\u2019an 710004, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jiamin","family":"Zhao","sequence":"additional","affiliation":[{"name":"Key Laboratory of Shaanxi Province for Craniofacial Precision Medicine Research, College of Stomatology, Xi\u2019an Jiaotong University, 98 XiWu Road, Xi\u2019an 710004, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tianjing","family":"Du","sequence":"additional","affiliation":[{"name":"Key Laboratory of Shaanxi Province for Craniofacial Precision Medicine Research, College of Stomatology, Xi\u2019an Jiaotong University, 98 XiWu Road, Xi\u2019an 710004, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dongning","family":"Li","sequence":"additional","affiliation":[{"name":"Key Laboratory of Shaanxi Province for Craniofacial Precision Medicine Research, College of Stomatology, Xi\u2019an Jiaotong University, 98 XiWu Road, Xi\u2019an 710004, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xinyan","family":"Zhao","sequence":"additional","affiliation":[{"name":"Key Laboratory of Shaanxi Province for Craniofacial Precision Medicine Research, College of Stomatology, Xi\u2019an Jiaotong University, 98 XiWu Road, Xi\u2019an 710004, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jinxiu","family":"Wang","sequence":"additional","affiliation":[{"name":"Key Laboratory of Shaanxi Province for Craniofacial Precision Medicine Research, College of Stomatology, Xi\u2019an Jiaotong University, 98 XiWu Road, Xi\u2019an 710004, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chen","family":"Li","sequence":"additional","affiliation":[{"name":"Shaanxi Provincial Key Laboratory of Big Data Knowledge Engineering, School of Computer Science and Technology, Xi\u2019an Jiaotong University, Xi\u2019an 710049, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Junbo","family":"Tu","sequence":"additional","affiliation":[{"name":"Key Laboratory of Shaanxi Province for Craniofacial Precision Medicine Research, College of Stomatology, Xi\u2019an Jiaotong University, 98 XiWu Road, Xi\u2019an 710004, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4532-2583","authenticated-orcid":false,"given":"Kun","family":"Qi","sequence":"additional","affiliation":[{"name":"Key Laboratory of Shaanxi Province for Craniofacial Precision Medicine Research, College of Stomatology, Xi\u2019an Jiaotong University, 98 XiWu Road, Xi\u2019an 710004, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2023,5,25]]},"reference":[{"key":"ref_1","unstructured":"Proffit, W.R., Fields, H.W., and Sarver, D.M. (2006). Contemporary Orthodontics, Elsevier Health Sciences."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Wu, J., Qian, B., Li, Y., Gao, Z., Ju, M., Yang, Y., Zheng, Y., Gong, T., Li, C., and Zhang, X. (2022, January 17\u201321). Leveraging multiple types of domain knowledge for safe and effective drug recommendation. Proceedings of the 31st ACM International Conference on Information & Knowledge Management, Atlanta, GA, USA.","DOI":"10.1145\/3511808.3557380"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"btad003","DOI":"10.1093\/bioinformatics\/btad003","article-title":"Dual Attention and Patient Similarity Network for Drug Recommendation","volume":"39","author":"Wu","year":"2023","journal-title":"Bioinformatics"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1093\/ejo\/cjab034","article-title":"Facial asymmetry assessment in skeletal Class III patients with spatially-dense geometric morphometrics","volume":"44","author":"Fan","year":"2022","journal-title":"Eur. J. Orthod."},{"key":"ref_5","first-page":"244","article-title":"A pilot study: 3D stereo photogrammetric image superimposition on to 3D CT scan images\u2013the future of orthognathic surgery","volume":"17","author":"Khambay","year":"2002","journal-title":"Int. J. Adult Orthod. Orthog. Surg."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Wu, J., Zhang, R., Gong, T., Bao, X., Gao, Z., Zhang, H., Wang, C., and Li, C. (2021, January 9\u201312). A precision diagnostic framework of renal cell carcinoma on whole-slide images using deep learning. Proceedings of the 2021 IEEE International Conference on Bioinformatics and Biomedicine (BIBM), Houston, TX, USA.","DOI":"10.1109\/BIBM52615.2021.9669870"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Wu, J., Zhang, R., Gong, T., Zhang, H., Wang, C., and Li, C. (2021, January 9\u201312). A personalized diagnostic generation framework based on multi-source heterogeneous data. Proceedings of the 2021 IEEE International Conference on Bioinformatics and Biomedicine (BIBM), Houston, TX, USA.","DOI":"10.1109\/BIBM52615.2021.9669427"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"112","DOI":"10.1597\/1545-1569_1992_029_0112_csmboc_2.3.co_2","article-title":"Craniofacial skeletal measurements based on computed tomography: Part I. Accuracy and reproducibility","volume":"29","author":"Waitzman","year":"1992","journal-title":"Cleft-Palate-Craniofacial J."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Wu, J., Tang, K., Zhang, H., Wang, C., and Li, C. (2020, January 16\u201319). Structured information extraction of pathology reports with attention-based graph convolutional network. Proceedings of the 2020 IEEE International Conference on Bioinformatics and Biomedicine (BIBM), Seoul, Republic of Korea.","DOI":"10.1109\/BIBM49941.2020.9313347"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Wu, J., Zhang, R., Gong, T., Liu, Y., Wang, C., and Li, C. (2021, January 9\u201312). Bioie: Biomedical information extraction with multi-head attention enhanced graph convolutional network. Proceedings of the 2021 IEEE International Conference on Bioinformatics and Biomedicine (BIBM), Houston, TX, USA.","DOI":"10.1109\/BIBM52615.2021.9669650"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"175","DOI":"10.1097\/00001665-200401000-00042","article-title":"Development of a new three-dimensional cranial imaging system","volume":"15","author":"Littlefield","year":"2004","journal-title":"J. Craniofacial Surg."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"2391","DOI":"10.1016\/j.joms.2009.10.017","article-title":"Registration of 3-dimensional facial photographs for clinical use","volume":"68","author":"Maal","year":"2010","journal-title":"J. Oral Maxillofac. Surg."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1326","DOI":"10.1016\/j.compind.2013.04.006","article-title":"3D human face soft tissues landmarking method: An advanced approach","volume":"64","author":"Vezzetti","year":"2013","journal-title":"Comput. Ind."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"895","DOI":"10.1007\/s11042-012-1091-3","article-title":"Geometry-based 3D face morphology analysis: Soft-tissue landmark formalization","volume":"68","author":"Vezzetti","year":"2014","journal-title":"Multimed. Tools Appl."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Sukno, F.M., Waddington, J.L., and Whelan, P.F. (2012, January 7\u201313). 3D facial landmark localization using combinatorial search and shape regression. Proceedings of the Computer Vision\u2013ECCV 2012, Workshops and Demonstrations, Florence, Italy. Proceedings, Part I 12.","DOI":"10.1007\/978-3-642-33863-2_4"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Yang, J., Liu, Q., and Zhang, K. (2017, January 21\u201326). Stacked hourglass network for robust facial landmark localisation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, Honolulu, HI, USA.","DOI":"10.1109\/CVPRW.2017.253"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Paulsen, R.R., Juhl, K.A., Haspang, T.M., Hansen, T., Ganz, M., and Einarsson, G. (2018, January 2\u20136). Multi-view consensus CNN for 3D facial landmark placement. Proceedings of the Computer Vision\u2013ACCV 2018: 14th Asian Conference on Computer Vision, Perth, Australia. Revised Selected Papers, Part I.","DOI":"10.1007\/978-3-030-20887-5_44"},{"key":"ref_18","unstructured":"Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Wang, K., Zhao, X., Gao, W., and Zou, J. (2018). A coarse-to-fine approach for 3D facial landmarking by using deep feature fusion. Symmetry, 10.","DOI":"10.3390\/sym10080308"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Bulat, A., and Tzimiropoulos, G. (2017, January 22\u201329). How far are we from solving the 2d & 3d face alignment problem? (and a dataset of 230,000 3d facial landmarks). Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.116"},{"key":"ref_21","unstructured":"Schouten, B., Juul, N.C., Drygajlo, A., and Tistarelli, M. Bosphorus Database for 3D Face Analysis. Proceedings of the Biometrics and Identity Management."},{"key":"ref_22","unstructured":"Yin, L., Wei, X., Sun, Y., Wang, J., and Rosato, M.J. (2006, January 10\u201312). A 3D facial expression database for facial behavior research. Proceedings of the 7th International Conference on Automatic Face and Gesture Recognition (FGR06), Southampton, UK."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Long, J., Shelhamer, E., and Darrell, T. (2015, January 7\u201312). Fully convolutional networks for semantic segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298965"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"622","DOI":"10.1093\/ejo\/cjaa069","article-title":"Accuracy of an automated method of 3D soft tissue landmark detection","volume":"43","author":"Baksi","year":"2021","journal-title":"Eur. J. Orthod."},{"key":"ref_25","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2015, December 10). Deep Residual Learning for Image Recognition. CoRR 2015, Available online: http:\/\/xxx.lanl.gov\/abs\/1512.03385."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Fanelli, G., Dantone, M., and Van Gool, L. (2013, January 22\u201326). Real time 3D face alignment with Random Forests-based Active Appearance Models. Proceedings of the 2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG), Shanghai, China.","DOI":"10.1109\/FG.2013.6553713"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1417","DOI":"10.1109\/TSMCB.2011.2148711","article-title":"Accurate Landmarking of Three-Dimensional Facial Data in the Presence of Facial Expressions and Occlusions Using a Three-Dimensional Statistical Facial Feature Model","volume":"41","author":"Zhao","year":"2011","journal-title":"IEEE Trans. Syst. Man Cybern. Part B (Cybern.)"},{"key":"ref_28","unstructured":"Sun, J., Huang, D., Wang, Y., and Chen, L. (2014, January 18). A coarse-to-fine approach to robust 3D facial landmarking via curvature analysis and Active Normal Model. Proceedings of the IEEE International Joint Conference on Biometrics, Clearwater, FL, USA."},{"key":"ref_29","unstructured":"Wang, Y., Cao, M., Fan, Z., and Peng, S. (March, January 22). Learning to Detect 3D Facial Landmarks via Heatmap Regression with Graph Convolutional Network. Proceedings of the AAAI Conference on Artificial Intelligence, Virtually."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Terada, T., Chen, Y.W., and Kimura, R. (2018, January 28\u201330). 3D facial landmark detection using deep convolutional neural networks. Proceedings of the 2018 14th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery (ICNC-FSKD), Huangshan, China.","DOI":"10.1109\/FSKD.2018.8687254"},{"key":"ref_31","unstructured":"Kipf, T.N., and Welling, M. (2016). Semi-supervised classification with graph convolutional networks. arXiv."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Wang, K., Peng, X., Yang, J., Lu, S., and Qiao, Y. (2020, January 13\u201319). Suppressing uncertainties for large-scale facial expression recognition. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00693"},{"key":"ref_33","first-page":"6000","article-title":"Attention is all you need","volume":"30","author":"Vaswani","year":"2017","journal-title":"Adv. Neural Inf. Process. Syst."}],"container-title":["Diagnostics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2075-4418\/13\/11\/1853\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T19:42:12Z","timestamp":1760125332000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2075-4418\/13\/11\/1853"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,5,25]]},"references-count":33,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2023,6]]}},"alternative-id":["diagnostics13111853"],"URL":"https:\/\/doi.org\/10.3390\/diagnostics13111853","relation":{},"ISSN":["2075-4418"],"issn-type":[{"value":"2075-4418","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,5,25]]}}}