{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,31]],"date-time":"2026-07-31T14:53:31Z","timestamp":1785509611956,"version":"3.56.0"},"reference-count":40,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2026,1,9]],"date-time":"2026-01-09T00:00:00Z","timestamp":1767916800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J. Imaging"],"abstract":"<jats:p>This study proposes an automated system using deep learning-based object detection to identify implant systems, leveraging recent progress in self-supervised learning, specifically masked image modeling (MIM). We advocate for self-pre-training, emphasizing that its advantages when acquiring suitable pre-training data is challenging. The proposed Masked Deep Embedding (MDE) pre-training method, extending the masked autoencoder (MAE) transformer, significantly enhances dental implant detection performance compared to baselines. Specifically, the proposed method achieves a best detection performance of AP = 96.1, outperforming supervised ViT and MAE baselines by up to +2.9 AP. In addition, we address the absence of a comprehensive dataset for implant design, enhancing an existing dataset under dental expert supervision. This augmentation includes annotations for implant design, such as coronal, middle, and apical parts, resulting in a unique Implant Design Dataset (IDD). The contributions encompass employing self-supervised learning for limited dental radiograph data, replacing MAE\u2019s patch reconstruction with patch embeddings, achieving substantial performance improvement in implant detection, and expanding possibilities through the labeling of implant design. This study paves the way for AI-driven solutions in implant dentistry, providing valuable tools for dentists and patients facing implant-related challenges.<\/jats:p>","DOI":"10.3390\/jimaging12010039","type":"journal-article","created":{"date-parts":[[2026,1,9]],"date-time":"2026-01-09T09:25:02Z","timestamp":1767950702000},"page":"39","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Self-Supervised Learning of Deep Embeddings for Classification and Identification of Dental Implants"],"prefix":"10.3390","volume":"12","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2118-9271","authenticated-orcid":false,"given":"Amani","family":"Almalki","sequence":"first","affiliation":[{"name":"Department of Computer and Information Sciences, Temple University, Philadelphia, PA 19122, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1739-7182","authenticated-orcid":false,"given":"Abdulrahman","family":"Almalki","sequence":"additional","affiliation":[{"name":"Department of Prosthetic Dental Sciences, Prince Sattam Bin Abdulaziz University, Al-Kharj 16278, Saudi Arabia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5102-8244","authenticated-orcid":false,"given":"Longin Jan","family":"Latecki","sequence":"additional","affiliation":[{"name":"Department of Computer and Information Sciences, Temple University, Philadelphia, PA 19122, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2026,1,9]]},"reference":[{"key":"ref_1","unstructured":"Shulman, L., and Driskell, T. (1997). Dental implants: A historical perspective. Implants in Dentistry, WB Saunders."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"220","DOI":"10.1111\/joor.12241","article-title":"Improving masticatory performance, bite force, nutritional state and patient\u2019s satisfaction with implant overdentures: A systematic review of the literature","volume":"42","author":"Boven","year":"2015","journal-title":"J. Oral Rehabil."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"476","DOI":"10.4047\/jap.2017.9.6.476","article-title":"Oral health-related quality of life in patients with implant treatment","volume":"9","author":"Kanehira","year":"2017","journal-title":"J. Adv. Prosthodont."},{"key":"ref_4","first-page":"217","article-title":"Management of implant\/prosthodontic complications","volume":"63","author":"Duqum","year":"2019","journal-title":"Dent. Clin."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"276","DOI":"10.1111\/clr.13127","article-title":"The diagnosis of peri-implantitis: A systematic review on the predictive value of bleeding on probing","volume":"29","author":"Hashim","year":"2018","journal-title":"Clin. Oral Implant. Res."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"S36","DOI":"10.1016\/j.metabol.2017.01.011","article-title":"Artificial intelligence in medicine","volume":"69","author":"Hamet","year":"2017","journal-title":"Metabolism"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"106","DOI":"10.1016\/j.jdent.2018.07.015","article-title":"Detection and diagnosis of dental caries using a deep learning-based convolutional neural network algorithm","volume":"77","author":"Lee","year":"2018","journal-title":"J. Dent."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1234","DOI":"10.1177\/0022034519867641","article-title":"Predicting the debonding of CAD\/CAM composite resin crowns with AI","volume":"98","author":"Yamaguchi","year":"2019","journal-title":"J. Dent. Res."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"115","DOI":"10.2186\/jpr.JPOR_2019_354","article-title":"A system for designing removable partial dentures using artificial intelligence. Part 1. Classification of partially edentulous arches using a convolutional neural network","volume":"65","author":"Takahashi","year":"2021","journal-title":"J. Prosthodont. Res."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1159\/000501643","article-title":"Health data in dentistry: An attempt to master the digital challenge","volume":"22","author":"Joda","year":"2019","journal-title":"Public Health Genom."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Hamamci, I.E., Er, S., Simsar, E., Sekuboyina, A., Gundogar, M., Stadlinger, B., Mehl, A., and Menze, B. (2023, January 8\u201312). Diffusion-Based Hierarchical Multi-label Object Detection to Analyze Panoramic Dental X-Rays. Proceedings of the Medical Image Computing and Computer Assisted Intervention\u2014MICCAI 2023, Vancouver, BC, Canada.","DOI":"10.1007\/978-3-031-43987-2_38"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"935","DOI":"10.1109\/TMI.2022.3221529","article-title":"Semantic Decomposition Network With Contrastive and Structural Constraints for Dental Plaque Segmentation","volume":"42","author":"Shi","year":"2022","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"467","DOI":"10.1109\/TMI.2022.3222388","article-title":"Hierarchical self-supervised learning for 3D tooth segmentation in intra-oral mesh scans","volume":"42","author":"Liu","year":"2022","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"3194","DOI":"10.1109\/TMI.2023.3263161","article-title":"Automatic detection of tooth-gingiva trim lines on Dental Surfaces","volume":"42","author":"Chen","year":"2023","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1","DOI":"10.5624\/isd.2019.49.1.1","article-title":"An overview of deep learning in the field of dentistry","volume":"49","author":"Hwang","year":"2019","journal-title":"Imaging Sci. Dent."},{"key":"ref_16","unstructured":"(2024, February 20). Implants Dataset. Available online: https:\/\/universe.roboflow.com\/al-xfpta\/implants-meckw."},{"key":"ref_17","unstructured":"Bao, H., Dong, L., Piao, S., and Wei, F. (2021). Beit: Bert pre-training of image transformers. arXiv."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"He, K., Gkioxari, G., Doll\u00e1r, P., and Girshick, R. (2017, January 22\u201329). Mask r-cnn. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.322"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Xie, Z., Zhang, Z., Cao, Y., Lin, Y., Bao, J., Yao, Z., Dai, Q., and Hu, H. (2022, January 18\u201324). Simmim: A simple framework for masked image modeling. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.","DOI":"10.1109\/CVPR52688.2022.00943"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Bozorgtabar, B., Mahapatra, D., and Thiran, J.P. (2023, January 8\u201312). AMAE: Adaptation of Pre-trained Masked Autoencoder for Dual-Distribution Anomaly Detection in Chest X-Rays. Proceedings of the Medical Image Computing and Computer Assisted Intervention\u2014MICCAI 2023, Vancouver, BC, Canada.","DOI":"10.1007\/978-3-031-43907-0_19"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Zhou, L., Liu, H., Bae, J., He, J., Samaras, D., and Prasanna, P. (2023, January 18\u201321). Self pre-training with masked autoencoders for medical image classification and segmentation. Proceedings of the 2023 IEEE 20th International Symposium on Biomedical Imaging (ISBI), Cartagena, Colombia.","DOI":"10.1109\/ISBI53787.2023.10230477"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Almalki, A., and Latecki, L.J. (2024, January 3\u20138). Self-Supervised Learning With Masked Autoencoders for Teeth Segmentation From Intra-Oral 3D Scans. Proceedings of the IEEE\/CVF Winter Conference on Applications of Computer Vision, Waikoloa, HI, USA.","DOI":"10.1109\/WACV57701.2024.00764"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Almalki, A., and Latecki, L.J. (2023, January 2\u20137). Self-supervised learning with masked image modeling for teeth numbering, detection of dental restorations, and instance segmentation in dental panoramic radiographs. Proceedings of the IEEE\/CVF Winter Conference on Applications of Computer Vision, Waikoloa, HI, USA.","DOI":"10.1109\/WACV56688.2023.00555"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Almalki, A., and Latecki, L.J. (2023, January 18\u201321). Enhanced Masked Image Modeling for Analysis of Dental Panoramic Radiographs. Proceedings of the 2023 IEEE 20th International Symposium on Biomedical Imaging (ISBI), Cartagena, Colombia.","DOI":"10.1109\/ISBI53787.2023.10230656"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"He, K., Chen, X., Xie, S., Li, Y., Doll\u00e1r, P., and Girshick, R. (2022, January 18\u201324). Masked autoencoders are scalable vision learners. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.","DOI":"10.1109\/CVPR52688.2022.01553"},{"key":"ref_26","unstructured":"Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., and Gelly, S. (2021, January 3\u20137). An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale. Proceedings of the ICLR, Virtual."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., and Guo, B. (2021, January 10\u201317). Swin transformer: Hierarchical vision transformer using shifted windows. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Montreal, QC, Canada.","DOI":"10.1109\/ICCV48922.2021.00986"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"161206","DOI":"10.1109\/ACCESS.2025.3606811","article-title":"Self-supervised masked deep embeddings for dental caries detection","volume":"13","author":"Almalki","year":"2025","journal-title":"IEEE Access"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Almalki, A., and Latecki, L.J. (2024, January 27\u201330). Masked Deep Embeddings of Patches for Teeth Segmentation in Cone Beam CT Images. Proceedings of the 2024 IEEE International Symposium on Biomedical Imaging (ISBI), Athens, Greece.","DOI":"10.1109\/ISBI56570.2024.10635608"},{"key":"ref_30","unstructured":"Almalki, A.H. (2024). Advancements in Artificial Intelligence and Computer Vision for Dental Imaging Analysis: Self-Supervised Learning Innovations, Temple University."},{"key":"ref_31","unstructured":"Brooks, J. (2022, March 14). COCO Annotator. Available online: https:\/\/github.com\/jsbroks\/coco-annotator\/."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"656","DOI":"10.1111\/sjos.12054","article-title":"A new regression model: Modal linear regression","volume":"41","author":"Yao","year":"2014","journal-title":"Scand. J. Stat."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"153","DOI":"10.1007\/s10614-007-9092-4","article-title":"Multidimensional spline interpolation: Theory and applications","volume":"30","author":"Habermann","year":"2007","journal-title":"Comput. Econ."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"e1772","DOI":"10.1002\/stvr.1772","article-title":"Testing of adaptive and context-aware systems: Approaches and challenges","volume":"31","author":"Siqueira","year":"2021","journal-title":"Softw. Test. Verif. Reliab."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"129","DOI":"10.1109\/TIT.1982.1056489","article-title":"Least squares quantization in PCM","volume":"28","author":"Lloyd","year":"1982","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Assran, M., Duval, Q., Misra, I., Bojanowski, P., Vincent, P., Rabbat, M., LeCun, Y., and Ballas, N. (2023, January 17\u201324). Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecture. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Vancouver, BC, Canada.","DOI":"10.1109\/CVPR52729.2023.01499"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Lin, T.Y., Doll\u00e1r, P., Girshick, R., He, K., Hariharan, B., and Belongie, S. (2017, January 21\u201326). Feature pyramid networks for object detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.106"},{"key":"ref_38","first-page":"8026","article-title":"Pytorch: An imperative style, high-performance deep learning library","volume":"32","author":"Paszke","year":"2019","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_39","unstructured":"Loshchilov, I., and Hutter, F. (2017). Decoupled weight decay regularization. arXiv."},{"key":"ref_40","unstructured":"Ultralytics (2024, February 20). YOLOv5: A State-of-the-Art Real-Time Object Detection System. Available online: https:\/\/docs.ultralytics.com."}],"container-title":["Journal of Imaging"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2313-433X\/12\/1\/39\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,1,9]],"date-time":"2026-01-09T09:40:47Z","timestamp":1767951647000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2313-433X\/12\/1\/39"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,1,9]]},"references-count":40,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2026,1]]}},"alternative-id":["jimaging12010039"],"URL":"https:\/\/doi.org\/10.3390\/jimaging12010039","relation":{},"ISSN":["2313-433X"],"issn-type":[{"value":"2313-433X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,1,9]]}}}