{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,10]],"date-time":"2026-09-10T06:00:39Z","timestamp":1789020039827,"version":"build-2803163510"},"reference-count":29,"publisher":"MDPI AG","issue":"12","license":[{"start":{"date-parts":[[2021,6,11]],"date-time":"2021-06-11T00:00:00Z","timestamp":1623369600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JCM"],"abstract":"<jats:p>Panoramic radiographs, also known as orthopantomograms, are routinely used in most dental clinics. However, it has been difficult to develop an automated method that detects the various structures present in these radiographs. One of the main reasons for this is that structures of various sizes and shapes are collectively shown in the image. In order to solve this problem, the recently proposed concept of panoptic segmentation, which integrates instance segmentation and semantic segmentation, was applied to panoramic radiographs. A state-of-the-art deep neural network model designed for panoptic segmentation was trained to segment the maxillary sinus, maxilla, mandible, mandibular canal, normal teeth, treated teeth, and dental implants on panoramic radiographs. Unlike conventional semantic segmentation, each object in the tooth and implant classes was individually classified. For evaluation, the panoptic quality, segmentation quality, recognition quality, intersection over union (IoU), and instance-level IoU were calculated. The evaluation and visualization results showed that the deep learning-based artificial intelligence model can perform panoptic segmentation of images, including those of the maxillary sinus and mandibular canal, on panoramic radiographs. This automatic machine learning method might assist dental practitioners to set up treatment plans and diagnose oral and maxillofacial diseases.<\/jats:p>","DOI":"10.3390\/jcm10122577","type":"journal-article","created":{"date-parts":[[2021,6,11]],"date-time":"2021-06-11T12:44:37Z","timestamp":1623415477000},"page":"2577","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":52,"title":["Panoptic Segmentation on Panoramic Radiographs: Deep Learning-Based Segmentation of Various Structures Including Maxillary Sinus and Mandibular Canal"],"prefix":"10.3390","volume":"10","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1968-7343","authenticated-orcid":false,"given":"Jun-Young","family":"Cha","sequence":"first","affiliation":[{"name":"Department of Prosthodontics, School of Dentistry and Dental Research Institute, Seoul National University, Daehak-ro 101, Jongro-gu, Seoul 03080, Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9597-6342","authenticated-orcid":false,"given":"Hyung-In","family":"Yoon","sequence":"additional","affiliation":[{"name":"Department of Prosthodontics, School of Dentistry and Dental Research Institute, Seoul National University, Daehak-ro 101, Jongro-gu, Seoul 03080, Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6780-2601","authenticated-orcid":false,"given":"In-Sung","family":"Yeo","sequence":"additional","affiliation":[{"name":"Department of Prosthodontics, School of Dentistry and Dental Research Institute, Seoul National University, Daehak-ro 101, Jongro-gu, Seoul 03080, Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8771-0392","authenticated-orcid":false,"given":"Kyung-Hoe","family":"Huh","sequence":"additional","affiliation":[{"name":"Department of Oral and Maxillofacial Radiology, School of Dentistry and Dental Research Institute, Seoul National University, Daehak-ro 101, Jongro-gu, Seoul 03080, Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jung-Suk","family":"Han","sequence":"additional","affiliation":[{"name":"Department of Prosthodontics, School of Dentistry and Dental Research Institute, Seoul National University, Daehak-ro 101, Jongro-gu, Seoul 03080, Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2021,6,11]]},"reference":[{"key":"ref_1","unstructured":"Tran, P.V. (2016). A fully convolutional neural network for cardiac segmentation in short-axis MRI. arXiv."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"101715","DOI":"10.1016\/j.compmedimag.2020.101715","article-title":"Semantic segmentation of the multiform proximal femur and femoral head bones with the deep convolutional neural networks in low quality MRI sections acquired in different MRI protocols","volume":"81","author":"Bilgili","year":"2020","journal-title":"Comput. Med. Imaging Graph."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"103445","DOI":"10.1016\/j.compbiomed.2019.103445","article-title":"Deep learning based retinal OCT segmentation","volume":"114","author":"Pekala","year":"2019","journal-title":"Comput. Biol. Med."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Sa, R., Owens, W., Wiegand, R., Studin, M., Capoferri, D., Barooha, K., Greaux, A., Rattray, R., Hutton, A., and Cintineo, J. (2017, January 11\u201315). Intervertebral disc detection in X-ray images using faster R-CNN. Proceedings of the 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Jeju Island, Korea.","DOI":"10.1109\/EMBC.2017.8036887"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"e180001","DOI":"10.1148\/ryai.2019180001","article-title":"Convolutional neural networks for automated fracture detection and localization on wrist radiographs","volume":"1","author":"Thian","year":"2019","journal-title":"Radiol. Artif. Intell."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Wang, J., Li, Z., Jiang, R., and Xie, Z. (2019, January 5\u20137). Instance segmentation of anatomical structures in chest radiographs. Proceedings of the 2019 IEEE 32nd International Symposium on Computer-Based Medical Systems (CBMS), Cordoba, Spain.","DOI":"10.1109\/CBMS.2019.00092"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"103226","DOI":"10.1016\/j.jdent.2019.103226","article-title":"Convolutional neural networks for dental image diagnostics: A scoping review","volume":"91","author":"Schwendicke","year":"2019","journal-title":"J. Dent."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Koch, T.L., Perslev, M., Igel, C., and Brandt, S.S. (2019, January 8\u201311). Accurate segmentation of dental panoramic radiographs with U-NETS. Proceedings of the 2019 IEEE 16th International Symposium on Biomedical Imaging (ISBI 2019), Venice, Italy.","DOI":"10.1109\/ISBI.2019.8759563"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"424","DOI":"10.1016\/j.oooo.2019.05.014","article-title":"Automatic detection and classification of radiolucent lesions in the mandible on panoramic radiographs using a deep learning object detection technique","volume":"128","author":"Ariji","year":"2019","journal-title":"Oral Surg. Oral Med. Oral Pathol. Oral Radiol."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Yang, H., Jo, E., Kim, H.J., Cha, I.-h., Jung, Y.-S., Nam, W., Kim, J.-Y., Kim, J.-K., Kim, Y.H., and Oh, T.G. (2020). Deep learning for automated detection of cyst and tumors of the jaw in panoramic radiographs. J. Clin. Med., 9.","DOI":"10.3390\/jcm9061839"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"20200185","DOI":"10.1259\/dmfr.20200185","article-title":"Automatic diagnosis for cysts and tumors of both jaws on panoramic radiographs using a deep convolution neural network","volume":"49","author":"Kwon","year":"2020","journal-title":"Dentomaxillofac. Radiol."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"635","DOI":"10.1016\/j.oooo.2019.11.007","article-title":"Application of a fully deep convolutional neural network to the automation of tooth segmentation on panoramic radiographs","volume":"129","author":"Lee","year":"2020","journal-title":"Oral Surg. Oral Med. Oral Pathol. Oral Radiol."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Kirillov, A., He, K., Girshick, R., Rother, C., and Doll\u00e1r, P. (2019, January 16\u201320). Panoptic segmentation. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00963"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Cheng, B., Collins, M.D., Zhu, Y., Liu, T., Huang, T.S., Adam, H., and Chen, L.-C. (2020, January 14\u201319). Panoptic-deeplab: A simple, strong, and fast baseline for bottom-up panoptic segmentation. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, online.","DOI":"10.1109\/CVPR42600.2020.01249"},{"key":"ref_15","unstructured":"(2021, February 28). Cityscapes Dataset Benchmark Suite. Available online: https:\/\/www.cityscapes-dataset.com\/benchmarks\/."},{"key":"ref_16","unstructured":"(2021, February 28). COCO Dataset\u2014Panoptic Leaderboard. Available online: https:\/\/cocodataset.org\/#panoptic-leaderboard."},{"key":"ref_17","unstructured":"Cordts, M., Omran, M., Ramos, S., Rehfeld, T., Enzweiler, M., Benenson, R., Franke, U., Roth, S., and Schiele, B. (July, January 26). The cityscapes dataset for semantic urban scene understanding. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Lin, T., Maire, M., Belongie, S.J., Bourdev, L.D., Girshick, R.B., Hays, J., Perona, P., Ramanan, D., Doll\u00e1r, P., and Zitnick, C.L. (2014). Microsoft COCO: Common objects in context. arXiv.","DOI":"10.1007\/978-3-319-10602-1_48"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"211","DOI":"10.1007\/s11263-015-0816-y","article-title":"Imagenet large scale visual recognition challenge","volume":"115","author":"Russakovsky","year":"2015","journal-title":"Int. J. Comput. Vis."},{"key":"ref_20","unstructured":"Kingma, D.P., and Ba, J. (2014). Adam: A method for stochastic optimization. arXiv."},{"key":"ref_21","unstructured":"Wu, Y., Kirillov, A., Massa, F., Lo, W., and Girshick, R. (2021, March 17). Detectron2. Available online: https:\/\/github.com\/facebookresearch\/detectron2."},{"key":"ref_22","unstructured":"Brooks, J. (2021, March 07). COCO Annotator. Available online: https:\/\/github.com\/jsbroks\/coco-annotator\/."},{"key":"ref_23","unstructured":"(2021, March 20). The Cityscapes Dataset. Available online: https:\/\/github.com\/mcordts\/cityscapesScripts."},{"key":"ref_24","unstructured":"(2021, March 20). COCO 2018 Panoptic Segmentation Task API. Available online: https:\/\/github.com\/cocodataset\/panopticapi."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"301","DOI":"10.1007\/s11282-018-0363-7","article-title":"Deep-learning classification using convolutional neural network for evaluation of maxillary sinusitis on panoramic radiography","volume":"35","author":"Murata","year":"2019","journal-title":"Oral Radiol."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"152","DOI":"10.1111\/odi.13223","article-title":"Diagnosis of cystic lesions using panoramic and cone beam computed tomographic images based on deep learning neural network","volume":"26","author":"Lee","year":"2020","journal-title":"Oral Dis."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"He, K., Gkioxari, G., Doll\u00e1r, P., and Girshick, R. (2017). Mask R-CNN. arXiv.","DOI":"10.1109\/ICCV.2017.322"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Kirillov, A., Girshick, R., He, K., and Doll\u00e1r, P. (2019, January 16\u201320). Panoptic feature pyramid networks. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00656"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41598-021-85454-5","article-title":"Generalizability of deep learning models for dental image analysis","volume":"11","author":"Krois","year":"2021","journal-title":"Sci. Rep."}],"container-title":["Journal of Clinical Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2077-0383\/10\/12\/2577\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T06:13:13Z","timestamp":1760163193000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2077-0383\/10\/12\/2577"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,6,11]]},"references-count":29,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2021,6]]}},"alternative-id":["jcm10122577"],"URL":"https:\/\/doi.org\/10.3390\/jcm10122577","relation":{},"ISSN":["2077-0383"],"issn-type":[{"value":"2077-0383","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,6,11]]}}}