{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T02:35:01Z","timestamp":1760236501469,"version":"build-2065373602"},"reference-count":55,"publisher":"MDPI AG","issue":"23","license":[{"start":{"date-parts":[[2021,11,29]],"date-time":"2021-11-29T00:00:00Z","timestamp":1638144000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["51707135"],"award-info":[{"award-number":["51707135"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Key R&amp;D Program of Hubei Province, China","award":["2020BAB109"],"award-info":[{"award-number":["2020BAB109"]}]},{"name":"Fundamental Research Funds for the Central Universities, China","award":["2042019kf1014"],"award-info":[{"award-number":["2042019kf1014"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Radiography is an essential basis for the diagnosis of fractures. For the pediatric elbow joint diagnosis, the doctor needs to diagnose abnormalities based on the location and shape of each bone, which is a great challenge for AI algorithms when interpreting radiographs. Bone instance segmentation is an effective upstream task for automatic radiograph interpretation. Pediatric elbow bone instance segmentation is a process by which each bone is extracted separately from radiography. However, the arbitrary directions and the overlapping of bones pose issues for bone instance segmentation. In this paper, we design a detection-segmentation pipeline to tackle these problems by using rotational bounding boxes to detect bones and proposing a robust segmentation method. The proposed pipeline mainly contains three parts: (i) We use Faster R-CNN-style architecture to detect and locate bones. (ii) We adopt the Oriented Bounding Box (OBB) to improve the localizing accuracy. (iii) We design the Global-Local Fusion Segmentation Network to combine the global and local contexts of the overlapped bones. To verify the effectiveness of our proposal, we conduct experiments on our self-constructed dataset that contains 1274 well-annotated pediatric elbow radiographs. The qualitative and quantitative results indicate that the network significantly improves the performance of bone extraction. Our methodology has good potential for applying deep learning in the radiography\u2019s bone instance segmentation.<\/jats:p>","DOI":"10.3390\/s21237966","type":"journal-article","created":{"date-parts":[[2021,12,1]],"date-time":"2021-12-01T01:45:02Z","timestamp":1638323102000},"page":"7966","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Accurate Instance Segmentation in Pediatric Elbow Radiographs"],"prefix":"10.3390","volume":"21","author":[{"given":"Dixiao","family":"Wei","sequence":"first","affiliation":[{"name":"Electronic Information School, Wuhan University, Wuhan 430072, China"}]},{"given":"Qiongshui","family":"Wu","sequence":"additional","affiliation":[{"name":"Electronic Information School, Wuhan University, Wuhan 430072, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7969-5882","authenticated-orcid":false,"given":"Xianpei","family":"Wang","sequence":"additional","affiliation":[{"name":"Electronic Information School, Wuhan University, Wuhan 430072, China"}]},{"given":"Meng","family":"Tian","sequence":"additional","affiliation":[{"name":"Electronic Information School, Wuhan University, Wuhan 430072, China"}]},{"given":"Bowen","family":"Li","sequence":"additional","affiliation":[{"name":"Electronic Information School, Wuhan University, Wuhan 430072, China"}]}],"member":"1968","published-online":{"date-parts":[[2021,11,29]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1053","DOI":"10.2214\/AJR.10.7314","article-title":"Pediatric Bone Imaging: Imaging Elbow Trauma in Children\u2014A Review of Acute and Chronic Injuries","volume":"198","author":"Iyer","year":"2012","journal-title":"Am. J. Roentgenol."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"420","DOI":"10.1017\/cem.2017.34","article-title":"Determining the clinical significance of errors in pediatric radiograph interpretation between emergency physicians and radiologists","volume":"20","author":"Taves","year":"2018","journal-title":"Can. J. Emerg. Med."},{"key":"ref_3","unstructured":"Kraynov, L. (2016). Variability in the Interpretation of Elbow Fractures in Children, The University of Arizona."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"311","DOI":"10.1097\/00006416-200609000-00007","article-title":"Broken bones: Common pediatric upper extremity fractures\u2014Part II","volume":"25","author":"Hart","year":"2006","journal-title":"Orthop. Nurs."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"7030","DOI":"10.4081\/or.2017.7030","article-title":"Radiographic evaluation of common pediatric elbow injuries","volume":"9","author":"DeFroda","year":"2017","journal-title":"Orthop. Rev."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Huang, G., Liu, Z., Van Der Maaten, L., and Weinberger, K.Q. (2017, January 21\u201326). Densely connected convolutional networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.243"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Rajpurkar, P., Irvin, J., Ball, R.L., Zhu, K., Yang, B., Mehta, H., Duan, T., Ding, D., Bagul, A., and Langlotz, C.P. (2018). Deep learning for chest radiograph diagnosis: A retrospective comparison of the CheXNeXt algorithm to practicing radiologists. PLoS Med., 15.","DOI":"10.1371\/journal.pmed.1002686"},{"key":"ref_8","unstructured":"Irvin, J., Rajpurkar, P., Ko, M., Yu, Y., Ciurea-Ilcus, S., Chute, C., Marklund, H., Haghgoo, B., Ball, R., and Shpanskaya, K. (February, January 27). Chexpert: A large chest radiograph dataset with uncertainty labels and expert comparison. Proceedings of the AAAI Conference on Artificial Intelligence, Honolulu, HI, USA."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"101","DOI":"10.1097\/RLI.0000000000000615","article-title":"Using a dual-input convolutional neural network for automated detection of pediatric supracondylar fracture on conventional radiography","volume":"55","author":"Choi","year":"2020","journal-title":"Investig. Radiol."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"e180015","DOI":"10.1148\/ryai.2019180015","article-title":"Binomial classification of pediatric elbow fractures using a deep learning multiview approach emulating radiologist decision making","volume":"1","author":"Rayan","year":"2019","journal-title":"Radiol. Artif. Intell."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1361","DOI":"10.2214\/AJR.18.19974","article-title":"Detection of traumatic pediatric elbow joint effusion using a deep convolutional neural network","volume":"211","author":"England","year":"2018","journal-title":"Am. J. Roentgenol."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"He, K., Gkioxari, G., Doll\u00e1r, P., and Girshick, R. (2017, January 22\u201329). Mask r-cnn. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.322"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Chen, H., Sun, K., Tian, Z., Shen, C., Huang, Y., and Yan, Y. (2020, January 13\u201319). BlendMask: Top-down meets bottom-up for instance segmentation. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00860"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Chen, K., Pang, J., Wang, J., Xiong, Y., Li, X., Sun, S., Feng, W., Liu, Z., Shi, J., and Ouyang, W. (2019, January 15\u201320). Hybrid task cascade for instance segmentation. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00511"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Ding, J., Xue, N., Long, Y., Xia, G.S., and Lu, Q. (2019, January 15\u201320). Learning roi transformer for oriented object detection in aerial images. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00296"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Chen, L.C., Zhu, Y., Papandreou, G., Schroff, F., and Adam, H. (2018, January 8\u201314). Encoder-decoder with atrous separable convolution for semantic image segmentation. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01234-2_49"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Tian, Z., Shen, C., Chen, H., and He, T. (2019, January 27\u201328). Fcos: Fully convolutional one-stage object detection. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Seoul, Korea.","DOI":"10.1109\/ICCV.2019.00972"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Lin, T.Y., Goyal, P., Girshick, R., He, K., and Doll\u00e1r, P. (2017, January 22\u201329). Focal loss for dense object detection. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.324"},{"key":"ref_19","unstructured":"Redmon, J., and Farhadi, A. (2018). Yolov3: An incremental improvement. arXiv."},{"key":"ref_20","unstructured":"Ren, S., He, K., Girshick, R., and Sun, J. (2015). Faster r-cnn: Towards real-time object detection with region proposal networks. arXiv."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Cai, Z., and Vasconcelos, N. (2018, January 18\u201322). Cascade r-cnn: Delving into high quality object detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00644"},{"key":"ref_22","unstructured":"Chi, C., Zhang, S., Xing, J., Lei, Z., Li, S.Z., and Zou, X. (February, January 27). Selective refinement network for high performance face detection. Proceedings of the AAAI Conference on Artificial Intelligence, Honolulu, HI, USA."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Wang, Q., Zhang, L., Bertinetto, L., Hu, W., and Torr, P.H. (2019, January 15\u201320). Fast online object tracking and segmentation: A unifying approach. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00142"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"032028","DOI":"10.1088\/1742-6596\/1486\/3\/032028","article-title":"The Research on autopilot system based on lightweight YOLO-V3 target detection algorithm","volume":"1486","author":"Gao","year":"2020","journal-title":"J. Phys. Conf. Ser."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Tanzi, L., Vezzetti, E., Moreno, R., and Moos, S. (2020). X-ray bone fracture classification using deep learning: A baseline for designing a reliable approach. Appl. Sci., 10.","DOI":"10.3390\/app10041507"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"106530","DOI":"10.1016\/j.compeleceng.2019.106530","article-title":"Arm fracture detection in X-rays based on improved deep convolutional neural network","volume":"81","author":"Guan","year":"2020","journal-title":"Comput. Electr. Eng."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"e180001","DOI":"10.1148\/ryai.2019180001","article-title":"Convolutional neural networks for automated fracture detection and localization on wrist radiographs","volume":"1","author":"Thian","year":"2019","journal-title":"Radiol. Artif. Intell."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Sa, R., Owens, W., Wiegand, R., Studin, M., Capoferri, D., Barooha, K., Greaux, A., Rattray, R., Hutton, A., and Cintineo, J. (2017, January 11\u201315). Intervertebral disc detection in X-ray images using faster R-CNN. Proceedings of the 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Jeju Island, Korea.","DOI":"10.1109\/EMBC.2017.8036887"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Koitka, S., Demircioglu, A., Kim, M.S., Friedrich, C.M., and Nensa, F. (2018). Ossification area localization in pediatric hand radiographs using deep neural networks for object detection. PloS ONE, 13.","DOI":"10.1371\/journal.pone.0207496"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Yahalomi, E., Chernofsky, M., and Werman, M. (2019). Detection of distal radius fractures trained by a small set of X-ray images and Faster R-CNN. Intelligent Computing\u2014Proceedings of the Computing Conference, Springer.","DOI":"10.1007\/978-3-030-22871-2_69"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"834","DOI":"10.1109\/TPAMI.2017.2699184","article-title":"Deeplab: Semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected crfs","volume":"40","author":"Chen","year":"2017","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_32","unstructured":"Chen, L.C., Papandreou, G., Schroff, F., and Adam, H. (2017). Rethinking atrous convolution for semantic image segmentation. arXiv."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Ronneberger, O., Fischer, P., and Brox, T. (2015). U-Net: Convolutional networks for biomedical image segmentation. arXiv.","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Zhou, Z., Siddiquee, M.M.R., Tajbakhsh, N., and Liang, J. (2018). Unet++: A nested u-net architecture for medical image segmentation. Deep Learning in Medical Image Analysis and Multimodal Learning for Clinical Decision Support, Springer.","DOI":"10.1007\/978-3-030-00889-5_1"},{"key":"ref_35","unstructured":"Badhe, S., Singh, V., Li, J., and Lakhani, P. (2020). Automated Segmentation of Vertebrae on Lateral Chest Radiography Using Deep Learning. arXiv."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Tan, Z., Yang, K., Sun, Y., Wu, B., Tao, H., Hu, Y., and Zhang, J. (2018, January 12\u201315). An Automatic Scoliosis Diagnosis and Measurement System Based on Deep Learning. Proceedings of the 2018 IEEE International Conference on Robotics and Biomimetics (ROBIO), Kuala Lumpur, Malaysia.","DOI":"10.1109\/ROBIO.2018.8665296"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"9205082","DOI":"10.1155\/2020\/9205082","article-title":"Computer-Aided System for the Detection of Multicategory Pulmonary Tuberculosis in Radiographs","volume":"2020","author":"Xie","year":"2020","journal-title":"J. Healthc. Eng."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Wang, J., Li, Z., Jiang, R., and Xie, Z. (2019, January 5\u20137). Instance segmentation of anatomical structures in chest radiographs. Proceedings of the 2019 IEEE 32nd International Symposium on Computer-Based Medical Systems (CBMS), Cordoba, Spain.","DOI":"10.1109\/CBMS.2019.00092"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Wang, B., Wu, Z., Khan, Z.U., Liu, C., and Zhu, M. (2019, January 19\u201321). Deep convolutional neural network with segmentation techniques for chest X-ray analysis. Proceedings of the 2019 14th IEEE Conference on Industrial Electronics and Applications (ICIEA), Xi\u2019an, China.","DOI":"10.1109\/ICIEA.2019.8834117"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Jodeiri, A., Zoroofi, R.A., Hiasa, Y., Takao, M., Sugano, N., Sato, Y., and Otake, Y. (2019, January 27\u201328). Region-based Convolution Neural Network Approach for Accurate Segmentation of Pelvic Radiograph. Proceedings of the 2019 26th National and 4th International Iranian Conference on Biomedical Engineering (ICBME), Tehran, Iran.","DOI":"10.1109\/ICBME49163.2019.9030401"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Yang, Z., Skalli, W., Vergari, C., Angelini, E.D., and Gajny, L. (2019). Automated spinal midline delineation on biplanar X-rays using Mask R-CNN. ECCOMAS Thematic Conference on Computational Vision and Medical Image Processing, Springer.","DOI":"10.1007\/978-3-030-32040-9_32"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Gurses, A., and Oktay, A.B. (2020, January 9\u201311). Human Identification with Panoramic Dental Images using Mask R-CNN and SURF. Proceedings of the 2020 5th International Conference on Computer Science and Engineering (UBMK), Diyarbakir, Turkey.","DOI":"10.1109\/UBMK50275.2020.9219513"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Silva, B., Pinheiro, L., Oliveira, L., and Pithon, M. (2020, January 7\u201310). A study on tooth segmentation and numbering using end-to-end deep neural networks. Proceedings of the 2020 33rd SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI), Porto de Galinhas, Brazil.","DOI":"10.1109\/SIBGRAPI51738.2020.00030"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Konya, S., Allouch, H., Nahleh, K.A., Dogheim, O.Y., and Boehm, H. (2020). Convolutional Neural Networks based automated segmentation and labelling of the lumbar spine X-ray. arXiv.","DOI":"10.4103\/jcvjs.jcvjs_186_20"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Lin, T.Y., Doll\u00e1r, P., Girshick, R., He, K., Hariharan, B., and Belongie, S. (2017, January 21\u201326). Feature pyramid networks for object detection. Proceedings of the IEEE conference on computer vision and pattern recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.106"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"1745","DOI":"10.1109\/LGRS.2018.2856921","article-title":"Toward arbitrary-oriented ship detection with rotated region proposal and discrimination networks","volume":"15","author":"Zhang","year":"2018","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"4307","DOI":"10.1109\/TGRS.2020.3010051","article-title":"Learning Center Probability Map for Detecting Objects in Aerial Images","volume":"59","author":"Wang","year":"2020","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Han, J., Ding, J., Li, J., and Xia, G.S. (2021). Align deep features for oriented object detection. IEEE Trans. Geosci. Remote Sens., 1\u201311.","DOI":"10.1109\/TGRS.2021.3062048"},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Wang, J., Ding, J., Guo, H., Cheng, W., Pan, T., and Yang, W. (2019). Mask obb: A semantic attention-based mask oriented bounding box representation for multi-category object detection in aerial images. Remote Sens., 11.","DOI":"10.3390\/rs11242930"},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Hu, J., Shen, L., and Sun, G. (2018, January 18\u201322). Squeeze-and-excitation networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00745"},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Hoiem, D., Chodpathumwan, Y., and Dai, Q. (2012). Diagnosing error in object detectors. European Conference on Computer Vision, Springer.","DOI":"10.1007\/978-3-642-33712-3_25"},{"key":"ref_53","unstructured":"Ng, H., Ong, S., Foong, K., Goh, P.S., and Nowinski, W. (2006, January 26\u201328). Medical image segmentation using k-means clustering and improved watershed algorithm. Proceedings of the 2006 IEEE Southwest Symposium on Image Analysis and Interpretation, Denver, CO, USA."},{"key":"ref_54","unstructured":"Zhang, Y., Hartley, R., Mashford, J., and Burn, S. (2011, January 6\u201313). Superpixels via pseudo-boolean optimization. Proceedings of the 2011 International Conference on Computer Vision, Barcelona, Spain."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"298","DOI":"10.1007\/s11263-014-0744-2","article-title":"Seeds: Superpixels extracted via energy-driven sampling","volume":"111","author":"Boix","year":"2015","journal-title":"Int. J. Comput. Vis."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/23\/7966\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T07:37:22Z","timestamp":1760168242000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/23\/7966"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,11,29]]},"references-count":55,"journal-issue":{"issue":"23","published-online":{"date-parts":[[2021,12]]}},"alternative-id":["s21237966"],"URL":"https:\/\/doi.org\/10.3390\/s21237966","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2021,11,29]]}}}