{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T01:46:17Z","timestamp":1760060777708,"version":"build-2065373602"},"reference-count":29,"publisher":"MDPI AG","issue":"10","license":[{"start":{"date-parts":[[2025,10,7]],"date-time":"2025-10-07T00:00:00Z","timestamp":1759795200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100000266","name":"Engineering and Physical Sciences Research Council (EPSRC)","doi-asserted-by":"publisher","award":["EP\/W011794\/1"],"award-info":[{"award-number":["EP\/W011794\/1"]}],"id":[{"id":"10.13039\/501100000266","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J. Imaging"],"abstract":"<jats:p>Single-view-based anomaly detection approaches present challenges due to the lack of context, particularly for multi-label problems. In this work, we demonstrate the efficacy of using multiview image data for improved classification using a hierarchical learning approach. Using 170,958 images from the International Mouse Phenotyping Consortium (IMPC) repository, a specimen-wise multiview dataset comprising 54,046 specimens was curated. Next, two hierarchical classification frameworks were developed by customizing ConvNeXT and a convolutional autoencoder (CAE) as CNN backbones, respectively. The customized architectures were trained at three hierarchy levels with increasing anatomical granularity, enabling specialized layers to learn progressively more detailed features. At the top level (L1), multiview (MV) classification performed about the same as single views, with a high mean AUC of 0.95. However, using MV images in the hierarchical model greatly improved classification at levels 2 and 3. The model showed consistently higher average AUC scores with MV compared to single views such as dorsoventral or lateral. For example, at Level 2 (L2), the model divided abnormal cases into three subclasses, achieving AUCs of 0.65 for DV, 0.76 for LV, and 0.87 for MV. Then, at Level 3 (L3), it further divided these into ten specific abnormalities, with AUCs of 0.54 for DV, 0.59 for LV, and 0.82 for MV. A similar performance was achieved by the CAE-driven architecture, with mean AUCs of 0.87, 0.88, and 0.89 at Level 2 (L2) and 0.74, 0.78, and 0.81 at Level 3 (L3), respectively, for DV, LV, and MV views. The overall results demonstrate the advantage of multiview image data coupled with hierarchical learning for skeletal abnormality detection in a multi-label context.<\/jats:p>","DOI":"10.3390\/jimaging11100348","type":"journal-article","created":{"date-parts":[[2025,10,7]],"date-time":"2025-10-07T10:48:07Z","timestamp":1759834087000},"page":"348","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Hierarchical Deep Learning for Abnormality Classification in Mouse Skeleton Using Multiview X-Ray Images: Convolutional Autoencoders Versus ConvNeXt"],"prefix":"10.3390","volume":"11","author":[{"given":"Muhammad M.","family":"Jawaid","sequence":"first","affiliation":[{"name":"School of Engineering & Physical Sciences, College of Health & Science, University of Lincoln, Brayford Pool, Lincoln LN6 7TS, UK"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0443-7704","authenticated-orcid":false,"given":"Rasneer S.","family":"Bains","sequence":"additional","affiliation":[{"name":"Mary Lyon Centre at MRC Harwell, Oxfordshire OX11 0RD, UK"}]},{"given":"Sara","family":"Wells","sequence":"additional","affiliation":[{"name":"Mary Lyon Centre at MRC Harwell, Oxfordshire OX11 0RD, UK"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7636-4554","authenticated-orcid":false,"given":"James M.","family":"Brown","sequence":"additional","affiliation":[{"name":"School of Engineering & Physical Sciences, College of Health & Science, University of Lincoln, Brayford Pool, Lincoln LN6 7TS, UK"}]}],"member":"1968","published-online":{"date-parts":[[2025,10,7]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Harini, N., Ramji, B., Sriram, S., Sowmya, V., and Soman, K. (2020). Musculoskeletal radiographs classification using deep learning. Deep Learning for Data Analytics, Elsevier.","DOI":"10.1016\/B978-0-12-819764-6.00006-5"},{"key":"ref_2","unstructured":"International Mouse Phenotyping Consortium (2025, January 10). Programmatic Data Access: Image Data. Available online: https:\/\/www.mousephenotype.org\/help\/programmatic-data-access\/images\/."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Foessl, I., Bassett, J.D., Bj\u00f8rnerem, \u00c5., Busse, B., Calado, \u00c2., Chavassieux, P., Christou, M., Douni, E., Fiedler, I.A., and Fonseca, J.E. (2021). Bone phenotyping approaches in human, mice and zebrafish\u2014Expert overview of the EU cost action GEMSTONE (\u201cGEnomics of MusculoSkeletal traits TranslatiOnal NEtwork\u201d). Front. Endocrinol., 12.","DOI":"10.3389\/fendo.2021.720728"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"16657","DOI":"10.1007\/s11042-024-19716-5","article-title":"Weakly supervised learning based bone abnormality detection from musculoskeletal x-rays","volume":"84","author":"Kumar","year":"2025","journal-title":"Multimed. Tools Appl."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Yadav, D., and Rathor, S. (2020, January 28\u201329). Bone Fracture Detection and Classification using Deep Learning Approach. Proceedings of the International Conference on Power Electronics & IoT Applications in Renewable Energy and Its Control (PARC), Mathura, India.","DOI":"10.1109\/PARC49193.2020.236611"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Ajiboye, A., and Babalola, K. (2021, January 23\u201325). Determining Mice Sex from Chest X-rays using Deep Learning. Proceedings of the 2020 IEEE 2nd International Conference on Cyberspac (CYBER NIGERIA), Abuja, Nigeria.","DOI":"10.1109\/CYBERNIGERIA51635.2021.9428822"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Babalola, K., Mashhadi, H.H., Mu\u00f1oz-Fuentes, V., Mason, J., Meehan, T., and Consortium, I.M.P. (2020, January 15\u201317). Investigating sex related phenotype changes in knockout mice by applying deep learning to x-ray images. Proceedings of the Medical Image Understanding and Analysis: 24th Annual Conference, MIUA 2020, Oxford, UK. Proceedings 24.","DOI":"10.1007\/978-3-030-52791-4_28"},{"key":"ref_8","unstructured":"Zeiler, M.D., and Fergus, R. (2014, January 6\u201312). Visualizing and understanding convolutional networks. Proceedings of the Computer Vision\u2013ECCV 2014: 13th European Conference, Zurich, Switzerland. Proceedings, Part I 13."},{"key":"ref_9","first-page":"555","article-title":"Computer-Assisted Framework for Automatic Detection of Structural Hand Deformities","volume":"48","author":"Memon","year":"2021","journal-title":"J. Hunan Univ. Nat. Sci."},{"key":"ref_10","first-page":"391","article-title":"Automatic Detection of Elbow Abnormalities in X-ray Imagery","volume":"11","author":"Afzal","year":"2020","journal-title":"Int. J. Adv. Comput. Sci. Appl."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"250","DOI":"10.1002\/bdrc.20016","article-title":"Microcomputed tomography imaging of skeletal development and growth","volume":"72","author":"Guldberg","year":"2004","journal-title":"Birth Defects Res. Part C Embryo Today Rev."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Tanzi, L., Vezzetti, E., Moreno, R., and Moos, S. (2020). X-ray bone fracture classification using deep learning: A baseline for designing a reliable approach. Appl. Sci., 10.","DOI":"10.3390\/app10041507"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"132","DOI":"10.1007\/s00530-024-01321-z","article-title":"Multi-label local awareness and global co-occurrence priori learning improve chest X-ray classification","volume":"30","author":"Wang","year":"2024","journal-title":"Multimed. Syst."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Zhang, K., Liang, W., Cao, P., Liu, X., Yang, J., and Zaiane, O. (2024). Label correlation guided discriminative label feature learning for multi-label chest image classification. Comput. Methods Programs Biomed., 245.","DOI":"10.1016\/j.cmpb.2024.108032"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Lu, Y., Hu, Y., Li, L., Xu, Z., Liu, H., Liang, H., and Fu, X. (2024, January 7\u20139). CvTGNet: A Novel Framework for Chest X-Ray Multi-label Classification. Proceedings of the 21st ACM International Conference on Computing Frontiers, Naples, Italy.","DOI":"10.1145\/3649153.3649216"},{"key":"ref_16","first-page":"590","article-title":"Chexpert: A large chest radiograph dataset with uncertainty labels and expert comparison","volume":"33","author":"Irvin","year":"2019","journal-title":"Proc. AAAI Conf. Artif. Intell."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"4409","DOI":"10.1109\/JBHI.2023.3281466","article-title":"Multi-label local to global learning: A novel learning paradigm for chest x-ray abnormality classification","volume":"27","author":"Liu","year":"2023","journal-title":"IEEE J. Biomed. Health Inform."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Ke, A., Ellsworth, W., Banerjee, O., Ng, A.Y., and Rajpurkar, P. (2021, January 8\u201310). CheXtransfer: Performance and parameter efficiency of ImageNet models for chest X-Ray interpretation. Proceedings of the Conference on Health, Inference, and Learning, Virtual Event.","DOI":"10.1145\/3450439.3451867"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Huang, G.H., Fu, Q.J., Gu, M.Z., Lu, N.H., Liu, K.Y., and Chen, T.B. (2022). Deep transfer learning for the multilabel classification of chest X-ray images. Diagnostics, 12.","DOI":"10.3390\/diagnostics12061457"},{"key":"ref_20","unstructured":"Wehrmann, J., Cerri, R., and Barros, R. (2018, January 10\u201315). Hierarchical multi-label classification networks. Proceedings of the International Conference on Machine Learning, PMLR, Stockholm, Sweden."},{"key":"ref_21","unstructured":"Asadi, M., Sodok\u00e9, K., Gerard, I.J., and Kersten-Oertel, M. (2025). Clinically-Inspired Hierarchical Multi-Label Classification of Chest X-rays with a Penalty-Based Loss Function. arXiv."},{"key":"ref_22","unstructured":"Jawaid, M.M., Bains, S.R., Wells, S., and Brown, J.M. Hierarchical Multi-label Learning for Musculoskeletal Phenotyping in Mice. Proceedings of the Annual Conference on Medical Image Understanding and Analysis."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"508","DOI":"10.1038\/nature19356","article-title":"High-throughput discovery of novel developmental phenotypes","volume":"537","author":"Dickinson","year":"2016","journal-title":"Nature"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"D802","DOI":"10.1093\/nar\/gkt977","article-title":"The International Mouse Phenotyping Consortium Web Portal, a unified point of access for knockout mice and related phenotyping data","volume":"42","author":"Koscielny","year":"2014","journal-title":"Nucleic Acids Res."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Liu, Z., Mao, H., Wu, C.Y., Feichtenhofer, C., Darrell, T., and Xie, S. (2022, January 21\u201324). A convnet for the 2020s. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.","DOI":"10.1109\/CVPR52688.2022.01167"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Masci, J., Meier, U., Cire\u015fan, D., and Schmidhuber, J. (2011, January 14\u201317). Stacked convolutional auto-encoders for hierarchical feature extraction. Proceedings of the Artificial Neural Networks and Machine Learning\u2013ICANN 2011: 21st International Conference on Artificial Neural Networks, Espoo, Finland. Proceedings, Part I 21.","DOI":"10.1007\/978-3-642-21735-7_7"},{"key":"ref_27","unstructured":"Tan, M., and Le, Q. (2019, January 9\u201315). Efficientnet: Rethinking model scaling for convolutional neural networks. Proceedings of the International Conference on Machine Learning, PMLR, Long Beach, CA, USA."},{"key":"ref_28","unstructured":"Kingma, D.P. (2014). Adam: A method for stochastic optimization. arXiv."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Selvaraju, R.R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., and Batra, D. (2017, January 22\u201329). Grad-cam: Visual explanations from deep networks via gradient-based localization. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.74"}],"container-title":["Journal of Imaging"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2313-433X\/11\/10\/348\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,9]],"date-time":"2025-10-09T18:49:57Z","timestamp":1760035797000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2313-433X\/11\/10\/348"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,10,7]]},"references-count":29,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2025,10]]}},"alternative-id":["jimaging11100348"],"URL":"https:\/\/doi.org\/10.3390\/jimaging11100348","relation":{},"ISSN":["2313-433X"],"issn-type":[{"type":"electronic","value":"2313-433X"}],"subject":[],"published":{"date-parts":[[2025,10,7]]}}}