{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,23]],"date-time":"2026-09-23T17:20:27Z","timestamp":1790184027155,"version":"4.1.0"},"reference-count":34,"publisher":"PeerJ","license":[{"start":{"date-parts":[[2020,4,1]],"date-time":"2020-04-01T00:00:00Z","timestamp":1585699200000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Chinese National Public Welfare Basic Scientific Research Program of Chinese Academy of Medical Sciences","award":["2018PT32003"],"award-info":[{"award-number":["2018PT32003"]}]},{"name":"Chinese National Public Welfare Basic Scientific Research Program of Chinese Academy of Medical Sciences","award":["2017PT32004"],"award-info":[{"award-number":["2017PT32004"]}]},{"name":"Beijing Municipal Natural Science Foundation","award":["7192153"],"award-info":[{"award-number":["7192153"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"abstract":"<jats:sec>\n                    <jats:title>Objective<\/jats:title>\n                    <jats:p>Bone age (BA) is a crucial indicator for revealing the growth and development of children. This study tested the performance of a fully automated artificial intelligence (AI) system for BA assessment of Chinese children with abnormal growth and development.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Materials and Methods<\/jats:title>\n                    <jats:p>A fully automated AI system based on the Greulich and Pyle (GP) method was developed for Chinese children by using 8,000 BA radiographs from five medical centers nationwide in China. Then, a total of 745 cases (360 boys and 385 girls) with abnormal growth and development from another tertiary medical center of north China were consecutively collected between January and October 2018 to test the system. The reference standard was defined as the result interpreted by two experienced reviewers (a radiologist with 10 years and an endocrinologist with 15 years of experience in BA reading) through consensus using the GP atlas. BA accuracy within 1 year, root mean square error (RMSE), mean absolute difference (MAD), and 95% limits of agreement according to the Bland-Altman plot were statistically calculated.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>For Chinese pediatric patients with abnormal growth and development, the accuracy of this new automated AI system within 1 year was 84.60% as compared to the reference standard, with the highest percentage of 89.45% in the 12- to 18-year group. The RMSE, MAD, and 95% limits of agreement of the AI system were 0.76 years, 0.58 years, and \u22121.547 to 1.428, respectively, according to the Bland-Altman plot. The largest difference between the AI and experts\u2019 BA result was noted for patients of short stature with bone deformities, severe osteomalacia, or different rates of maturation of the carpals and phalanges.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>The developed automated AI system could achieve comparable BA results to experienced reviewers for Chinese children with abnormal growth and development.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.7717\/peerj.8854","type":"journal-article","created":{"date-parts":[[2020,4,1]],"date-time":"2020-04-01T05:07:37Z","timestamp":1585717657000},"page":"e8854","source":"Crossref","is-referenced-by-count":28,"title":["Artificial intelligence system can achieve comparable results to experts for bone age assessment of Chinese children with abnormal growth and development"],"prefix":"10.7717","volume":"8","author":[{"given":"Fengdan","family":"Wang","sequence":"first","affiliation":[{"name":"Department of Radiology, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences & Peking Union Medical College, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xiao","family":"Gu","sequence":"additional","affiliation":[{"name":"Department of Endocrinology, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences & Peking Union Medical College, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shi","family":"Chen","sequence":"additional","affiliation":[{"name":"Department of Endocrinology, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences & Peking Union Medical College, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yongliang","family":"Liu","sequence":"additional","affiliation":[{"name":"Hangzhou YITU Healthcare Technology Co., Ltd., Hangzhou, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Qing","family":"Shen","sequence":"additional","affiliation":[{"name":"Hangzhou YITU Healthcare Technology Co., Ltd., Hangzhou, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hui","family":"Pan","sequence":"additional","affiliation":[{"name":"Department of Endocrinology, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences & Peking Union Medical College, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lei","family":"Shi","sequence":"additional","affiliation":[{"name":"Hangzhou YITU Healthcare Technology Co., Ltd., Hangzhou, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhengyu","family":"Jin","sequence":"additional","affiliation":[{"name":"Department of Radiology, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences & Peking Union Medical College, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"4443","published-online":{"date-parts":[[2020,4,1]]},"reference":[{"issue":"6","key":"10.7717\/peerj.8854\/ref-1","doi-asserted-by":"publisher","first-page":"2910","DOI":"10.1007\/s00330-018-5792-5","article-title":"Is the Greulich and Pyle atlas applicable to all ethnicities? A systematic review and meta-analysis","volume":"29","author":"Alshamrani","year":"2019","journal-title":"Eurpean Radiology"},{"issue":"1","key":"10.7717\/peerj.8854\/ref-2","doi-asserted-by":"publisher","first-page":"39","DOI":"10.1097\/RCT.0000000000000786","article-title":"Evaluation of a computer-aided diagnosis system for automated bone age assessment in comparison to the greulich-pyle atlas method","volume":"43","author":"Booz","year":"2019","journal-title":"Journal of Computer Assisted Tomography"},{"key":"10.7717\/peerj.8854\/ref-3","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.artmed.2019.04.005","article-title":"Incorporated region detection and classification using deep convolutional networks for bone age assessment","volume":"97","author":"Bui","year":"2019","journal-title":"Artificial Intelligence in Medicine"},{"issue":"6","key":"10.7717\/peerj.8854\/ref-4","doi-asserted-by":"publisher","first-page":"785","DOI":"10.1007\/s00256-017-2616-7","article-title":"Skeletal development of the hand and wrist: digital bone age companion\u2014a suitable alternative to the Greulich and Pyle atlas for bone age assessment?","volume":"46","author":"Bunch","year":"2017","journal-title":"Skeletal Radiology"},{"issue":"10","key":"10.7717\/peerj.8854\/ref-5","doi-asserted-by":"publisher","first-page":"5469","DOI":"10.1007\/s00330-019-06167-y","article-title":"Application of a deep learning algorithm for detection and visualization of hip fractures on plain pelvic radiographs","volume":"29","author":"Cheng","year":"2019","journal-title":"European Radiology"},{"issue":"6","key":"10.7717\/peerj.8854\/ref-6","doi-asserted-by":"publisher","first-page":"e201714","DOI":"10.1542\/peds.2017-1486","article-title":"Bone age: a handy tool for pediatric providers","volume":"140","author":"Creo","year":"2017","journal-title":"Pediatrics"},{"key":"10.7717\/peerj.8854\/ref-7","article-title":"AI will change radiology, but it won\u2019t replace radiologists","author":"Davenport","year":"2018"},{"issue":"7","key":"10.7717\/peerj.8854\/ref-8","doi-asserted-by":"publisher","first-page":"63","DOI":"10.4103\/2230-8210.145076","article-title":"Hand X-ray in pediatric endocrinology: skeletal age assessment and beyond","volume":"18","author":"De Sanctis","year":"2014","journal-title":"Indian Journal of Endocrinology and Metabolism"},{"key":"10.7717\/peerj.8854\/ref-9","doi-asserted-by":"publisher","first-page":"1543","DOI":"10.1016\/j.mex.2019.06.004","article-title":"Evaluation of skeletal age based on Greulich-Pyle method in Tehran","volume":"6","author":"Ebrahimzade","year":"2019","journal-title":"Methods"},{"issue":"7639","key":"10.7717\/peerj.8854\/ref-10","doi-asserted-by":"publisher","first-page":"115","DOI":"10.1038\/nature21056","article-title":"Dermatologist-level classification of skin cancer with deep neural networks","volume":"542","author":"Esteva","year":"2017","journal-title":"Nature"},{"key":"10.7717\/peerj.8854\/ref-11","volume-title":"Radiographic atlas of skeletal development of the hand and wrist","author":"Greulich","year":"1959","edition":"2"},{"issue":"22","key":"10.7717\/peerj.8854\/ref-12","doi-asserted-by":"publisher","first-page":"2402","DOI":"10.1001\/jama.2016.17216","article-title":"Development and validation of a deep learning algorithm for detection of diabetic retinopathy in retinal fundus photographs","volume":"316","author":"Gulshan","year":"2016","journal-title":"Journal of the American Medical Association"},{"issue":"2","key":"10.7717\/peerj.8854\/ref-13","doi-asserted-by":"publisher","first-page":"498","DOI":"10.1148\/radiol.2018180736","article-title":"The RSNA pediatric bone age machine learning challenge","volume":"290","author":"Halabi","year":"2019","journal-title":"Radiology"},{"issue":"8","key":"10.7717\/peerj.8854\/ref-14","doi-asserted-by":"publisher","first-page":"500","DOI":"10.1038\/s41568-018-0016-5","article-title":"Artificial intelligence in radiology","volume":"18","author":"Hosny","year":"2018","journal-title":"Nature Reviews Cancer"},{"issue":"9","key":"10.7717\/peerj.8854\/ref-15","doi-asserted-by":"publisher","first-page":"767","DOI":"10.1097\/00029330-200705010-00006","article-title":"Computerized geometric features of carpal bone for bone age estimation","volume":"120","author":"Hsieh","year":"2007","journal-title":"Chinese Medcial Journal"},{"issue":"6","key":"10.7717\/peerj.8854\/ref-16","doi-asserted-by":"publisher","first-page":"629","DOI":"10.3969\/j.issn.1004-5619.2017.06.013","article-title":"Advantages and application prospects of deep learning in image recognition and BA assessment","volume":"33","author":"Hu","year":"2017","journal-title":"Fa Yi Xue Za Zhi"},{"issue":"3","key":"10.7717\/peerj.8854\/ref-17","doi-asserted-by":"publisher","first-page":"322","DOI":"10.4103\/0019-5413.65144","article-title":"Skeletal age in idiopathic short stature: an analytical study by the TW3 method, Greulich and Pyle method","volume":"44","author":"Kim","year":"2010","journal-title":"Indian Journal of Orthopaedics"},{"issue":"6","key":"10.7717\/peerj.8854\/ref-18","doi-asserted-by":"publisher","first-page":"1374","DOI":"10.1001\/jama.2016.17216","article-title":"Computerized bone age estimation using deep learning-based program: evaluation of the accuracy and efficiency","volume":"209","author":"Kim","year":"2017","journal-title":"American Journal of Roentgenology"},{"issue":"1","key":"10.7717\/peerj.8854\/ref-19","doi-asserted-by":"publisher","first-page":"313","DOI":"10.1148\/radiol.2017170236","article-title":"Performance of a deep-learning neural network model in assessing skeletal maturity on pediatric hand radiographs","volume":"287","author":"Larson","year":"2018","journal-title":"Radiology"},{"issue":"8","key":"10.7717\/peerj.8854\/ref-20","doi-asserted-by":"publisher","first-page":"678","DOI":"10.1016\/j.compmedimag.2008.08.005","article-title":"Automatic bone age assessment based on intelligent algorithms and comparison with TW3 method","volume":"32","author":"Liu","year":"2008","journal-title":"Computerized Medical Imaging and Graphics"},{"key":"10.7717\/peerj.8854\/ref-21","doi-asserted-by":"publisher","first-page":"161","DOI":"10.1016\/j.combiomed.2019.03.015","article-title":"A multi-scale data fusion framework for bone age assessment with convolutional neural networks","volume":"108","author":"Liu","year":"2019","journal-title":"Computers in Biology and Medicine"},{"issue":"4","key":"10.7717\/peerj.8854\/ref-22","doi-asserted-by":"publisher","first-page":"143","DOI":"10.1297\/cpe.24.143","article-title":"Bone age: assessment methods and clinical applications","volume":"24","author":"Mari","year":"2015","journal-title":"Clinical Pediatric Endocrinology"},{"issue":"4","key":"10.7717\/peerj.8854\/ref-23","doi-asserted-by":"publisher","first-page":"421","DOI":"10.1080\/03014460410001723969","article-title":"TW3 bone age: RUS\/CB and gender differences of percentiles for score and score increments","volume":"31","author":"Molinari","year":"2004","journal-title":"Annals of Human Biology"},{"issue":"4","key":"10.7717\/peerj.8854\/ref-24","doi-asserted-by":"publisher","first-page":"480","DOI":"10.1007\/bf00856538","article-title":"Alternate-day steroids affect carpal maturation more than radius, ulna and short bones","volume":"8","author":"Polito","year":"1994","journal-title":"Pediatric Nephrology"},{"issue":"2","key":"10.7717\/peerj.8854\/ref-25","doi-asserted-by":"publisher","first-page":"305","DOI":"10.1148\/radiol.201818371","article-title":"Detection of breast cancer with mammography: effect of an artificial intelligence support system","volume":"290","author":"Rodr\u00edguez-Ruiz","year":"2019","journal-title":"Radiology"},{"issue":"2","key":"10.7717\/peerj.8854\/ref-26","doi-asserted-by":"publisher","first-page":"504","DOI":"10.1148\/radiol.2018182657","article-title":"What can we learn from the RSNA pediatric bone age machine learning challenge?","volume":"290","author":"Siegel","year":"2019","journal-title":"Radiology"},{"key":"10.7717\/peerj.8854\/ref-27","doi-asserted-by":"publisher","first-page":"41","DOI":"10.1016\/j.media.2016.10.010","article-title":"Deep learning for automated skeletal bone age assessment in X-ray images","volume":"36","author":"Spampinato","year":"2017","journal-title":"Medical Image Analysis"},{"issue":"2","key":"10.7717\/peerj.8854\/ref-28","doi-asserted-by":"publisher","first-page":"275","DOI":"10.1007\/s00256-018-3033-2","article-title":"Artificial intelligence-assisted interpretation of bone age radiographs improves accuracy and decreases variability","volume":"48","author":"Tajmir","year":"2019","journal-title":"Skeletal Radiology"},{"key":"10.7717\/peerj.8854\/ref-29","article-title":"Growth at adolescence: with a general consideration of the effects of hereditary and environmental factors upon growth and maturation from birth to maturity","author":"Tanner","year":"1962","edition":"2"},{"key":"10.7717\/peerj.8854\/ref-30","volume-title":"Assessment of skeletal maturity and prediction of adult height (TW3 method)","author":"Tanner","year":"2001","edition":"3"},{"key":"10.7717\/peerj.8854\/ref-31","volume-title":"Assessment of skeletal maturity and prediction of adult height (TW2 method), 2nd edition","author":"Tanner","year":"1983"},{"issue":"3","key":"10.7717\/peerj.8854\/ref-32","doi-asserted-by":"publisher","first-page":"771","DOI":"10.1007\/s00414-016-1471-8","article-title":"Automated determination of bone age from hand X-rays at the end of puberty and its applicability for age estimation","volume":"131","author":"Thodberg","year":"2017","journal-title":"International Journal of Legal Medicine"},{"issue":"9","key":"10.7717\/peerj.8854\/ref-33","doi-asserted-by":"publisher","first-page":"1024","DOI":"10.1258\/ar.2012.120443","article-title":"Bone age assessment: automated techniques coming of age?","volume":"54","author":"Van Rijn","year":"2013","journal-title":"Acta Radiologica"},{"issue":"11","key":"10.7717\/peerj.8854\/ref-34","first-page":"851","article-title":"Reference values of differences between TW3-C RUS and TW3-C carpal bone ages of children from five cities of China","volume":"46","author":"Zhang","year":"2008","journal-title":"Zhonghua Er Ke Za Zhi"}],"container-title":["PeerJ"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/peerj.com\/articles\/8854.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/peerj.com\/articles\/8854.xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/peerj.com\/articles\/8854.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/peerj.com\/articles\/8854.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2020,4,1]],"date-time":"2020-04-01T05:07:49Z","timestamp":1585717669000},"score":1,"resource":{"primary":{"URL":"https:\/\/peerj.com\/articles\/8854"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,4,1]]},"references-count":34,"alternative-id":["10.7717\/peerj.8854"],"URL":"https:\/\/doi.org\/10.7717\/peerj.8854","archive":["CLOCKSS","LOCKSS","Portico"],"relation":{"has-review":[{"id-type":"doi","id":"10.7287\/peerj.8854v0.1\/reviews\/2","asserted-by":"object"},{"id-type":"doi","id":"10.7287\/peerj.8854v0.1\/reviews\/1","asserted-by":"object"},{"id-type":"doi","id":"10.7287\/peerj.8854v0.2\/reviews\/1","asserted-by":"object"}]},"ISSN":["2167-8359"],"issn-type":[{"value":"2167-8359","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,4,1]]},"article-number":"e8854"}}