{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,7]],"date-time":"2026-07-07T22:38:08Z","timestamp":1783463888627,"version":"3.55.0"},"reference-count":23,"publisher":"FapUNIFESP (SciELO)","issue":"5","license":[{"start":{"date-parts":[[2023,9,1]],"date-time":"2023-09-01T00:00:00Z","timestamp":1693526400000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2023,9,1]],"date-time":"2023-09-01T00:00:00Z","timestamp":1693526400000},"content-version":"am","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2023,9,1]],"date-time":"2023-09-01T00:00:00Z","timestamp":1693526400000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Radiol Bras"],"abstract":"<jats:p>Abstract  Objective: To validate a deep learning (DL) model for bone age estimation in individuals in the city of S\u00e3o Paulo, comparing it with the Greulich and Pyle method.  Materials and Methods: This was a cross-sectional study of hand and wrist radiographs obtained for the determination of bone age. The manual analysis was performed by an experienced radiologist. The model used was based on a convolutional neural network that placed third in the 2017 Radiological Society of North America challenge. The mean absolute error (MAE) and the root-mean-square error (RMSE) were calculated for the model versus the radiologist, with comparisons by sex, race, and age.  Results: The sample comprised 714 examinations. There was a correlation between the two methods, with a coefficient of determination of 0.94. The MAE of the predictions was 7.68 months, and the RMSE was 10.27 months. There were no statistically significant differences between sexes or among races (p &gt; 0.05). The algorithm overestimated bone age in younger individuals (p = 0.001).  Conclusion: Our DL algorithm demonstrated potential for estimating bone age in individuals in the city of S\u00e3o Paulo, regardless of sex and race. However, improvements are needed, particularly in relation to its use in younger patients.<\/jats:p>","DOI":"10.1590\/0100-3984.2023.0056-en","type":"journal-article","created":{"date-parts":[[2023,12,1]],"date-time":"2023-12-01T09:32:04Z","timestamp":1701423124000},"page":"263-268","source":"Crossref","is-referenced-by-count":3,"title":["Validation of a deep learning algorithm for bone age estimation among patients in the city of S\u00e3o Paulo, Brazil"],"prefix":"10.1590","volume":"56","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7292-9017","authenticated-orcid":false,"given":"Augusto Sarquis","family":"Serpa","sequence":"first","affiliation":[{"name":"Escola Paulista de Medicina da Universidade Federal de S\u00e3o Paulo,  Brazil; Dasa,  Brazil"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0002-0655-7494","authenticated-orcid":false,"given":"Abrah\u00e3o","family":"Elias Neto","sequence":"additional","affiliation":[{"name":"Escola Paulista de Medicina da Universidade Federal de S\u00e3o Paulo,  Brazil"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9992-5630","authenticated-orcid":false,"given":"Felipe Campos","family":"Kitamura","sequence":"additional","affiliation":[{"name":"Escola Paulista de Medicina da Universidade Federal de S\u00e3o Paulo,  Brazil; Dasa,  Brazil"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0000-0081-4061","authenticated-orcid":false,"given":"Soraya Silveira","family":"Monteiro","sequence":"additional","affiliation":[{"name":"Escola Paulista de Medicina da Universidade Federal de S\u00e3o Paulo,  Brazil"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4200-2066","authenticated-orcid":false,"given":"Rodrigo","family":"Ragazzini","sequence":"additional","affiliation":[{"name":"Escola Paulista de Medicina da Universidade Federal de S\u00e3o Paulo,  Brazil"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-6556-8866","authenticated-orcid":false,"given":"Gustavo Antunes Rodrigues","family":"Duarte","sequence":"additional","affiliation":[{"name":"Escola Paulista de Medicina da Universidade Federal de S\u00e3o Paulo,  Brazil"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1149-083X","authenticated-orcid":false,"given":"Lucas Andr\u00e9","family":"Caricati","sequence":"additional","affiliation":[{"name":"Escola Paulista de Medicina da Universidade Federal de S\u00e3o Paulo,  Brazil"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0421-0959","authenticated-orcid":false,"given":"Nitamar","family":"Abdala","sequence":"additional","affiliation":[{"name":"Escola Paulista de Medicina da Universidade Federal de S\u00e3o Paulo,  Brazil; Ionic Health,  Brasil"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"530","published-online":{"date-parts":[[2023,9]]},"reference":[{"key":"ref1","doi-asserted-by":"crossref","first-page":"143","DOI":"10.1297\/cpe.24.143","article-title":"Bone age: assessment methods and clinical applications","volume":"24","author":"Satoh M.","year":"2015","journal-title":"Clin Pediatr Endocrinol"},{"key":"ref2","doi-asserted-by":"crossref","first-page":"1269","DOI":"10.1007\/s00247-016-3618-7","article-title":"Bone age assessment practices in infants and older children among Society for Pediatric Radiology members","volume":"46","author":"Breen MA","year":"2016","journal-title":"Pediatr Radiol"},{"key":"ref3","first-page":"53","article-title":"Radiographic atlas of skeletal development of the hand and wrist","volume":"91","author":"Bayer LM.","year":"1959","journal-title":"Calif Med"},{"key":"ref4","doi-asserted-by":"crossref","first-page":"2910","DOI":"10.1007\/s00330-018-5792-5","article-title":"Is the Greulich and Pyle atlas applicable to all ethnicities? A systematic review and meta-analysis","volume":"29","author":"Alshamrani K","year":"2019","journal-title":"Eur Radiol"},{"key":"ref5","doi-asserted-by":"crossref","first-page":"507","DOI":"10.2214\/ajr.176.2.1760507","article-title":"Effect of knowledge of chronologic age on the variability of pediatric bone age determined using the Greulich and Pyle standards","volume":"176","author":"Berst MJ","year":"2001","journal-title":"AJR Am J Roentgenol"},{"key":"ref6","doi-asserted-by":"crossref","first-page":"e0220242","DOI":"10.1371\/journal.pone.0220242","article-title":"Bone age assessment with various machine learning techniques: a systematic literature review and meta-analysis","volume":"14","author":"Dallora AL","year":"2019","journal-title":"PLoS One"},{"key":"ref7","doi-asserted-by":"crossref","first-page":"6388","DOI":"10.1038\/s41598-022-10292-y","article-title":"Accuracy and self-validation of automated bone age determination","volume":"12","author":"Martin DD","year":"2022","journal-title":"Sci Rep"},{"key":"ref8","series-title":"Rio de Janeiro","volume-title":"Censo brasileiro de 2010","year":"2012"},{"key":"ref9","doi-asserted-by":"crossref","first-page":"498","DOI":"10.1148\/radiol.2018180736","article-title":"The RSNA pediatric bone age machine learning challenge","volume":"290","author":"Halabi SS","year":"2019","journal-title":"Radiology"},{"key":"ref10","doi-asserted-by":"crossref","first-page":"79","DOI":"10.3354\/cr030079","article-title":"Advantages of the mean absolute error (MAE) over the root mean square error (RMSE) in assessing average model performance","volume":"30","author":"Willmott CJ","year":"2005","journal-title":"Climate Research"},{"key":"ref11","series-title":"Scotts Valley","volume-title":"Python 3 reference manual","author":"Van Rossum G","year":"2009"},{"key":"ref12","series-title":"Pandas-dev\/pandas: Pandas (v2.0.1)","year":"2023"},{"key":"ref13","doi-asserted-by":"crossref","first-page":"261","DOI":"10.1038\/s41592-019-0686-2","article-title":"SciPy 1.0: fundamental algorithms for scientific computing in Python","volume":"17","author":"Virtanen P","year":"2020","journal-title":"Nat Methods"},{"key":"ref14","doi-asserted-by":"crossref","first-page":"90","DOI":"10.1109\/MCSE.2007.55","article-title":"Matplotlib: a 2D graphics environment","volume":"9","author":"Hunter JD.","year":"2007","journal-title":"Computing in Science & Engineering"},{"key":"ref15","doi-asserted-by":"crossref","first-page":"3021","DOI":"10.21105\/joss.03021","article-title":"Seaborn: statistical data visualization","volume":"6","author":"Waskom ML.","year":"2021","journal-title":"J Open Source Soft"},{"key":"ref16","series-title":"arXiv:1912.01703v1","volume-title":"PyTorch: an imperative style, high-performance deep learning library","author":"Paszke A"},{"key":"ref17","doi-asserted-by":"crossref","first-page":"357","DOI":"10.1038\/s41586-020-2649-2","article-title":"Array programming with NumPy","volume":"585","author":"Harris CR","year":"2020","journal-title":"Nature"},{"key":"ref18","doi-asserted-by":"crossref","first-page":"598","DOI":"10.1007\/s00247-008-1114-4","article-title":"Clinical application of automated Greulich-Pyle bone age determination in children with short stature","volume":"39","author":"Martin DD","year":"2009","journal-title":"Pediatr Radiol"},{"key":"ref19","doi-asserted-by":"crossref","first-page":"1615","DOI":"10.1007\/s00247-013-2744-8","article-title":"Validation of automatic bone age determination in children with congenital adrenal hyperplasia","volume":"43","author":"Martin DD","year":"2013","journal-title":"Pediatr Radiol"},{"key":"ref20","doi-asserted-by":"crossref","first-page":"1009","DOI":"10.1515\/JPEM.2011.420","article-title":"Validation of automatic bone age rating in children with precocious and early puberty","volume":"24","author":"Martin DD","year":"2011","journal-title":"J Pediatr Endocrinol Metab"},{"key":"ref21","doi-asserted-by":"crossref","first-page":"692","DOI":"10.1148\/radiol.2021204021","article-title":"Artificial intelligence algorithm improves radiologist performance in skeletal age assessment: a prospective multicenter randomized controlled trial","volume":"301","author":"Eng DK","year":"2021","journal-title":"Radiology"},{"key":"ref22","series-title":"Rio de Janeiro","volume-title":"Pesquisa nacional por amostra de domic\u00edlios cont\u00ednua","year":"2021"},{"key":"ref23","doi-asserted-by":"crossref","first-page":"580314","DOI":"10.3389\/fped.2021.580314","article-title":"Evaluation of bone age in children: a mini-review","volume":"9","author":"Cavallo F","year":"2021","journal-title":"Front Pediatr"}],"container-title":["Radiologia Brasileira"],"original-title":["Valida\u00e7\u00e3o de algoritmo de aprendizado profundo para detec\u00e7\u00e3o da idade \u00f3ssea em pacientes de S\u00e3o Paulo, Brasil"],"link":[{"URL":"http:\/\/www.scielo.br\/scielo.php?script=sci_pdf&pid=S0100-39842023000500263&tlng=en","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,12,22]],"date-time":"2023-12-22T05:00:32Z","timestamp":1703221232000},"score":1,"resource":{"primary":{"URL":"http:\/\/www.scielo.br\/scielo.php?script=sci_arttext&pid=S0100-39842023000500263&tlng=en"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,9]]},"references-count":23,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2023,9]]}},"alternative-id":["S0100-39842023000500263"],"URL":"https:\/\/doi.org\/10.1590\/0100-3984.2023.0056-en","relation":{"is-translation-of":[{"id-type":"doi","id":"10.1590\/0100-3984.2023.0056","asserted-by":"subject"},{"id-type":"doi","id":"10.1590\/0100-3984.2023.0056","asserted-by":"object"}]},"ISSN":["1678-7099"],"issn-type":[{"value":"1678-7099","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,9]]}}}