{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,29]],"date-time":"2026-09-29T17:58:06Z","timestamp":1790704686727,"version":"4.1.0"},"reference-count":58,"publisher":"JMIR Publications Inc.","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JMIR Med Inform"],"abstract":"<jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>Although Digital Imaging and Communications in Medicine (DICOM) metadata are widely used to manage medical imaging data and support clinical workflows, their suitability as a sole basis for automatic computed tomography (CT) series labeling and characterization is limited. DICOM metadata are frequently inconsistently populated, institution specific, use unregulated private tags, and have variable reliability even within standardized fields. Consequently, automated series selection for downstream AI applications often remains unreliable, necessitating manual curation within clinical workflows.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Objective<\/jats:title>\n                    <jats:p>This study presents Orchestrate, a modular AI framework for automated orchestration of CT imaging data. By integrating a hierarchy of deep learning models, Orchestrate enables pixel-level classification and routing of CT series and accurate metadata-independent identification of anatomical regions, contrast-enhanced series, and reconstruction kernels, supporting seamless downstream AI integration without manual curation.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>Orchestrate combined 3 pretrained models for anatomical regions, landmarks, and body part classification and 4 newly developed You Only Look Once (YOLO) v8\u2013based models to classify contrast enhancement, recognize reconstruction kernels, and infer laterality. Three datasets were used: an internal development dataset comprising 27,418 CT studies for individual model development, an internal framework evaluation dataset comprising 200 CT studies to assess the complete framework under a simulated real-world scenario, and an external dataset from The Cancer Imaging Archive comprising 100 CT studies. For the internal development data, reference standards were derived from complete and unambiguous DICOM metadata following institutional definitions. For the 2 evaluation datasets, 3 radiographers independently established reference standards as DICOM metadata were not assumed to be complete or consistent. Clinical utility was assessed through cohort selection tasks involving 3 predefined target cases, with 3 radiologists reviewing selection accuracy. The interrater agreement was assessed using the Fleiss \u03ba. The model performance was evaluated using F1-scores.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>DICOM metadata were incomplete in the internal framework evaluation dataset and external dataset, with missing rates of 42.9% (413\/963) and 92.9% (105\/113) for contrast enhancement, respectively, and a missing reconstruction kernel information rate of 0.4% (4\/963) in the internal framework evaluation dataset. During model development, individual models achieved macro\u2013F1-scores ranging from 0.982 to 0.989. At the framework level, Orchestrate achieved high classification performance across internal (weighted F1-score ranged from 0.920 to 1.000; macro\u2013F1-score ranged from 0.879 to 1.000) and external (weighted F1-score ranged from 0.946 to 1.000; macro\u2013F1-score ranged from 0.777 to 0.929) cohorts. For clinical use cases, the overall selection accuracy was 97.7% (217\/222).<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>Orchestrate enables automated pixel-based classification, detection, and semantic description of CT series, reducing reliance on manual selection and the risk of inconsistent metadata. By generating standardized semantic content, the framework provides a proof of concept for improving interoperability with clinical systems and supports the reliable, reproducible integration of AI-driven imaging pipelines into clinical workflows.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.2196\/93018","type":"journal-article","created":{"date-parts":[[2026,9,29]],"date-time":"2026-09-29T17:05:07Z","timestamp":1790701507000},"page":"e93018","source":"Crossref","is-referenced-by-count":0,"title":["A Multi-Model, Pixel-Native Framework for Automated Computed Tomography Series Labeling and Characterization: Proof-of-Concept Study"],"prefix":"10.2196","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0009-0003-8557-6665","authenticated-orcid":false,"given":"Yutong","family":"Wen","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8168-8406","authenticated-orcid":false,"given":"Anton Sheahan","family":"Quinsten","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1994-0687","authenticated-orcid":false,"given":"Cynthia Sabrina","family":"Schmidt","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0006-9635-4795","authenticated-orcid":false,"given":"Christian","family":"Bojahr","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0009-8826-3481","authenticated-orcid":false,"given":"Judith","family":"Kohnke","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0005-6074-804X","authenticated-orcid":false,"given":"Kamyar","family":"Arzideh","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0002-2262-2655","authenticated-orcid":false,"given":"Sina","family":"Warmer","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0008-3474-897X","authenticated-orcid":false,"given":"Sebastian","family":"Blex","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0007-9900-4843","authenticated-orcid":false,"given":"Ann-Christin","family":"Jacoby","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0006-5747-5316","authenticated-orcid":false,"given":"Max","family":"Eberts","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-4350-2735","authenticated-orcid":false,"given":"Hanna","family":"Lehmann","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0000-0038-3986","authenticated-orcid":false,"given":"Olivia Barbara","family":"Pollok","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0719-2207","authenticated-orcid":false,"given":"Mathias","family":"Holtkamp","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5376-3154","authenticated-orcid":false,"given":"Luca","family":"Salh\u00f6fer","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5215-7171","authenticated-orcid":false,"given":"Lale","family":"Umutlu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5584-9824","authenticated-orcid":false,"given":"Michael","family":"Forsting","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4843-5911","authenticated-orcid":false,"given":"Johannes","family":"Haubold","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5811-7100","authenticated-orcid":false,"given":"Felix","family":"Nensa","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6987-6041","authenticated-orcid":false,"given":"Katarzyna","family":"Borys","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1760-2342","authenticated-orcid":false,"given":"Ren\u00e9","family":"Hosch","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1010","published-online":{"date-parts":[[2026,9,29]]},"reference":[{"key":"ref1","doi-asserted-by":"publisher","DOI":"10.3174\/ajnr.a3293"},{"key":"ref2","doi-asserted-by":"publisher","DOI":"10.1016\/j.media.2019.02.007"},{"key":"ref3","doi-asserted-by":"publisher","DOI":"10.1016\/j.media.2022.102527"},{"key":"ref4","doi-asserted-by":"publisher","DOI":"10.1109\/JBHI.2020.3002582"},{"key":"ref5","author":"Bencevic, M","year":"2021","journal-title":"2021 International Symposium ELMAR"},{"key":"ref6","first-page":"424","author":"\u00c7i\u00e7ek, \u00d6","year":"2016","journal-title":"Medical Image Computing and Computer-Assisted Intervention \u2013 MICCAI 2016"},{"key":"ref7","doi-asserted-by":"publisher","DOI":"10.1097\/RLI.0000000000000755"},{"key":"ref8","doi-asserted-by":"publisher","DOI":"10.1016\/j.acra.2019.07.006"},{"key":"ref9","doi-asserted-by":"publisher","DOI":"10.1186\/s12911-024-02527-x"},{"key":"ref10","doi-asserted-by":"publisher","DOI":"10.1002\/mp.14131"},{"key":"ref11","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-022-20108-8"},{"key":"ref12","doi-asserted-by":"publisher","DOI":"10.1148\/ryai.230024"},{"key":"ref13","doi-asserted-by":"publisher","DOI":"10.1097\/RLI.0000000000001040"},{"key":"ref14","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-024-62431-2"},{"key":"ref15","doi-asserted-by":"publisher","DOI":"10.1007\/s00330-020-07147-3"},{"key":"ref16","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-022-20419-w"},{"key":"ref17","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-022-17611-3"},{"key":"ref18","doi-asserted-by":"publisher","DOI":"10.3390\/cancers13246186"},{"key":"ref19","doi-asserted-by":"publisher","DOI":"10.1093\/noajnl\/vdae022"},{"key":"ref20","doi-asserted-by":"publisher","DOI":"10.1093\/noajnl\/vdae225"},{"key":"ref21","doi-asserted-by":"publisher","DOI":"10.1097\/RLI.0000000000000867"},{"key":"ref22","doi-asserted-by":"publisher","DOI":"10.1002\/jmri.25970"},{"key":"ref23","doi-asserted-by":"publisher","DOI":"10.3174\/ajnr.A8107"},{"key":"ref24","doi-asserted-by":"publisher","DOI":"10.1186\/s13244-023-01586-4"},{"key":"ref25","doi-asserted-by":"publisher","DOI":"10.1055\/a-2521-4250"},{"key":"ref26","doi-asserted-by":"publisher","DOI":"10.1148\/ryai.2019180031"},{"key":"ref27","doi-asserted-by":"publisher","DOI":"10.1186\/s13244-023-01541-3"},{"key":"ref28","doi-asserted-by":"publisher","DOI":"10.3389\/fninf.2012.00008"},{"key":"ref29","unstructured":"Convolution kernel attributeInnolitics2025-08-25https:\/\/dicom.innolitics.com\/ciods\/ct-image\/ct-image\/00181210"},{"key":"ref30","doi-asserted-by":"publisher","DOI":"10.1007\/s10278-019-00308-x"},{"key":"ref31","first-page":"139","author":"Zhou, B","year":"2019","journal-title":"Domain Adaptation and Representation Transfer and Medical Image Learning with Less Labels and Imperfect Data"},{"key":"ref32","doi-asserted-by":"publisher","DOI":"10.1148\/ryai.210285"},{"key":"ref33","doi-asserted-by":"publisher","DOI":"10.1109\/TMI.2003.815073"},{"key":"ref34","author":"Riemer, A","year":"2025","journal-title":"Computertomografie f\u00fcr MTR\/RT: Inklusive Herz-CT"},{"key":"ref35","doi-asserted-by":"publisher","DOI":"10.1117\/12.3006608"},{"key":"ref36","doi-asserted-by":"publisher","DOI":"10.1007\/s00330-023-09525-z"},{"key":"ref37","unstructured":"SmithKClarkKBennettWNolanTKirbyJWolfsbergerMMoultonJVendtBFreymannJData from CT colonography (ACRIN 6664) (version 2) [dataset]The Cancer Imaging Archive20132026-09-16https:\/\/doi.org\/10.7937\/k9\/tcia.2015.nwtesay1"},{"key":"ref38","author":"Redmon, J","year":"2016","journal-title":"2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)"},{"key":"ref39","unstructured":"Ultralytics YOLO27GitHub2025-08-23https:\/\/github.com\/ultralytics\/ultralytics"},{"key":"ref40","doi-asserted-by":"publisher","DOI":"10.1007\/s00330-026-12830-y"},{"key":"ref41","unstructured":"WenYFigure 1. Schematic overview of the complete Orchestrate frameworkBioRender2026-09-22https:\/\/app.biorender.com\/citation\/6ab127132443472779e64865"},{"key":"ref42","first-page":"92","author":"Seabold, S","year":"2010","journal-title":"Proceedings of the 9th Python in Science Conference 2010 (SciPy 2010)"},{"key":"ref43","doi-asserted-by":"publisher","DOI":"10.5812\/ijem.3505"},{"key":"ref44","doi-asserted-by":"publisher","DOI":"10.1080\/01621459.1954.10501232"},{"key":"ref45","doi-asserted-by":"publisher","DOI":"10.1038\/s41592-019-0686-2"},{"key":"ref46","doi-asserted-by":"publisher","DOI":"10.5555\/1953048.2078195"},{"key":"ref47","unstructured":"Full document previewAmerican College of Radiology2025-11-25https:\/\/gravitas.acr.org\/PPTS\/GetDocumentView?docId=13"},{"key":"ref48","doi-asserted-by":"publisher","DOI":"10.1007\/s10278-026-01865-8"},{"key":"ref49","doi-asserted-by":"publisher","DOI":"10.1097\/RLI.0000000000001071"},{"key":"ref50","doi-asserted-by":"publisher","DOI":"10.1046\/j.1440-1673.2000.00797.x"},{"key":"ref51","doi-asserted-by":"publisher","DOI":"10.3390\/tomography9050145"},{"key":"ref52","author":"Gueld, MO","year":"2002","journal-title":"Medical Imaging 2002: PACS and Integrated Medical Information Systems: Design and Evaluation"},{"key":"ref53","unstructured":"Overview - FHIR v4.0.1HL7 FHIR2024-10-02https:\/\/hl7.org\/fhir\/R4\/overview.html"},{"key":"ref54","unstructured":"What is SNOMED CT?SNOMED International2026-09-22https:\/\/www.snomed.org\/what-is-snomed-ct"},{"key":"ref55","doi-asserted-by":"publisher","DOI":"10.2174\/1573405619666230123105057"},{"key":"ref56","doi-asserted-by":"publisher","DOI":"10.1097\/RLI.0000000000001236"},{"key":"ref57","doi-asserted-by":"publisher","DOI":"10.32604\/cmc.2025.067994"},{"key":"ref58","unstructured":"UMEssen\/OrchestrateGitHub2026-02-05https:\/\/github.com\/UMEssen\/Orchestrate"}],"container-title":["JMIR Medical Informatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/medinform.jmir.org\/2026\/1\/e93018","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,9,29]],"date-time":"2026-09-29T17:05:10Z","timestamp":1790701510000},"score":1,"resource":{"primary":{"URL":"https:\/\/medinform.jmir.org\/2026\/1\/e93018"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,9,29]]},"references-count":58,"URL":"https:\/\/doi.org\/10.2196\/93018","relation":{"has-preprint":[{"id-type":"doi","id":"10.2196\/preprints.93018","asserted-by":"object"}]},"ISSN":["2291-9694"],"issn-type":[{"value":"2291-9694","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,9,29]]}}}