{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,30]],"date-time":"2026-04-30T18:28:51Z","timestamp":1777573731992,"version":"3.51.4"},"reference-count":26,"publisher":"Oxford University Press (OUP)","issue":"7","license":[{"start":{"date-parts":[[2024,5,9]],"date-time":"2024-05-09T00:00:00Z","timestamp":1715212800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/pages\/standard-publication-reuse-rights"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2024,6,20]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Objective<\/jats:title>\n                    <jats:p>ModelDB (https:\/\/modeldb.science) is a discovery platform for computational neuroscience, containing over 1850 published model codes with standardized metadata. These codes were mainly supplied from unsolicited model author submissions, but this approach is inherently limited. For example, we estimate we have captured only around one-third of NEURON models, the most common type of models in ModelDB. To more completely characterize the state of computational neuroscience modeling work, we aim to identify works containing results derived from computational neuroscience approaches and their standardized associated metadata (eg, cell types, research topics).<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Materials and Methods<\/jats:title>\n                    <jats:p>Known computational neuroscience work from ModelDB and identified neuroscience work queried from PubMed were included in our study. After pre-screening with SPECTER2 (a free document embedding method), GPT-3.5, and GPT-4 were used to identify likely computational neuroscience work and relevant metadata.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>SPECTER2, GPT-4, and GPT-3.5 demonstrated varied but high abilities in identification of computational neuroscience work. GPT-4 achieved 96.9% accuracy and GPT-3.5 improved from 54.2% to 85.5% through instruction-tuning and Chain of Thought. GPT-4 also showed high potential in identifying relevant metadata annotations.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Discussion<\/jats:title>\n                    <jats:p>Accuracy in identification and extraction might further be improved by dealing with ambiguity of what are computational elements, including more information from papers (eg, Methods section), improving prompts, etc.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion<\/jats:title>\n                    <jats:p>Natural language processing and large language model techniques can be added to ModelDB to facilitate further model discovery, and will contribute to a more standardized and comprehensive framework for establishing domain-specific resources.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1093\/jamia\/ocae097","type":"journal-article","created":{"date-parts":[[2024,4,17]],"date-time":"2024-04-17T20:56:25Z","timestamp":1713387385000},"page":"1463-1470","source":"Crossref","is-referenced-by-count":4,"title":["Automating literature screening and curation with applications to computational neuroscience"],"prefix":"10.1093","volume":"31","author":[{"given":"Ziqing","family":"Ji","sequence":"first","affiliation":[{"name":"Biostatistics, Yale School of Public Health, Yale University , New Haven, CT 06510, United States"}]},{"given":"Siyan","family":"Guo","sequence":"additional","affiliation":[{"name":"Biostatistics, Yale School of Public Health, Yale University , New Haven, CT 06510, United States"}]},{"given":"Yujie","family":"Qiao","sequence":"additional","affiliation":[{"name":"Biostatistics, Yale School of Public Health, Yale University , New Haven, CT 06510, United States"},{"name":"Integrative Genomics, Princeton University , Princeton, NJ 08540, United States"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6394-3127","authenticated-orcid":false,"given":"Robert A","family":"McDougal","sequence":"additional","affiliation":[{"name":"Biostatistics, Yale School of Public Health, Yale University , New Haven, CT 06510, United States"},{"name":"Biomedical Informatics and Data Science, Yale School of Medicine, Yale University , New Haven, CT 06510, United States"},{"name":"Program in Computational Biology and Bioinformatics, Yale University , New Haven, CT 06510, United States"},{"name":"Wu Tsai Institute, Yale University , New Haven, CT 06510, United States"}]}],"member":"286","published-online":{"date-parts":[[2024,5,9]]},"reference":[{"issue":"10","key":"2024062007512112800_ocae097-B1","doi-asserted-by":"crossref","first-page":"78","DOI":"10.1145\/2629489","article-title":"Wikidata: a free collaborative knowledgebase","volume":"57","author":"Vrande\u010di\u0107","year":"2014","journal-title":"Commun ACM"},{"key":"2024062007512112800_ocae097-B2","first-page":"D36","article-title":"GenBank","volume":"41(Database issue)","author":"Benson","year":"2013","journal-title":"Nucleic Acids Res"},{"issue":"35","key":"2024062007512112800_ocae097-B3","doi-asserted-by":"crossref","first-page":"9247","DOI":"10.1523\/JNEUROSCI.2055-07.2007","article-title":"NeuroMorpho.Org: a central resource for neuronal morphologies","volume":"27","author":"Ascoli","year":"2007","journal-title":"J Neurosci"},{"issue":"10","key":"2024062007512112800_ocae097-B4","doi-asserted-by":"crossref","first-page":"e1002275","DOI":"10.1371\/journal.pbio.1002275","article-title":"Sharing neuron data: carrots, sticks, and digital records","volume":"13","author":"Ascoli","year":"2015","journal-title":"PLoS Biol"},{"issue":"10","key":"2024062007512112800_ocae097-B5","doi-asserted-by":"crossref","first-page":"2021","DOI":"10.1109\/TBME.2016.2539602","article-title":"Reproducibility in computational neuroscience models and simulations","volume":"63","author":"McDougal","year":"2016","journal-title":"IEEE Trans Biomed Eng"},{"key":"2024062007512112800_ocae097-B6","doi-asserted-by":"crossref","first-page":"23","DOI":"10.3389\/fninf.2020.00023","article-title":"Editorial: reproducibility and rigour in computational neuroscience","volume":"14","author":"Crook","year":"2020","journal-title":"Front Neuroinform"},{"issue":"1","key":"2024062007512112800_ocae097-B7","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1007\/s12021-020-09509-0","article-title":"A standards organization for open and FAIR neuroscience: the international neuroinformatics coordinating facility","volume":"20","author":"Abrams","year":"2022","journal-title":"Neuroinformatics"},{"issue":"2","key":"2024062007512112800_ocae097-B8","doi-asserted-by":"crossref","first-page":"507","DOI":"10.1007\/s12021-021-09557-0","article-title":"Is neuroscience FAIR? a call for collaborative standardisation of neuroscience data","volume":"20","author":"Poline","year":"2022","journal-title":"Neuroinformatics"},{"issue":"3","key":"2024062007512112800_ocae097-B9","doi-asserted-by":"crossref","first-page":"361","DOI":"10.1007\/s12021-018-9403-z","article-title":"Automated metadata suggestion during repository submission","volume":"17","author":"McDougal","year":"2019","journal-title":"Neuroinformatics"},{"issue":"1","key":"2024062007512112800_ocae097-B10","doi-asserted-by":"crossref","first-page":"26","DOI":"10.1186\/s40708-022-00174-4","article-title":"Assisted neuroscience knowledge extraction via machine learning applied to neural reconstruction metadata on NeuroMorpho.Org","volume":"9","author":"Bijari","year":"2022","journal-title":"Brain Inform"},{"issue":"1","key":"2024062007512112800_ocae097-B11","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s10827-016-0623-7","article-title":"Twenty years of ModelDB and beyond: building essential modeling tools for the future of neuroscience","volume":"42","author":"McDougal","year":"2017","journal-title":"J Comput Neurosci"},{"key":"2024062007512112800_ocae097-B12","doi-asserted-by":"crossref","first-page":"5548","DOI":"10.18653\/v1\/2023.emnlp-main.338","volume-title":"Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing","author":"Singh","year":"2023"},{"key":"2024062007512112800_ocae097-B13","author":"Devlin"},{"key":"2024062007512112800_ocae097-B14","author":"Wei"},{"key":"2024062007512112800_ocae097-B15","doi-asserted-by":"crossref","first-page":"105692","DOI":"10.1016\/j.nbd.2022.105692","article-title":"Dopamine depletion can be predicted by the aperiodic component of subthalamic local field potentials","volume":"168","author":"Kim","year":"2022","journal-title":"Neurobiol Dis"},{"issue":"3","key":"2024062007512112800_ocae097-B16","doi-asserted-by":"crossref","first-page":"175","DOI":"10.1007\/s12021-008-9032-z","article-title":"The NIFSTD and BIRNLex vocabularies: building comprehensive ontologies for neuroscience","volume":"6","author":"Bug","year":"2008","journal-title":"Neuroinformatics"},{"issue":"1","key":"2024062007512112800_ocae097-B17","doi-asserted-by":"crossref","first-page":"101","DOI":"10.1007\/s12021-022-09598-z","article-title":"EBRAINS live papers\u2014interactive resource sheets for computational studies in neuroscience","volume":"21","author":"Appukuttan","year":"2023","journal-title":"Neuroinformatics"},{"issue":"1","key":"2024062007512112800_ocae097-B18","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1007\/s12021-021-09522-x","article-title":"Correction to: a standards organization for open and FAIR neuroscience: the international neuroinformatics coordinating facility","volume":"20","author":"Abrams","year":"2022","journal-title":"Neuroinformatics"},{"issue":"1","key":"2024062007512112800_ocae097-B19","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s40708-016-0053-3","article-title":"Name-calling in the hippocampus (and beyond): coming to terms with neuron types and properties","volume":"4","author":"Hamilton","year":"2017","journal-title":"Brain Inform"},{"key":"2024062007512112800_ocae097-B20","doi-asserted-by":"crossref","first-page":"25","DOI":"10.3389\/fnana.2019.00025","article-title":"Neuron names: a gene- and property-based name format, with special reference to cortical neurons","volume":"13","author":"Shepherd","year":"2019","journal-title":"Front Neuroanat"},{"key":"2024062007512112800_ocae097-B21","doi-asserted-by":"crossref","first-page":"46","DOI":"10.3389\/fninf.2017.00046","article-title":"Software for brain network simulations: a comparative study","volume":"11","author":"Tikidji-Hamburyan","year":"2017","journal-title":"Front Neuroinform"},{"key":"2024062007512112800_ocae097-B22","first-page":"16","article-title":"Abnormal excitability of oblique dendrites implicated in early Alzheimer\u2019s: a computational study","volume":"4","author":"Morse","year":"2010","journal-title":"Front Neural Circuits"},{"issue":"4871","key":"2024062007512112800_ocae097-B23","doi-asserted-by":"crossref","first-page":"1299","DOI":"10.1126\/science.3045969","article-title":"Computational neuroscience","volume":"241","author":"Sejnowski","year":"1988","journal-title":"Science"},{"key":"2024062007512112800_ocae097-B24","first-page":"70","volume-title":"Proceedings of the Fourteenth Conference on Computational Natural Language Learning\u2014Shared Task","author":"Kilicoglu","year":"2010"},{"issue":"3","key":"2024062007512112800_ocae097-B25","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3386252","article-title":"Generalizing from a few examples: a survey on few-shot learning","volume":"53","author":"Wang","year":"2020","journal-title":"ACM Comput Surv"},{"key":"2024062007512112800_ocae097-B26","author":"Howard","year":"2018"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/31\/7\/1463\/58243708\/ocae097.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/31\/7\/1463\/58243708\/ocae097.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,6,20]],"date-time":"2024-06-20T03:53:43Z","timestamp":1718855623000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/31\/7\/1463\/7667646"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,5,9]]},"references-count":26,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2024,5,9]]},"published-print":{"date-parts":[[2024,6,20]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocae097","relation":{"has-preprint":[{"id-type":"doi","id":"10.1101\/2023.12.15.571963","asserted-by":"object"}]},"ISSN":["1067-5027","1527-974X"],"issn-type":[{"value":"1067-5027","type":"print"},{"value":"1527-974X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2024,7]]},"published":{"date-parts":[[2024,5,9]]}}}