{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,3]],"date-time":"2026-05-03T23:46:45Z","timestamp":1777852005264,"version":"3.51.4"},"reference-count":26,"publisher":"SAGE Publications","issue":"3","license":[{"start":{"date-parts":[[2025,7,1]],"date-time":"2025-07-01T00:00:00Z","timestamp":1751328000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"},{"start":{"date-parts":[[2025,7,1]],"date-time":"2025-07-01T00:00:00Z","timestamp":1751328000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"funder":[{"name":"National Institute of General Medical Sciences of the National Institutes of Health","award":["P20 GM121342"],"award-info":[{"award-number":["P20 GM121342"]}]},{"DOI":"10.13039\/100000092","name":"National Library of Medicine","doi-asserted-by":"crossref","award":["R15LM012941"],"award-info":[{"award-number":["R15LM012941"]}],"id":[{"id":"10.13039\/100000092","id-type":"DOI","asserted-by":"crossref"}]},{"name":"NIH\/NLM T15 SC BIDS4Health research training program","award":["T15LM013977"],"award-info":[{"award-number":["T15LM013977"]}]}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Health Informatics J"],"published-print":{"date-parts":[[2025,7]]},"abstract":"<jats:p>\n                    <jats:bold>Objectives:<\/jats:bold>\n                    To obtain insights about inexperienced clinical researchers\u2019 hypothesis quality and associated factors. The findings inform the development of informatics tools to aid the hypothesis generation process.\n                    <jats:bold>Methods:<\/jats:bold>\n                    We analyzed an existing dataset collected through a randomized controlled study, focusing on individual hypotheses and participants. We invited clinical researchers to analyze datasets and develop hypotheses using the think-aloud method. Participants\u2019 screen activity and audio were recorded, transcribed, coded, and analyzed to measure the time and cognitive events (a granular unit of thought processes used by the participants while generating hypotheses). Hypotheses were rated by an expert panel. Here we analyzed (1) the top 5-rated hypotheses, (2) the bottom 5-rated hypotheses, and (3) the participants who generated them.\n                    <jats:bold>Results:<\/jats:bold>\n                    Participants who generated the top 5-rated hypotheses utilized fewer cognitive events and a shorter range of time per hypothesis; their hypotheses presented a higher valid rate, and they were more experienced.\n                    <jats:bold>Conclusion:<\/jats:bold>\n                    Having more experience is positively associated with higher quality and valid rates of the generated hypotheses. The higher-rated hypotheses seem to be positively associated with slightly fewer cognitive events and shorter time. The effect may not be linear. These analyses provide evidence for customized study designs or tool development based on these associated factors.\n                  <\/jats:p>","DOI":"10.1177\/14604582251353587","type":"journal-article","created":{"date-parts":[[2025,8,6]],"date-time":"2025-08-06T17:34:19Z","timestamp":1754501659000},"update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":2,"title":["A secondary data analysis on hypotheses generated by inexperienced clinical researchers: Cases from a randomized controlled study"],"prefix":"10.1177","volume":"31","author":[{"given":"Mytchell A.","family":"Ernst","sequence":"first","affiliation":[{"name":"Department of Public Health Sciences, College of Behavioral, Social and Health Sciences, Clemson University, Clemson, SC, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Brooke N.","family":"Draghi","sequence":"additional","affiliation":[{"name":"Department of Public Health Sciences, College of Behavioral, Social and Health Sciences, Clemson University, Clemson, SC, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4101-1622","authenticated-orcid":false,"given":"James J.","family":"Cimino","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics and Data Science, Heersink School of Medicine, The University of Alabama at Birmingham, AL, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Vimla L.","family":"Patel","sequence":"additional","affiliation":[{"name":"Cognitive Studies in Medicine and Public Health, The New York Academy of Medicine, New York City, NY, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yuchun","family":"Zhou","sequence":"additional","affiliation":[{"name":"Patton College of Education, Ohio University, Athens, OH, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jay H.","family":"Shubrook","sequence":"additional","affiliation":[{"name":"Department of Clinical Sciences and Community Health, Touro University California College of Osteopathic Medicine, Vallejo, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sonsoles","family":"De Lacalle","sequence":"additional","affiliation":[{"name":"Department of Health Science, California State University Channel Islands, Camarillo, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Aneesa","family":"Weaver","sequence":"additional","affiliation":[{"name":"Department of Public Health Sciences, College of Behavioral, Social and Health Sciences, Clemson University, Clemson, SC, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chang","family":"Liu","sequence":"additional","affiliation":[{"name":"Russ College of Engineering and Technology, Ohio University, Athens, OH, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1916-4588","authenticated-orcid":false,"given":"Xia","family":"Jing","sequence":"additional","affiliation":[{"name":"Department of Public Health Sciences, College of Behavioral, Social and Health Sciences, Clemson University, Clemson, SC, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"179","published-online":{"date-parts":[[2025,8,6]]},"reference":[{"key":"e_1_3_8_2_2","doi-asserted-by":"publisher","DOI":"10.1177\/0272989X9301300305"},{"key":"e_1_3_8_3_2","doi-asserted-by":"publisher","DOI":"10.1207\/s15516709cog1001_4"},{"key":"e_1_3_8_4_2","doi-asserted-by":"publisher","DOI":"10.1177\/0272989X9001000107"},{"key":"e_1_3_8_5_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4471-5490-7"},{"key":"e_1_3_8_6_2","doi-asserted-by":"publisher","DOI":"10.1207\/s15516709cog1201_1"},{"key":"e_1_3_8_7_2","doi-asserted-by":"crossref","unstructured":"Spangler S Wilkins AD Bachman BJ et al. Automated hypothesis generation based on mining scientific literature. In: Proceedings of the 20th ACM SIGKDD international conference on knowledge discovery and data mining New York NY 24 - 27 August 2014 Association for Computing Machinery 2014 pp. 1877\u20131886.","DOI":"10.1145\/2623330.2623667"},{"key":"e_1_3_8_8_2","doi-asserted-by":"publisher","DOI":"10.1145\/3097983.3098057"},{"key":"e_1_3_8_9_2","first-page":"365","volume-title":"The nature of insight","author":"Dunbar K","year":"1995","unstructured":"Dunbar K. How scientists really reason: scientific reasoning in real-world laboratories. The nature of insight. The MIT Press, 1995, pp. 365\u2013395."},{"key":"e_1_3_8_10_2","doi-asserted-by":"publisher","DOI":"10.7551\/mitpress\/1251.003.0013"},{"key":"e_1_3_8_11_2","doi-asserted-by":"publisher","DOI":"10.1093\/oxfordhb\/9780199734689.013.0013"},{"key":"e_1_3_8_12_2","volume-title":"The cambridge handbook of thinking and reasoning","author":"Holyoak KJ","year":"2005","unstructured":"Holyoak KJ, Morrison RG. The cambridge handbook of thinking and reasoning. Cambridge University Press, 2005."},{"key":"e_1_3_8_13_2","first-page":"561","article-title":"Using think-aloud protocol to identify cognitive events while generating data-driven scientific hypotheses by inexperienced clinical researchers","volume":"2024","author":"Jing X","year":"2024","unstructured":"Jing X, Draghi BN, Ernst MA, et al. Using think-aloud protocol to identify cognitive events while generating data-driven scientific hypotheses by inexperienced clinical researchers. AMIA Annu Symp Proc 2024; 2024: 561\u2013570, eCollection. https:\/\/pmc.ncbi.nlm.nih.gov\/articles\/PMC12099392\/","journal-title":"AMIA Annu Symp Proc"},{"key":"e_1_3_8_14_2","doi-asserted-by":"publisher","DOI":"10.2196\/39414"},{"key":"e_1_3_8_15_2","doi-asserted-by":"publisher","DOI":"10.1017\/cts.2023.708"},{"key":"e_1_3_8_16_2","doi-asserted-by":"publisher","DOI":"10.2196\/44644"},{"key":"e_1_3_8_17_2","doi-asserted-by":"publisher","DOI":"10.1186\/s12874-025-02460-1"},{"key":"e_1_3_8_18_2","doi-asserted-by":"publisher","DOI":"10.18103\/mra.v12i2.513"},{"key":"e_1_3_8_19_2","doi-asserted-by":"publisher","DOI":"10.1016\/S0079-7421(08)60411-9"},{"key":"e_1_3_8_20_2","doi-asserted-by":"publisher","DOI":"10.1023\/A:1009788531273"},{"key":"e_1_3_8_21_2","unstructured":"Draghi B Ernst M Patel V et al. Number of scientific hypotheses and time needed in a 2-hour study session among inexperienced clinical researchers\u2014preliminary results. In: AMIA summit 2023 Seattle 18-21 Mar 2023; 13-16 Mar 2023 818."},{"key":"e_1_3_8_22_2","unstructured":"Jing X Zhou YC Cimino JJ et al. Development and preliminary validation of metrics to evaluate data-driven clinical research hypotheses. In: AMIA Washington DC 5-9 Nov 2022 pp. 1363\u20131364."},{"key":"e_1_3_8_23_2","doi-asserted-by":"publisher","DOI":"10.1037\/a0032148"},{"key":"e_1_3_8_24_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.cognition.2018.04.017"},{"key":"e_1_3_8_25_2","doi-asserted-by":"publisher","DOI":"10.1006\/ceps.1998.1000"},{"key":"e_1_3_8_26_2","doi-asserted-by":"publisher","DOI":"10.7551\/mitpress\/5657.001.0001"},{"key":"e_1_3_8_27_2","first-page":"287","volume-title":"The Nature of Expertise","author":"Groen GJ","year":"1988","unstructured":"Groen GJ, Patel VL. Relationship between comprehension and reasoning in medical expertise. In: Chi M, Glaser R, Farr M (eds). The Nature of Expertise. Lawrence Erlbaum, 1988, pp. 287\u2013310."}],"container-title":["Health Informatics Journal"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/14604582251353587","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/14604582251353587","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/14604582251353587","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T22:28:56Z","timestamp":1777501736000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/14604582251353587"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,7]]},"references-count":26,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2025,7]]}},"alternative-id":["10.1177\/14604582251353587"],"URL":"https:\/\/doi.org\/10.1177\/14604582251353587","relation":{},"ISSN":["1460-4582","1741-2811"],"issn-type":[{"value":"1460-4582","type":"print"},{"value":"1741-2811","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,7]]},"article-number":"14604582251353587"}}