{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,9,21]],"date-time":"2025-09-21T17:40:09Z","timestamp":1758476409640},"reference-count":59,"publisher":"Wiley","issue":"1","license":[{"start":{"date-parts":[[2017,6,19]],"date-time":"2017-06-19T00:00:00Z","timestamp":1497830400000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/onlinelibrary.wiley.com\/termsAndConditions#vor"}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["PM&amp;R"],"published-print":{"date-parts":[[2018,1]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec><jats:title>Background<\/jats:title><jats:p>Several barriers exist in the recruitment of individuals with a history of mild traumatic brain injury (mTBI). The current study is the first to examine whether crowdsourcing, which has been used in other clinical populations, is useful in the recruitment of those with mTBI.<\/jats:p><\/jats:sec><jats:sec><jats:title>Objective<\/jats:title><jats:p>To examine whether Amazon's Mechanical Turk (MTurk), an online crowdsourcing platform, is a useful tool in the recruitment of individuals with a history of mTBI and to examine the injury and psychological characteristics of individuals who report a history of mTBI.<\/jats:p><\/jats:sec><jats:sec><jats:title>Design<\/jats:title><jats:p>Retrospective, cross\u2010sectional study.<\/jats:p><\/jats:sec><jats:sec><jats:title>Setting<\/jats:title><jats:p>Online.<\/jats:p><\/jats:sec><jats:sec><jats:title>Participants<\/jats:title><jats:p>A total of 468 MTurk workers (215 who reported mTBI history on the screener, 253 who did not).<\/jats:p><\/jats:sec><jats:sec><jats:title>Methods<\/jats:title><jats:p>Comparison of MTurk participants (\u201cworkers\u201d) who report a history of mTBI on a one\u2010item screener and\/or a more comprehensive mTBI assessment tool (ie, the Ohio State University Traumatic Brain Injury Identification Method [OSU TBI\u2010ID]) with workers who do not report mTBI history.<\/jats:p><\/jats:sec><jats:sec><jats:title>Main Outcome Measures<\/jats:title><jats:p>Prevalence rates of mTBI in the MTurk sample (one\u2010item screener and\/or OSU TBI\u2010ID), associations between self\u2010reported mTBI with history of psychological disorders and current psychological symptoms (ie, selected Patient\u2010Reported Outcomes Measurement Information System scales).<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>Of workers who reported a history of mTBI on the screener, 169 (79%) met mTBI criteria on the OSU TBI\u2010ID. Compared with those who denied history of mTBI on both the screener and OSU TBI\u2010ID, workers who reported a history of mTBI on both measures were more likely to have a history of diagnosed depression (<jats:italic>P<\/jats:italic> = .008), anxiety (<jats:italic>P<\/jats:italic> = .007) or attention deficit\u2010hyperactivity disorder (<jats:italic>P<\/jats:italic> = .04), and were more likely to currently experience cognitive (<jats:italic>P<\/jats:italic> = .01) and sleep disorder symptoms (<jats:italic>P<\/jats:italic> = .003).<\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusions<\/jats:title><jats:p>Workers recruited via MTurk with history of mTBI show similar rates of psychological disorder history and current symptoms to samples recruited via noncrowdsourcing methods in previous studies. MTurk may be a useful recruitment tool in the mTBI population and should be used in future studies of outcomes after mTBI.<\/jats:p><\/jats:sec><jats:sec><jats:title>Level of Evidence<\/jats:title><jats:p>III<\/jats:p><\/jats:sec>","DOI":"10.1016\/j.pmrj.2017.06.010","type":"journal-article","created":{"date-parts":[[2017,6,20]],"date-time":"2017-06-20T08:30:17Z","timestamp":1497947417000},"page":"45-55","update-policy":"http:\/\/dx.doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["Characteristics of a Mild Traumatic Brain Injury Sample Recruited Using Amazon's Mechanical Turk"],"prefix":"10.1002","volume":"10","author":[{"given":"John","family":"Bernstein","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Matthew","family":"Calamia","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"311","published-online":{"date-parts":[[2017,6,19]]},"reference":[{"key":"e_1_2_6_2_2","doi-asserted-by":"publisher","DOI":"10.1097\/00001199-200611000-00009"},{"key":"e_1_2_6_3_2","volume-title":"Traumatic brain injury in the United States","author":"Faul M.","year":"2010"},{"key":"e_1_2_6_4_2","doi-asserted-by":"publisher","DOI":"10.1227\/01.NEU.0000175725.75780.DD"},{"key":"e_1_2_6_5_2","doi-asserted-by":"publisher","DOI":"10.1037\/neu0000037"},{"key":"e_1_2_6_6_2","doi-asserted-by":"crossref","first-page":"149","DOI":"10.1080\/026990501458380","article-title":"Misconceptions about brain injury among the general public and non\u2010expert health professionals: An exploratory study","volume":"15","author":"Swift T.L.","year":"2001","journal-title":"Brain injury"},{"key":"e_1_2_6_7_2","doi-asserted-by":"publisher","DOI":"10.3109\/02699052.2011.579935"},{"key":"e_1_2_6_8_2","doi-asserted-by":"publisher","DOI":"10.1542\/peds.2008-2720"},{"key":"e_1_2_6_9_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.pediatrneurol.2010.05.012"},{"key":"e_1_2_6_10_2","first-page":"S129","article-title":"The influence of diagnostic terminology on parents' perception of severity following pediatric mild traumatic brain injury or concussion","volume":"9","author":"Raugust J.","year":"2013","journal-title":"PM R"},{"key":"e_1_2_6_11_2","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0131618"},{"key":"e_1_2_6_12_2","doi-asserted-by":"publisher","DOI":"10.2147\/OAJSM.S58005"},{"key":"e_1_2_6_13_2","doi-asserted-by":"publisher","DOI":"10.1080\/16501960410023859"},{"key":"e_1_2_6_14_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jemermed.2005.01.020"},{"issue":"1","key":"e_1_2_6_15_2","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1176\/ajp.153.1.7","article-title":"Money matters: A meta\u2010analytic review of the effects","volume":"153","author":"Binder L.M.","year":"1996","journal-title":"Am J Psychiatry"},{"key":"e_1_2_6_16_2","doi-asserted-by":"publisher","DOI":"10.1080\/02699050601111419"},{"key":"e_1_2_6_17_2","doi-asserted-by":"publisher","DOI":"10.1080\/16501960410023732"},{"key":"e_1_2_6_18_2","doi-asserted-by":"publisher","DOI":"10.1097\/00001199-200012000-00004"},{"key":"e_1_2_6_19_2","doi-asserted-by":"publisher","DOI":"10.1177\/002221949502800507"},{"key":"e_1_2_6_20_2","doi-asserted-by":"crossref","first-page":"281","DOI":"10.2466\/pms.2001.93.1.281","article-title":"Symptom cluster associated with mild traumatic brain injury in university students","volume":"93","author":"Laforce R.","year":"2001","journal-title":"Perceptual Motor Skills"},{"key":"e_1_2_6_21_2","doi-asserted-by":"publisher","DOI":"10.3109\/02699052.2011.635354"},{"key":"e_1_2_6_22_2","doi-asserted-by":"publisher","DOI":"10.3758\/s13428-011-0081-0"},{"key":"e_1_2_6_23_2","doi-asserted-by":"publisher","DOI":"10.3758\/s13428-011-0124-6"},{"key":"e_1_2_6_24_2","doi-asserted-by":"crossref","unstructured":"Horton JJ Chilton LB. The labor economics of paid crowdsourcing. Paper presented at: Proceedings of the 11th ACM Conference on Electronic Commerce 2010.","DOI":"10.1145\/1807342.1807376"},{"key":"e_1_2_6_25_2","doi-asserted-by":"publisher","DOI":"10.1177\/1745691610393980"},{"key":"e_1_2_6_26_2","unstructured":"D.N.Shapiro J.Chandler P.A.Mueller.Using Mechanical Turk to study clinical populations.Clin Psychol Sci2013 2167702612469015"},{"key":"e_1_2_6_27_2","doi-asserted-by":"publisher","DOI":"10.3758\/s13428-014-0483-x"},{"key":"e_1_2_6_28_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.psychres.2014.06.001"},{"key":"e_1_2_6_29_2","doi-asserted-by":"crossref","unstructured":"B.T.Wymbs A.E.Dawson.Screening Amazon's Mechanical Turk for adults with ADHD.J Atten Disord2015 1087054715597471","DOI":"10.1177\/1087054715597471"},{"key":"e_1_2_6_30_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.beth.2013.04.001"},{"key":"e_1_2_6_31_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jad.2014.03.018"},{"key":"e_1_2_6_32_2","doi-asserted-by":"publisher","DOI":"10.1037\/pas0000217"},{"key":"e_1_2_6_33_2","doi-asserted-by":"publisher","DOI":"10.1076\/jcen.24.4.448.1039"},{"key":"e_1_2_6_34_2","doi-asserted-by":"publisher","DOI":"10.1097\/01.wad.0000213865.09806.92"},{"key":"e_1_2_6_35_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/alzrt94","article-title":"A web\u2010based normative calculator for the uniform data set (UDS) neuropsychological test battery","volume":"3","author":"Shirk S.D.","year":"2011","journal-title":"Alzheimer Res Ther"},{"key":"e_1_2_6_36_2","doi-asserted-by":"publisher","DOI":"10.1097\/01.HTR.0000300227.67748.77"},{"key":"e_1_2_6_37_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jclinepi.2010.04.011"},{"key":"e_1_2_6_38_2","doi-asserted-by":"publisher","DOI":"10.1089\/neu.2014.3424"},{"key":"e_1_2_6_39_2","doi-asserted-by":"publisher","DOI":"10.1089\/neu.2012.2393"},{"key":"e_1_2_6_40_2","doi-asserted-by":"crossref","unstructured":"M.H.Preece M.S.Horswill T.Ownsworth.Do self\u2010reported concussions have cumulative or enduring effects on drivers' anticipation of traffic hazards?.Brain Injury2016;1\u20137","DOI":"10.3109\/02699052.2016.1165868"},{"key":"e_1_2_6_41_2","doi-asserted-by":"publisher","DOI":"10.1097\/01.jsm.0000432853.77520.3d"},{"key":"e_1_2_6_42_2","doi-asserted-by":"publisher","DOI":"10.1097\/HTR.0000000000000018"},{"key":"e_1_2_6_43_2","doi-asserted-by":"publisher","DOI":"10.4085\/1062-6050-49.3.34"},{"key":"e_1_2_6_44_2","doi-asserted-by":"crossref","first-page":"46","DOI":"10.1136\/bjsm.2009.058172","article-title":"Is there a gender difference in concussion incidence and outcomes?","volume":"43","author":"Dick R.W.","year":"2012","journal-title":"Br J Sports Med"},{"key":"e_1_2_6_45_2","doi-asserted-by":"publisher","DOI":"10.1080\/23279095.2015.1079713"},{"key":"e_1_2_6_46_2","doi-asserted-by":"publisher","DOI":"10.3109\/02699052.2012.661914"},{"key":"e_1_2_6_47_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.drugalcdep.2015.09.029"},{"key":"e_1_2_6_48_2","doi-asserted-by":"crossref","unstructured":"S.C.Miller C.R.Whitehead C.N.Otte et al.Risk for broad\u2010spectrum neuropsychiatric disorders after mild traumatic brain injury in a cohort of US Air Force personnel.Occup Environ Med2015 oemed\u20102014\u2010102646","DOI":"10.1136\/oemed-2014-102646"},{"key":"e_1_2_6_49_2","unstructured":"Perry BN Wolde M Howard RS et al. Effect of concussion and blast exposure on clinical symptoms following deployment of US military personnel. Paper presented at BRAIN INJURY 2014. Available athttps:\/\/ibia.conference\u2010services.net\/reports\/template\/onetextabstract.xml?xsl=template\/onetextabstract.xsl&conferenceID=3754&abstractID=784743."},{"key":"e_1_2_6_50_2","doi-asserted-by":"publisher","DOI":"10.1542\/peds.2013-2988"},{"key":"e_1_2_6_51_2","doi-asserted-by":"publisher","DOI":"10.1016\/S0887-8994(00)00254-X"},{"key":"e_1_2_6_52_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.sleep.2007.04.014"},{"key":"e_1_2_6_53_2","doi-asserted-by":"publisher","DOI":"10.3109\/02699052.2012.654588"},{"key":"e_1_2_6_54_2","doi-asserted-by":"publisher","DOI":"10.1080\/09540260310001606692"},{"key":"e_1_2_6_55_2","doi-asserted-by":"publisher","DOI":"10.1089\/neu.2010.1516"},{"key":"e_1_2_6_56_2","doi-asserted-by":"publisher","DOI":"10.1111\/j.1553-2712.2000.tb00515.x"},{"key":"e_1_2_6_57_2","doi-asserted-by":"publisher","DOI":"10.1093\/brain\/awh296"},{"key":"e_1_2_6_58_2","doi-asserted-by":"publisher","DOI":"10.1080\/09638288.2016.1193905"},{"key":"e_1_2_6_59_2","doi-asserted-by":"publisher","DOI":"10.1093\/arclin\/acp006"},{"key":"e_1_2_6_60_2","doi-asserted-by":"publisher","DOI":"10.3109\/02699052.2010.531690"}],"container-title":["PM&amp;R"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/api.wiley.com\/onlinelibrary\/tdm\/v1\/articles\/10.1016%2Fj.pmrj.2017.06.010","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/api.elsevier.com\/content\/article\/PII:S1934148217306676?httpAccept=text\/xml","content-type":"text\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/api.elsevier.com\/content\/article\/PII:S1934148217306676?httpAccept=text\/plain","content-type":"text\/plain","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1016\/j.pmrj.2017.06.010","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,9,14]],"date-time":"2023-09-14T21:39:43Z","timestamp":1694727583000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1016\/j.pmrj.2017.06.010"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,6,19]]},"references-count":59,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2018,1]]}},"alternative-id":["10.1016\/j.pmrj.2017.06.010"],"URL":"https:\/\/doi.org\/10.1016\/j.pmrj.2017.06.010","archive":["Portico"],"relation":{},"ISSN":["1934-1482","1934-1563"],"issn-type":[{"value":"1934-1482","type":"print"},{"value":"1934-1563","type":"electronic"}],"subject":[],"published":{"date-parts":[[2017,6,19]]},"assertion":[{"value":"2016-08-05","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2017-06-08","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2017-06-19","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}