{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,8,30]],"date-time":"2025-08-30T16:26:29Z","timestamp":1756571189400,"version":"3.37.3"},"reference-count":31,"publisher":"Springer Science and Business Media LLC","issue":"7","license":[{"start":{"date-parts":[[2022,9,21]],"date-time":"2022-09-21T00:00:00Z","timestamp":1663718400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/www.springernature.com\/gp\/researchers\/text-and-data-mining"},{"start":{"date-parts":[[2022,9,21]],"date-time":"2022-09-21T00:00:00Z","timestamp":1663718400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.springernature.com\/gp\/researchers\/text-and-data-mining"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Behav Res"],"DOI":"10.3758\/s13428-022-01944-y","type":"journal-article","created":{"date-parts":[[2022,9,21]],"date-time":"2022-09-21T17:04:13Z","timestamp":1663779853000},"page":"3313-3325","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Do you know the Wooly Bully? Testing era-based knowledge to verify participant age online"],"prefix":"10.3758","volume":"55","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9714-3224","authenticated-orcid":false,"given":"Rachel","family":"Hartman","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Aaron J.","family":"Moss","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Israel","family":"Rabinowitz","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Nathaniel","family":"Bahn","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Cheskie","family":"Rosenzweig","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jonathan","family":"Robinson","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Leib","family":"Litman","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2022,9,21]]},"reference":[{"key":"1944_CR1","doi-asserted-by":"publisher","first-page":"231","DOI":"10.1177\/1525822X15603149","volume":"28","author":"C Antoun","year":"2016","unstructured":"Antoun, C., Zhang, C., Conrad, F. G., & Schober, M. F. (2016). Comparisons of online recruitment strategies for convenience samples: Craigslist, Google AdWords, Facebook, and Amazon Mechanical Turk. Field Methods, 28, 231\u2013246. https:\/\/doi.org\/10.1177\/1525822X15603149","journal-title":"Field Methods"},{"issue":"4","key":"1944_CR2","doi-asserted-by":"publisher","first-page":"615","DOI":"10.1037\/\/0882-7974.16.4.615","volume":"16","author":"ME Beier","year":"2001","unstructured":"Beier, M. E., & Ackerman, P. L. (2001). Current-events knowledge in adults: An investigation of age, intelligence, and nonability determinants. Psychology and Aging, 16(4), 615\u2013628. https:\/\/doi.org\/10.1037\/\/0882-7974.16.4.615","journal-title":"Psychology and Aging"},{"issue":"9-10","key":"1944_CR3","doi-asserted-by":"publisher","first-page":"934","DOI":"10.1080\/13674676.2018.1486394","volume":"21","author":"MJ Burnham","year":"2018","unstructured":"Burnham, M. J., Le, Y. K., & Piedmont, R. L. (2018). Who is Mturk? Personal characteristics and sample consistency of these online workers. Mental Health, Religion & Culture, 21(9-10), 934\u2013944.","journal-title":"Mental Health, Religion & Culture"},{"key":"1944_CR4","doi-asserted-by":"publisher","first-page":"500","DOI":"10.1177\/1948550617698203","volume":"8","author":"J Chandler","year":"2017","unstructured":"Chandler, J., & Paolacci, G. (2017). Lie for a dime: When most prescreening responses are honest but most study participants are impostors. Social Psychological and Personality Science, 8, 500\u2013508. https:\/\/doi.org\/10.1177\/1948550617698203","journal-title":"Social Psychological and Personality Science"},{"issue":"5","key":"1944_CR5","doi-asserted-by":"publisher","first-page":"2022","DOI":"10.3758\/s13428-019-01273-7","volume":"51","author":"J Chandler","year":"2019","unstructured":"Chandler, J., Rosenzweig, C., Moss, A. J., Robinson, J., & Litman, L. (2019). Online panels in social science research: Expanding sampling methods beyond Mechanical Turk. Behavior Research Methods, 51(5), 2022\u20132038. https:\/\/doi.org\/10.3758\/s13428-019-01273-7","journal-title":"Behavior Research Methods"},{"issue":"1","key":"1944_CR6","doi-asserted-by":"publisher","first-page":"49","DOI":"10.1037\/abn0000479","volume":"129","author":"J Chandler","year":"2020","unstructured":"Chandler, J., Sisso, I., & Shapiro, D. (2020). Participant carelessness and fraud: Consequences for clinical research and potential solutions. Journal of Abnormal Psychology, 129(1), 49.","journal-title":"Journal of Abnormal Psychology"},{"key":"1944_CR7","doi-asserted-by":"publisher","first-page":"537","DOI":"10.1109\/ICSE43902.2021.00057","volume-title":"2021 IEEE\/ACM 43rd International Conference on Software Engineering (ICSE)","author":"A Danilova","year":"2021","unstructured":"Danilova, A., Naiakshina, A., Horstmann, S., & Smith, M. (2021). Do you really code? Designing and evaluating screening questions for online surveys with programmers. In 2021 IEEE\/ACM 43rd International Conference on Software Engineering (ICSE) (pp. 537\u2013548). IEEE."},{"key":"1944_CR8","doi-asserted-by":"publisher","unstructured":"Fan, X., Miller, B. C., Christensen, M., Park, K. E., Grotevant, H. D., van Dulmen, M., \u2026 Bayley, B. (2002). Questionnaire and interview inconsistencies exaggerated differences between adopted and non-adopted adolescents in a national sample. Adoption Quarterly, 6, 7\u201327. https:\/\/doi.org\/10.1300\/J145v06n02_02","DOI":"10.1300\/J145v06n02_02"},{"key":"1944_CR9","doi-asserted-by":"publisher","first-page":"1631e1640","DOI":"10.1145\/2702123.2702443","volume-title":"Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, CHI 2015, Seoul, Republic of Korea, April 18-23","author":"U Gadiraju","year":"2015","unstructured":"Gadiraju, U., Kawase, R., Dietze, S., & Demartini, G. (2015). Understanding malicious behavior in crowdsourcing platforms: the case of online surveys. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, CHI 2015, Seoul, Republic of Korea, April 18-23 (p. 1631e1640). https:\/\/doi.org\/10.1145\/2702123.2702443"},{"issue":"1","key":"1944_CR10","doi-asserted-by":"publisher","first-page":"400","DOI":"10.3758\/s13428-015-0578-z","volume":"48","author":"DJ Hauser","year":"2016","unstructured":"Hauser, D. J., & Schwarz, N. (2016). Attentive Turkers: MTurk participants perform better on online attention checks than do subject pool participants. Behavior Research Methods, 48(1), 400\u2013407. https:\/\/doi.org\/10.3758\/s13428-015-0578-z","journal-title":"Behavior Research Methods"},{"issue":"4","key":"1944_CR11","doi-asserted-by":"publisher","first-page":"738","DOI":"10.1080\/09541440701554409","volume":"20","author":"SMJ Janssen","year":"2008","unstructured":"Janssen, S. M. J., Murre, J. M. J., & Meeter, M. (2008). Reminiscence bump in memory for public events. European Journal of Cognitive Psychology, 20(4), 738\u2013764. https:\/\/doi.org\/10.1080\/09541440701554409","journal-title":"European Journal of Cognitive Psychology"},{"issue":"3","key":"1944_CR12","first-page":"530","volume":"28","author":"MJ Kahana","year":"2002","unstructured":"Kahana, M. J., Howard, M. W., Zaromb, F., & Wingfield, A. (2002). Age dissociates recency and lag recency effects in free recall. Journal of Experimental Psychology: Learning, Memory, and Cognition, 28(3), 530.","journal-title":"Journal of Experimental Psychology: Learning, Memory, and Cognition"},{"key":"1944_CR13","doi-asserted-by":"publisher","first-page":"243","DOI":"10.1016\/j.chb.2018.02.005","volume":"83","author":"IP Kan","year":"2018","unstructured":"Kan, I. P., & Drummey, A. B. (2018). Do imposters threaten data quality? An examination of worker misrepresentation and downstream consequences in Amazon\u2019s Mechanical Turk workforce. Computers in Human Behavior, 83, 243\u2013253.","journal-title":"Computers in Human Behavior"},{"key":"1944_CR14","doi-asserted-by":"publisher","unstructured":"Kramer, J., Rubin, A., Coster, W., Helmuth, E., Hermos, J., Rosenbloom, D., \u2026 Liljenquist, K. (2014). Strategies to address participant misrepresentation for eligibility in Web-based research. International Journal of Methods in Psychiatric Research, 23(1), 120\u2013129. https:\/\/doi.org\/10.1002\/mpr.1415","DOI":"10.1002\/mpr.1415"},{"key":"1944_CR15","volume-title":"Conducting online research on Amazon Mechanical Turk and beyond","author":"L Litman","year":"2020","unstructured":"Litman, L., & Robinson, J. (2020). Conducting online research on Amazon Mechanical Turk and beyond. Sage Academic Publishing."},{"key":"1944_CR16","doi-asserted-by":"publisher","first-page":"433","DOI":"10.3758\/s13428-016-0727-z","volume":"49","author":"L Litman","year":"2017","unstructured":"Litman, L., Robinson, J., & Abberbock, T. (2017). TurkPrime.com: A versatile crowdsourcing data acquisition platform for the behavioral sciences. Behavior research methods, 49, 433\u2013442.","journal-title":"Behavior research methods"},{"key":"1944_CR17","first-page":"217","volume-title":"Conducting online research on Amazon Mechanical Turk and beyond","author":"L Litman","year":"2020","unstructured":"Litman, L., Robinson, J., & Rosenzweig, C. (2020a). Beyond Mechanical Turk: Using online market research platforms. In L. Litman & J. Robinson (Eds.), Conducting online research on Amazon Mechanical Turk and beyond (pp. 217\u2013233). Sage Academic Publishing."},{"key":"1944_CR18","first-page":"148","volume-title":"Conducting online research on Amazon Mechanical Turk and beyond","author":"L Litman","year":"2020","unstructured":"Litman, L., Robinson, J., & Rosenzweig, C. (2020b). Sampling Mechanical Turk workers: Problems and solutions. In L. Litman & J. Robinson (Eds.), Conducting online research on Amazon Mechanical Turk and beyond (pp. 148\u2013172). Sage Academic Publishing."},{"key":"1944_CR19","doi-asserted-by":"publisher","first-page":"109603","DOI":"10.1016\/j.paid.2019.109603","volume":"152","author":"CC MacInnis","year":"2020","unstructured":"MacInnis, C. C., Boss, H. C., & Bourdage, J. S. (2020). More evidence of participant misrepresentation on Mturk and investigating who misrepresents. Personality and Individual Differences, 152, 109603. https:\/\/doi.org\/10.1016\/j.paid.2019.109603","journal-title":"Personality and Individual Differences"},{"key":"1944_CR20","volume-title":"Music Preferences in the US: 1982-2002","author":"L Mizell","year":"2005","unstructured":"Mizell, L. (2005). Music Preferences in the US: 1982-2002. National Endowment for the Arts."},{"issue":"2","key":"1944_CR21","doi-asserted-by":"publisher","first-page":"188","DOI":"10.1177\/2515245919838479","volume":"2","author":"S Permut","year":"2019","unstructured":"Permut, S., Fisher, M., & Oppenheimer, D. M. (2019). Taskmaster: A tool for determining when subjects are on task. Advances in Methods and Practices in Psychological Science, 2(2), 188\u2013196. https:\/\/doi.org\/10.1177\/2515245919838479","journal-title":"Advances in Methods and Practices in Psychological Science"},{"key":"1944_CR22","first-page":"121","volume-title":"Conducting online research on Amazon Mechanical Turk and beyond","author":"J Robinson","year":"2020","unstructured":"Robinson, J., Litman, L., & Rosenzweig, C. (2020). Who are the Mechanical Turk workers? In L. Litman & J. Robinson (Eds.), Conducting online research on Amazon Mechanical Turk and beyond (pp. 121\u2013147). Sage Academic Publishing."},{"issue":"4","key":"1944_CR23","doi-asserted-by":"publisher","first-page":"171","DOI":"10.3102\/0013189X14534297","volume":"43","author":"JP Robinson-Cimpian","year":"2014","unstructured":"Robinson-Cimpian, J. P. (2014). Inaccurate estimation of disparities due to mischievous responders: Several suggestions to assess conclusions. Educational Researcher, 43(4), 171\u2013185.","journal-title":"Educational Researcher"},{"key":"1944_CR24","unstructured":"Rosenzweig, C., Robinson, J., & Litman, L. (2016) Are they who they say they are?: Reliability and validity of web-based participants\u2019 self-reported demographic information. Poster presented at the 18th Society for Personality and Social Psychology Annual Convention, San Antonio, TX."},{"key":"1944_CR25","doi-asserted-by":"publisher","first-page":"101526","DOI":"10.1016\/j.intell.2021.101526","volume":"85","author":"U Schroeders","year":"2021","unstructured":"Schroeders, U., Watrin, L., & Wilhelm, O. (2021). Age-related nuances in knowledge assessment. Intelligence, 85, 101526. https:\/\/doi.org\/10.1016\/j.intell.2021.101526","journal-title":"Intelligence"},{"issue":"4","key":"1944_CR26","doi-asserted-by":"publisher","first-page":"537","DOI":"10.1177\/0894439316650163","volume":"35","author":"I Shatz","year":"2017","unstructured":"Shatz, I. (2017). Fast, free, and targeted: Reddit as a source for recruiting participants online. Social Science Computer Review, 35(4), 537\u2013549.","journal-title":"Social Science Computer Review"},{"key":"1944_CR27","doi-asserted-by":"publisher","first-page":"239","DOI":"10.1111\/jasp.12580","volume":"49","author":"JT Siegel","year":"2019","unstructured":"Siegel, J. T., & Navarro, M. N. (2019). A conceptual replication examining the risk of overtly listing eligibility criteria on Amazon\u2019s Mechanical Turk. Journal of Applied Social Psychology, 49, 239\u2013248. https:\/\/doi.org\/10.1111\/jasp.12580","journal-title":"Journal of Applied Social Psychology"},{"key":"1944_CR28","doi-asserted-by":"publisher","first-page":"256","DOI":"10.1016\/j.socscimed.2015.08.020","volume":"142","author":"JT Siegel","year":"2015","unstructured":"Siegel, J. T., Navarro, M. A., & Thomson, A. L. (2015). The impact of overtly listing eligibility requirements on MTurk: An investigation involving organ donation, recruitment scripts, and feelings of elevation. Social Science and Medicine, 142, 256\u2013260.","journal-title":"Social Science and Medicine"},{"key":"1944_CR29","doi-asserted-by":"publisher","unstructured":"Steger, D., Schroeders, U., & Wilhelm, O. (2020). Caught in the act: Predicting cheating in unproctored knowledge assessment. Assessment, 1\u201314. https:\/\/doi.org\/10.1177\/1073191120914970","DOI":"10.1177\/1073191120914970"},{"key":"1944_CR30","doi-asserted-by":"publisher","first-page":"211","DOI":"10.1093\/jcr\/ucx053","volume":"44","author":"K Wessling","year":"2017","unstructured":"Wessling, K., Huber, J., & Netzer, O. (2017). MTurk character misrepresentation: Assessment and solutions. Journal of Consumer Research, 44, 211\u2013230. https:\/\/doi.org\/10.1093\/jcr\/ucx053","journal-title":"Journal of Consumer Research"},{"issue":"4","key":"1944_CR31","doi-asserted-by":"publisher","first-page":"547","DOI":"10.1177\/0305735618812199","volume":"48","author":"D Zimprich","year":"2020","unstructured":"Zimprich, D. (2020). Individual differences in the reminiscence bump of very long-term memory for popular songs in old age: A non-linear mixed model approach. Psychology of Music, 48(4), 547\u2013563. https:\/\/doi.org\/10.1177\/0305735618812199","journal-title":"Psychology of Music"}],"container-title":["Behavior Research Methods"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.3758\/s13428-022-01944-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.3758\/s13428-022-01944-y\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.3758\/s13428-022-01944-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,10,30]],"date-time":"2023-10-30T16:04:57Z","timestamp":1698681897000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.3758\/s13428-022-01944-y"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,9,21]]},"references-count":31,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2023,10]]}},"alternative-id":["1944"],"URL":"https:\/\/doi.org\/10.3758\/s13428-022-01944-y","relation":{},"ISSN":["1554-3528"],"issn-type":[{"type":"electronic","value":"1554-3528"}],"subject":[],"published":{"date-parts":[[2022,9,21]]},"assertion":[{"value":"25 July 2022","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"21 September 2022","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"Data, analysis script, and supplemental materials are available on OSF: .","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Open Practices Statement"}},{"value":"None of the studies were preregistered.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Open Practices Statement"}},{"value":"This content has been made available to all.","name":"free","label":"Free to read"}]}}