{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T12:59:29Z","timestamp":1776085169671,"version":"3.50.1"},"reference-count":93,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2019,6,30]],"date-time":"2019-06-30T00:00:00Z","timestamp":1561852800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Trans. Soc. Comput."],"published-print":{"date-parts":[[2019,6,30]]},"abstract":"<jats:p>Crowd employment is a new form of short-term and flexible employment that has emerged during the past decade. To understand this new form of employment, it is crucial to illuminate the underlying motivations of the workforce involved in it. This article introduces the Multidimensional Crowdworker Motivation Scale (MCMS), a scale for measuring the motivation of crowdworkers on microtask platforms. The MCMS is theoretically grounded in self-determination theory and tailored specifically to the context of paid crowdsourced microlabor. The scale measures the motivation of crowdworkers along six motivational dimensions, ranging from amotivation to intrinsic motivation. We validated the MCMS on data collected in ten countries and three income groups. Factor analyses demonstrated that the MCMS\u2019s six dimensions showed good model fit, validity, and reliability. Furthermore, our measurement invariance tests showed that motivations measured with the MCMS are comparable across countries and income groups, and we present a first cross-country comparison of crowdworker motivations. This work constitutes an important first step toward understanding the motivations of the international crowd workforce.<\/jats:p>","DOI":"10.1145\/3335081","type":"journal-article","created":{"date-parts":[[2019,9,23]],"date-time":"2019-09-23T12:10:12Z","timestamp":1569240612000},"page":"1-34","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":23,"title":["Measuring Motivations of Crowdworkers"],"prefix":"10.1145","volume":"2","author":[{"given":"Lisa","family":"Posch","sequence":"first","affiliation":[{"name":"GESIS--Leibniz Institute for the Social Sciences, Germany and Graz University of Technology, Graz, Austria"}]},{"given":"Arnim","family":"Bleier","sequence":"additional","affiliation":[{"name":"GESIS--Leibniz Institute for the Social Sciences, Cologne, Germany"}]},{"given":"Clemens M.","family":"Lechner","sequence":"additional","affiliation":[{"name":"GESIS--Leibniz Institute for the Social Sciences, Mannheim, Germany"}]},{"given":"Daniel","family":"Danner","sequence":"additional","affiliation":[{"name":"University of Applied Labour Studies, Mannheim, Germany"}]},{"given":"Fabian","family":"Fl\u00f6ck","sequence":"additional","affiliation":[{"name":"GESIS--Leibniz Institute for the Social Sciences, Cologne, Germany"}]},{"given":"Markus","family":"Strohmaier","sequence":"additional","affiliation":[{"name":"RWTH Aachen University, Germany and GESIS -- Leibniz Institute for the Social Sciences, Cologne, Germany"}]}],"member":"320","published-online":{"date-parts":[[2019,9,23]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"Proceedings of the Conference on Human Factors in Computing Systems (CHI\u201912)","author":"Antin Judd","year":"2076","unstructured":"Judd Antin and Aaron D. Shaw . 2012. Social desirability bias and self-reports of motivation: A study of Amazon mechanical turk in the U.S. and India . In Proceedings of the Conference on Human Factors in Computing Systems (CHI\u201912) , Joseph A. Konstan, Ed H. Chi, and Kristina H\u00f6\u00f6k (Eds.). ACM, 2925--2934. DOI:https:\/\/doi.org\/10.1145\/2 2076 76.2208699 10.1145\/2207676.2208699 Judd Antin and Aaron D. Shaw. 2012. Social desirability bias and self-reports of motivation: A study of Amazon mechanical turk in the U.S. and India. In Proceedings of the Conference on Human Factors in Computing Systems (CHI\u201912), Joseph A. Konstan, Ed H. Chi, and Kristina H\u00f6\u00f6k (Eds.). ACM, 2925--2934. DOI:https:\/\/doi.org\/10.1145\/2207676.2208699"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1037\/0033-2909.88.3.588"},{"key":"e_1_2_1_3_1","volume-title":"Income security in the on-demand economy: Findings and policy lessons from a survey of crowdworkers. Comp. Lab. L. 8 Pol\u2019y J. 37","author":"Berg Janine","year":"2015","unstructured":"Janine Berg . 2016. Income security in the on-demand economy: Findings and policy lessons from a survey of crowdworkers. Comp. Lab. L. 8 Pol\u2019y J. 37 ( 2015 ), 543. Janine Berg. 2016. Income security in the on-demand economy: Findings and policy lessons from a survey of crowdworkers. Comp. Lab. L. 8 Pol\u2019y J. 37 (2015), 543."},{"key":"e_1_2_1_4_1","volume-title":"Geneva: International Labour Organization","author":"Berg Janine","year":"2018","unstructured":"Janine Berg , M. Furrer , E. Harmon , U. Rani , and M. S. Silberman . 2018. Digital labour platforms and the future of work: Towards decent work in the online world . Geneva: International Labour Organization , September 20 ( 2018 ). Janine Berg, M. Furrer, E. Harmon, U. Rani, and M. S. Silberman. 2018. Digital labour platforms and the future of work: Towards decent work in the online world. Geneva: International Labour Organization, September 20 (2018)."},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/2791285"},{"key":"e_1_2_1_6_1","first-page":"185","article-title":"The work motivation inventory","volume":"14","author":"Blais M. R.","year":"1993","unstructured":"M. R. Blais , L. Lachance , R. J. Vallerand , N. M. Briere , and A. S. Riddle . 1993 . The work motivation inventory . Revue Quebecoise de Psychologie 14 (1993), 185 -- 215 . M. R. Blais, L. Lachance, R. J. Vallerand, N. M. Briere, and A. S. Riddle. 1993. The work motivation inventory. Revue Quebecoise de Psychologie 14 (1993), 185--215.","journal-title":"Revue Quebecoise de Psychologie"},{"key":"e_1_2_1_7_1","volume-title":"Structural Equations with Latent Variables","author":"Bollen Kenneth A.","unstructured":"Kenneth A. Bollen . 1989. Structural Equations with Latent Variables . John Wiley 8 Sons. Kenneth A. Bollen. 1989. Structural Equations with Latent Variables. John Wiley 8 Sons."},{"key":"e_1_2_1_8_1","unstructured":"Robin Bordoli. 2018. Focused on the Future with a New Name. Retrieved from http:\/\/www.figure-eight.com\/focused-future-new-name\/. Robin Bordoli. 2018. Focused on the Future with a New Name. Retrieved from http:\/\/www.figure-eight.com\/focused-future-new-name\/."},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jebo.2013.03.003"},{"key":"e_1_2_1_10_1","volume-title":"Blei","author":"Chang Jonathan","year":"2009","unstructured":"Jonathan Chang , Jordan L. Boyd-Graber , Sean Gerrish , Chong Wang , and David M . Blei . 2009 . Reading tea leaves: How humans interpret topic models. In Proceedings of the 23rd Annual Conference on Neural Information Processing Systems, Yoshua Bengio, Dale Schuurmans, John D. Lafferty, Christopher K. I. Williams, and Aron Culotta (Eds.). Curran Associates, 288--296. Retrieved from http:\/\/papers.nips.cc\/paper\/3700-reading-tea-leaves-how-humans-interpret-topic-models. Jonathan Chang, Jordan L. Boyd-Graber, Sean Gerrish, Chong Wang, and David M. Blei. 2009. Reading tea leaves: How humans interpret topic models. In Proceedings of the 23rd Annual Conference on Neural Information Processing Systems, Yoshua Bengio, Dale Schuurmans, John D. Lafferty, Christopher K. I. Williams, and Aron Culotta (Eds.). Curran Associates, 288--296. Retrieved from http:\/\/papers.nips.cc\/paper\/3700-reading-tea-leaves-how-humans-interpret-topic-models."},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1037\/a0036212"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1080\/10705510701301834"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1177\/0022022100031002003"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1207\/S15328007SEM0902_5"},{"key":"e_1_2_1_15_1","volume-title":"Market efficiency and equitable opportunities or unfair precarisation? Market Efficiency and Equitable Opportunities or Unfair Precarisation","author":"Codagnone Cristiano","year":"2016","unstructured":"Cristiano Codagnone , Fabienne Abadie , and Federico Biagi . 2016. The future of work in the \u201csharing economy .\u201d Market efficiency and equitable opportunities or unfair precarisation? Market Efficiency and Equitable Opportunities or Unfair Precarisation ( 2016 ). Cristiano Codagnone, Fabienne Abadie, and Federico Biagi. 2016. The future of work in the \u201csharing economy.\u201d Market efficiency and equitable opportunities or unfair precarisation? Market Efficiency and Equitable Opportunities or Unfair Precarisation (2016)."},{"key":"e_1_2_1_16_1","unstructured":"European Commission. 2016. A European agenda for the collaborative economy. Retrieved from http:\/\/ec.europa.eu\/DocsRoom\/documents\/16881. European Commission. 2016. A European agenda for the collaborative economy. Retrieved from http:\/\/ec.europa.eu\/DocsRoom\/documents\/16881."},{"key":"e_1_2_1_17_1","volume-title":"Coefficient alpha and the internal structure of tests. psychometrika 16, 3","author":"Cronbach Lee J.","year":"1951","unstructured":"Lee J. Cronbach . 1951. Coefficient alpha and the internal structure of tests. psychometrika 16, 3 ( 1951 ), 297--334. Lee J. Cronbach. 1951. Coefficient alpha and the internal structure of tests. psychometrika 16, 3 (1951), 297--334."},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1037\/h0047358"},{"key":"e_1_2_1_19_1","first-page":"p54","article-title":"Construct validity of Likert scales through confirmatory factor analysis: A simulation study comparing different methods of estimation based on Pearson and polychoric correlations","volume":"1","author":"de los \u00c1ngeles Morata-Ram\u00edrez Mar\u00eda","year":"2013","unstructured":"Mar\u00eda de los \u00c1ngeles Morata-Ram\u00edrez and Francisco Pablo Holgado-Tello . 2013 . Construct validity of Likert scales through confirmatory factor analysis: A simulation study comparing different methods of estimation based on Pearson and polychoric correlations . Int. J. Soc. Sci. Studies 1 , 1 (2013), p54 -- p61 . Mar\u00eda de los \u00c1ngeles Morata-Ram\u00edrez and Francisco Pablo Holgado-Tello. 2013. Construct validity of Likert scales through confirmatory factor analysis: A simulation study comparing different methods of estimation based on Pearson and polychoric correlations. Int. J. Soc. Sci. Studies 1, 1 (2013), p54--61.","journal-title":"Int. J. Soc. Sci. Studies"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0065-2601(08)60130-6"},{"key":"e_1_2_1_21_1","volume-title":"Ryan","author":"Deci Edward L.","year":"1985","unstructured":"Edward L. Deci and Richard M . Ryan . 1985 . Intrinsic Motivation and Self-Determination in Human Behavior. Springer US. Edward L. Deci and Richard M. Ryan. 1985. Intrinsic Motivation and Self-Determination in Human Behavior. Springer US."},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1207\/S15327965PLI1104_01"},{"key":"e_1_2_1_23_1","volume-title":"Ryan","author":"Deci Edward L.","year":"2002","unstructured":"Edward L. Deci and Richard M . Ryan . 2002 . Handbook of Self-determination Research. University Rochester Press . Edward L. Deci and Richard M. Ryan. 2002. Handbook of Self-determination Research. University Rochester Press."},{"key":"e_1_2_1_24_1","volume-title":"Ryan","author":"Deci Edward L.","year":"2002","unstructured":"Edward L. Deci and Richard M . Ryan . 2002 . Overview of self-determination theory: An organismic dialectical perspective. Handbook Self-determ. Res . (2002), 3--33. Edward L. Deci and Richard M. Ryan. 2002. Overview of self-determination theory: An organismic dialectical perspective. Handbook Self-determ. Res. (2002), 3--33."},{"key":"e_1_2_1_25_1","volume-title":"Scale Development: Theory and Applications.","author":"DeVellis Robert F.","year":"2016","unstructured":"Robert F. DeVellis . 2016 . Scale Development: Theory and Applications. Vol. 26 . Sage publications. Robert F. DeVellis. 2016. Scale Development: Theory and Applications. Vol. 26. Sage publications."},{"key":"e_1_2_1_26_1","first-page":"1","article-title":"Validation of the physician teaching motivation questionnaire (PTMQ)","volume":"15","author":"Dybowski Christoph","year":"2015","unstructured":"Christoph Dybowski and Sigrid Harendza . 2015 . Validation of the physician teaching motivation questionnaire (PTMQ) . BMC Med. Edu. 15 , 1 (2015), 1 . Christoph Dybowski and Sigrid Harendza. 2015. Validation of the physician teaching motivation questionnaire (PTMQ). BMC Med. Edu. 15, 1 (2015), 1.","journal-title":"BMC Med. Edu."},{"key":"e_1_2_1_27_1","volume-title":"Working the crowd: Employment and labor law in the crowdsourcing industry. Berkeley J. Employ. Labor Law","author":"Felstiner Alek","year":"2011","unstructured":"Alek Felstiner . 2011. Working the crowd: Employment and labor law in the crowdsourcing industry. Berkeley J. Employ. Labor Law ( 2011 ), 143--203. Alek Felstiner. 2011. Working the crowd: Employment and labor law in the crowdsourcing industry. Berkeley J. Employ. Labor Law (2011), 143--203."},{"key":"e_1_2_1_28_1","volume-title":"Finney and Christine DiStefano","author":"Sara","year":"2006","unstructured":"Sara J. Finney and Christine DiStefano . 2006 . Non-normal and categorical data in structural equation modeling. Structural equation modeling: A second course (2006), 269--314. Sara J. Finney and Christine DiStefano. 2006. Non-normal and categorical data in structural equation modeling. Structural equation modeling: A second course (2006), 269--314."},{"key":"e_1_2_1_29_1","unstructured":"GESIS--Leibniz Institute for the Social Sciences. 2019. Retrieved from http:\/\/crowdworkers.info. GESIS--Leibniz Institute for the Social Sciences. 2019. Retrieved from http:\/\/crowdworkers.info."},{"key":"e_1_2_1_30_1","volume-title":"Larcker","author":"Fornell Claes","year":"1981","unstructured":"Claes Fornell and David F . Larcker . 1981 . Evaluating structural equation models with unobservable variables and measurement error. J. Market. Res . (1981), 39--50. Claes Fornell and David F. Larcker. 1981. Evaluating structural equation models with unobservable variables and measurement error. J. Market. Res. (1981), 39--50."},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/2487575.2487697"},{"key":"e_1_2_1_32_1","article-title":"Elements to consider in planning the use of factor analysis","volume":"2","author":"Froman Robin D.","year":"2001","unstructured":"Robin D. Froman . 2001 . Elements to consider in planning the use of factor analysis . South. Online J. Nurs. Res. 2 , 5 (2001). Robin D. Froman. 2001. Elements to consider in planning the use of factor analysis. South. Online J. Nurs. Res. 2, 5 (2001).","journal-title":"South. Online J. Nurs. Res."},{"key":"e_1_2_1_33_1","first-page":"331","article-title":"Self-determination theory and work motivation. J.f Organiz","volume":"26","author":"Gagn\u00e9 Maryl\u00e8ne","year":"2005","unstructured":"Maryl\u00e8ne Gagn\u00e9 and Edward L. Deci . 2005 . Self-determination theory and work motivation. J.f Organiz . Behav. 26 , 4 (2005), 331 -- 362 . Maryl\u00e8ne Gagn\u00e9 and Edward L. Deci. 2005. Self-determination theory and work motivation. J.f Organiz. Behav. 26, 4 (2005), 331--362.","journal-title":"Behav."},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1177\/0013164409355698"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1080\/1359432X.2013.877892"},{"key":"e_1_2_1_36_1","unstructured":"Darren George and M. Mallery. 2003. Using SPSS for Windows step by step: A simple guide and reference. Allyn 8 Bacon Boston MA. Darren George and M. Mallery. 2003. Using SPSS for Windows step by step: A simple guide and reference. Allyn 8 Bacon Boston MA."},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1080\/00220973.2013.876231"},{"key":"e_1_2_1_38_1","volume-title":"Proceedings of the 17th Conference on Computer Supported Cooperative Work.","author":"Gupta Neha","year":"2014","unstructured":"Neha Gupta , Andy Crabtree , Tom Rodden , David Martin , and Jacki O\u2019Neill . 2014 . Understanding Indian crowdworkers . In Proceedings of the 17th Conference on Computer Supported Cooperative Work. Neha Gupta, Andy Crabtree, Tom Rodden, David Martin, and Jacki O\u2019Neill. 2014. Understanding Indian crowdworkers. In Proceedings of the 17th Conference on Computer Supported Cooperative Work."},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/2660398.2660403"},{"key":"e_1_2_1_40_1","volume-title":"Black","author":"Hair Joseph F.","year":"2018","unstructured":"Joseph F. Hair , Joseph F. Jr. , Barry J. Babin , Rolph E. Anderson , and William C . Black . 2018 . Multivariate Data Analysis (8th Ed.). Cengage, Hampshire, United Kingdom . Joseph F. Hair, Joseph F. Jr., Barry J. Babin, Rolph E. Anderson, and William C. Black. 2018. Multivariate Data Analysis (8th Ed.). Cengage, Hampshire, United Kingdom."},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1177\/0002764212466235"},{"key":"e_1_2_1_42_1","first-page":"53","article-title":"Structural equation modelling: Guidelines for determining model fit","volume":"6","author":"Hooper Daire","year":"2008","unstructured":"Daire Hooper , Joseph Coughlan , and Michael Mullen . 2008 . Structural equation modelling: Guidelines for determining model fit . Electronic Journal of Business Research Methods 6 (2008), 53 -- 60 . Daire Hooper, Joseph Coughlan, and Michael Mullen. 2008. Structural equation modelling: Guidelines for determining model fit. Electronic Journal of Business Research Methods 6 (2008), 53--60.","journal-title":"Electronic Journal of Business Research Methods"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1080\/03610739208253916"},{"key":"e_1_2_1_44_1","volume-title":"Proceedings of the 11th ACM Conference on Electronic Commerce (EC\u201910)","author":"Horton John Joseph","year":"1807","unstructured":"John Joseph Horton and Lydia B. Chilton . 2010. The labor economics of paid crowdsourcing . In Proceedings of the 11th ACM Conference on Electronic Commerce (EC\u201910) , David C. Parkes, Chrysanthos Dellarocas, and Moshe Tennenholtz (Eds.). ACM, 209--218. DOI:https:\/\/doi.org\/10.1145\/ 1807 342.1807376 10.1145\/1807342.1807376 John Joseph Horton and Lydia B. Chilton. 2010. The labor economics of paid crowdsourcing. In Proceedings of the 11th ACM Conference on Electronic Commerce (EC\u201910), David C. Parkes, Chrysanthos Dellarocas, and Moshe Tennenholtz (Eds.). ACM, 209--218. DOI:https:\/\/doi.org\/10.1145\/1807342.1807376"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICIMTR.2012.6236409"},{"key":"e_1_2_1_46_1","unstructured":"Joshua L. Howard Maryl\u00e8ne Gagn\u00e9 Alexandre J. S. Morin and Jacques Forest. 2016. Using bifactor exploratory structural equation modeling to test for a continuum structure of motivation. J. Manage. (2016) 0149206316645653. Joshua L. Howard Maryl\u00e8ne Gagn\u00e9 Alexandre J. S. Morin and Jacques Forest. 2016. Using bifactor exploratory structural equation modeling to test for a continuum structure of motivation. J. Manage. (2016) 0149206316645653."},{"key":"e_1_2_1_47_1","volume-title":"Crowdsourcing: A Definition.","author":"Howe Jeff","year":"2006","unstructured":"Jeff Howe . 2006 . Crowdsourcing: A Definition. Retrieved from http:\/\/crowdsourcing.typepad.com\/cs\/2006\/06\/crowdsourcing_a.html. Jeff Howe. 2006. Crowdsourcing: A Definition. Retrieved from http:\/\/crowdsourcing.typepad.com\/cs\/2006\/06\/crowdsourcing_a.html."},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/1869086.1869094"},{"key":"e_1_2_1_49_1","volume-title":"Demographics of mechanical turk. CeDER Working Papers","author":"Ipeirotis Panagiotis G.","year":"2010","unstructured":"Panagiotis G. Ipeirotis . 2010. Demographics of mechanical turk. CeDER Working Papers ( 2010 ). Panagiotis G. Ipeirotis. 2010. Demographics of mechanical turk. CeDER Working Papers (2010)."},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1177\/000312240907400101"},{"key":"e_1_2_1_51_1","volume-title":"Proceedings of the 17th Americas Conference on Information Systems: A Renaissance of Information Technology for Sustainability and Global Competitiveness (AMCIS\u201911)","author":"Kaufmann Nicolas","year":"2011","unstructured":"Nicolas Kaufmann , Thimo Schulze , and Daniel Veit . 2011 . More than fun and money. Worker motivation in crowdsourcing\u2014A study on mechanical turk . In Proceedings of the 17th Americas Conference on Information Systems: A Renaissance of Information Technology for Sustainability and Global Competitiveness (AMCIS\u201911) , Vallabh Sambamurthy and Mohan Tanniru (Eds.). Association for Information Systems. Retrieved from http:\/\/aisel.aisnet.org\/amcis 2011_submissions\/340. Nicolas Kaufmann, Thimo Schulze, and Daniel Veit. 2011. More than fun and money. Worker motivation in crowdsourcing\u2014A study on mechanical turk. In Proceedings of the 17th Americas Conference on Information Systems: A Renaissance of Information Technology for Sustainability and Global Competitiveness (AMCIS\u201911), Vallabh Sambamurthy and Mohan Tanniru (Eds.). Association for Information Systems. Retrieved from http:\/\/aisel.aisnet.org\/amcis2011_submissions\/340."},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/1926180.1926195"},{"key":"e_1_2_1_53_1","volume-title":"Principles and Practice of Structural Equation Modeling","author":"Kline Rex B.","unstructured":"Rex B. Kline . 2015. Principles and Practice of Structural Equation Modeling . Guilford Publications . Rex B. Kline. 2015. Principles and Practice of Structural Equation Modeling. Guilford Publications."},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1146\/annurev.psych.50.1.537"},{"key":"e_1_2_1_55_1","unstructured":"Siou Chew Kuek Cecilia Paradi-Guilford Toks Fayomi Saori Imaizumi Panos Ipeirotis Patricia Pina Manpreet Singh etal 2015. The Global Opportunity in Online Outsourcing. Technical Report. The World Bank. Siou Chew Kuek Cecilia Paradi-Guilford Toks Fayomi Saori Imaizumi Panos Ipeirotis Patricia Pina Manpreet Singh et al. 2015. The Global Opportunity in Online Outsourcing. Technical Report. The World Bank."},{"key":"e_1_2_1_56_1","volume-title":"Preacher","author":"Lee Ihno A.","year":"2013","unstructured":"Ihno A. Lee and Kristopher J . Preacher . 2013 . Calculation for the test of the difference between two dependent correlations with one variable in common [Computer software]. Retrieved from http:\/\/quantpsy.org\/corrtest\/corrtest3.htm. Ihno A. Lee and Kristopher J. Preacher. 2013. Calculation for the test of the difference between two dependent correlations with one variable in common [Computer software]. Retrieved from http:\/\/quantpsy.org\/corrtest\/corrtest3.htm."},{"key":"e_1_2_1_57_1","volume-title":"Proceedings of the 7th International Conference on Weblogs and Social Media (ICWSM\u201913)","author":"Lee Tak Yeon","year":"2013","unstructured":"Tak Yeon Lee , Casey Dugan , Werner Geyer , Tristan Ratchford , Jamie C. Rasmussen , N. Sadat Shami , and Stela Lupushor . 2013 . Experiments on motivational feedback for crowdsourced workers . In Proceedings of the 7th International Conference on Weblogs and Social Media (ICWSM\u201913) . Emre Kiciman, Nicole B. Ellison, Bernie Hogan, Paul Resnick, and Ian Soboroff (Eds.). The AAAI Press. Retrieved from http:\/\/www.aaai.org\/ocs\/index.php\/ICWSM\/ICWSM13\/paper\/view\/6118. Tak Yeon Lee, Casey Dugan, Werner Geyer, Tristan Ratchford, Jamie C. Rasmussen, N. Sadat Shami, and Stela Lupushor. 2013. Experiments on motivational feedback for crowdsourced workers. In Proceedings of the 7th International Conference on Weblogs and Social Media (ICWSM\u201913). Emre Kiciman, Nicole B. Ellison, Bernie Hogan, Paul Resnick, and Ian Soboroff (Eds.). The AAAI Press. Retrieved from http:\/\/www.aaai.org\/ocs\/index.php\/ICWSM\/ICWSM13\/paper\/view\/6118."},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.lindif.2015.05.006"},{"key":"e_1_2_1_59_1","unstructured":"Irene Mandl Maurizio Curtarelli Sara Riso Oscar Vargas and Elias Gerogiannis. 2015. New forms of employment. Eurofound Report. Irene Mandl Maurizio Curtarelli Sara Riso Oscar Vargas and Elias Gerogiannis. 2015. New forms of employment. Eurofound Report."},{"key":"e_1_2_1_60_1","volume-title":"Multivariate applications book series. Contemporary Psychometrics: A Festschrift for Roderick P","author":"Marsh Herbert W.","unstructured":"Herbert W. Marsh , Kit-Tai Hau , and David Grayson . 2005. Goodness of fit in structural equation models . In Multivariate applications book series. Contemporary Psychometrics: A Festschrift for Roderick P . McDonald, A. Maydeu-Olivares and J. J. McArdle (Eds.). Lawrence Erlbaum Associates Publishers , Mahwah, NJ , US. Herbert W. Marsh, Kit-Tai Hau, and David Grayson. 2005. Goodness of fit in structural equation models. In Multivariate applications book series. Contemporary Psychometrics: A Festschrift for Roderick P. McDonald, A. Maydeu-Olivares and J. J. McArdle (Eds.). Lawrence Erlbaum Associates Publishers, Mahwah, NJ, US."},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1145\/2531602.2531663"},{"key":"e_1_2_1_62_1","volume-title":"Test Theory: A Unified Treatment","author":"McDonald Roderick P.","year":"1999","unstructured":"Roderick P. McDonald . 1999 . Test Theory: A Unified Treatment . Lawrence Erlbaum Associates Publishers . Roderick P. McDonald. 1999. Test Theory: A Unified Treatment. Lawrence Erlbaum Associates Publishers."},{"key":"e_1_2_1_63_1","volume-title":"Millsap and Margarita Olivera-Aguilar","author":"Roger","year":"2012","unstructured":"Roger E. Millsap and Margarita Olivera-Aguilar . 2012 . Investigating measurement invariance using confirmatory factor analysis. In Handbook of Structural Equation Modeling, R. Hoyle (Ed.). Guilford Press , New York. Roger E. Millsap and Margarita Olivera-Aguilar. 2012. Investigating measurement invariance using confirmatory factor analysis. In Handbook of Structural Equation Modeling, R. Hoyle (Ed.). Guilford Press, New York."},{"key":"e_1_2_1_64_1","volume-title":"How to measure motivation? In Motivation of Workers on Microtask Crowdsourcing Platforms","author":"Naderi Babak","unstructured":"Babak Naderi . 2018. How to measure motivation? In Motivation of Workers on Microtask Crowdsourcing Platforms . Springer , 29--44. Babak Naderi. 2018. How to measure motivation? In Motivation of Workers on Microtask Crowdsourcing Platforms. Springer, 29--44."},{"key":"e_1_2_1_65_1","volume-title":"Proceedings of the International ACM Workshop on Crowdsourcing for Multimedia (CrowdMM\u201914)","author":"Naderi Babak","year":"2014","unstructured":"Babak Naderi , Ina Wechsung , Tim Polzehl , and Sebastian M\u00f6ller . 2014 . Development and validation of extrinsic motivation scale for crowdsourcing microtask platforms . In Proceedings of the International ACM Workshop on Crowdsourcing for Multimedia (CrowdMM\u201914) , Judith Redi and Mathias Lux (Eds.). ACM, 31--36. DOI:https:\/\/doi.org\/10.1145\/2660114.2660122 10.1145\/2660114.2660122 Babak Naderi, Ina Wechsung, Tim Polzehl, and Sebastian M\u00f6ller. 2014. Development and validation of extrinsic motivation scale for crowdsourcing microtask platforms. In Proceedings of the International ACM Workshop on Crowdsourcing for Multimedia (CrowdMM\u201914), Judith Redi and Mathias Lux (Eds.). ACM, 31--36. DOI:https:\/\/doi.org\/10.1145\/2660114.2660122"},{"key":"e_1_2_1_66_1","unstructured":"Bloomberg News. 2016. Venezuela\u2019s Currency is Collapsing on the Black Market Again. Retrieved from http:\/\/www.bloomberg.com\/news\/articles\/2016-11-01\/venezuela-s-currency-is-collapsing-on-the-black-market-again. Bloomberg News. 2016. Venezuela\u2019s Currency is Collapsing on the Black Market Again. Retrieved from http:\/\/www.bloomberg.com\/news\/articles\/2016-11-01\/venezuela-s-currency-is-collapsing-on-the-black-market-again."},{"key":"e_1_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.psychsport.2015.11.004"},{"key":"e_1_2_1_68_1","doi-asserted-by":"publisher","DOI":"10.1111\/0023-8333.00111"},{"key":"e_1_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jesp.2009.03.009"},{"key":"e_1_2_1_70_1","first-page":"131","article-title":"Best practices in exploratory factor analysis: Four recommendations for getting the most from your analysis. Pan-Pacific Manage","volume":"12","author":"Osborne Jason W.","year":"2009","unstructured":"Jason W. Osborne and Anna B. Costello . 2009 . Best practices in exploratory factor analysis: Four recommendations for getting the most from your analysis. Pan-Pacific Manage . Rev. 12 , 2 (2009), 131 -- 146 . Jason W. Osborne and Anna B. Costello. 2009. Best practices in exploratory factor analysis: Four recommendations for getting the most from your analysis. Pan-Pacific Manage. Rev. 12, 2 (2009), 131--146.","journal-title":"Rev."},{"key":"e_1_2_1_71_1","doi-asserted-by":"crossref","first-page":"411","DOI":"10.1017\/S1930297500002205","article-title":"Running experiments on Amazon mechanical turk","volume":"5","author":"Paolacci Gabriele","year":"2010","unstructured":"Gabriele Paolacci , Jesse Chandler , and Panagiotis G. Ipeirotis . 2010 . Running experiments on Amazon mechanical turk . Judg. Decis. Mak. 5 , 5 (2010), 411 -- 419 . Gabriele Paolacci, Jesse Chandler, and Panagiotis G. Ipeirotis. 2010. Running experiments on Amazon mechanical turk. Judg. Decis. Mak. 5, 5 (2010), 411--419.","journal-title":"Judg. Decis. Mak."},{"key":"e_1_2_1_72_1","unstructured":"European Parliament. 2016. The situation of workers in the Collaborative Economy. Retrieved from http:\/\/www.europarl.europa.eu\/RegData\/etudes\/IDAN\/2016\/587316\/IPOL_IDA(2016)587316_EN.pdf. European Parliament. 2016. The situation of workers in the Collaborative Economy. Retrieved from http:\/\/www.europarl.europa.eu\/RegData\/etudes\/IDAN\/2016\/587316\/IPOL_IDA(2016)587316_EN.pdf."},{"key":"e_1_2_1_73_1","unstructured":"Lisa Posch Arnim Bleier Fabian Fl\u00f6ck and Markus Strohmaier. 2018. Characterizing the global crowd workforce: A cross-country comparison of crowdworker demographics. arXiv preprint arXiv:1812.05948. Lisa Posch Arnim Bleier Fabian Fl\u00f6ck and Markus Strohmaier. 2018. Characterizing the global crowd workforce: A cross-country comparison of crowdworker demographics. arXiv preprint arXiv:1812.05948."},{"key":"e_1_2_1_74_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-24489-1_26"},{"key":"e_1_2_1_75_1","volume-title":"Measuring motivations of crowdworkers: The multidimensional crowdworker motivation scale (first version). CoRR http:\/\/arxiv.org\/abs\/1702.01661v1","author":"Posch Lisa","year":"2017","unstructured":"Lisa Posch , Arnim Bleier , and Markus Strohmaier . 2017. Measuring motivations of crowdworkers: The multidimensional crowdworker motivation scale (first version). CoRR http:\/\/arxiv.org\/abs\/1702.01661v1 ( 2017 ). Lisa Posch, Arnim Bleier, and Markus Strohmaier. 2017. Measuring motivations of crowdworkers: The multidimensional crowdworker motivation scale (first version). CoRR http:\/\/arxiv.org\/abs\/1702.01661v1 (2017)."},{"key":"e_1_2_1_76_1","unstructured":"Jakob Rogstadius Vassilis Kostakos Aniket Kittur Boris Smus Jim Laredo and Maja Vukovic. 2011. An assessment of intrinsic and extrinsic motivation on task performance in crowdsourcing markets. Retrieved from http:\/\/www.aaai.org\/ocs\/index.php\/ICWSM\/ICWSM11\/paper\/view\/2778. Jakob Rogstadius Vassilis Kostakos Aniket Kittur Boris Smus Jim Laredo and Maja Vukovic. 2011. An assessment of intrinsic and extrinsic motivation on task performance in crowdsourcing markets. Retrieved from http:\/\/www.aaai.org\/ocs\/index.php\/ICWSM\/ICWSM11\/paper\/view\/2778."},{"key":"e_1_2_1_77_1","doi-asserted-by":"publisher","DOI":"10.1145\/1753846.1753873"},{"key":"e_1_2_1_78_1","doi-asserted-by":"publisher","DOI":"10.18637\/jss.v048.i02"},{"key":"e_1_2_1_79_1","doi-asserted-by":"publisher","DOI":"10.1037\/0022-3514.57.5.749"},{"key":"e_1_2_1_80_1","doi-asserted-by":"publisher","DOI":"10.1006\/ceps.1999.1020"},{"key":"e_1_2_1_81_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-35176-1_33"},{"key":"e_1_2_1_82_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11336-009-9135-y"},{"key":"e_1_2_1_83_1","unstructured":"semTools Contributors. 2016. semTools: Useful Tools for Structural Equation Modeling. Retrieved from http:\/\/CRAN.R-project.org\/package&equals;semTools. semTools Contributors. 2016. semTools: Useful Tools for Structural Equation Modeling. Retrieved from http:\/\/CRAN.R-project.org\/package&equals;semTools."},{"key":"e_1_2_1_84_1","doi-asserted-by":"publisher","DOI":"10.1177\/0146167298245010"},{"key":"e_1_2_1_85_1","doi-asserted-by":"crossref","first-page":"1122","DOI":"10.2307\/256929","article-title":"A meta-analysis of the effects of organizational behavior modification on task performance, 1975--95","volume":"40","author":"Stajkovic Alexander D.","year":"1997","unstructured":"Alexander D. Stajkovic and Fred Luthans . 1997 . A meta-analysis of the effects of organizational behavior modification on task performance, 1975--95 . Acad. Manage. J. 40 , 5 (1997), 1122 -- 1149 . Alexander D. Stajkovic and Fred Luthans. 1997. A meta-analysis of the effects of organizational behavior modification on task performance, 1975--95. Acad. Manage. J. 40, 5 (1997), 1122--1149.","journal-title":"Acad. Manage. J."},{"key":"e_1_2_1_86_1","doi-asserted-by":"publisher","DOI":"10.1037\/0033-2909.87.2.245"},{"key":"e_1_2_1_87_1","doi-asserted-by":"publisher","DOI":"10.1027\/1614-2241\/a000049"},{"key":"e_1_2_1_88_1","doi-asserted-by":"publisher","DOI":"10.1037\/a0015167"},{"key":"e_1_2_1_89_1","unstructured":"Amazon Mechanical Turk. 2018. Amazon Mechanical Turk: Worker Web Site FAQs. Retrieved from http:\/\/www.mturk.com\/mturk\/help?helpPage&equals;worker#how_paid. Amazon Mechanical Turk. 2018. Amazon Mechanical Turk: Worker Web Site FAQs. Retrieved from http:\/\/www.mturk.com\/mturk\/help?helpPage&equals;worker#how_paid."},{"key":"e_1_2_1_90_1","doi-asserted-by":"publisher","DOI":"10.1177\/0013164492052004025"},{"key":"e_1_2_1_91_1","doi-asserted-by":"publisher","DOI":"10.1080\/17405629.2012.686740"},{"key":"e_1_2_1_92_1","doi-asserted-by":"publisher","DOI":"10.1002\/9781118294895.ch17"},{"key":"e_1_2_1_93_1","doi-asserted-by":"publisher","DOI":"10.1177\/0011000006288127"}],"container-title":["ACM Transactions on Social Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3335081","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3335081","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T23:45:01Z","timestamp":1750203901000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3335081"}},"subtitle":["The Multidimensional Crowdworker Motivation Scale"],"short-title":[],"issued":{"date-parts":[[2019,6,30]]},"references-count":93,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2019,6,30]]}},"alternative-id":["10.1145\/3335081"],"URL":"https:\/\/doi.org\/10.1145\/3335081","relation":{},"ISSN":["2469-7818","2469-7826"],"issn-type":[{"value":"2469-7818","type":"print"},{"value":"2469-7826","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,6,30]]},"assertion":[{"value":"2018-05-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2019-05-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2019-09-23","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}