{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T20:33:43Z","timestamp":1776112423904,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":113,"publisher":"ACM","license":[{"start":{"date-parts":[[2025,4,25]],"date-time":"2025-04-25T00:00:00Z","timestamp":1745539200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"NASA EPSCoR RID Award","award":["80NSSC22M0040"],"award-info":[{"award-number":["80NSSC22M0040"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2025,4,26]]},"DOI":"10.1145\/3706598.3714195","type":"proceedings-article","created":{"date-parts":[[2025,4,24]],"date-time":"2025-04-24T04:40:09Z","timestamp":1745469609000},"page":"1-32","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":3,"title":["Towards Fair and Equitable Incentives to Motivate Paid and Unpaid Crowd Contributions"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5297-1659","authenticated-orcid":false,"given":"Shaun","family":"Wallace","sequence":"first","affiliation":[{"name":"Computer Science and Statistics, University of Rhode Island, Kingston, Rhode Island, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4048-919X","authenticated-orcid":false,"given":"Talie","family":"Massachi","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Brown University, Providence, Rhode Island, USA"}]},{"ORCID":"https:\/\/orcid.org\/0009-0007-4417-0481","authenticated-orcid":false,"given":"Jiaqi","family":"Su","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Brown University, Providence, Rhode Island, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9706-4630","authenticated-orcid":false,"given":"Dave B","family":"Miller","sequence":"additional","affiliation":[{"name":"Department of Mechanical Engineering, Tufts University, Medford, Massachusetts, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3453-5666","authenticated-orcid":false,"given":"Jeff","family":"Huang","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Brown University, Providence, Rhode Island, USA"}]}],"member":"320","published-online":{"date-parts":[[2025,4,25]]},"reference":[{"key":"e_1_3_3_3_2_2","unstructured":"Bryan Alexander. 2020. The little spreadsheet that could and did: crowdsourcing COVID-19 higher education data and stories. https:\/\/bryanalexander.org\/research-topics\/the-little-spreadsheet-that-could-and-did-crowdsourcing-covid-19-higher-education-data-and-stories\/. (Accessed on 04\/12\/2021)."},{"key":"e_1_3_3_3_3_2","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3025974"},{"key":"e_1_3_3_3_4_2","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3026057"},{"key":"e_1_3_3_3_5_2","doi-asserted-by":"publisher","DOI":"10.4337\/9780857939852.00012"},{"key":"e_1_3_3_3_6_2","doi-asserted-by":"publisher","DOI":"10.1145\/2441955.2441979"},{"key":"e_1_3_3_3_7_2","doi-asserted-by":"crossref","unstructured":"Michael\u00a0S Bernstein. 2013. Crowd-powered systems. KI-K\u00fcnstliche Intelligenz 27 1 (2013) 69\u201373.","DOI":"10.1007\/s13218-012-0233-0"},{"key":"e_1_3_3_3_8_2","doi-asserted-by":"publisher","DOI":"10.1145\/1866029.1866078"},{"key":"e_1_3_3_3_9_2","doi-asserted-by":"crossref","unstructured":"Michael\u00a0S Bernstein Greg Little Robert\u00a0C Miller Bj\u00f6rn Hartmann Mark\u00a0S Ackerman David\u00a0R Karger David Crowell and Katrina Panovich. 2015. Soylent: a word processor with a crowd inside. Commun. ACM 58 8 (2015) 85\u201394.","DOI":"10.1145\/2791285"},{"key":"e_1_3_3_3_10_2","unstructured":"Toine Bogers and Rasmus\u00a0Nordenhoff Wernersen. 2014. How\u2019Social\u2019are Social News Sites? Exploring the Motivations for Using Reddit. com. iConference 2014: Breaking Down Walls: Culture-Context-Computing (2014) 329\u2013344."},{"key":"e_1_3_3_3_11_2","doi-asserted-by":"publisher","DOI":"10.1609\/hcomp.v2i1.13205"},{"key":"e_1_3_3_3_12_2","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702329"},{"key":"e_1_3_3_3_13_2","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858198"},{"key":"e_1_3_3_3_14_2","doi-asserted-by":"crossref","unstructured":"Gordon Burtch Yili Hong Ravi Bapna and Vladas Griskevicius. 2018. Stimulating online reviews by combining financial incentives and social norms. Management Science 64 5 (2018) 2065\u20132082.","DOI":"10.1287\/mnsc.2016.2715"},{"key":"e_1_3_3_3_15_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICPR.2014.756"},{"key":"e_1_3_3_3_16_2","doi-asserted-by":"crossref","unstructured":"Luca Cacciapuoti Veselin\u00a0B Kostov Marc Kuchner Elisa\u00a0V Quintana Knicole\u00a0D Col\u00f3n Jonathan Brande Susan\u00a0E Mullally Quadry Chance Jessie\u00a0L Christiansen John\u00a0P Ahlers et\u00a0al. 2022. The TESS Triple-9 Catalog: 999 uniformly vetted exoplanet candidates. Monthly Notices of the Royal Astronomical Society 513 1 (2022) 102\u2013116.","DOI":"10.1093\/mnras\/stac652"},{"key":"e_1_3_3_3_17_2","first-page":"52","volume-title":"Proceedings of the International AAAI Conference on Web and Social Media","volume":"10","author":"Chang Shuo","year":"2016","unstructured":"Shuo Chang, F Harper, Lingfei He, and Loren Terveen. 2016. CrowdLens: experimenting with crowd-powered recommendation and explanation. In Proceedings of the International AAAI Conference on Web and Social Media , Vol.\u00a010. 52\u201361."},{"key":"e_1_3_3_3_18_2","doi-asserted-by":"crossref","unstructured":"Yan Chen F\u00a0Maxwell Harper Joseph Konstan and Sherry\u00a0Xin Li. 2010. Social comparisons and contributions to online communities: A field experiment on movielens. American Economic Review 100 4 (2010) 1358\u20131398.","DOI":"10.1257\/aer.100.4.1358"},{"key":"e_1_3_3_3_19_2","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702145"},{"key":"e_1_3_3_3_20_2","doi-asserted-by":"crossref","unstructured":"Aaron Clauset Samuel Arbesman and Daniel\u00a0B Larremore. 2015. Systematic inequality and hierarchy in faculty hiring networks. Science Advances 1 1 (2015) e1400005.","DOI":"10.1126\/sciadv.1400005"},{"key":"e_1_3_3_3_21_2","doi-asserted-by":"crossref","unstructured":"Joanna Coast and Sue Horrocks. 2007. Developing attributes and levels for discrete choice experiments using qualitative methods. Journal of health services research & policy 12 1 (2007) 25\u201330.","DOI":"10.1258\/135581907779497602"},{"key":"e_1_3_3_3_22_2","doi-asserted-by":"publisher","DOI":"10.1145\/1216295.1216309"},{"key":"e_1_3_3_3_23_2","unstructured":"Paramita Das Bhanu Prakash\u00a0Reddy Guda Debajit Chakraborty Soumya Sarkar and Animesh Mukherjee. 2021. When expertise gone missing: Uncovering the loss of prolific contributors in Wikipedia. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/2109.09979 (2021)."},{"key":"e_1_3_3_3_24_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-33876-2_3"},{"key":"e_1_3_3_3_25_2","doi-asserted-by":"publisher","DOI":"10.1145\/3613904.3642429"},{"key":"e_1_3_3_3_26_2","volume-title":"Cidr","author":"Deng Dong","year":"2017","unstructured":"Dong Deng, Raul\u00a0Castro Fernandez, Ziawasch Abedjan, Sibo Wang, Michael Stonebraker, Ahmed\u00a0K Elmagarmid, Ihab\u00a0F Ilyas, Samuel Madden, Mourad Ouzzani, and Nan Tang. 2017. The Data Civilizer System.. In Cidr."},{"key":"e_1_3_3_3_27_2","doi-asserted-by":"crossref","unstructured":"Greg d\u2019Eon Joslin Goh Kate Larson and Edith Law. 2019. Paying crowd workers for collaborative work. Proceedings of the ACM on Human-Computer Interaction 3 CSCW (2019) 1\u201324.","DOI":"10.1145\/3359227"},{"key":"e_1_3_3_3_28_2","doi-asserted-by":"crossref","unstructured":"Anhai Doan Raghu Ramakrishnan and Alon\u00a0Y Halevy. 2011. Crowdsourcing systems on the world-wide web. Commun. ACM 54 4 (2011) 86\u201396.","DOI":"10.1145\/1924421.1924442"},{"key":"e_1_3_3_3_29_2","doi-asserted-by":"crossref","unstructured":"Daniel\u00a0A Epstein Fannie Liu Andr\u00e9s Monroy-Hern\u00e1ndez and Dennis Wang. 2022. Revisiting piggyback prototyping: Examining benefits and tradeoffs in extending existing social computing systems. Proceedings of the ACM on Human-Computer Interaction 6 CSCW2 (2022) 1\u201328.","DOI":"10.1145\/3555557"},{"key":"e_1_3_3_3_30_2","doi-asserted-by":"crossref","unstructured":"Shaoyang Fan Ujwal Gadiraju Alessandro Checco and Gianluca Demartini. 2020. Crowdco-op: Sharing risks and rewards in crowdsourcing. Proceedings of the ACM on Human-Computer Interaction 4 CSCW2 (2020) 1\u201324.","DOI":"10.1145\/3415203"},{"key":"e_1_3_3_3_31_2","doi-asserted-by":"crossref","unstructured":"Claudia Flores-Saviaga Ricardo Granados Liliana Savage Lizbeth Escobedo and Saiph Savage. 2020. Understanding the complementary nature of paid and volunteer crowds for content creation. Avances en Interacci\u00f3n Humano-Computadora 1 1 (2020) 37\u201344.","DOI":"10.47756\/aihc.y5i1.65"},{"key":"e_1_3_3_3_32_2","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702443"},{"key":"e_1_3_3_3_33_2","unstructured":"Rishab\u00a0A Ghosh Ruediger Glott Bernhard Krieger and Gregorio Robles. 2002. Free\/libre and open source software: Survey and study."},{"key":"e_1_3_3_3_34_2","doi-asserted-by":"crossref","unstructured":"Ilka\u00a0H Gleibs. 2017. Are all \u201cresearch fields\u201d equal? Rethinking practice for the use of data from crowdsourcing market places. Behavior Research Methods 49 4 (2017) 1333\u20131342.","DOI":"10.3758\/s13428-016-0789-y"},{"key":"e_1_3_3_3_35_2","doi-asserted-by":"publisher","unstructured":"Daniel Haas Jason Ansel Lydia Gu and Adam Marcus. 2015. Argonaut: Macrotask Crowdsourcing for Complex Data Processing. Proceedings of the VLDB Endowment 8 12 (Aug. 2015) 1642\u20131653. 10.14778\/2824032.2824062","DOI":"10.14778\/2824032.2824062"},{"key":"e_1_3_3_3_36_2","doi-asserted-by":"crossref","unstructured":"Benjamin\u00a0V Hanrahan Anita Chen JiaHua Ma Ning\u00a0F Ma Anna Squicciarini and Saiph Savage. 2021. The expertise involved in deciding which HITs are worth doing on Amazon Mechanical Turk. Proceedings of the ACM on Human-Computer Interaction 5 CSCW1 (2021) 1\u201323.","DOI":"10.1145\/3449202"},{"key":"e_1_3_3_3_37_2","doi-asserted-by":"publisher","DOI":"10.1145\/2983323.2983740"},{"key":"e_1_3_3_3_38_2","unstructured":"Benjamin\u00a0Mako Hill and Aaron Shaw. 2020. Wikipedia and the End of Open Collaboration. Wikipedia 20 (2020)."},{"key":"e_1_3_3_3_39_2","doi-asserted-by":"publisher","DOI":"10.1145\/2736277.2741102"},{"key":"e_1_3_3_3_40_2","doi-asserted-by":"publisher","DOI":"10.1145\/1807342.1807376"},{"key":"e_1_3_3_3_41_2","doi-asserted-by":"publisher","DOI":"10.1145\/2470654.2470743"},{"key":"e_1_3_3_3_42_2","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300637"},{"key":"e_1_3_3_3_43_2","doi-asserted-by":"crossref","unstructured":"Hasan Humayun Masitah Ghazali and Mohammad\u00a0Noman Malik. 2023. Is sustained participation a myth in crowdsourcing? A review. European Journal of Innovation Management (2023).","DOI":"10.1108\/EJIM-10-2022-0589"},{"key":"e_1_3_3_3_44_2","doi-asserted-by":"crossref","unstructured":"Hasan Humayun Mohammad\u00a0Nauman Malik and Masitah Ghazali. 2024. Analysis of Motivational Theories in Crowdsourcing Using Long Tail Theory: A Systematic Literature Review. International Journal of Crowd Science 8 1 (2024) 10\u201327.","DOI":"10.26599\/IJCS.2023.9100010"},{"key":"e_1_3_3_3_45_2","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858327"},{"key":"e_1_3_3_3_46_2","doi-asserted-by":"publisher","DOI":"10.1145\/3306446.3340826"},{"key":"e_1_3_3_3_47_2","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300541"},{"key":"e_1_3_3_3_48_2","doi-asserted-by":"crossref","unstructured":"Warut Khern-am nuai Karthik Kannan and Hossein Ghasemkhani. 2018. Extrinsic versus intrinsic rewards for contributing reviews in an online platform. Information Systems Research 29 4 (2018) 871\u2013892.","DOI":"10.1287\/isre.2017.0750"},{"key":"e_1_3_3_3_49_2","doi-asserted-by":"publisher","DOI":"10.1609\/icwsm.v11i1.14900"},{"key":"e_1_3_3_3_50_2","unstructured":"Juho Kim et\u00a0al. 2015. Learnersourcing: improving learning with collective learner activity. Ph.\u00a0D. Dissertation. Massachusetts Institute of Technology."},{"key":"e_1_3_3_3_51_2","doi-asserted-by":"publisher","DOI":"10.1145\/1357054.1357127"},{"key":"e_1_3_3_3_52_2","doi-asserted-by":"publisher","DOI":"10.1145\/1460563.1460572"},{"key":"e_1_3_3_3_53_2","doi-asserted-by":"publisher","DOI":"10.1145\/2441776.2441923"},{"key":"e_1_3_3_3_54_2","unstructured":"W Kuhfeld. 2001. Multinomial logit discrete choice modeling. An introduction to designing choice experiments and collecting processing and analyzing choice data with SAS. SAS Institute TS-643 (2001)."},{"key":"e_1_3_3_3_55_2","doi-asserted-by":"crossref","unstructured":"Natalie Kupferberg and Bridget\u00a0McCrate Protus. 2011. Accuracy and completeness of drug information in Wikipedia: an assessment. Journal of the Medical Library Association: JMLA 99 4 (2011) 310.","DOI":"10.3163\/1536-5050.99.4.010"},{"key":"e_1_3_3_3_56_2","doi-asserted-by":"crossref","unstructured":"Marjan Laal and Seyed\u00a0Mohammad Ghodsi. 2012. Benefits of collaborative learning. Procedia-social and behavioral sciences 31 (2012) 486\u2013490.","DOI":"10.1016\/j.sbspro.2011.12.091"},{"key":"e_1_3_3_3_57_2","doi-asserted-by":"crossref","unstructured":"Tracy\u00a0Xiao Liu Jiang Yang Lada\u00a0A Adamic and Yan Chen. 2014. Crowdsourcing with all-pay auctions: A field experiment on taskcn. Management Science 60 8 (2014) 2020\u20132037.","DOI":"10.1287\/mnsc.2013.1845"},{"key":"e_1_3_3_3_58_2","doi-asserted-by":"crossref","unstructured":"Jordan\u00a0J Louviere and Emily Lancsar. 2009. Choice experiments in health: the good the bad the ugly and toward a brighter future. Health Economics Policy and Law 4 4 (2009) 527\u2013546.","DOI":"10.1017\/S1744133109990193"},{"key":"e_1_3_3_3_59_2","doi-asserted-by":"crossref","unstructured":"Eddy Maddalena Luis-Daniel Ib\u00e1\u00f1ez Neal Reeves and Elena Simperl. 2023. Qrowdsmith: Enhancing paid microtask crowdsourcing with gamification and furtherance incentives. ACM Transactions on Intelligent Systems and Technology 14 5 (2023) 1\u201326.","DOI":"10.1145\/3604940"},{"key":"e_1_3_3_3_60_2","doi-asserted-by":"crossref","unstructured":"Lindsay\u00a0J Mangham Kara Hanson and Barbara McPake. 2009. How to do (or not to do)\u2026 Designing a discrete choice experiment for application in a low-income country. Health policy and planning 24 2 (2009) 151\u2013158.","DOI":"10.1093\/heapol\/czn047"},{"key":"e_1_3_3_3_61_2","doi-asserted-by":"publisher","DOI":"10.1609\/hcomp.v1i1.13075"},{"key":"e_1_3_3_3_62_2","unstructured":"Adam Marcus. 2013. How I Learned to Stop Worrying and Love the Crowd. https:\/\/www.youtube.com\/watch?v=FL9Q43zO1BQ (Online; accessed on 2020-04-20)."},{"key":"e_1_3_3_3_63_2","doi-asserted-by":"publisher","DOI":"10.1145\/3578503.3583622"},{"key":"e_1_3_3_3_64_2","doi-asserted-by":"publisher","unstructured":"Winter Mason and Duncan\u00a0J. Watts. 2009. Financial Incentives and the \u201cPerformance of Crowds\u201d. ACM SigKDD Explorations Newsletter 11 2 (2009) 77\u201385. 10.1145\/1600150.1600175","DOI":"10.1145\/1600150.1600175"},{"key":"e_1_3_3_3_65_2","doi-asserted-by":"publisher","DOI":"10.1145\/3308558.3313583"},{"key":"e_1_3_3_3_66_2","unstructured":"Marc Miquel-Rib\u00e9 Cristian Consonni and David Laniado. 2021. Wikipedia Editor Drop-Off. Wiki Workshop at The Web Conference 2021 (2021)."},{"key":"e_1_3_3_3_67_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICL.2013.6644565"},{"key":"e_1_3_3_3_68_2","doi-asserted-by":"crossref","unstructured":"Carrie Moore and Lisa Chuang. 2017. Redditors revealed: Motivational factors of the Reddit community. Proceedings of the 50th Hawaii International Conference on System Sciences (2017) 1\u201310.","DOI":"10.24251\/HICSS.2017.279"},{"key":"e_1_3_3_3_69_2","doi-asserted-by":"crossref","unstructured":"Mar\u00e7al Mora-Cantallops Salvador S\u00e1nchez-Alonso and Elena Garc\u00eda-Barriocanal. 2019. A systematic literature review on Wikidata. Data Technologies and Applications 53 3 (2019) 250\u2013268.","DOI":"10.1108\/DTA-12-2018-0110"},{"key":"e_1_3_3_3_70_2","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3025687"},{"key":"e_1_3_3_3_71_2","doi-asserted-by":"publisher","DOI":"10.1145\/1753326.1753587"},{"key":"e_1_3_3_3_72_2","doi-asserted-by":"publisher","DOI":"10.5555\/3278335"},{"key":"e_1_3_3_3_73_2","doi-asserted-by":"crossref","unstructured":"Robbie\u00a0T Nakatsu Elissa\u00a0B Grossman and Charalambos\u00a0L Iacovou. 2014. A taxonomy of crowdsourcing based on task complexity. Journal of Information Science 40 6 (2014) 823\u2013834.","DOI":"10.1177\/0165551514550140"},{"key":"e_1_3_3_3_74_2","doi-asserted-by":"crossref","unstructured":"Senthilselvan Natarajan Subramaniyaswamy Vairavasundaram Sivaramakrishnan Natarajan and Amir\u00a0H Gandomi. 2020. Resolving data sparsity and cold start problem in collaborative filtering recommender system using linked open data. Expert Systems with Applications 149 (2020) 113248.","DOI":"10.1016\/j.eswa.2020.113248"},{"key":"e_1_3_3_3_75_2","first-page":"86","volume-title":"SemTab@ ISWC","author":"Nguyen Phuc","year":"2020","unstructured":"Phuc Nguyen, Ikuya Yamada, Natthawut Kertkeidkachorn, Ryutaro Ichise, and Hideaki Takeda. 2020. MTab4Wikidata at SemTab 2020: Tabular Data Annotation with Wikidata.. In SemTab@ ISWC. ACM, New York, NY, USA, 86\u201395."},{"key":"e_1_3_3_3_76_2","unstructured":"DOE\u00a0Office of Science. 2022. Argonne Computer Scientist Works on Power and Processor Efficiency While Diversifying Workforce. https:\/\/www.hpcwire.com\/off-the-wire\/argonne-computer-scientist-works-on-power-and-processor-efficiency-while-diversifying-workforce\/. (Accessed on 11\/01\/2022)."},{"key":"e_1_3_3_3_77_2","doi-asserted-by":"publisher","DOI":"10.1145\/2615569.2615644"},{"key":"e_1_3_3_3_78_2","unstructured":"Bryan Orme. 2002. Interpreting conjoint analysis data. Sawtooth Software Research Paper Series (2002)."},{"key":"e_1_3_3_3_79_2","doi-asserted-by":"publisher","DOI":"10.1609\/hcomp.v3i1.13230"},{"key":"e_1_3_3_3_80_2","volume-title":"Wirtschaftsinformatik","author":"Pilz Dennis","year":"2013","unstructured":"Dennis Pilz and Heiko Gewald. 2013. Does Money Matter? Motivational Factors for Participation in Paid- and Non-Profit-Crowdsourcing Communities. In Wirtschaftsinformatik. https:\/\/api.semanticscholar.org\/CorpusID:7858381"},{"key":"e_1_3_3_3_81_2","unstructured":"Wikimedia Project. 2021. Wikipedia and Wikidata Tools - Meta. https:\/\/meta.wikimedia.org\/wiki\/Wikipedia_and_Wikidata_Tools. (Accessed on 07\/10\/2021)."},{"key":"e_1_3_3_3_82_2","unstructured":"Wikimedia Project. 2022. Why is Wikipedia losing contributors - thinking about remedies. https:\/\/en.wikipedia.org\/wiki\/Wikipedia:Why_is_Wikipedia_losing_contributors_-_Thinking_about_remedies. (Accessed on 06\/02\/2022)."},{"key":"e_1_3_3_3_83_2","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376403"},{"key":"e_1_3_3_3_84_2","doi-asserted-by":"crossref","unstructured":"Matthew Quaife Fern Terris-Prestholt Gian\u00a0Luca Di\u00a0Tanna and Peter Vickerman. 2018. How well do discrete choice experiments predict health choices? A systematic review and meta-analysis of external validity. The European journal of health economics 19 (2018) 1053\u20131066.","DOI":"10.1007\/s10198-018-0954-6"},{"key":"e_1_3_3_3_85_2","doi-asserted-by":"publisher","DOI":"10.1145\/1978942.1979148"},{"key":"e_1_3_3_3_86_2","doi-asserted-by":"crossref","unstructured":"Sam Ransbotham and Gerald\u00a0C Kane. 2011. Membership turnover and collaboration success in online communities: Explaining rises and falls from grace in Wikipedia. Mis Quarterly 35 (2011) 613\u2013627.","DOI":"10.2307\/23042799"},{"key":"e_1_3_3_3_87_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-87753-0"},{"key":"e_1_3_3_3_88_2","doi-asserted-by":"publisher","DOI":"10.1145\/2675133.2675246"},{"key":"e_1_3_3_3_89_2","first-page":"321","volume-title":"Fifth International AAAI Conference on Weblogs and Social Media","author":"Rogstadius Jakob","year":"2011","unstructured":"Jakob Rogstadius, Vassilis Kostakos, Aniket Kittur, Boris Smus, Jim Laredo, and Maja Vukovic. 2011. An assessment of intrinsic and extrinsic motivation on task performance in crowdsourcing markets. In Fifth International AAAI Conference on Weblogs and Social Media. AAAI, Menlo Park, CA, USA, 321\u2013328."},{"key":"e_1_3_3_3_90_2","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702508"},{"key":"e_1_3_3_3_91_2","doi-asserted-by":"publisher","DOI":"10.1145\/3366423.3380200"},{"key":"e_1_3_3_3_92_2","doi-asserted-by":"publisher","DOI":"10.1145\/2818048.2819985"},{"key":"e_1_3_3_3_93_2","doi-asserted-by":"crossref","unstructured":"Linda See Alexis Comber Carl Salk Steffen Fritz Marijn van\u00a0der Velde Christoph Perger Christian Schill Ian McCallum Florian Kraxner and Michael Obersteiner. 2013. Comparing the quality of crowdsourced data contributed by expert and non-experts. PloS one 8 7 (2013) e69958.","DOI":"10.1371\/journal.pone.0069958"},{"key":"e_1_3_3_3_94_2","doi-asserted-by":"crossref","unstructured":"Danqing Shi Xinyue Xu Fuling Sun Yang Shi and Nan Cao. 2020. Calliope: Automatic visual data story generation from a spreadsheet. IEEE Transactions on Visualization and Computer Graphics 27 2 (2020) 453\u2013463.","DOI":"10.1109\/TVCG.2020.3030403"},{"key":"e_1_3_3_3_95_2","doi-asserted-by":"publisher","DOI":"10.1145\/2567948.2579215"},{"key":"e_1_3_3_3_96_2","doi-asserted-by":"publisher","DOI":"10.1145\/3491140.3528277"},{"key":"e_1_3_3_3_97_2","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376783"},{"key":"e_1_3_3_3_98_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-55128-4_21"},{"key":"e_1_3_3_3_99_2","first-page":"45","volume-title":"ISWC Satellites","author":"Szekely Pedro\u00a0A","year":"2019","unstructured":"Pedro\u00a0A Szekely, Daniel Garijo, Jay Pujara, Divij Bhatia, and Jiasheng Wu. 2019. T2WML: A Cell-Based Language to Map Tables into Wikidata Records.. In ISWC Satellites. ACM, New York, NY, USA, 45\u201348."},{"key":"e_1_3_3_3_100_2","doi-asserted-by":"crossref","unstructured":"Carlos Toxtli Siddharth Suri and Saiph Savage. 2021. Quantifying the invisible labor in crowd work. Proceedings of the ACM on human-computer interaction 5 CSCW2 (2021) 1\u201326.","DOI":"10.1145\/3476060"},{"key":"e_1_3_3_3_101_2","doi-asserted-by":"publisher","DOI":"10.1145\/3491101.3503803"},{"key":"e_1_3_3_3_102_2","volume-title":"CS Open Rankings","author":"Wallace Shaun","year":"2020","unstructured":"Shaun Wallace, Long Do, Alice Marbach, and Jeff Huang. 2020. CS Open Rankings. Retrieved January 21, 2025 from https:\/\/drafty.cs.brown.edu\/csopenrankings\/"},{"key":"e_1_3_3_3_103_2","doi-asserted-by":"crossref","unstructured":"Shaun Wallace Brendan Le Luis\u00a0A Leiva Aman Haq Ari Kintisch Gabrielle Bufrem Linda Chang and Jeff Huang. 2020. Sketchy: Drawing inspiration from the crowd. Proceedings of the ACM on Human-Computer Interaction 4 CSCW2 (2020) 1\u201327.","DOI":"10.1145\/3415243"},{"key":"e_1_3_3_3_104_2","doi-asserted-by":"crossref","unstructured":"Shaun Wallace Alexandra Papoutsaki Neilly\u00a0H Tan Hua Guo and Jeff Huang. 2021. Case Studies on the Motivation and Performance of Contributors Who Verify and Maintain In-Flux Tabular Datasets. Proceedings of the ACM on Human-Computer Interaction 5 CSCW2 (2021) 1\u201325.","DOI":"10.1145\/3479592"},{"key":"e_1_3_3_3_105_2","doi-asserted-by":"publisher","DOI":"10.1609\/hcomp.v5i1.13300"},{"key":"e_1_3_3_3_106_2","doi-asserted-by":"crossref","unstructured":"Jing Wang Gen Li and Kai-Lung Hui. 2018. Do Monetary Incentives Create a Spillover Effect on Free Knowledge Contribution? Evidence from a Natural Experiment. Evidence from a Natural Experiment (June 25 2018) (2018) 1\u201324.","DOI":"10.2139\/ssrn.3212596"},{"key":"e_1_3_3_3_107_2","doi-asserted-by":"crossref","unstructured":"Sylvain Weber. 2021. A step-by-step procedure to implement discrete choice experiments in Qualtrics. Social Science Computer Review 39 5 (2021) 903\u2013921.","DOI":"10.1177\/0894439319885317"},{"key":"e_1_3_3_3_108_2","first-page":"1611","volume-title":"Proceedings of the International AAAI Conference on Web and Social Media","volume":"18","author":"Weld Galen","year":"2024","unstructured":"Galen Weld, Amy\u00a0X Zhang, and Tim Althoff. 2024. Making online communities \u2018better\u2019: a taxonomy of community values on reddit. In Proceedings of the International AAAI Conference on Web and Social Media , Vol.\u00a018. 1611\u20131633."},{"key":"e_1_3_3_3_109_2","doi-asserted-by":"crossref","unstructured":"Dennis\u00a0M Wilkinson and Bernardo\u00a0A Huberman. 2007. Assessing the value of coooperation in wikipedia. arXiv preprint cs\/0702140 (2007) 1\u201314.","DOI":"10.5210\/fm.v12i4.1763"},{"key":"e_1_3_3_3_110_2","doi-asserted-by":"publisher","DOI":"10.1145\/3544548.3581282"},{"key":"e_1_3_3_3_111_2","first-page":"201","volume-title":"IJCAI","author":"Yin Ming","year":"2015","unstructured":"Ming Yin and Yiling Chen. 2015. Bonus or not? learn to reward in crowdsourcing.. In IJCAI. 201\u2013208."},{"key":"e_1_3_3_3_112_2","doi-asserted-by":"crossref","unstructured":"Xuefeng Zhang Enjun Xia Chao Shen and Jiafu Su. 2022. Factors Influencing Solvers\u2019 Behaviors in Knowledge-Intensive Crowdsourcing: A Systematic Literature Review. Journal of Theoretical and Applied Electronic Commerce Research 17 4 (2022) 1297\u20131319.","DOI":"10.3390\/jtaer17040066"},{"key":"e_1_3_3_3_113_2","doi-asserted-by":"publisher","DOI":"10.1145\/2818048.2819957"},{"key":"e_1_3_3_3_114_2","doi-asserted-by":"crossref","unstructured":"Yudian Zheng Guoliang Li Yuanbing Li Caihua Shan and Reynold Cheng. 2017. Truth inference in crowdsourcing: Is the problem solved? Proc. VLDB Endowment 10 5 (2017) 541\u2013552.","DOI":"10.14778\/3055540.3055547"}],"event":{"name":"CHI 2025: CHI Conference on Human Factors in Computing Systems","location":"Yokohama Japan","acronym":"CHI '25","sponsor":["SIGCHI ACM Special Interest Group on Computer-Human Interaction"]},"container-title":["Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3706598.3714195","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3706598.3714195","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,4]],"date-time":"2025-07-04T06:00:45Z","timestamp":1751608845000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3706598.3714195"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,4,25]]},"references-count":113,"alternative-id":["10.1145\/3706598.3714195","10.1145\/3706598"],"URL":"https:\/\/doi.org\/10.1145\/3706598.3714195","relation":{},"subject":[],"published":{"date-parts":[[2025,4,25]]},"assertion":[{"value":"2025-04-25","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}