{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T02:01:19Z","timestamp":1760148079033,"version":"build-2065373602"},"reference-count":64,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2023,3,29]],"date-time":"2023-03-29T00:00:00Z","timestamp":1680048000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001871","name":"FCT\u2014Funda\u00e7\u00e3o para a Ci\u00eancia e a Tecnologia (Portuguese Foundation for Science and Technology)","doi-asserted-by":"publisher","award":["SFRH\/BD\/148991\/2019"],"award-info":[{"award-number":["SFRH\/BD\/148991\/2019"]}],"id":[{"id":"10.13039\/501100001871","id-type":"DOI","asserted-by":"publisher"}]},{"name":"European Social Fund","award":["SFRH\/BD\/148991\/2019"],"award-info":[{"award-number":["SFRH\/BD\/148991\/2019"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>The study of data quality in crowdsourcing campaigns is currently a prominent research topic, given the diverse range of participants involved. A potential solution to enhancing data quality processes in crowdsourcing is cognitive personalization, which involves appropriately adapting or assigning tasks based on a crowd worker\u2019s cognitive profile. There are two common methods for assessing a crowd worker\u2019s cognitive profile: administering online cognitive tests, and inferring behavior from task fingerprinting based on user interaction log events. This article presents the findings of a study that investigated the complementarity of both approaches in a microtask scenario, focusing on personalizing task design. The study involved 134 unique crowd workers recruited from a crowdsourcing marketplace. The main objective was to examine how the administration of cognitive ability tests can be used to allocate crowd workers to microtasks with varying levels of difficulty, including the development of a deep learning model. Another goal was to investigate if task fingerprinting can be used to allocate crowd workers to different microtasks in a personalized manner. The results indicated that both objectives were accomplished, validating the usage of cognitive tests and task fingerprinting as effective mechanisms for microtask personalization, including the development of a deep learning model with 95% accuracy in predicting the accuracy of the microtasks. While we achieved an accuracy of 95%, it is important to note that the small dataset size may have limited the model\u2019s performance.<\/jats:p>","DOI":"10.3390\/s23073571","type":"journal-article","created":{"date-parts":[[2023,3,30]],"date-time":"2023-03-30T01:31:30Z","timestamp":1680139890000},"page":"3571","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["A Model for Cognitive Personalization of Microtask Design"],"prefix":"10.3390","volume":"23","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8463-6302","authenticated-orcid":false,"given":"Dennis","family":"Paulino","sequence":"first","affiliation":[{"name":"School of Science and Technology, University of Tr\u00e1s-os-Montes e Alto Douro, 5000-801 Vila Real, Portugal"},{"name":"INESC TEC, 4200-465 Porto, Portugal"}]},{"given":"Diogo","family":"Guimar\u00e3es","sequence":"additional","affiliation":[{"name":"School of Science and Technology, University of Tr\u00e1s-os-Montes e Alto Douro, 5000-801 Vila Real, Portugal"},{"name":"INESC TEC, 4200-465 Porto, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2736-3835","authenticated-orcid":false,"given":"Ant\u00f3nio","family":"Correia","sequence":"additional","affiliation":[{"name":"School of Science and Technology, University of Tr\u00e1s-os-Montes e Alto Douro, 5000-801 Vila Real, Portugal"},{"name":"INESC TEC, 4200-465 Porto, Portugal"}]},{"given":"Jos\u00e9","family":"Ribeiro","sequence":"additional","affiliation":[{"name":"School of Science and Technology, University of Tr\u00e1s-os-Montes e Alto Douro, 5000-801 Vila Real, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4847-5104","authenticated-orcid":false,"given":"Jo\u00e3o","family":"Barroso","sequence":"additional","affiliation":[{"name":"School of Science and Technology, University of Tr\u00e1s-os-Montes e Alto Douro, 5000-801 Vila Real, Portugal"},{"name":"INESC TEC, 4200-465 Porto, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4274-4783","authenticated-orcid":false,"given":"Hugo","family":"Paredes","sequence":"additional","affiliation":[{"name":"School of Science and Technology, University of Tr\u00e1s-os-Montes e Alto Douro, 5000-801 Vila Real, Portugal"},{"name":"INESC TEC, 4200-465 Porto, Portugal"}]}],"member":"1968","published-online":{"date-parts":[[2023,3,29]]},"reference":[{"key":"ref_1","unstructured":"World Health Organization (2001). International Classification of Functioning, Disability and Health (ICF), World Health Organization."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"574","DOI":"10.3109\/09638288.2016.1145258","article-title":"Refinements of the ICF Linking Rules to strengthen their potential for establishing comparability of health information","volume":"41","author":"Cieza","year":"2019","journal-title":"Disabil. Rehabil."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"334","DOI":"10.1055\/s-2007-986530","article-title":"The Application of the ICF in Cognitive-Communication Disorders following Traumatic Brain Injury","volume":"28","author":"Larkins","year":"2007","journal-title":"Semin. Speech Lang."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1262","DOI":"10.1016\/S0140-6736(06)68542-5","article-title":"Mild cognitive impairment","volume":"367","author":"Gauthier","year":"2006","journal-title":"Lancet"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.jalz.2016.07.150","article-title":"The worldwide costs of dementia 2015 and comparisons with 2010","volume":"13","author":"Wimo","year":"2017","journal-title":"Alzheimer\u2019s Dement."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"863","DOI":"10.2147\/CIA.S154717","article-title":"Usability and acceptability of technology for community-dwelling older adults with mild cognitive impairment and dementia: A systematic literature review","volume":"13","author":"Holthe","year":"2018","journal-title":"Clin. Interv. Aging"},{"key":"ref_7","first-page":"101","article-title":"Prompting Technology and Persons With Dementia: The Significance of Context and Communication","volume":"59","author":"Braley","year":"2018","journal-title":"Gerontology"},{"key":"ref_8","first-page":"57","article-title":"Collaborative computer-assisted cognitive rehabilitation system","volume":"6","author":"Oliver","year":"2017","journal-title":"ADCAIJ Adv. Distrib. Comput. Artif. Intell. J."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Ge, S., Zhu, Z., Wu, B., and McConnell, E.S. (2018). Technology-based cognitive training and rehabilitation interventions for individuals with mild cognitive impairment: A systematic review. BMC Geriatr., 18.","DOI":"10.1186\/s12877-018-0893-1"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Shraga, R., Scharf, C., Ackerman, R., and Gal, A. (2020, January 14\u201319). Incognitomatch: Cognitive-aware matching via crowdsourcing. Proceedings of the 2020 ACM SIGMOD International Conference on Management of Data, Portland, OR, USA.","DOI":"10.1145\/3318464.3384697"},{"key":"ref_11","first-page":"90","article-title":"Predictors of Performance in Everyday Technology Tasks in Older Adults With and Without Mild Cognitive Impairment","volume":"59","author":"Schmidt","year":"2018","journal-title":"Gerontology"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"162","DOI":"10.1037\/0022-3514.86.1.162","article-title":"General mental ability in the world of work: Occupational attainment and job performance","volume":"86","author":"Schmidt","year":"2004","journal-title":"J. Personal. Soc. Psychol."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1111\/cdep.12352","article-title":"The development of academic achievement and cognitive abilities: A bidirectional perspective","volume":"14","author":"Peng","year":"2020","journal-title":"Child Dev. Perspect."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"99","DOI":"10.1016\/B978-008045046-9.00418-6","article-title":"Executive function and higher-order cognition: Definition and neural substrates","volume":"4","author":"Miller","year":"2009","journal-title":"Encycl. Neurosci."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"45","DOI":"10.1146\/annurev-orgpsych-031413-091255","article-title":"Personality and cognitive ability as predictors of effective performance at work","volume":"1","author":"Schmitt","year":"2014","journal-title":"Annu. Rev. Organ. Psychol. Organ. Behav."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Ones, D.S., Anderson, N., Viswesvaran, C., and Sinangil, H.K. (2018). Handbook of Industrial, Work & Organizational Psychology: Personnel Psychology and Employee Performance, Sage Publications.","DOI":"10.4135\/9781473914940"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Herreen, D., and Zajac, I.T. (2018). The reliability and validity of a self-report measure of cognitive abilities in older adults: More personality than cognitive function. J. Intell., 6.","DOI":"10.3390\/jintelligence6010001"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"e2318","DOI":"10.1002\/pa.2318","article-title":"Intelligence quotient, job satisfaction, and job performance: The moderating role of personality type","volume":"21","author":"Murtza","year":"2020","journal-title":"J. Public Aff."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Nguyen, N.N., Nham, P.T., and Takahashi, Y. (2019). Relationship between Ability-Based Emotional Intelligence, Cognitive Intelligence, and Job Performance. Sustainability, 11.","DOI":"10.3390\/su11082299"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"106","DOI":"10.1016\/j.chb.2016.11.006","article-title":"Predicting computer proficiency in older adults","volume":"67","author":"Zhang","year":"2017","journal-title":"Comput. Hum. Behav."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"43","DOI":"10.1016\/j.cosrev.2015.05.001","article-title":"Crowdsourcing: A taxonomy and systematic mapping study","volume":"17","author":"Hosseini","year":"2015","journal-title":"Comput. Sci. Rev."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"110611","DOI":"10.1016\/j.jss.2020.110611","article-title":"General framework, opportunities and challenges for crowdsourcing techniques: A Comprehensive survey","volume":"167","author":"Bhatti","year":"2020","journal-title":"J. Syst. Softw."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"57","DOI":"10.1007\/s10660-006-5988-7","article-title":"Community based innovation: How to integrate members of virtual communities into new product development","volume":"6","author":"Bartl","year":"2006","journal-title":"Electron. Commer. Res."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Zyskowski, K., Morris, M.R., Bigham, J.P., Gray, M.L., and Kane, S.K. (2015, January 14\u201318). Accessible crowdwork? Understanding the value in and challenge of microtask employment for people with disabilities. Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing, Vancouver, BC, Canada.","DOI":"10.1145\/2675133.2675158"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Cheng, J., Teevan, J., Iqbal, S.T., and Bernstein, M.S. (2015, January 18\u201323). Break it down: A comparison of macro-and microtasks. Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, Seoul, Republic of Korea.","DOI":"10.1145\/2702123.2702146"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Rzeszotarski, J.M., and Kittur, A. (2011, January 16\u201319). Instrumenting the crowd: Using implicit behavioral measures to predict task performance. Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology, Santa Barbara, CA, USA.","DOI":"10.1145\/2047196.2047199"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"56","DOI":"10.1145\/2870649","article-title":"Crowdsourcing Human Annotation on Web Page Structure: Infrastructure Design and Behavior-Based Quality Control","volume":"7","author":"Han","year":"2016","journal-title":"ACM Trans. Intell. Syst. Technol."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Zheng, Y., Wang, J., Li, G., Cheng, R., and Feng, J. (June, January 31). QASCA: A quality-aware task assignment system for crowdsourcing applications. Proceedings of the 2015 ACM SIGMOD International Conference on Management of Data, Melbourne, Australia.","DOI":"10.1145\/2723372.2749430"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"815","DOI":"10.1007\/s10606-018-9336-y","article-title":"Crowd Anatomy Beyond the Good and Bad: Behavioral Traces for Crowd Worker Modeling and Pre-selection","volume":"28","author":"Gadiraju","year":"2019","journal-title":"Comput. Support. Coop. Work (CSCW)"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3479586","article-title":"Quality Control in Crowdsourcing based on Fine-Grained Behavioral Features","volume":"5","author":"Pei","year":"2021","journal-title":"Proc. ACM Hum.-Comput. Interact."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Goncalves, J., Feldman, M., Hu, S., Kostakos, V., and Bernstein, A. (2017, January 3\u20137). Task routing and assignment in crowdsourcing based on cognitive abilities. Proceedings of the 26th International Conference on World Wide Web Companion, Perth, Australia.","DOI":"10.1145\/3041021.3055128"},{"key":"ref_32","unstructured":"Hettiachchi, D., van Berkel, N., Hosio, S., Kostakos, V., and Goncalves, J. (2019). Human-Computer Interaction\u2013INTERACT 2019, Springer."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3415181","article-title":"CrowdCog: A Cognitive Skill based System for Heterogeneous Task Assignment and Recommendation in Crowdsourcing","volume":"4","author":"Hettiachchi","year":"2020","journal-title":"Proc. ACM Hum.-Comput. Interact."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Paulino, D., Pinheiro, P., Rocha, J., Martins, P., Rocha, T., Barroso, J., and Paredes, H. (2020, January 2\u20134). Assessment of wizards for eliciting users\u2019 accessibility preferences. Proceedings of the 9th International Conference on Software Development and Technologies for Enhancing Accessibility and Fighting Info-Exclusion, Online.","DOI":"10.1145\/3439231.3439232"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Eickhoff, C. (2018, January 5\u20139). Cognitive biases in crowdsourcing. Proceedings of the Eleventh ACM International Conference on Web Search and Data Mining, Marina Del Rey, CA, USA.","DOI":"10.1145\/3159652.3159654"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"194","DOI":"10.1145\/3359296","article-title":"I Say, You Say, We Say: Using Spoken Language to Model Socio-Cognitive Processes during Computer-Supported Collaborative Problem Solving","volume":"3","author":"Stewart","year":"2019","journal-title":"Proc. ACM Hum.-Comput. Interact."},{"key":"ref_37","unstructured":"Alagarai Sampath, H., Rajeshuni, R., and Indurkhya, B. (May, January 26). Cognitively inspired task design to improve user performance on crowdsourcing platforms. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Toronto, ON, Canada."},{"key":"ref_38","unstructured":"Paulino, D., Correia, A., Reis, A., Guimar\u00e3es, D., Rudenko, R., Nunes, C., Silva, T., Barroso, J., and Paredes, H. (2022). Universal Access in Human-Computer Interaction: Novel Design Approaches and Technologies, Springer International Publishing."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Paulino, D., Correia, A., Guimar\u00e3es, D., Barroso, J., and Paredes, H. (2022, January 4\u20136). Uncovering the Potential of Cognitive Personalization for UI Adaptation in Crowd Work. Proceedings of the 2022 IEEE 25th International Conference on Computer Supported Cooperative Work in Design (CSCWD), Hangzhou, China.","DOI":"10.1109\/CSCWD54268.2022.9776164"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Rzeszotarski, J., and Kittur, A. (2012, January 7\u201310). CrowdScape: Interactively visualizing user behavior and output. Proceedings of the 25th annual ACM Symposium on User Interface Software and Technology, Cambridge, MA, USA.","DOI":"10.1145\/2380116.2380125"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Yuasa, S., Nakai, T., Maruichi, T., Landsmann, M., Kise, K., Matsubara, M., and Morishima, A. (2019, January 9\u201312). Towards quality assessment of crowdworker output based on behavioral data. Proceedings of the 2019 IEEE International Conference on Big Data (Big Data), Los Angeles, CA, USA.","DOI":"10.1109\/BigData47090.2019.9006114"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Goyal, T., McDonnell, T., Kutlu, M., Elsayed, T., and Lease, M. (2018, January 5\u20138). Your behavior signals your reliability: Modeling crowd behavioral traces to ensure quality relevance annotations. Proceedings of the Sixth AAAI Conference on Human Computation and Crowdsourcing, Zurich, Switzerland.","DOI":"10.1609\/hcomp.v6i1.13331"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Kazai, G., and Zitouni, I. (2016, January 22\u201325). Quality Management in Crowdsourcing using Gold Judges Behavior. Proceedings of the Ninth ACM International Conference on Web Search and Data Mining, San Francisco, CA, USA.","DOI":"10.1145\/2835776.2835835"},{"key":"ref_44","unstructured":"Paulino, D., Barroso, J., and Paredes, H. (ERCIM News, 2022). Introducing People with Autism to Inclusive Digital Work using Microtask Fingerprinting, ERCIM News."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Difallah, D.E., Demartini, G., and Cudr\u00e9-Mauroux, P. (2013, January 13\u201317). Pick-a-crowd: Tell me what you like, and I\u2019ll tell you what to do. Proceedings of the 22nd International Conference on World Wide Web, Rio de Janeiro, Brazil.","DOI":"10.1145\/2488388.2488421"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Gadiraju, U., Kawase, R., and Dietze, S. (2014, January 1\u20134). A taxonomy of microtasks on the web. Proceedings of the 25th ACM Conference on Hypertext and Social Media, Santiage de Chile, Chile.","DOI":"10.1145\/2631775.2631819"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"143","DOI":"10.3758\/BF03203267","article-title":"Effects of noise letters upon the identification of a target letter in a nonsearch task","volume":"16","author":"Eriksen","year":"1974","journal-title":"Percept. Psychophys."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"46","DOI":"10.1002\/hbm.20131","article-title":"N-back working memory paradigm: A meta-analysis of normative functional neuroimaging studies","volume":"25","author":"Owen","year":"2005","journal-title":"Hum. Brain Mapp."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"873","DOI":"10.1073\/pnas.90.3.873","article-title":"Dissociation of human mid-dorsolateral from posterior dorsolateral frontal cortex in memory processing","volume":"90","author":"Petrides","year":"1993","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"163","DOI":"10.1037\/0033-2909.109.2.163","article-title":"Half a century of research on the Stroop effect: An integrative review","volume":"109","author":"MacLeod","year":"1991","journal-title":"Psychol. Bull."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"134","DOI":"10.1016\/S1364-6613(03)00028-7","article-title":"Task switching","volume":"7","author":"Monsell","year":"2003","journal-title":"Trends Cogn. Sci."},{"key":"ref_52","unstructured":"Washington, G. (1796). Papers, Series 5: Financial Papers, 1750\u20131796, Library of Congress."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"171","DOI":"10.1145\/363958.363994","article-title":"A technique for computer detection and correction of spelling errors","volume":"7","author":"Damerau","year":"1964","journal-title":"Commun. ACM"},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"60655","DOI":"10.1109\/ACCESS.2018.2875869","article-title":"Accessibility and activity-centered design for ICT users: ACCESIBILITIC ontology","volume":"6","author":"Torres","year":"2018","journal-title":"IEEE Access"},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"1","DOI":"10.3758\/s13428-014-0458-y","article-title":"jsPsych: A JavaScript library for creating behavioral experiments in a Web browser","volume":"47","year":"2015","journal-title":"Behav. Res. Methods"},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1146\/annurev-clinpsy-021815-093623","article-title":"Conducting clinical research using crowdsourced convenience samples","volume":"12","author":"Chandler","year":"2016","journal-title":"Annu. Rev. Clin. Psychol."},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"899","DOI":"10.1037\/amp0000190","article-title":"Big data in psychology: A framework for research advancement","volume":"73","author":"Adjerid","year":"2018","journal-title":"Am. Psychol."},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"8825","DOI":"10.1073\/pnas.1915841117","article-title":"Scaling up psychology via scientific regret minimization","volume":"117","author":"Agrawal","year":"2020","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_59","unstructured":"Hara, K., and Tanaka, Y. (May, January 29). Understanding Crowdsourcing Requesters\u2019 Wage Setting Behaviors. Proceedings of the CHI Conference on Human Factors in Computing Systems, New Orleans, LA, USA. Extended Abstracts."},{"key":"ref_60","doi-asserted-by":"crossref","first-page":"427","DOI":"10.1007\/s40745-019-00237-0","article-title":"Deep learning: Hope or hype","volume":"7","author":"Ahmed","year":"2020","journal-title":"Ann. Data Sci."},{"key":"ref_61","doi-asserted-by":"crossref","first-page":"338","DOI":"10.1002\/inf2.12028","article-title":"Machine learning in materials science","volume":"1","author":"Wei","year":"2019","journal-title":"InfoMat"},{"key":"ref_62","doi-asserted-by":"crossref","first-page":"168","DOI":"10.1016\/j.chb.2017.11.040","article-title":"How intrinsic motivation and extrinsic incentives affect task effort in crowdsourcing contests: A mediated moderation model","volume":"81","author":"Liang","year":"2018","journal-title":"Comput. Hum. Behav."},{"key":"ref_63","doi-asserted-by":"crossref","first-page":"161","DOI":"10.1332\/273241721X16295434739161","article-title":"Between automation and gamification: Forms of labour control on crowdwork platforms","volume":"1","author":"Krzywdzinski","year":"2021","journal-title":"Work Glob. Econ."},{"key":"ref_64","unstructured":"Paulino, D., Correia, A., Barroso, J., Liberato, M., and Paredes, H. (2021). World Conference on Information Systems and Technologies, Springer."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/7\/3571\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T19:05:53Z","timestamp":1760123153000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/7\/3571"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,3,29]]},"references-count":64,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2023,4]]}},"alternative-id":["s23073571"],"URL":"https:\/\/doi.org\/10.3390\/s23073571","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2023,3,29]]}}}