{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,4]],"date-time":"2025-11-04T10:39:28Z","timestamp":1762252768840,"version":"build-2065373602"},"reference-count":67,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2018,6,19]],"date-time":"2018-06-19T00:00:00Z","timestamp":1529366400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Future Internet"],"abstract":"<jats:p>Collective problem-solving and decision-making, along with other forms of collaboration online, are central phenomena within ICT. There had been several attempts to create a system able to go beyond the passive accumulation of data. However, those systems often neglect important variables such as group size, the difficulty of the tasks, the tendency to cooperate, and the presence of selfish individuals (free riders). Given the complex relations among those variables, numerical simulations could be the ideal tool to explore such relationships. We take into account the cost of cooperation in collaborative problem solving by employing several simulated scenarios. The role of two parameters was explored: the capacity, the group\u2019s capability to solve increasingly challenging tasks coupled with the collective knowledge of a group, and the payoff, an individual\u2019s own benefit in terms of new knowledge acquired. The final cooperation rate is only affected by the cost of cooperation in the case of simple tasks and small communities. In contrast, the fitness of the community, the difficulty of the task, and the groups sizes interact in a non-trivial way, hence shedding some light on how to improve crowdsourcing when the cost of cooperation is high.<\/jats:p>","DOI":"10.3390\/fi10060055","type":"journal-article","created":{"date-parts":[[2018,6,19]],"date-time":"2018-06-19T11:20:36Z","timestamp":1529407236000},"page":"55","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["Simulating the Cost of Cooperation: A Recipe for Collaborative Problem-Solving"],"prefix":"10.3390","volume":"10","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0203-4461","authenticated-orcid":false,"given":"Andrea","family":"Guazzini","sequence":"first","affiliation":[{"name":"Center for the Study of Complex Dynamics (CSDC), University of Florence, Via di San Salvi 12, 50135 Firenze, Italy"},{"name":"Department of Education and Psychology, University of Florence, Via di San Salvi 12, 50135 Firenze, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8272-9484","authenticated-orcid":false,"given":"Mirko","family":"Duradoni","sequence":"additional","affiliation":[{"name":"Department of Information Engineering, University of Florence, Via Santa Marta 3, 50139 Firenze, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3112-9010","authenticated-orcid":false,"given":"Alessandro","family":"Lazzeri","sequence":"additional","affiliation":[{"name":"Department of Information Engineering, University of Pisa, Via Girolamo Caruso 16, 56122 Pisa, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0543-4900","authenticated-orcid":false,"given":"Giorgio","family":"Gronchi","sequence":"additional","affiliation":[{"name":"Center for the Study of Complex Dynamics (CSDC), University of Florence, Via di San Salvi 12, 50135 Firenze, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2018,6,19]]},"reference":[{"key":"ref_1","first-page":"497","article-title":"A collaborative video annotation system based on semantic web technologies","volume":"4","author":"Grassi","year":"2012","journal-title":"Cogn. Comput."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"157","DOI":"10.1007\/s12559-012-9136-5","article-title":"CO-WORKER: Toward real-time and context-aware systems for human collaborative knowledge building","volume":"4","author":"Squartini","year":"2012","journal-title":"Cogn. Comput."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1119","DOI":"10.1007\/s12559-016-9419-3","article-title":"Group decision making with dual hesitant fuzzy preference relations","volume":"8","author":"Zhao","year":"2016","journal-title":"Cogn. Comput."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"16557","DOI":"10.1038\/srep16557","article-title":"Modeling crowdsourcing as collective problem solving","volume":"5","author":"Guazzini","year":"2015","journal-title":"Sci. Rep."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"879","DOI":"10.1038\/461879a","article-title":"Massively collaborative mathematics","volume":"461","author":"Gowers","year":"2009","journal-title":"Nature"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"340","DOI":"10.1002\/poi3.102","article-title":"The fundamentals of policy crowdsourcing","volume":"7","author":"Taeihagh","year":"2015","journal-title":"Policy Internet"},{"key":"ref_7","unstructured":"Mau, B., and Leonard, J. (2004). Massive Change: The Institute without Boundaries, Phaidon."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"75","DOI":"10.1177\/1354856507084420","article-title":"Crowdsourcing as a model for problem solving an introduction and cases","volume":"14","author":"Brabham","year":"2008","journal-title":"Convergence"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"86","DOI":"10.1145\/1924421.1924442","article-title":"Crowdsourcing systems on the world-wide web","volume":"54","author":"Doan","year":"2011","journal-title":"Commun. ACM"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Kazai, G. (2011, January 18\u201321). In search of quality in crowdsourcing for search engine evaluation. Proceedings of the European Conference on Information Retrieval, Dublin, Ireland.","DOI":"10.1007\/978-3-642-20161-5_17"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"La Vecchia, G., and Cisternino, A. (2010, January 5\u20139). Collaborative workforce, business process crowdsourcing as an alternative of BPO. Proceedings of the International Conference on Web Engineering, Vienna, Austria.","DOI":"10.1007\/978-3-642-16985-4_40"},{"key":"ref_12","unstructured":"Mazzola, D., and Distefano, A. (2010, January 8\u20139). Crowdsourcing and the participation process for problem solving: The Case of BP. Proceedings of the ItAIS 2010 VII Conference of the Italian Chapter of AIS, Naples, Italy."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Chang, E.C., D\u2019Zurilla, T.J., and Sanna, L.J. (2004). Social Problem Solving: Theory, Research, and Training, American Psychological Association.","DOI":"10.1037\/10805-000"},{"key":"ref_14","unstructured":"Newell, B.R., Lagnado, D.A., and Shanks, D.R. (2015). Straight Choices: The Psychology of Decision Making, Psychology Press."},{"key":"ref_15","unstructured":"Baron, R., and Kerr, N. (2003). Group Process, Group Decision, Group Action 2\/E, McGraw-Hill Education."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"548","DOI":"10.1177\/0002764212469364","article-title":"Motivation for open collaboration crowd and community models and the case of OpenStreetMap","volume":"57","author":"Budhathoki","year":"2013","journal-title":"Am. Behav. Sci."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Barrett, L., Dunbar, R., and Lycett, J. (2002). Human Evolutionary Psychology, Princeton University Press.","DOI":"10.5040\/9781350363366"},{"key":"ref_18","unstructured":"Chanal, V., and Caron-Fasan, M.L. (2008, January 28\u201331). How to invent a new business model based on crowdsourcing: The Crowdspirit\u00ae case. Proceedings of the Conf\u00e9rence de l\u2019Association Internationale de Management Strat\u00e9gique, Sophia-Antipolis, France."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Whitla, P. (2009). Crowdsourcing and its application in marketing activities. Contemp. Manag. Res., 5.","DOI":"10.7903\/cmr.1145"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1362","DOI":"10.1126\/science.1153808","article-title":"Antisocial punishment across societies","volume":"319","author":"Herrmann","year":"2008","journal-title":"Science"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"3677","DOI":"10.1038\/ncomms4677","article-title":"Social heuristics shape intuitive cooperation","volume":"5","author":"Rand","year":"2014","journal-title":"Nat. Commun."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"540","DOI":"10.1518\/001872008X288457","article-title":"On teams, teamwork, and team performance: Discoveries and developments","volume":"50","author":"Salas","year":"2008","journal-title":"Hum. Factor"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"815","DOI":"10.1080\/03640210701530763","article-title":"Representation, interaction, and intersubjectivity","volume":"31","author":"Alterman","year":"2007","journal-title":"Cogn. Sci."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"255","DOI":"10.1111\/cogs.12009","article-title":"Interactive team cognition","volume":"37","author":"Cooke","year":"2013","journal-title":"Cogn. Sci."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"299","DOI":"10.1017\/S1930297500005994","article-title":"The environment matters: Comparing individuals and dyads in their adaptive use of decision strategies","volume":"8","author":"Gaissmaier","year":"2013","journal-title":"Judgm. Decis. Mak."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1383","DOI":"10.1111\/cogs.12052","article-title":"Social learning strategies in networked groups","volume":"37","author":"Wisdom","year":"2013","journal-title":"Cogn. Sci."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"20131151","DOI":"10.1098\/rspb.2013.1151","article-title":"Processing power limits social group size: Computational evidence for the cognitive costs of sociality","volume":"280","author":"Dunbar","year":"2013","journal-title":"Proc. R. Soc. B"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"123","DOI":"10.1016\/j.compedu.2012.10.025","article-title":"Influence of group size on students\u2019 participation in online discussion forums","volume":"62","author":"Kim","year":"2013","journal-title":"Comput. Educ."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"7937","DOI":"10.1038\/srep07937","article-title":"Group size effect on cooperation in one-shot social dilemmas","volume":"5","author":"Barcelo","year":"2015","journal-title":"Sci. Rep."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Capraro, V., and Barcelo, H. (2015). Group size effect on cooperation in one-shot social dilemmas II: Curvilinear effect. PLoS ONE, 10.","DOI":"10.1371\/journal.pone.0131419"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"823","DOI":"10.1177\/0165551514550140","article-title":"A taxonomy of crowdsourcing based on task complexity","volume":"40","author":"Nakatsu","year":"2014","journal-title":"J. Inf. Sci."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"424","DOI":"10.1038\/415424a","article-title":"Reputation helps solve the \u2018tragedy of the commons\u2019","volume":"415","author":"Milinski","year":"2002","journal-title":"Nature"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"573","DOI":"10.1038\/31225","article-title":"Evolution of indirect reciprocity by image scoring","volume":"393","author":"Nowak","year":"1998","journal-title":"Nature"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"107","DOI":"10.1016\/j.jtbi.2004.06.005","article-title":"How should we define goodness?\u2014Reputation dynamics in indirect reciprocity","volume":"231","author":"Ohtsuki","year":"2004","journal-title":"J. Theor. Biol."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1038\/415137a","article-title":"Altruistic punishment in humans","volume":"415","author":"Fehr","year":"2002","journal-title":"Nature"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"330","DOI":"10.1016\/j.evolhumbehav.2007.04.001","article-title":"Punishing free riders: Direct and indirect promotion of cooperation","volume":"28","author":"Shinada","year":"2007","journal-title":"Evol. Hum. Behav."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"17435","DOI":"10.1073\/pnas.0704598104","article-title":"Gossip as an alternative for direct observation in games of indirect reciprocity","volume":"104","author":"Sommerfeld","year":"2007","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"172","DOI":"10.1016\/j.evolhumbehav.2007.12.002","article-title":"Concerns about reputation via gossip promote generous allocations in an economic game","volume":"29","author":"Piazza","year":"2008","journal-title":"Evol. Hum. Behav."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"87","DOI":"10.1177\/1088868306294789","article-title":"Agent-based modeling: A new approach for theory building in social psychology","volume":"11","author":"Smith","year":"2007","journal-title":"Pers. Soc. Psychol. Rev."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"2","DOI":"10.18564\/jasss.3414","article-title":"A Taxonomy for Agent-Based Models in Human Infectious Disease Epidemiology","volume":"20","author":"Hunter","year":"2017","journal-title":"J. Artif. Soc. Soc. Simul."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"5","DOI":"10.18564\/jasss.3090","article-title":"Agent-Based Simulation to Inform Planning Strategies for Welfare Facilities for the Elderly: Day Care Center Development in a Japanese City","volume":"19","author":"Ma","year":"2016","journal-title":"J. Artif. Soc. Soc. Simul."},{"key":"ref_42","unstructured":"Swinscoe, T., Knoeri, C., Fleskens, L., and Barrett, J. (2014, January 1\u20135). Agent-based modelling of agricultural water abstraction in response to climate change and policies: In East Anglia, UK. Proceedings of the Social Simulation Conference, Barcelona, Spain."},{"key":"ref_43","unstructured":"Van Voorn, G., Ligtenberg, A., and ten Broeke, G. (2014, January 1\u20135). A spatially explicit agent-based model of opinion and reputation dynamics. Proceedings of the Social Simulation Conference, Barcelona, Spain."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"581","DOI":"10.1093\/biomet\/60.3.581","article-title":"A model for spatial conflict","volume":"60","author":"Clifford","year":"1973","journal-title":"Biometrika"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"87","DOI":"10.1142\/S0219525900000078","article-title":"Mixing beliefs among interacting agents","volume":"3","author":"Deffuant","year":"2000","journal-title":"Adv. Complex Syst."},{"key":"ref_46","unstructured":"Sen, P., and Chakrabarti, B.K. (2014). Sociophysics\u2014An Introduction, Oxford University Press."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"453","DOI":"10.1016\/j.physa.2003.10.041","article-title":"Contrarian deterministic effects on opinion dynamics: \u201cThe hung elections scenario\u201d","volume":"333","author":"Galam","year":"2004","journal-title":"Physica A"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"409","DOI":"10.1142\/S0129183108012297","article-title":"Sociophysics: A review of Galam models","volume":"19","author":"Galam","year":"2008","journal-title":"Int. J. Mod. Phys. C"},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"686","DOI":"10.1038\/srep00686","article-title":"Social and strategic imitation: The way to consensus","volume":"2","author":"Vilone","year":"2012","journal-title":"Sci. Rep."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"022810","DOI":"10.1103\/PhysRevE.90.022810","article-title":"Social imitation versus strategic choice, or consensus versus cooperation, in the networked Prisoner\u2019s Dilemma","volume":"90","author":"Vilone","year":"2014","journal-title":"Phys. Rev. E"},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"1157","DOI":"10.1080\/13504851.2016.1139672","article-title":"When is the risk of cooperation worth taking? The prisoner\u2019s dilemma as a game of multiple motives","volume":"23","author":"Engel","year":"2016","journal-title":"Appl. Econ. Lett."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"6790","DOI":"10.1038\/srep06790","article-title":"Heuristics guide the implementation of social preferences in one-shot Prisoner\u2019s Dilemma experiments","volume":"4","author":"Capraro","year":"2014","journal-title":"Sci. Rep."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"649","DOI":"10.1177\/1745691610388763","article-title":"Collaborative memory: Cognitive research and theory","volume":"5","author":"Rajaram","year":"2010","journal-title":"Perspect. Psychol. Sci."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"531","DOI":"10.1177\/001872679404700504","article-title":"Understanding our differences: Performance in decision-making groups with diverse members","volume":"47","author":"Maznevski","year":"1994","journal-title":"Hum. Relat."},{"key":"ref_55","unstructured":"Witte, E.H., and Davis, J.H. (2013). Understanding Group Behavior: Volume 1: Consensual Action by Small Groups; Volume 2: Small Group Processes and Interpersonal Relations, Psychology Press."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"686","DOI":"10.1126\/science.1193147","article-title":"Evidence for a collective intelligence factor in the performance of human groups","volume":"330","author":"Woolley","year":"2010","journal-title":"Science"},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"239","DOI":"10.1017\/S0140525X02000055","article-title":"Altruism and selfishness","volume":"25","author":"Rachlin","year":"2002","journal-title":"Behav. Brain Sci."},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"135","DOI":"10.1016\/j.cogsys.2007.07.001","article-title":"The cognitive modeling of human behavior: Why a model is (sometimes) better than 10,000 words","volume":"8","author":"Fum","year":"2007","journal-title":"Cogn. Syst. Res."},{"key":"ref_59","unstructured":"Lewin, K. (1951). Field Theory in Social Science, Harpers."},{"key":"ref_60","doi-asserted-by":"crossref","unstructured":"Lewandowsky, S., and Farrell, S. (2010). Computational Modeling in Cognition: Principles and Practice, Sage Publications.","DOI":"10.4135\/9781483349428"},{"key":"ref_61","unstructured":"Kennedy, W.G. (2009, January 24\u201326). Cognitive plausibility in cognitive modeling, artificial Intelligence, and social simulation. Proceedings of the International Conference on Cognitive Modeling (ICCM), Manchester, UK."},{"key":"ref_62","doi-asserted-by":"crossref","unstructured":"Guazzini, A., Duradoni, M., and Gronchi, G. (2016, January 11\u201314). The selfish vaccine Recipe: A simple mechanism for avoiding free-riding. Proceedings of the IEEE Winter Simulation Conference (WSC), Arlington, VA, USA.","DOI":"10.1109\/WSC.2016.7822373"},{"key":"ref_63","doi-asserted-by":"crossref","unstructured":"Hofbauer, J., and Sigmund, K. (1998). Evolutionary Games and Population Dynamics, University of Cambridge.","DOI":"10.1017\/CBO9781139173179"},{"key":"ref_64","doi-asserted-by":"crossref","unstructured":"Wang, Y., Jia, X., Jin, Q., and Ma, J. (2017). Mobile crowdsourcing: Framework, challenges, and solutions. Concur. Comput. Pract. Exp., 29.","DOI":"10.1002\/cpe.3789"},{"key":"ref_65","unstructured":"Van Lange, P.A., Balliet, D.P., and Parks, C.D. (2014). Social Dilemmas: Understanding Human Cooperation, Oxford University Press."},{"key":"ref_66","doi-asserted-by":"crossref","unstructured":"Winther, B., Riegler, M., Calvet, L., Griwodz, C., and Halvorsen, P. (2015, January 30). Why design matters: Crowdsourcing of complex tasks. Proceedings of the Fourth International Workshop on Crowdsourcing for Multimedia, Brisbane, Australia.","DOI":"10.1145\/2810188.2810190"},{"key":"ref_67","doi-asserted-by":"crossref","first-page":"126","DOI":"10.1037\/0022-3514.67.1.126","article-title":"Social value orientations and impressions of partner\u2019s honesty and intelligence: A test of the might versus morality effect","volume":"67","author":"Kuhlman","year":"1994","journal-title":"J. Personal. Soc. Psychol."}],"container-title":["Future Internet"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-5903\/10\/6\/55\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T15:09:12Z","timestamp":1760195352000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-5903\/10\/6\/55"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,6,19]]},"references-count":67,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2018,6]]}},"alternative-id":["fi10060055"],"URL":"https:\/\/doi.org\/10.3390\/fi10060055","relation":{},"ISSN":["1999-5903"],"issn-type":[{"type":"electronic","value":"1999-5903"}],"subject":[],"published":{"date-parts":[[2018,6,19]]}}}