{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,18]],"date-time":"2026-05-18T16:28:49Z","timestamp":1779121729555,"version":"3.51.4"},"reference-count":54,"publisher":"Springer Science and Business Media LLC","issue":"4-5","license":[{"start":{"date-parts":[[2011,12,17]],"date-time":"2011-12-17T00:00:00Z","timestamp":1324080000000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/www.springer.com\/tdm"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Comput Supported Coop Work"],"published-print":{"date-parts":[[2012,10]]},"DOI":"10.1007\/s10606-011-9155-x","type":"journal-article","created":{"date-parts":[[2011,12,16]],"date-time":"2011-12-16T09:29:12Z","timestamp":1324027752000},"page":"417-448","source":"Crossref","is-referenced-by-count":40,"title":["Contested Collective Intelligence: Rationale, Technologies, and a Human-Machine Annotation Study"],"prefix":"10.1007","volume":"21","author":[{"given":"Anna","family":"De Liddo","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"\u00c1gnes","family":"S\u00e1ndor","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Simon","family":"Buckingham Shum","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2011,12,17]]},"reference":[{"issue":"2\/3","key":"9155_CR1","doi-asserted-by":"crossref","first-page":"121","DOI":"10.1017\/S1351324902002887","volume":"8","author":"S A\u00eft-Mokhtar","year":"2002","unstructured":"A\u00eft-Mokhtar, S., Chanod, J. P., & Roux, C. (2002). Robustness beyond shallowness: incremental dependency parsing. Natural Language Engineering, 8(2\/3), 121\u2013144.","journal-title":"Natural Language Engineering"},{"key":"9155_CR2","doi-asserted-by":"crossref","unstructured":"Andriessen, J., Baker, M., & Suthers, D. (2003). Arguing to learn: Confronting cognitions in computer-supported collaborative learning environments (Eds.). Kluwer: Dordrecht","DOI":"10.1007\/978-94-017-0781-7"},{"key":"9155_CR3","doi-asserted-by":"crossref","unstructured":"Birnbaum, L., Horvitz, E., Kurlander, D., Lieberman, H., Marks, J., & Roth, S. (1996). Compelling intelligent user interfaces: How much AI?, Proceedings ACM International Conference on Intelligent Interfaces, Orlando, FL, January 1996. ACM Press: NY","DOI":"10.1145\/238218.238319"},{"key":"9155_CR4","volume-title":"Handbook of child psychology: Cognitive development (vol. 3)","author":"AL Brown","year":"1983","unstructured":"Brown, A. L., Bransford, R. A., Ferraraand, R. A., & Campione, J. C. (1983). Learning, remembering, and understanding. In J. H. Flavell & E. H. Markman (Eds.), Handbook of child psychology: Cognitive development (vol. 3). New York: Wiley."},{"issue":"3\u20134","key":"9155_CR5","first-page":"32","volume":"7","author":"L Browning","year":"2005","unstructured":"Browning, L., & Boud\u00e8s, T. (2005). The use of narrative to understand and respond to complexity: a comparative analysis of the Cynefin and Weickian models. Emergence: Complexity & Organization\u2014An International Transdisciplinary Journal of Complex Social Systems, 7(3\u20134), 32\u201339.","journal-title":"Emergence: Complexity & Organization\u2014An International Transdisciplinary Journal of Complex Social Systems"},{"key":"9155_CR6","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1007\/978-1-4471-0037-9_1","volume-title":"Visualizing argumentation","author":"S Buckingham Shum","year":"2003","unstructured":"Buckingham Shum, S. (2003). The roots of computer supported argument visualization. In P. Kirschner, S. Buckingham Shum, & C. Carr (Eds.), Visualizing argumentation (pp. 3\u201324). London: Springer."},{"key":"9155_CR7","unstructured":"Buckingham Shum, S. (2008). Cohere: Towards Web 2.0 argumentation. 2nd International Conference on Computational Models of Argument, 28\u201330 May 2008, Toulouse. IOS Press: Amsterdam."},{"issue":"3","key":"9155_CR8","doi-asserted-by":"crossref","first-page":"267","DOI":"10.1207\/s15327051hci1203_2","volume":"12","author":"S Buckingham Shum","year":"1997","unstructured":"Buckingham Shum, S., Maclean, A., Bellotti, V. M., & Hammond, N. V. (1997). Graphical argumentation and design cognition. Human-Computer Interaction, 12(3), 267\u2013300.","journal-title":"Human-Computer Interaction"},{"key":"9155_CR9","doi-asserted-by":"crossref","first-page":"111","DOI":"10.1007\/978-3-540-30998-7_5","volume-title":"Rationale management in software engineering","author":"S Buckingham Shum","year":"2006","unstructured":"Buckingham Shum, S., Selvin, A., Sierhuis, M., Conklin, J., Haley, C., & Nuseibeh, B. (2006). Hypermedia support for argumentation-based rationale: 15 years on from gIBIS and QOC. In A. Dutoit, R. McCall, I. Mistrik, & B. Paech (Eds.), Rationale management in software engineering (pp. 111\u2013132). Berlin: Springer."},{"issue":"6","key":"9155_CR10","doi-asserted-by":"crossref","first-page":"303","DOI":"10.1145\/58566.59297","volume":"4","author":"J Conklin","year":"1988","unstructured":"Conklin, J., & Begeman, M. L. (1988). gIBIS: a hypertext tool for exploratory policy discussion. ACM Transactions on Office Information Systems, 4(6), 303\u2013331.","journal-title":"ACM Transactions on Office Information Systems"},{"key":"9155_CR11","doi-asserted-by":"crossref","first-page":"353","DOI":"10.1007\/s10606-008-9080-9","volume":"17","author":"G Convertino","year":"2008","unstructured":"Convertino, G., Billman, D., Pirolli, P., Massar, J. P., & Shrager, J. (2008). The CACHE Study: group effects in computer-supported collaborative analysis. Computer Supported Cooperative Work (CSCW). An International Journal, 17, 353\u2013393.","journal-title":"Computer Supported Cooperative Work (CSCW). An International Journal"},{"key":"9155_CR12","unstructured":"De Liddo, A., & Buckingham Shum, S. (2010). Cohere: A prototype for contested collective intelligence. Workshop on Collective Intelligence in Organizations: Toward a Research Agenda, ACM Conference on Computer Supported Cooperative Work, Feb. 6\u201310, 2010, Savannah GA, USA. Available as ePrint: http:\/\/oro.open.ac.uk\/19554 ."},{"key":"9155_CR13","unstructured":"De Waard, A., S. Buckingham Shum, A. Carusi, J. Park, M. Samwald, & A. S\u00e1ndor (2009). Hypotheses, evidence and relationships: The HypER approach for representing scientific knowledge claims. Workshop on Semantic Web Applications in Scientific Discourse, 8th International Semantic Web Conference. LNCS, Springer Verlag: Berlin, 26 Oct 2009, Washington DC."},{"key":"9155_CR14","first-page":"876","volume-title":"Encyclopedia of communication theory","author":"B Dervin","year":"2009","unstructured":"Dervin, B., & Naumer, C. (2009). Sense-making. In S. W. Littlejohn & K. A. Foss (Eds.), Encyclopedia of communication theory (pp. 876\u2013880). Los Angeles: Sage."},{"key":"9155_CR15","unstructured":"Engelbart, D. C. (1963). A conceptual framework for the augmentation of man\u2019s intellect, in Vistas in Information Handling, P. Howerton and Weeks, Editors. 1963, Spartan Books: Washington, DC: London. p. 1\u201329."},{"issue":"4\/5","key":"9155_CR16","doi-asserted-by":"crossref","first-page":"302","DOI":"10.1108\/09696470410538206","volume":"11","author":"A Ghosh","year":"2004","unstructured":"Ghosh, A. (2004). Learning in strategic alliances: a Vygotskian perspective. The Learning Organization, 11(4\/5), 302\u2013311.","journal-title":"The Learning Organization"},{"key":"9155_CR17","first-page":"79","volume-title":"New directions in the philosophy of mathematics","author":"N Goodman","year":"1986","unstructured":"Goodman, N. (1986). Mathematics as an objective science. In T. Tymocyko (Ed.), New directions in the philosophy of mathematics (pp. 79\u201394). Boston: Birkhauser."},{"key":"9155_CR18","doi-asserted-by":"crossref","first-page":"3686","DOI":"10.1016\/j.ins.2010.06.011","volume":"180","author":"A Gurkan","year":"2010","unstructured":"Gurkan, A., Iandoli, L., Klein, M., & Zollo, G. (2010). Mediating debate through on-line large-scale argumentation: evidence from the field. Information Sciences, 180, 3686\u20133702.","journal-title":"Information Sciences"},{"key":"9155_CR19","unstructured":"Hagel, J. III, Seely Brown, J., & Davison, L. (2010). The power of pull: How small moves, smartly made, can set big things in motion. Basic Books"},{"key":"9155_CR20","volume-title":"The psychology of intelligence analysis","author":"R Heuer","year":"1999","unstructured":"Heuer, R. (1999). The psychology of intelligence analysis. Washington, DC: Center for the Study of Intelligence, Central Intelligence Agency."},{"key":"9155_CR21","doi-asserted-by":"crossref","unstructured":"Hong, L., Chi, E. H., Budiu, R., Pirolli, P., & Nelson, L. (2008): SparTag.us: A low cost tagging system for foraging of web content. In: Proc. AVI 2008, pp. 65\u201372. ACM, New York.","DOI":"10.1145\/1385569.1385582"},{"key":"9155_CR22","doi-asserted-by":"crossref","unstructured":"Horvitz, E. (1999). Principles of mixed-initiative user interfaces, In Proceeding of the ACM Conference on Human Factors in Computing Systems.","DOI":"10.1145\/302979.303030"},{"key":"9155_CR23","doi-asserted-by":"crossref","unstructured":"Kalnikait\u00e9, V., & Whittaker, S. (2008). Social summarization: does social feedback improve access to speech data? In Proceedings of conference on computer supported co-operative work, ACM Press, New York, pp 9\u201312.","DOI":"10.1145\/1460563.1460567"},{"issue":"4","key":"9155_CR24","doi-asserted-by":"crossref","first-page":"70","DOI":"10.1109\/MIS.2006.75","volume":"21","author":"G Klein","year":"2006","unstructured":"Klein, G., Moon, B., & Hoffman, R. F. (2006). Making sense of sensemaking 1: alternative perspectives. IEEE Intelligent Systems, 21(4), 70\u201373.","journal-title":"IEEE Intelligent Systems"},{"issue":"3","key":"9155_CR25","doi-asserted-by":"crossref","first-page":"462","DOI":"10.1147\/sj.423.0462","volume":"42","author":"C Kurtz","year":"2003","unstructured":"Kurtz, C., & Snowden, D. (2003). The new dynamics of strategy: sense-making in a complex-complicated world. IBM Systems Journal, 42(3), 462\u201383.","journal-title":"IBM Systems Journal"},{"key":"9155_CR26","unstructured":"Kong, N., Hanrahan, B., Weksteen, T., Convertino, G., & Chi E. H. (2011).: VisualWikiCurator: Human and Machine Intelligence for Organizing Wiki Content. In: Proc. IUI2011."},{"issue":"4","key":"9155_CR27","doi-asserted-by":"crossref","first-page":"77","DOI":"10.1145\/205323.205346","volume":"38","author":"DM Levy","year":"1995","unstructured":"Levy, D. M., & Marshall, C. C. (1995). Going digital: a look at assumptions underlying digital libraries. Communications of the ACM, 38(4), 77\u201384.","journal-title":"Communications of the ACM"},{"issue":"3","key":"9155_CR28","doi-asserted-by":"crossref","first-page":"43","DOI":"10.1007\/BF02299633","volume":"47","author":"X Lin","year":"1999","unstructured":"Lin, X., Hmelo, C., Kinzer, C. K., & Secules, T. J. (1999). Designing technology to support reflection. Educational Technology Research and Development, 47(3), 43\u201362.","journal-title":"Educational Technology Research and Development"},{"key":"9155_CR29","volume-title":"Knowledge cartography: Software tools and mapping techniques","author":"J Lowrance","year":"2008","unstructured":"Lowrance, J., Harrison, I., Rodriguez, A., Yeh, E., Boyce, T., Murdock, J., Thomere, J., & Murray, K. (2008). Template-based structured argumentation. In A. Okada, S. Buckingham Shum, & T. Sherborne (Eds.), Knowledge cartography: Software tools and mapping techniques. London: Springer."},{"key":"9155_CR30","unstructured":"Malone, T. W., Laubacher, R., & Dellarocas, C. N. (2009). Harnessing crowds: Mapping the genome of collective intelligence. MIT Sloan Research Paper No. 4732\u201309. Available at SSRN: http:\/\/ssrn.com\/abstract=1381502 ."},{"issue":"2","key":"9155_CR31","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1558\/japl.2004.1.2.137","volume":"1","author":"N Mercer","year":"2004","unstructured":"Mercer, N. (2004). Sociocultural discourse analysis: analysing classroom talk as a social mode of thinking. Journal of Applied Linguistics, 1(2), 137\u2013168.","journal-title":"Journal of Applied Linguistics"},{"key":"9155_CR32","doi-asserted-by":"crossref","DOI":"10.1007\/978-1-84800-149-7","volume-title":"Knowledge cartography: Software tools and mapping techniques","author":"A Okada","year":"2008","unstructured":"Okada, A., Buckingham Shum, S., & Sherborne, T. (2008). Knowledge cartography: Software tools and mapping techniques. London: Springer."},{"key":"9155_CR33","doi-asserted-by":"crossref","first-page":"265","DOI":"10.1207\/s15326985ep2803_6","volume":"28","author":"RD Pea","year":"1993","unstructured":"Pea, R. D. (1993). Learning scientific concepts through material and social activities: conversational analysis meets conceptual change. Educational Psychologist, 28, 265\u2013277.","journal-title":"Educational Psychologist"},{"key":"9155_CR34","unstructured":"Pirolli, P., & Card, S. (1995) The sensemaking process and leverage points for analyst technology as identified through cognitive task analysis. Proceedings of 2005 International Conference on Intelligence Analysis, 2\u20134"},{"key":"9155_CR35","unstructured":"Pirolli, P., & Russell, D. (2008). Call for submissions to special issue on sensemaking, Human-Computer Interaction. http:\/\/www.tandf.co.uk\/journals\/cfp\/hhcicfp_sp1.pdf"},{"issue":"1","key":"9155_CR36","doi-asserted-by":"crossref","first-page":"52","DOI":"10.1177\/0022487108328486","volume":"60","author":"PJ Rich","year":"2009","unstructured":"Rich, P. J., & Hannafin, M. (2009). Video annotation tools: technologies to scaffold, structure, and transform teacher reflection. Journal of Teacher Education, 60(1), 52\u201367.","journal-title":"Journal of Teacher Education"},{"key":"9155_CR37","doi-asserted-by":"crossref","unstructured":"Rittel, H., & Webber, M. (1973). Dilemmas in a general theory of planning. Policy Sciences, 4, 155\u2013169.","DOI":"10.1007\/BF01405730"},{"key":"9155_CR38","doi-asserted-by":"crossref","unstructured":"Russell, D. M., Stefik, M. J., Pirolli, P., & Card, S. K. (1993). The cost structure of sensemaking. Proceedings of InterCHI \u201893, pp. 269\u2013276. Amsterdam: Association for Computing Machinery.","DOI":"10.1145\/169059.169209"},{"issue":"2","key":"9155_CR39","doi-asserted-by":"crossref","first-page":"97","DOI":"10.3917\/rfla.122.0097","volume":"200","author":"\u00c1 S\u00e1ndor","year":"2007","unstructured":"S\u00e1ndor, \u00c1. (2007). Modeling metadiscourse conveying the author\u2019s rhetorical strategy in biomedical research abstracts. Revue Fran\u00e7aise de Linguistique Appliqu\u00e9e, 200(2), 97\u2013109.","journal-title":"Revue Fran\u00e7aise de Linguistique Appliqu\u00e9e"},{"key":"9155_CR40","unstructured":"S\u00e1ndor, \u00c1., & Vorndran, A. (2010), Extracting relevant messages from social science research papers for improving retevance of retrieval. Workshop on Natural Language Processing Tools Applied to Discourse Analysis in Psychology, Buenos Aires, 10\u201314 May 2010."},{"key":"9155_CR41","doi-asserted-by":"crossref","first-page":"185","DOI":"10.1006\/ijhc.1996.0048","volume":"45","author":"M Scaife","year":"1996","unstructured":"Scaife, M., & Rogers, Y. (1996). External cognition: how do graphical representations work? International Journal of Human-Computer Studies, 45, 185\u2013213.","journal-title":"International Journal of Human-Computer Studies"},{"key":"9155_CR42","doi-asserted-by":"crossref","first-page":"265","DOI":"10.1207\/s15327809jls0303_3","volume":"3","author":"M Scardamalia","year":"1994","unstructured":"Scardamalia, M., & Bereiter, C. (1994). Computer support for knowledge-building communities. The Journal of the Learning Sciences, 3, 265\u2013283.","journal-title":"The Journal of the Learning Sciences"},{"key":"9155_CR43","unstructured":"Scardamalia, M. (2002). Collective cognitive responsibility for the advancement of knowledge. In B. Smith (Ed.), Liberal education in a knowledge society (pp. 67\u201398). Chicago: Open Court."},{"key":"9155_CR44","unstructured":"Selvin, A. (2011, forthcoming). Making representations matter: Understanding practitioner experience in participatory sensemaking. Unpublished Doctoral Dissertation, Knowledge Media Institute, The Open University, UK"},{"key":"9155_CR45","unstructured":"Sellen, A., & Harper, R. (2003). The myth of the paperless office. MIT Press"},{"key":"9155_CR46","unstructured":"Sereno, B., Buckingham Shum, S., & Motta, E. (2007). Formalization, user strategy and interaction design: Users\u2019 behaviour with discourse tagging semantics. Workshop on Social and Collaborative Construction of Structured Knowledge, 16 th International World Wide Web Conference (WWW 2007), Banff, AB, Canada; 8\u201312 May 2007."},{"issue":"1","key":"9155_CR47","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1111\/j.1756-8765.2009.01049.x","volume":"2","author":"J Shrager","year":"2010","unstructured":"Shrager, J., Billman, D. O., Convertino, G., Massar, J. P., & Pirolli, P. L. (2010). Soccer science and the Bayes community: exploring the cognitive implications of modern scientific communication. topiCS - Topics in Cognitive Science, 2(1), 53\u201372.","journal-title":"topiCS - Topics in Cognitive Science"},{"key":"9155_CR48","first-page":"321","volume-title":"Macrocognition in teams: Theories and methodologies","author":"HS Smallman","year":"2008","unstructured":"Smallman, H. S. (2008). JIGSAW-joint intelligence graphical situation awareness web for collaborative intelligence analysis. In M. P. Letsky, N. Warner, S. Fiore, & C. A. P. Smith (Eds.), Macrocognition in teams: Theories and methodologies (pp. 321\u2013337). Hampshire, England: Ashgate Publishing."},{"key":"9155_CR49","unstructured":"Snowden, D. J., & Boone, M. E. (2007). Leader\u2019s framework for decision making. Harvard Business Review, Nov 01, 2007."},{"key":"9155_CR50","unstructured":"Tecuci, G., Boicu, M., & Cox, M. T. (2007). Seven aspects of mixed-initiative reasoning: an introduction to this special issue on mixed-initiative assistants. AI Magazine, 28(2)."},{"issue":"5","key":"9155_CR51","doi-asserted-by":"crossref","first-page":"420","DOI":"10.1016\/j.ijhcs.2005.09.004","volume":"64","author":"V Uren","year":"2006","unstructured":"Uren, V., Buckingham Shum, S., Li, G., & Bachler, M. (2006). Sensemaking tools for understanding research literatures: design, implementation and user evaluation. International Journal of Human Computer Studies, 64(5), 420\u2013445.","journal-title":"International Journal of Human Computer Studies"},{"key":"9155_CR52","first-page":"97","volume-title":"Visualizing argumentation: software tools for collaborative and educational sense-making","author":"TJ Gelder van","year":"2002","unstructured":"van Gelder, T. J. (2002). Enhancing Deliberation Through Computer-Supported Argument Visualization. In P. Kirschner, S. Buckingham Shum, & C. Carr (Eds.), Visualizing argumentation: software tools for collaborative and educational sense-making (pp. 97\u2013115). London: Springer."},{"key":"9155_CR53","volume-title":"Sensemaking in Organizations","author":"KE Weick","year":"1995","unstructured":"Weick, K. E. (1995). Sensemaking in Organizations. Thousand Oaks, CA: Sage Publications."},{"key":"9155_CR54","doi-asserted-by":"crossref","first-page":"1723","DOI":"10.1177\/0170840606068351","volume":"27","author":"KE Weick","year":"2006","unstructured":"Weick, K. E. (2006). Faith, evidence, and action: better guesses in an unknowable world. Organization Studies, 27, 1723\u20131736.","journal-title":"Organization Studies"}],"container-title":["Computer Supported Cooperative Work (CSCW)"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s10606-011-9155-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1007\/s10606-011-9155-x\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s10606-011-9155-x","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2020,6,28]],"date-time":"2020-06-28T22:37:04Z","timestamp":1593383824000},"score":1,"resource":{"primary":{"URL":"http:\/\/link.springer.com\/10.1007\/s10606-011-9155-x"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2011,12,17]]},"references-count":54,"journal-issue":{"issue":"4-5","published-print":{"date-parts":[[2012,10]]}},"alternative-id":["9155"],"URL":"https:\/\/doi.org\/10.1007\/s10606-011-9155-x","relation":{},"ISSN":["0925-9724","1573-7551"],"issn-type":[{"value":"0925-9724","type":"print"},{"value":"1573-7551","type":"electronic"}],"subject":[],"published":{"date-parts":[[2011,12,17]]}}}