{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,28]],"date-time":"2026-04-28T22:36:38Z","timestamp":1777415798428,"version":"3.51.4"},"reference-count":111,"publisher":"Maximum Academic Press","license":[{"start":{"date-parts":[[2018,8,15]],"date-time":"2018-08-15T00:00:00Z","timestamp":1534291200000},"content-version":"unspecified","delay-in-days":226,"URL":"https:\/\/www.cambridge.org\/core\/terms"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["The Knowledge Engineering Review"],"published-print":{"date-parts":[[2018]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>\n                    The World Wide Web has had a notable impact on a variety of epistemically relevant activities, many of which lie at the heart of the discipline of knowledge engineering. Systems like Wikipedia, for example, have altered our views regarding the acquisition of knowledge, while citizen science systems such as Galaxy Zoo have arguably transformed our approach to knowledge discovery. Other Web-based systems have highlighted the ways in which the human social environment can be used to support the development of intelligent systems, either by contributing to the provision of epistemic resources or by helping to shape the profile of machine learning. In the present paper, such systems are referred to as\n                    <jats:italic>knowledge machines<\/jats:italic>\n                    . In addition to providing an overview of the knowledge machine concept, the present paper reviews a number of issues that are associated with the scientific and philosophical study of knowledge machines. These include the potential impact of knowledge machines for the theory and practice of knowledge engineering, the role of social participation in the realization of knowledge-based processes, and the role of standardized, semantically enriched data formats in supporting the\n                    <jats:italic>ad hoc<\/jats:italic>\n                    assembly of special-purpose knowledge systems and knowledge processing pipelines.\n                  <\/jats:p>","DOI":"10.1017\/s0269888918000139","type":"journal-article","created":{"date-parts":[[2018,10,2]],"date-time":"2018-10-02T01:16:02Z","timestamp":1538442962000},"source":"Crossref","is-referenced-by-count":6,"title":["Knowledge machines"],"prefix":"10.48130","volume":"33","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9989-5307","authenticated-orcid":false,"given":"Paul","family":"Smart","sequence":"first","affiliation":[]}],"member":"27968","published-online":{"date-parts":[[2018,8,15]]},"reference":[{"key":"S0269888918000139_ref16","doi-asserted-by":"publisher","DOI":"10.1002\/asi.20870"},{"key":"S0269888918000139_ref47","doi-asserted-by":"crossref","DOI":"10.7551\/mitpress\/1881.001.0001","volume-title":"Cognition in the Wild","author":"Hutchins","year":"1995"},{"key":"S0269888918000139_ref28","first-page":"11","volume-title":"Social Epistemology: Essential Readings","author":"Goldman","year":"2011"},{"key":"S0269888918000139_ref26","volume-title":"Epistemology and Cognition","author":"Goldman","year":"1986"},{"key":"S0269888918000139_ref75","unstructured":"Rzeszotarski J. & Kittur A. 2012. Crowdscape: interactively visualizing user behavior and output. In 25th Annual ACM Symposium on User Interface Software and Technology, Miller, R., Benko, H. & Latulipe, C. (eds). ACM, 55\u201362."},{"key":"S0269888918000139_ref66","doi-asserted-by":"publisher","DOI":"10.1126\/science.aad6499"},{"key":"S0269888918000139_ref107","unstructured":"von Ahn L. & Dabbish L. 2004. Labeling images with a computer game. In SIGCHI Conference on Human Factors in Computing Systems, Dykstra-Erickson, E. & Tscheligi, M. (eds). ACM, 319\u2013326."},{"key":"S0269888918000139_ref68","first-page":"185","volume-title":"The Cambridge Handbook of Situated Cognition","author":"Myin","year":"2009"},{"key":"S0269888918000139_ref111","first-page":"89","volume-title":"Handbook of Collective Intelligence","author":"Weld","year":"2015"},{"key":"S0269888918000139_ref76","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1145\/2093548.2093553","article-title":"Gaining wisdom from crowds","volume":"55","author":"Savage","year":"2012","journal-title":"Communications of the ACM"},{"key":"S0269888918000139_ref65","doi-asserted-by":"publisher","DOI":"10.1111\/phis.12036"},{"key":"S0269888918000139_ref106","doi-asserted-by":"publisher","DOI":"10.1109\/MC.2006.196"},{"key":"S0269888918000139_ref98","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1016\/j.biocon.2013.11.003","article-title":"The eBird enterprise: an integrated approach to development and application of citizen science","volume":"169","author":"Sullivan","year":"2014","journal-title":"Biological Conservation"},{"key":"S0269888918000139_ref72","doi-asserted-by":"publisher","DOI":"10.1007\/s11097-016-9489-4"},{"key":"S0269888918000139_ref110","doi-asserted-by":"publisher","DOI":"10.1007\/s11229-016-1238-2"},{"key":"S0269888918000139_ref93","unstructured":"Spiers H. J. , Manley E. , Silva R. , Conroy Dalton T. , Wiener J. M. , Hoolscher C. , Bohbot V. & Hornberger M. 2016. Spatial navigation ability assessed in over 1 million people globally. In Neuroscience."},{"key":"S0269888918000139_ref105","doi-asserted-by":"publisher","DOI":"10.1007\/s11721-010-0049-1"},{"key":"S0269888918000139_ref77","doi-asserted-by":"publisher","DOI":"10.1145\/2461256.2461275"},{"key":"S0269888918000139_ref56","unstructured":"Law E. & von Ahn L. 2009. Input-agreement: a new mechanism for collecting data using human computation games. In SIGCHI Conference on Human Factors in Computing Systems, Olsen, D. R., Arthur, R. B., Hinckley, K., Morris, M. R., Hudson, S. & Greenberg, S. (eds). ACM, 1197\u20131206."},{"key":"S0269888918000139_ref38","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511488801"},{"key":"S0269888918000139_ref62","doi-asserted-by":"publisher","DOI":"10.1016\/j.cogsys.2012.06.005"},{"key":"S0269888918000139_ref50","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1115898108"},{"key":"S0269888918000139_ref94","volume-title":"Thought in a Hostile World: The Evolution of Human Cognition","author":"Sterelny","year":"2003"},{"key":"S0269888918000139_ref33","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511844645"},{"key":"S0269888918000139_ref9","doi-asserted-by":"publisher","DOI":"10.1177\/2053951715612822"},{"key":"S0269888918000139_ref43","doi-asserted-by":"publisher","DOI":"10.1016\/j.cogsys.2015.12.007"},{"key":"S0269888918000139_ref30","volume-title":"Ontological Engineering","author":"Gomez-Perez","year":"2004"},{"key":"S0269888918000139_ref10","doi-asserted-by":"publisher","DOI":"10.1093\/acprof:oso\/9780195333213.001.0001"},{"key":"S0269888918000139_ref11","doi-asserted-by":"publisher","DOI":"10.1016\/S1470-2045(14)70259-1"},{"key":"S0269888918000139_ref51","doi-asserted-by":"publisher","DOI":"10.1038\/nsmb.2119"},{"key":"S0269888918000139_ref20","volume-title":"Mirror Worlds","author":"Gelernter","year":"1992"},{"key":"S0269888918000139_ref14","doi-asserted-by":"crossref","first-page":"615","DOI":"10.1007\/978-1-4614-8806-4_48","volume-title":"Handbook of Human Computation","author":"Crouser","year":"2013"},{"key":"S0269888918000139_ref48","doi-asserted-by":"crossref","first-page":"745","DOI":"10.1093\/bjps\/axv058","article-title":"The metaphysics of constitutive mechanistic phenomena","volume":"68","author":"Kaiser","year":"2017","journal-title":"The British Journal for the Philosophy of Science"},{"key":"S0269888918000139_ref5","unstructured":"Bozzon A. , Brambilla M. , Ceri S. , Silvestri M. & Vesci G. 2013. Choosing the right crowd: expert finding in social networks. In 16th International Conference on Extending Database Technology, N. W. Paton, G. Guerrini, B. Catania, M. Castellanos, P. Atzeni, P. Fraternali & A. Gounaris(eds). ACM, 637\u2013648."},{"key":"S0269888918000139_ref55","doi-asserted-by":"publisher","DOI":"10.1511\/2004.49.3434"},{"key":"S0269888918000139_ref37","volume-title":"Building Expert Systems","author":"Hayes-Roth","year":"1983"},{"key":"S0269888918000139_ref45","first-page":"165","volume-title":"The Cambridge Handbook of Expertise and Expert Performance","author":"Hoffman","year":"2006"},{"key":"S0269888918000139_ref29","doi-asserted-by":"publisher","DOI":"10.1093\/acprof:oso\/9780199812875.001.0001"},{"key":"S0269888918000139_ref40","doi-asserted-by":"publisher","DOI":"10.1016\/j.artint.2009.11.010"},{"key":"S0269888918000139_ref4","first-page":"45","article-title":"Decisions 2.0: the power of collective intelligence","volume":"50","author":"Bonabeau","year":"2009","journal-title":"MIT Sloan Management Review"},{"key":"S0269888918000139_ref44","first-page":"373","article-title":"The glass house effect: big data, the new oil, and the power of analogy","volume":"66","author":"Hirsch","year":"2014","journal-title":"Maine Law Review"},{"key":"S0269888918000139_ref58","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4614-8806-4_14"},{"key":"S0269888918000139_ref57","doi-asserted-by":"crossref","first-page":"167","DOI":"10.3233\/SW-140134","article-title":"DBpedia\u2014a large-scale, multilingual knowledge base extracted from Wikipedia","volume":"6","author":"Lehmann","year":"2012","journal-title":"Semantic Web"},{"key":"S0269888918000139_ref3","doi-asserted-by":"publisher","DOI":"10.1038\/scientificamerican0501-34"},{"key":"S0269888918000139_ref18","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2012.10.010"},{"key":"S0269888918000139_ref6","first-page":"3","article-title":"The ignorant led by the blind: a hybrid human-machine vision system for fine-grained categorization","volume":"108","author":"Branson","year":"2014","journal-title":"International Journal of Computer Vision"},{"key":"S0269888918000139_ref84","first-page":"163","volume-title":"Evaluation of Human Work","author":"Shadbolt","year":"2015"},{"key":"S0269888918000139_ref78","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2012.10.001"},{"key":"S0269888918000139_ref32","doi-asserted-by":"publisher","DOI":"10.1111\/j.1533-6077.2007.00122.x"},{"key":"S0269888918000139_ref97","doi-asserted-by":"publisher","DOI":"10.1016\/S0169-023X(97)00056-6"},{"key":"S0269888918000139_ref1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-76298-0_52"},{"key":"S0269888918000139_ref24","doi-asserted-by":"publisher","DOI":"10.1093\/oso\/9780198779711.001.0001"},{"key":"S0269888918000139_ref35","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1016\/j.websem.2007.11.011","article-title":"Collective knowledge systems: where the Social Web meets the Semantic Web","volume":"6","author":"Gruber","year":"2008","journal-title":"Web Semantics: Science, Services and Agents on the World Wide Web"},{"key":"S0269888918000139_ref71","doi-asserted-by":"publisher","DOI":"10.1007\/s11229-015-0695-3"},{"key":"S0269888918000139_ref8","doi-asserted-by":"publisher","DOI":"10.1093\/oso\/9780198801764.001.0001"},{"key":"S0269888918000139_ref53","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.85.13.4686"},{"key":"S0269888918000139_ref39","doi-asserted-by":"publisher","DOI":"10.1146\/annurev.soc.012809.102632"},{"key":"S0269888918000139_ref67","doi-asserted-by":"publisher","DOI":"10.1016\/S1474-4422(16)30123-5"},{"key":"S0269888918000139_ref52","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4613-1823-1"},{"key":"S0269888918000139_ref17","first-page":"297","volume-title":"Social Epistemology: Essential Readings","author":"Fallis","year":"2011"},{"key":"S0269888918000139_ref34","doi-asserted-by":"publisher","DOI":"10.1111\/j.1933-1592.2011.00567.x"},{"key":"S0269888918000139_ref41","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4842-1156-4"},{"key":"S0269888918000139_ref12","first-page":"176","volume-title":"The Routledge Companion to Epistemology","author":"Comesa\u00f1a","year":"2011"},{"key":"S0269888918000139_ref60","doi-asserted-by":"crossref","first-page":"1179","DOI":"10.1111\/j.1365-2966.2008.13689.x","article-title":"Galaxy Zoo: morphologies derived from visual inspection of galaxies from the Sloan Digital Sky Survey","volume":"389","author":"Lintott","year":"2008","journal-title":"Monthly Notices of the Royal Astronomical Society"},{"key":"S0269888918000139_ref69","first-page":"65","article-title":"Ushahidi, or \u2018testimony\u2019: Web 2.0 tools for crowdsourcing crisis information","volume":"59","author":"Okolloh","year":"2009","journal-title":"Participatory Learning and Action"},{"key":"S0269888918000139_ref7","doi-asserted-by":"publisher","DOI":"10.1111\/j.1365-2966.2009.15383.x"},{"key":"S0269888918000139_ref73","first-page":"163","volume-title":"International Workshop on Environments for Multi-Agent Systems\u2019, Vol. 3830 of Lecture Notes in Artificial Intelligence","author":"Parunak","year":"2005"},{"key":"S0269888918000139_ref22","doi-asserted-by":"publisher","DOI":"10.1017\/S0269888910000408"},{"key":"S0269888918000139_ref82","doi-asserted-by":"publisher","DOI":"10.1109\/MCE.2016.2516179"},{"key":"S0269888918000139_ref101","doi-asserted-by":"crossref","first-page":"97","DOI":"10.1162\/106454699568700","article-title":"A brief history of stigmergy","volume":"5","author":"Theraulaz","year":"1999","journal-title":"Artificial Life"},{"key":"S0269888918000139_ref108","doi-asserted-by":"publisher","DOI":"10.1145\/1378704.1378719"},{"key":"S0269888918000139_ref89","unstructured":"Smart P. R. , Huynh T. D. , Braines D. & Shadbolt N. R. 2010. Dynamic networks and distributed problem-solving. In Knowledge Systems for Coalition Operations (KSCO'10)."},{"key":"S0269888918000139_ref23","doi-asserted-by":"publisher","DOI":"10.1038\/438900a"},{"key":"S0269888918000139_ref90","first-page":"261","article-title":"The social scaffolding of machine intelligence","volume":"10","author":"Smart","year":"2017","journal-title":"International Journal On Advances in Intelligent Systems"},{"key":"S0269888918000139_ref91","doi-asserted-by":"crossref","first-page":"6855","DOI":"10.4018\/978-1-4666-5888-2.ch675","volume-title":"Encyclopedia of Information Science and Technology","author":"Smart","year":"2014"},{"key":"S0269888918000139_ref2","volume-title":"Weaving the Web: The Original Design and Ultimate Destiny of the World Wide Web","author":"Berners-Lee","year":"1999"},{"key":"S0269888918000139_ref63","volume-title":"Reality is Broken: Why Games Make us Better and How They Can Change the World","author":"McGonigal","year":"2011"},{"key":"S0269888918000139_ref27","doi-asserted-by":"publisher","DOI":"10.1111\/j.1933-1592.2002.tb00151.x"},{"key":"S0269888918000139_ref88","doi-asserted-by":"publisher","DOI":"10.1109\/MIS.2008.45"},{"key":"S0269888918000139_ref42","doi-asserted-by":"publisher","DOI":"10.1016\/j.cogsys.2015.12.002"},{"key":"S0269888918000139_ref13","doi-asserted-by":"publisher","DOI":"10.1038\/nature09304"},{"key":"S0269888918000139_ref70","first-page":"105","article-title":"Extended knowledge and social epistemology","volume":"2","author":"Palermos","year":"2013","journal-title":"Social Epistemology Review and Reply Collective"},{"key":"S0269888918000139_ref79","volume-title":"Knowledge Engineering and Management: The CommonKADS Methodology","author":"Schreiber","year":"2000"},{"key":"S0269888918000139_ref61","first-page":"21","article-title":"The collective intelligence genome","volume":"51","author":"Malone","year":"2010","journal-title":"MIT Sloan Management Review"},{"key":"S0269888918000139_ref80","doi-asserted-by":"publisher","DOI":"10.1088\/0004-637X\/768\/2\/127"},{"key":"S0269888918000139_ref87","doi-asserted-by":"publisher","DOI":"10.1111\/j.1365-2966.2012.20770.x"},{"key":"S0269888918000139_ref85","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4614-8806-4_13"},{"key":"S0269888918000139_ref31","doi-asserted-by":"publisher","DOI":"10.1186\/gb-2011-12-12-135"},{"key":"S0269888918000139_ref92","doi-asserted-by":"crossref","first-page":"51","DOI":"10.1007\/978-3-319-08681-1_3","volume-title":"Social Collective Intelligence: Combining the Powers of Humans and Machines to Build a Smarter Society","author":"Smart","year":"2014"},{"key":"S0269888918000139_ref46","unstructured":"Hooper C. , Bailey B. , Glaser H. & Hendler J. 2016. Social machines in practice: solutions, stakeholders and scopes. In 8th International ACM Web Science Conference, Nejdl, W., Hall, W., Parigi P. & S. Staab, (eds). ACM, 156\u2013160."},{"key":"S0269888918000139_ref74","volume-title":"Knowledge","author":"Pritchard","year":"2009"},{"key":"S0269888918000139_ref83","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2012.10.008"},{"key":"S0269888918000139_ref103","doi-asserted-by":"publisher","DOI":"10.1109\/MIS.2013.50"},{"key":"S0269888918000139_ref25","volume-title":"The Routledge Handbook of Mechanisms and Mechanical Philosophy","author":"Glennan","year":"2018"},{"key":"S0269888918000139_ref100","doi-asserted-by":"publisher","DOI":"10.1007\/s11097-010-9182-y"},{"key":"S0269888918000139_ref54","doi-asserted-by":"publisher","DOI":"10.1016\/j.websem.2007.09.001"},{"key":"S0269888918000139_ref59","doi-asserted-by":"publisher","DOI":"10.1111\/j.1365-2966.2009.15299.x"},{"key":"S0269888918000139_ref95","first-page":"119","volume-title":"Handbook of Collective Intelligence","author":"Steyvers","year":"2015"},{"key":"S0269888918000139_ref102","doi-asserted-by":"publisher","DOI":"10.1109\/MIC.2015.94"},{"key":"S0269888918000139_ref81","doi-asserted-by":"crossref","first-page":"96","DOI":"10.1109\/MIS.2006.62","article-title":"The Semantic Web revisited","volume":"21","author":"Shadbolt","year":"2006","journal-title":"IEEE Intelligent Systems"},{"key":"S0269888918000139_ref21","doi-asserted-by":"publisher","DOI":"10.1140\/epjst\/e2012-01688-9"},{"key":"S0269888918000139_ref64","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9781316182635"},{"key":"S0269888918000139_ref86","doi-asserted-by":"publisher","DOI":"10.1017\/S0269888913000192"},{"key":"S0269888918000139_ref109","doi-asserted-by":"publisher","DOI":"10.1088\/0004-637X\/776\/1\/10"},{"key":"S0269888918000139_ref36","volume-title":"Knowledge Acquisition for Expert Systems","author":"Hart","year":"1986"},{"key":"S0269888918000139_ref49","unstructured":"Kamar E. , Hacker S. & Horvitz E. 2012. Combining human and machine intelligence in large-scale crowdsourcing. In 11th International Conference on Autonomous Agents and Multiagent Systems, van der Hoek, W., Padgham, L., Conitzer, V. & Winikoff, M. (eds). 1, IFAAMAS 467\u2013474."},{"key":"S0269888918000139_ref19","doi-asserted-by":"publisher","DOI":"10.1109\/MIS.2011.52"},{"key":"S0269888918000139_ref99","doi-asserted-by":"publisher","DOI":"10.1016\/j.biocon.2009.05.006"},{"key":"S0269888918000139_ref104","doi-asserted-by":"publisher","DOI":"10.1109\/MIC.2012.66"},{"key":"S0269888918000139_ref96","doi-asserted-by":"publisher","DOI":"10.1109\/MIS.2014.80"},{"key":"S0269888918000139_ref15","doi-asserted-by":"publisher","DOI":"10.1016\/j.comnet.2015.05.018"}],"container-title":["The Knowledge Engineering Review"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.cambridge.org\/core\/services\/aop-cambridge-core\/content\/view\/S0269888918000139","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,1,5]],"date-time":"2026-01-05T14:42:09Z","timestamp":1767624129000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.cambridge.org\/core\/product\/identifier\/S0269888918000139\/type\/journal_article"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018]]},"references-count":111,"alternative-id":["S0269888918000139"],"URL":"https:\/\/doi.org\/10.1017\/s0269888918000139","relation":{},"ISSN":["0269-8889","1469-8005"],"issn-type":[{"value":"0269-8889","type":"print"},{"value":"1469-8005","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018]]},"article-number":"e11"}}