{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,7]],"date-time":"2026-04-07T17:18:24Z","timestamp":1775582304011,"version":"3.50.1"},"reference-count":25,"publisher":"Springer Science and Business Media LLC","issue":"4","license":[{"start":{"date-parts":[[2020,11,18]],"date-time":"2020-11-18T00:00:00Z","timestamp":1605657600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,11,18]],"date-time":"2020-11-18T00:00:00Z","timestamp":1605657600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100000848","name":"University of Edinburgh","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100000848","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Minds &amp; Machines"],"published-print":{"date-parts":[[2020,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>The Turing Test (TT) is best regarded as a model to test for intelligence, where an entity\u2019s intelligence is inferred from its ability to be attributed with \u2018human-likeness\u2019 during a text-based conversation. The problem with this model, however, is that it does not care <jats:italic>if<\/jats:italic> or <jats:italic>how well<\/jats:italic> an entity produces a meaningful conversation, as long as its interactions are humanlike enough. As a consequence, the TT attracts projects that concentrate on how best to fool the judges. In light of this, I propose a new version of the TT: the Questioning Turing Test (QTT). Here, the entity has to produce an enquiry rather than a conversation; and it is parametrised along two further dimensions in addition to \u2018human-likeness\u2019: \u2018correctness\u2019, evaluating <jats:italic>if<\/jats:italic> the entity accomplishes the enquiry; and \u2018strategicness\u2019, evaluating <jats:italic>how well<\/jats:italic> the entity accomplishes the enquiry, in terms of the number of questions asked (the fewer, the better).<\/jats:p>","DOI":"10.1007\/s11023-020-09551-6","type":"journal-article","created":{"date-parts":[[2020,11,18]],"date-time":"2020-11-18T10:04:14Z","timestamp":1605693854000},"page":"563-587","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":8,"title":["The Questioning Turing Test"],"prefix":"10.1007","volume":"30","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0417-525X","authenticated-orcid":false,"given":"Nicola","family":"Damassino","sequence":"first","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2020,11,18]]},"reference":[{"key":"9551_CR1","doi-asserted-by":"publisher","first-page":"5","DOI":"10.2307\/2184371","volume":"90","author":"N Block","year":"1981","unstructured":"Block, N. (1981). Behaviourism and psychologism. Philosophical Review, 90, 5\u201343.","journal-title":"Philosophical Review"},{"key":"9551_CR2","doi-asserted-by":"publisher","first-page":"519","DOI":"10.1023\/A:1011285919106","volume":"10","author":"JB Copeland","year":"2000","unstructured":"Copeland, J. B. (2000). The turing test. Minds and Machines, 10, 519\u2013539.","journal-title":"Minds and Machines"},{"key":"9551_CR3","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1016\/j.comnet.2015.05.018","volume":"90","author":"G Demartini","year":"2015","unstructured":"Demartini, G. (2015). Hybrid human\u2013machine information systems: Challenges and opportunities. Computer Network, 90, 5\u201313.","journal-title":"Computer Network"},{"key":"9551_CR4","doi-asserted-by":"publisher","first-page":"189","DOI":"10.1017\/epi.2012.8","volume":"9","author":"EJ Genot","year":"2012","unstructured":"Genot, E. J., & Jacot, J. (2012). How can questions be informative before they are answered? Strategic information in interrogative games. Episteme, 9, 189\u2013204.","journal-title":"Episteme"},{"key":"9551_CR5","first-page":"41","volume":"3","author":"PH Grice","year":"1975","unstructured":"Grice, P. H. (1975). Logic and conversation. Syntax and Semantics: Speech Acts, 3, 41\u201358.","journal-title":"Syntax and Semantics: Speech Acts"},{"key":"9551_CR6","doi-asserted-by":"publisher","first-page":"425","DOI":"10.1023\/A:1008315308862","volume":"9","author":"S Harnad","year":"2000","unstructured":"Harnad, S. (2000). Mind, machines and turing. Journal of Logic, Language and Information, 9, 425\u2013445.","journal-title":"Journal of Logic, Language and Information"},{"key":"9551_CR7","doi-asserted-by":"publisher","DOI":"10.1007\/978-94-015-9313-7","volume-title":"Inquiry as inquiry: A logic of scientific discovery","author":"J Hintikka","year":"1999","unstructured":"Hintikka, J. (1999). Inquiry as inquiry: A logic of scientific discovery. New York: Springer."},{"key":"9551_CR8","doi-asserted-by":"publisher","DOI":"10.1017\/9781316594179","volume-title":"The measure of all minds","author":"J Hern\u00e1ndez-Orallo","year":"2017","unstructured":"Hern\u00e1ndez-Orallo, J. (2017). The measure of all minds. Cambridge: Cambridge University Press."},{"key":"9551_CR9","unstructured":"Levesque, H. (2011). The winograd schema challenge. In Proceedings of the CommonSense-11 Symposium."},{"key":"9551_CR10","unstructured":"Levesque, H., Davis, E., & Morgenstern, L. (2012). The Winograd Schema Challenge. In Proceedings of the thirteenth international conference on principles of knowledge representation and reasoning."},{"key":"9551_CR11","first-page":"41","volume":"2","author":"L Lid\u00e8n","year":"2003","unstructured":"Lid\u00e8n, L. (2003). Artificial stupidity: The art of intentional mistakes. AI Wisdom, 2, 41\u201348.","journal-title":"AI Wisdom"},{"key":"9551_CR12","first-page":"283","volume-title":"Parsing the turing test","author":"KC McKinstry","year":"2006","unstructured":"McKinstry, K. C., et al. (2006). Mind as space. In R. Epstein (Ed.), Parsing the turing test (pp. 283\u2013299). New York: Springer."},{"key":"9551_CR13","doi-asserted-by":"publisher","first-page":"77","DOI":"10.1023\/A:1011218925467","volume":"11","author":"J Moor","year":"2001","unstructured":"Moor, J. (2001). The status and future of the turing test. Minds and Machines, 11, 77\u201393.","journal-title":"Minds and Machines"},{"key":"9551_CR14","doi-asserted-by":"publisher","first-page":"449","DOI":"10.1108\/03684921011036178","volume":"39","author":"H Shah","year":"2010","unstructured":"Shah, H., & Warwick, K. (2010). Testing Turing\u2019s five minutes, parallel-paired imitation game. Kybernetes, 39, 449\u2013465.","journal-title":"Kybernetes"},{"key":"9551_CR15","volume-title":"Automata studies","author":"CE Shannon","year":"1956","unstructured":"Shannon, C. E., & McCarthy, J. (1956). Automata studies. Princeton: Princeton University Press."},{"key":"9551_CR16","unstructured":"Sinha, K., et al. (2016). Designing a human\u2013machine hybrid computing system for unstructured data analytics. Retrieved from https:\/\/arxiv.org\/abs\/1606.04929."},{"key":"9551_CR17","doi-asserted-by":"publisher","first-page":"541","DOI":"10.1023\/A:1011242120015","volume":"10","author":"S Sterrett","year":"2000","unstructured":"Sterrett, S. (2000). Turing\u2019s two tests for intelligence. Minds and Machines, 10, 541\u2013559.","journal-title":"Minds and Machines"},{"key":"9551_CR18","doi-asserted-by":"publisher","first-page":"131","DOI":"10.1023\/A:1013741418638","volume":"12","author":"SG Sterrett","year":"2002","unstructured":"Sterrett, S. G. (2002a). Nested algorithms and \u201cThe Original Imitation Game Test\u201d: A reply to James Moor. Minds and Machines, 12, 131\u2013136.","journal-title":"Minds and Machines"},{"key":"9551_CR19","doi-asserted-by":"publisher","first-page":"39","DOI":"10.1080\/09528130210153505","volume":"14","author":"SG Sterrett","year":"2002","unstructured":"Sterrett, S. G. (2002b). Too many instincts: Contrasting philosophical views on intelligence in humans and non-humans. Journal of Experimental & Theoretical Artificial Intelligence, 14, 39\u201360.","journal-title":"Journal of Experimental & Theoretical Artificial Intelligence"},{"key":"9551_CR20","doi-asserted-by":"publisher","first-page":"561","DOI":"10.1023\/A:1011254505902","volume":"10","author":"S Traiger","year":"2000","unstructured":"Traiger, S. (2000). Making the Right Identification in the Turing Test. Minds and Machines, 10, 561\u2013572.","journal-title":"Minds and Machines"},{"key":"9551_CR21","unstructured":"Turing, A. M. (1939). Systems of Logic Based on Ordinals (PhD thesis). Princeton University Press."},{"key":"9551_CR22","volume-title":"A. M. Turing\u2019s ACE report of 1946 and other papers","author":"AM Turing","year":"1947","unstructured":"Turing, A. M. (1947). Lecture to the London Mathematical Society on 20 February 1947. In B. E. Carpenter & R. W. Doran (Eds.), A. M. Turing\u2019s ACE report of 1946 and other papers. New York: MIT Press."},{"key":"9551_CR23","doi-asserted-by":"publisher","first-page":"433","DOI":"10.1093\/mind\/LIX.236.433","volume":"59","author":"AM Turing","year":"1950","unstructured":"Turing, A. M. (1950). Computing machinery and intelligence. Mind, 59, 433\u2013460.","journal-title":"Mind"},{"key":"9551_CR24","first-page":"487","volume-title":"The essential turing","author":"AM Turing","year":"1952","unstructured":"Turing, A. M. (1952). Can automatic calculating machines be said to think? In B. J. Copeland (Ed.), The essential turing (pp. 487\u2013506). Cambridge: MIT Press."},{"key":"9551_CR25","doi-asserted-by":"publisher","first-page":"36","DOI":"10.1145\/365153.365168","volume":"9","author":"J Weizenbaum","year":"1966","unstructured":"Weizenbaum, J. (1966). ELIZA a computer program for the study of natural language communication between man and machine. Communications of the ACM, 9, 36\u201335.","journal-title":"Communications of the ACM"}],"container-title":["Minds and Machines"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s11023-020-09551-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1007\/s11023-020-09551-6\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s11023-020-09551-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2020,12,15]],"date-time":"2020-12-15T08:05:19Z","timestamp":1608019519000},"score":1,"resource":{"primary":{"URL":"http:\/\/link.springer.com\/10.1007\/s11023-020-09551-6"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,11,18]]},"references-count":25,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2020,12]]}},"alternative-id":["9551"],"URL":"https:\/\/doi.org\/10.1007\/s11023-020-09551-6","relation":{},"ISSN":["0924-6495","1572-8641"],"issn-type":[{"value":"0924-6495","type":"print"},{"value":"1572-8641","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,11,18]]},"assertion":[{"value":"24 April 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"3 November 2020","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"18 November 2020","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}