{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T15:36:57Z","timestamp":1776094617662,"version":"3.50.1"},"reference-count":53,"publisher":"Proceedings of the National Academy of Sciences","issue":"6","license":[{"start":{"date-parts":[[2019,8,4]],"date-time":"2019-08-04T00:00:00Z","timestamp":1564876800000},"content-version":"vor","delay-in-days":181,"URL":"https:\/\/www.pnas.org\/site\/aboutpnas\/licenses.xhtml"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["CHS-1526665"],"award-info":[{"award-number":["CHS-1526665"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["IIS-1149797"],"award-info":[{"award-number":["IIS-1149797"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["IIS-1217559"],"award-info":[{"award-number":["IIS-1217559"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100012884","name":"Bosch","doi-asserted-by":"crossref","award":["Unknown"],"award-info":[{"award-number":["Unknown"]}],"id":[{"id":"10.13039\/100012884","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/100006785","name":"Google","doi-asserted-by":"publisher","award":["Unknown"],"award-info":[{"award-number":["Unknown"]}],"id":[{"id":"10.13039\/100006785","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100008047","name":"Carnegie Mellon University","doi-asserted-by":"publisher","award":["Web2020 Initiate"],"award-info":[{"award-number":["Web2020 Initiate"]}],"id":[{"id":"10.13039\/100008047","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003977","name":"Israel Science Foundation","doi-asserted-by":"publisher","award":["1764\/15"],"award-info":[{"award-number":["1764\/15"]}],"id":[{"id":"10.13039\/501100003977","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Alon","award":["Unknown"],"award-info":[{"award-number":["Unknown"]}]},{"name":"The Hebrew University Jerusalum Israel Cyber Security Research Center","award":["Unknown"],"award-info":[{"award-number":["Unknown"]}]}],"content-domain":{"domain":["www.pnas.org"],"crossmark-restriction":true},"short-container-title":["Proc. Natl. Acad. Sci. U.S.A."],"published-print":{"date-parts":[[2019,2,5]]},"abstract":"<jats:p>Analogy\u2014the ability to find and apply deep structural patterns across domains\u2014has been fundamental to human innovation in science and technology. Today there is a growing opportunity to accelerate innovation by moving analogy out of a single person\u2019s mind and distributing it across many information processors, both human and machine. Doing so has the potential to overcome cognitive fixation, scale to large idea repositories, and support complex problems with multiple constraints. Here we lay out a perspective on the future of scalable analogical innovation and first steps using crowds and artificial intelligence (AI) to augment creativity that quantitatively demonstrate the promise of the approach, as well as core challenges critical to realizing this vision.<\/jats:p>","DOI":"10.1073\/pnas.1807185116","type":"journal-article","created":{"date-parts":[[2019,2,5]],"date-time":"2019-02-05T01:44:30Z","timestamp":1549331070000},"page":"1870-1877","update-policy":"https:\/\/doi.org\/10.1073\/pnas.cm10313","source":"Crossref","is-referenced-by-count":56,"title":["Scaling up analogical innovation with crowds and AI"],"prefix":"10.1073","volume":"116","author":[{"given":"Aniket","family":"Kittur","sequence":"first","affiliation":[{"name":"Human\u2013Computer Interaction Institute, Carnegie Mellon University, Pittsburgh, PA 15213;"}]},{"given":"Lixiu","family":"Yu","sequence":"additional","affiliation":[{"name":"Robert Bosch, Research and Technology Center, Division 3, Pittsburgh, PA 15222;"}]},{"given":"Tom","family":"Hope","sequence":"additional","affiliation":[{"name":"School of Computer Science and Engineering, The Hebrew University of Jerusalem, 9190401 Jerusalem, Israel;"}]},{"given":"Joel","family":"Chan","sequence":"additional","affiliation":[{"name":"College of Information Studies, University of Maryland, College Park, MD 20742;"}]},{"given":"Hila","family":"Lifshitz-Assaf","sequence":"additional","affiliation":[{"name":"Department of Information, Operations and Management Sciences, Leonard N. Stern School of Business, New York University, New York, NY 10012"}]},{"given":"Karni","family":"Gilon","sequence":"additional","affiliation":[{"name":"School of Computer Science and Engineering, The Hebrew University of Jerusalem, 9190401 Jerusalem, Israel;"}]},{"given":"Felicia","family":"Ng","sequence":"additional","affiliation":[{"name":"Human\u2013Computer Interaction Institute, Carnegie Mellon University, Pittsburgh, PA 15213;"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8554-2137","authenticated-orcid":false,"given":"Robert E.","family":"Kraut","sequence":"additional","affiliation":[{"name":"Human\u2013Computer Interaction Institute, Carnegie Mellon University, Pittsburgh, PA 15213;"}]},{"given":"Dafna","family":"Shahaf","sequence":"additional","affiliation":[{"name":"School of Computer Science and Engineering, The Hebrew University of Jerusalem, 9190401 Jerusalem, Israel;"}]}],"member":"341","published-online":{"date-parts":[[2019,2,4]]},"reference":[{"key":"e_1_3_3_1_2","volume-title":"Models and Analogies in Science","author":"Hesse MB","year":"1966","unstructured":"MB Hesse Models and Analogies in Science (Univ Notre Dame Press, Notre Dame, IN, 1966)."},{"key":"e_1_3_3_2_2","doi-asserted-by":"publisher","DOI":"10.1119\/1.1545761"},{"key":"e_1_3_3_3_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jcps.2010.01.002"},{"key":"e_1_3_3_4_2","doi-asserted-by":"publisher","DOI":"10.1509\/jmkr.39.1.47.18930"},{"key":"e_1_3_3_5_2","article-title":"BYU engineers use origami to make more space in space","author":"Monk M","year":"2013","unstructured":"M Monk, BYU engineers use origami to make more space in space. The Daily Universe, 2013).","journal-title":"The Daily Universe"},{"key":"e_1_3_3_6_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4615-0605-8_2"},{"key":"e_1_3_3_7_2","doi-asserted-by":"crossref","first-page":"403","DOI":"10.1037\/10227-016","volume-title":"Creative Thought: An Investigation of Conceptual Structures and Processes","author":"Gentner D","year":"1997","unstructured":"D Gentner, , Analogy and creativity in the works of Johannes Kepler. Creative Thought: An Investigation of Conceptual Structures and Processes, eds TB Ward, SM Smith, J Vaid (Am Psychological Association, Washington, DC), pp. 403\u2013459 (1997)."},{"key":"e_1_3_3_8_2","volume-title":"Mental Leaps: Analogy in Creative Thought","author":"Holyoak KJ","year":"1996","unstructured":"KJ Holyoak, KJ Holyoak, P Thagard Mental Leaps: Analogy in Creative Thought (MIT Press, Cambridge, MA, 1996)."},{"key":"e_1_3_3_9_2","first-page":"607","volume-title":"Proceedings of the International Conference on Systems, Man and Cybernetics","author":"Gentner D","year":"1985","unstructured":"D Gentner, R Landers, Analogical reminding: A good match is hard to find. Proceedings of the International Conference on Systems, Man and Cybernetics (IEEE, New York), pp. 607\u2013613 (1985)."},{"key":"e_1_3_3_10_2","doi-asserted-by":"publisher","DOI":"10.1287\/orsc.1090.0491"},{"key":"e_1_3_3_11_2","doi-asserted-by":"publisher","DOI":"10.1016\/S1364-6613(00)01698-3"},{"key":"e_1_3_3_12_2","doi-asserted-by":"publisher","DOI":"10.1016\/0010-0285(80)90013-4"},{"key":"e_1_3_3_13_2","doi-asserted-by":"publisher","DOI":"10.1016\/0010-0285(83)90002-6"},{"key":"e_1_3_3_14_2","doi-asserted-by":"publisher","DOI":"10.2307\/2393655"},{"key":"e_1_3_3_15_2","doi-asserted-by":"publisher","DOI":"10.1177\/0001839217747876"},{"key":"e_1_3_3_16_2","doi-asserted-by":"publisher","DOI":"10.3758\/BF03195939"},{"key":"e_1_3_3_17_2","first-page":"145","volume-title":"Proceedings of the ASME 2007 International Design Engineering Technical Conferences & Computers and Information in Engineering Conference","author":"Linsey JS","year":"2007","unstructured":"JS Linsey, JP Laux, E Clauss, KL Wood, AB Markman, Increasing innovation: A trilogy of experiments towards a design-by-analogy method. Proceedings of the ASME 2007 International Design Engineering Technical Conferences & Computers and Information in Engineering Conference (American Society of Mechanical Engineers, New York), pp. 145\u2013159 (2007)."},{"key":"e_1_3_3_18_2","doi-asserted-by":"publisher","DOI":"10.1115\/1.4023158"},{"key":"e_1_3_3_19_2","doi-asserted-by":"publisher","DOI":"10.1115\/1.4004396"},{"key":"e_1_3_3_20_2","doi-asserted-by":"publisher","DOI":"10.1109\/64.590078"},{"key":"e_1_3_3_21_2","volume-title":"Synectics: The Development of Creative Capacity","author":"Gordon WJJ","year":"1961","unstructured":"WJJ Gordon Synectics: The Development of Creative Capacity (Harper, New York, 1961)."},{"key":"e_1_3_3_22_2","doi-asserted-by":"publisher","DOI":"10.1201\/9781420038958"},{"key":"e_1_3_3_23_2","doi-asserted-by":"publisher","DOI":"10.1006\/cogp.1993.1013"},{"key":"e_1_3_3_24_2","doi-asserted-by":"publisher","DOI":"10.1037\/h0093599"},{"key":"e_1_3_3_25_2","doi-asserted-by":"publisher","DOI":"10.1017\/S0890060408000061"},{"key":"e_1_3_3_26_2","first-page":"265","volume-title":"Proceedings of IDETC\/CIE 2006 ASME 2006 International Design Engineering Technical Conferences & Computers and Information in Engineering Conference","author":"Linsey JS","year":"2006","unstructured":"JS Linsey, JT Murphy, AB Markman, KL Wood, T Kurtoglu, Representing analogies: Increasing the probability of innovation. Proceedings of IDETC\/CIE 2006 ASME 2006 International Design Engineering Technical Conferences & Computers and Information in Engineering Conference (Am Soc of Mechanical Engineers, New York), pp. 265\u2013282 (2006)."},{"key":"e_1_3_3_27_2","doi-asserted-by":"publisher","DOI":"10.1115\/1.4006145"},{"key":"e_1_3_3_28_2","article-title":"Increasing innovation: Presentation and evaluation of the WordTree design-by-analogy method","author":"Linsey JS","year":"2008","unstructured":"JS Linsey, KL Wood, AB Markman, Increasing innovation: Presentation and evaluation of the WordTree design-by-analogy method. Proceedings of the 2008 IDETC\/CIE Conference, 2008).","journal-title":"Proceedings of the 2008 IDETC\/CIE Conference"},{"key":"e_1_3_3_29_2","first-page":"13.1407.1","volume-title":"Proceedings of the 2008 ASEE Annual Conference","author":"Linsey J","year":"2008","unstructured":"J Linsey, AB Markman, KL Wood, WordTrees: A method for design-by-analogy. Proceedings of the 2008 ASEE Annual Conference (Am Soc for Engineering Education, Washington, DC), pp. 13.1407.1\u201313.1407.14 (2008)."},{"key":"e_1_3_3_30_2","first-page":"113","volume-title":"Computational Models of Creative Design IV","author":"Gero JS","year":"1998","unstructured":"JS Gero, V Kazakov, Using analogy to extend the behaviour state space in design. Computational Models of Creative Design IV, eds JS Gero, ML Maher (Univ of Sydney, Sydney), pp. 113\u2013143 (1998)."},{"key":"e_1_3_3_31_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-0-85729-224-7_16"},{"key":"e_1_3_3_32_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00163-001-0008-3"},{"key":"e_1_3_3_33_2","doi-asserted-by":"publisher","DOI":"10.1115\/1.4028348"},{"key":"e_1_3_3_34_2","doi-asserted-by":"publisher","DOI":"10.1145\/1357054.1357127"},{"key":"e_1_3_3_35_2","doi-asserted-by":"publisher","DOI":"10.1145\/2470654.2466265"},{"key":"e_1_3_3_36_2","doi-asserted-by":"crossref","first-page":"1245","DOI":"10.1145\/2556288.2557371","volume-title":"Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI \u201914","author":"Yu L","year":"2014","unstructured":"L Yu, A Kittur, RE Kraut, Distributed analogical idea generation: Inventing with crowds. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI \u201914, eds S Brewster, A Cockburn (ACM, New York), pp. 1245\u20131254 (2014)."},{"key":"e_1_3_3_37_2","first-page":"1225","volume-title":"Proceedings of the 32nd Annual ACM Conference on Human Factors in Computing Systems, CHI \u201914","author":"Yu L","year":"2014","unstructured":"L Yu, A Kittur, RE Kraut, Searching for analogical ideas with crowds. Proceedings of the 32nd Annual ACM Conference on Human Factors in Computing Systems, CHI \u201914, eds S Brewster, A Cockburn (ACM, New York), pp. 1225\u20131234 (2014)."},{"key":"e_1_3_3_38_2","first-page":"1214","volume-title":"Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing, CSCW \u201916","author":"Yu L","year":"2016","unstructured":"L Yu, A Kittur, RE Kraut, Encouraging \u201coutside- the- box\u201d thinking in crowd innovation through identifying domains of expertise. Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing, CSCW \u201916, eds P Bj\u00f8rn, J Konstan (ACM, New York), pp. 1214\u20131222 (2016)."},{"key":"e_1_3_3_39_2","doi-asserted-by":"publisher","DOI":"10.1207\/s15516709cog0702_3"},{"key":"e_1_3_3_40_2","doi-asserted-by":"publisher","DOI":"10.1016\/0004-3702(89)90077-5"},{"key":"e_1_3_3_41_2","first-page":"471","volume-title":"Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Long Papers","author":"Hartmann S","year":"2017","unstructured":"S Hartmann, I Kuznetsov, T Martin, I Gurevych, Out-of-domain framenet semantic role labeling. Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Long PapersM Lapata, P Blunsom, A Koller (Assoc for Computational Linguistics, Stroudsburg, PA) Vol 1, 471\u2013482 (2017)."},{"key":"e_1_3_3_42_2","first-page":"688","volume-title":"Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics","author":"Shutova E","year":"2010","unstructured":"E Shutova, Models of metaphor in NLP. Proceedings of the 48th Annual Meeting of the Association for Computational LinguisticsJ Chang, P Koehn (Assoc for Computational Linguistics, Stroudsburg, PA), pp. 688\u2013697 (2010)."},{"key":"e_1_3_3_43_2","unstructured":"T Mikolov K Chen G Corrado J Dean Efficient estimation of word representations in vector space. arXiv:1301.3781. Preprint posted January 16 2013. (2013)."},{"key":"e_1_3_3_44_2","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1097-4571(199009)41:6<391::AID-ASI1>3.0.CO;2-9"},{"key":"e_1_3_3_45_2","first-page":"993","article-title":"Latent Dirichlet allocation","volume":"3","author":"Blei DM","year":"2003","unstructured":"DM Blei, AY Ng, MI Jordan, Latent Dirichlet allocation. J Mach Learn Res 3, 993\u20131022 (2003).","journal-title":"J Mach Learn Res"},{"key":"e_1_3_3_46_2","doi-asserted-by":"crossref","first-page":"235","DOI":"10.1145\/3097983.3098038","volume-title":"Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD \u201917","author":"Hope T","year":"2017","unstructured":"T Hope, J Chan, A Kittur, D Shahaf, Accelerating innovation through analogy mining. Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD \u201917 (ACM, New York), pp. 235\u2013243 (2017)."},{"key":"e_1_3_3_47_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00163-001-0007-4"},{"key":"e_1_3_3_48_2","first-page":"31:1","volume-title":"Proceedings of the 21st ACM Conference on Computer-Supported Cooperative Work & Social Computing, CSCW \u201918","author":"Chan J","year":"2018","unstructured":"J Chan, JC Chang, T Hope, D Shahaf, A Kittur, A mixed initiative system for finding analogies between research papers. Proceedings of the 21st ACM Conference on Computer-Supported Cooperative Work & Social Computing, CSCW \u201918, eds G Fitzpatrick, K Karahalios, A Monroy-Hern\u00e1ndez, J Nichols (ACM, New York), pp. 31:1\u201331:21 (2018)."},{"key":"e_1_3_3_49_2","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/D14-1162"},{"key":"e_1_3_3_50_2","first-page":"1236","volume-title":"Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing","author":"Yu L","year":"2016","unstructured":"L Yu, RE Kraut, A Kittur, Distributed analogical idea generation with multiple constraints. Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing, eds S Brewster, A Cockburn (ACM, New York), pp. 1236\u20131245 (2016)."},{"key":"e_1_3_3_51_2","first-page":"121:1","volume-title":"Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, CHI \u201918","author":"Gilon K","year":"2018","unstructured":"K Gilon, , Analogy mining for specific design needs. Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, CHI \u201918A Dey, E Cutrell, MC Shraefel (ACM, New York), pp. 121:1\u2013121:11 (2018)."},{"key":"e_1_3_3_52_2","doi-asserted-by":"publisher","DOI":"10.1145\/219717.219745"},{"key":"e_1_3_3_53_2","unstructured":"K Lakhani InnoCentive.com (A). Harvard Business School Case No. 608-170 (Harvard Business School Cambridge MA). (2008)."}],"updated-by":[{"DOI":"10.1073\/pnas.1912314116","type":"correction","label":"Correction","source":"publisher","updated":{"date-parts":[[2019,8,12]],"date-time":"2019-08-12T00:00:00Z","timestamp":1565568000000}}],"container-title":["Proceedings of the National Academy of Sciences"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/www.pnas.org\/syndication\/doi\/10.1073\/pnas.1807185116","content-type":"unspecified","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/pnas.org\/doi\/pdf\/10.1073\/pnas.1807185116","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,4,13]],"date-time":"2022-04-13T07:34:48Z","timestamp":1649835288000},"score":1,"resource":{"primary":{"URL":"https:\/\/pnas.org\/doi\/full\/10.1073\/pnas.1807185116"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,2,4]]},"references-count":53,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2019,2,5]]}},"alternative-id":["10.1073\/pnas.1807185116"],"URL":"https:\/\/doi.org\/10.1073\/pnas.1807185116","relation":{"correction":[{"id-type":"doi","id":"10.1073\/pnas.1912314116","asserted-by":"object"}]},"ISSN":["0027-8424","1091-6490"],"issn-type":[{"value":"0027-8424","type":"print"},{"value":"1091-6490","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,2,4]]},"assertion":[{"value":"2019-02-04","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}