{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,17]],"date-time":"2025-12-17T17:58:31Z","timestamp":1765994311777,"version":"3.37.3"},"reference-count":38,"publisher":"Proceedings of the National Academy of Sciences","issue":"12","license":[{"start":{"date-parts":[[2016,9,7]],"date-time":"2016-09-07T00:00:00Z","timestamp":1473206400000},"content-version":"vor","delay-in-days":184,"URL":"http:\/\/www.pnas.org\/preview_site\/misc\/userlicense.xhtml"}],"funder":[{"DOI":"10.13039\/100000008","name":"David and Lucile Packard Foundation","doi-asserted-by":"publisher","award":["Fellowship for Science and Engineering"],"award-info":[{"award-number":["Fellowship for Science and Engineering"]}],"id":[{"id":"10.13039\/100000008","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["IIS-1252951"],"award-info":[{"award-number":["IIS-1252951"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000185","name":"DOD | Defense Advanced Research Projects Agency","doi-asserted-by":"publisher","award":["N66001-14-1-4037"],"award-info":[{"award-number":["N66001-14-1-4037"]}],"id":[{"id":"10.13039\/100000185","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000006","name":"DOD | Office of Naval Research","doi-asserted-by":"publisher","award":["N000141110743"],"award-info":[{"award-number":["N000141110743"]}],"id":[{"id":"10.13039\/100000006","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Brown Center for Computation and Visualization","award":["(none)"],"award-info":[{"award-number":["(none)"]}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61300111"],"award-info":[{"award-number":["61300111"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61133003"],"award-info":[{"award-number":["61133003"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["www.pnas.org"],"crossmark-restriction":true},"short-container-title":["Proc. Natl. Acad. Sci. U.S.A."],"published-print":{"date-parts":[[2016,3,22]]},"abstract":"<jats:title>Significance<\/jats:title><jats:p>The botanical value of angiosperm leaf shape and venation (\u201cleaf architecture\u201d) is well known, but the astounding complexity and variation of leaves have thwarted efforts to access this underused resource. This challenge is central for paleobotany because most angiosperm fossils are isolated, unidentified leaves. We here demonstrate that a computer vision algorithm trained on several thousand images of diverse cleared leaves successfully learns leaf-architectural features, then categorizes novel specimens into natural botanical groups above the species level. The system also produces heat maps to display the locations of numerous novel, informative leaf characters in a visually intuitive way. With assistance from computer vision, the systematic and paleobotanical value of leaves is ready to increase significantly.<\/jats:p>","DOI":"10.1073\/pnas.1524473113","type":"journal-article","created":{"date-parts":[[2016,3,8]],"date-time":"2016-03-08T04:09:07Z","timestamp":1457410147000},"page":"3305-3310","update-policy":"https:\/\/doi.org\/10.1073\/pnas.cm10313","source":"Crossref","is-referenced-by-count":113,"title":["Computer vision cracks the leaf code"],"prefix":"10.1073","volume":"113","author":[{"given":"Peter","family":"Wilf","sequence":"first","affiliation":[{"name":"Department of Geosciences, Pennsylvania State University, University Park, PA 16802;"}]},{"given":"Shengping","family":"Zhang","sequence":"additional","affiliation":[{"name":"Department of Cognitive, Linguistic and Psychological Sciences, Brown Institute for Brain Science, Brown University, Providence, RI 02912;"},{"name":"School of Computer Science and Technology, Harbin Institute of Technology, Weihai 264209, Shandong, People\u2019s Republic of China;"}]},{"given":"Sharat","family":"Chikkerur","sequence":"additional","affiliation":[{"name":"Azure Machine Learning, Microsoft, Cambridge, MA 02142;"}]},{"given":"Stefan A.","family":"Little","sequence":"additional","affiliation":[{"name":"Department of Geosciences, Pennsylvania State University, University Park, PA 16802;"},{"name":"Laboratoire Ecologie, Syst\u00e9matique et Evolution, Universit\u00e9 Paris-Sud, 91405 Orsay Cedex, France;"}]},{"given":"Scott L.","family":"Wing","sequence":"additional","affiliation":[{"name":"Department of Paleobiology, National Museum of Natural History, Smithsonian Institution, Washington, DC 20013"}]},{"given":"Thomas","family":"Serre","sequence":"additional","affiliation":[{"name":"Department of Cognitive, Linguistic and Psychological Sciences, Brown Institute for Brain Science, Brown University, Providence, RI 02912;"}]}],"member":"341","published-online":{"date-parts":[[2016,3,7]]},"reference":[{"key":"e_1_3_4_1_2","doi-asserted-by":"crossref","first-page":"538","DOI":"10.2307\/2395267","article-title":"The bases of angiosperm phylogeny: Vegetative morphology","volume":"62","author":"Hickey LJ","year":"1975","unstructured":"LJ Hickey, JA Wolfe, The bases of angiosperm phylogeny: Vegetative morphology. Ann Mo Bot Gard 62, 538\u2013589 (1975).","journal-title":"Ann Mo Bot Gard"},{"key":"e_1_3_4_2_2","doi-asserted-by":"crossref","first-page":"2","DOI":"10.1007\/BF02860849","article-title":"Early Cretaceous fossil evidence for angiosperm evolution","volume":"43","author":"Hickey LJ","year":"1977","unstructured":"LJ Hickey, JA Doyle, Early Cretaceous fossil evidence for angiosperm evolution. Bot Rev 43, 2\u2013104 (1977).","journal-title":"Bot Rev"},{"key":"e_1_3_4_3_2","first-page":"21","article-title":"Systematic value and evolution of leaf architecture across the angiosperms in light of molecular phylogenetic analyses","volume":"258","author":"Doyle JA","year":"2007","unstructured":"JA Doyle, Systematic value and evolution of leaf architecture across the angiosperms in light of molecular phylogenetic analyses. Cour Forschungsinst Senckenb 258, 21\u201337 (2007).","journal-title":"Cour Forschungsinst Senckenb"},{"key":"e_1_3_4_4_2","volume-title":"Phylogeny and Evolution of Angiosperms","author":"Soltis DE","year":"2005","unstructured":"DE Soltis, PS Soltis, PK Endress, MW Chase Phylogeny and Evolution of Angiosperms (Sinauer, Sunderland, MA, 2005)."},{"key":"e_1_3_4_5_2","doi-asserted-by":"crossref","DOI":"10.1017\/CBO9780511980206","volume-title":"Early Flowers and Angiosperm Evolution","author":"Friis EM","year":"2011","unstructured":"EM Friis, PR Crane, KR Pedersen Early Flowers and Angiosperm Evolution (Cambridge Univ Press, Cambridge, UK, 2011)."},{"key":"e_1_3_4_6_2","doi-asserted-by":"crossref","first-page":"319","DOI":"10.1017\/S1089332600001741","article-title":"Fossil angiosperm leaves: Paleobotany\u2019s difficult children prove themselves","volume":"14","author":"Wilf P","year":"2008","unstructured":"P Wilf, Fossil angiosperm leaves: Paleobotany\u2019s difficult children prove themselves. Paleontol Soc Pap 14, 319\u2013333 (2008).","journal-title":"Paleontol Soc Pap"},{"key":"e_1_3_4_7_2","volume-title":"A Field Guide to the Families and Genera of Woody Plants of Northwest South America (Colombia, Ecuador, Peru)","author":"Gentry AH","year":"1993","unstructured":"AH Gentry A Field Guide to the Families and Genera of Woody Plants of Northwest South America (Colombia, Ecuador, Peru) (Conservation International, Washington, DC, 1993)."},{"key":"e_1_3_4_8_2","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-0348-7905-7","volume-title":"Identification of Tropical Woody Plants in the Absence of Flowers: A Field Guide","author":"Keller R","year":"2004","unstructured":"R Keller Identification of Tropical Woody Plants in the Absence of Flowers: A Field Guide (Birkh\u00e4user Verlag, Basel, 2004)."},{"key":"e_1_3_4_9_2","doi-asserted-by":"crossref","first-page":"528","DOI":"10.2307\/2399846","article-title":"Phylogenetics of seed plants: An analysis of nucleotide sequences from the plastid gene rbcL","volume":"80","author":"Chase MW","year":"1993","unstructured":"MW Chase, , Phylogenetics of seed plants: An analysis of nucleotide sequences from the plastid gene rbcL. Ann Mo Bot Gard 80, 528\u2013580 (1993).","journal-title":"Ann Mo Bot Gard"},{"key":"e_1_3_4_10_2","doi-asserted-by":"crossref","first-page":"105","DOI":"10.1111\/j.1095-8339.2009.00996.x","article-title":"An update of the Angiosperm Phylogeny Group classification for the orders and families of flowering plants: APG III","volume":"161","author":"Angiosperm Phylogeny Group","year":"2009","unstructured":"; Angiosperm Phylogeny Group, An update of the Angiosperm Phylogeny Group classification for the orders and families of flowering plants: APG III. Bot J Linn Soc 161, 105\u2013121 (2009).","journal-title":"Bot J Linn Soc"},{"key":"e_1_3_4_11_2","first-page":"25","volume-title":"Anatomy of the Dicotyledons","author":"Hickey LJ","year":"1979","unstructured":"LJ Hickey, A revised classification of the architecture of dicotyledonous leaves. Anatomy of the Dicotyledons, eds CR Metcalfe, L Chalk (Clarendon, Oxford), pp. 25\u201339 (1979)."},{"key":"e_1_3_4_12_2","doi-asserted-by":"crossref","DOI":"10.1079\/9781845935849.0000","volume-title":"Manual of Leaf Architecture","author":"Ellis B","year":"2009","unstructured":"B Ellis, Manual of Leaf Architecture (Cornell Univ Press, Ithaca, NY, 2009)."},{"key":"e_1_3_4_13_2","first-page":"137","article-title":"Arquitectura foliar de Anacardiaceae","volume":"76","author":"Mart\u00ednez-Mill\u00e1n M","year":"2005","unstructured":"M Mart\u00ednez-Mill\u00e1n, SRS Cevallos-Ferriz, Arquitectura foliar de Anacardiaceae. Rev Mex Biodivers 76, 137\u2013190 (2005).","journal-title":"Rev Mex Biodivers"},{"key":"e_1_3_4_14_2","doi-asserted-by":"crossref","first-page":"1337","DOI":"10.3732\/ajb.1000539","article-title":"Paleocene Malvaceae from northern South America and their biogeographical implications","volume":"98","author":"Carvalho MR","year":"2011","unstructured":"MR Carvalho, FA Herrera, CA Jaramillo, SL Wing, R Callejas, Paleocene Malvaceae from northern South America and their biogeographical implications. Am J Bot 98, 1337\u20131355 (2011).","journal-title":"Am J Bot"},{"key":"e_1_3_4_15_2","doi-asserted-by":"crossref","first-page":"286","DOI":"10.1109\/TPAMI.2007.41","article-title":"Shape classification using the inner-distance","volume":"29","author":"Ling H","year":"2007","unstructured":"H Ling, DW Jacobs, Shape classification using the inner-distance. IEEE Trans Pattern Anal Mach Intell 29, 286\u2013299 (2007).","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"key":"e_1_3_4_16_2","doi-asserted-by":"crossref","unstructured":"PN Belhumeur Searching the world\u2019s herbaria: A system for visual identification of plant species. Computer Vision \u2013 ECCV 2008 Lecture Notes in Computer Science eds Forsyth D Torr P Zisserman A (Springer Berlin Heidelberg) Vol 5305 pp 116\u2013129. (2008).","DOI":"10.1007\/978-3-540-88693-8_9"},{"key":"e_1_3_4_17_2","doi-asserted-by":"crossref","first-page":"4667","DOI":"10.1109\/TIP.2012.2207391","article-title":"Multiscale distance matrix for fast plant leaf recognition","volume":"21","author":"Hu R","year":"2012","unstructured":"R Hu, W Jia, H Ling, D Huang, Multiscale distance matrix for fast plant leaf recognition. IEEE Trans Image Process 21, 4667\u20134672 (2012).","journal-title":"IEEE Trans Image Process"},{"key":"e_1_3_4_18_2","doi-asserted-by":"crossref","unstructured":"N Kumar Leafsnap: A computer vision system for automatic plant species identification. Computer Vision \u2013 ECCV 2012 Part II Lecture Notes in Computer Science eds Fitzgibbon A Lazebnik S Perona P Sato Y Schmid C (Springer Berlin Heidelberg) Vol 7573 pp 502\u2013516. (2012).","DOI":"10.1007\/978-3-642-33709-3_36"},{"key":"e_1_3_4_19_2","doi-asserted-by":"crossref","unstructured":"H Laga S Kurtek A Srivastava M Golzarian SJ Miklavcic A Riemannian elastic metric for shape-based plant leaf classification 2012 International Conference on Digital Image Computing Techniques and Applications (DICTA) Fremantle Australia December 3\u20135 2012 pp 1\u20137 10.1109\/DICTA.2012.6411702.","DOI":"10.1109\/DICTA.2012.6411702"},{"key":"e_1_3_4_20_2","doi-asserted-by":"crossref","first-page":"245","DOI":"10.1016\/j.cviu.2007.08.002","article-title":"A similarity-based leaf image retrieval scheme: Joining shape and venation features","volume":"110","author":"Nam Y","year":"2008","unstructured":"Y Nam, E Hwang, D Kim, A similarity-based leaf image retrieval scheme: Joining shape and venation features. Comput Vis Image Underst 110, 245\u2013259 (2008).","journal-title":"Comput Vis Image Underst"},{"key":"e_1_3_4_21_2","doi-asserted-by":"crossref","first-page":"158","DOI":"10.1016\/j.patcog.2013.06.012","article-title":"Automatic classification of legumes using leaf vein image features","volume":"47","author":"Larese MG","year":"2014","unstructured":"MG Larese, , Automatic classification of legumes using leaf vein image features. Pattern Recognit 47, 158\u2013168 (2014).","journal-title":"Pattern Recognit"},{"key":"e_1_3_4_22_2","doi-asserted-by":"crossref","first-page":"061914","DOI":"10.1103\/PhysRevE.65.061914","article-title":"Constitutive property of the local organization of leaf venation networks","volume":"65","author":"Bohn S","year":"2002","unstructured":"S Bohn, B Andreotti, S Douady, J Munzinger, Y Couder, Constitutive property of the local organization of leaf venation networks. Phys Rev E Stat Nonlin Soft Matter Phys 65, 061914 (2002).","journal-title":"Phys Rev E Stat Nonlin Soft Matter Phys"},{"key":"e_1_3_4_23_2","first-page":"3890","article-title":"Leaf vein extraction using independent component analysis","volume":"5","author":"Li Y","year":"2006","unstructured":"Y Li, Z Chi, DD Feng, Leaf vein extraction using independent component analysis. IEEE Int Conf Syst Man Cybern 5, 3890\u20133894 (2006).","journal-title":"IEEE Int Conf Syst Man Cybern"},{"key":"e_1_3_4_24_2","doi-asserted-by":"crossref","first-page":"87","DOI":"10.1111\/j.1461-0248.2011.01712.x","article-title":"Scaling and structure of dicotyledonous leaf venation networks","volume":"15","author":"Price CA","year":"2012","unstructured":"CA Price, S Wing, JS Weitz, Scaling and structure of dicotyledonous leaf venation networks. Ecol Lett 15, 87\u201395 (2012).","journal-title":"Ecol Lett"},{"key":"e_1_3_4_25_2","doi-asserted-by":"crossref","first-page":"e37994","DOI":"10.1371\/journal.pone.0037994","article-title":"Quantifying loopy network architectures","volume":"7","author":"Katifori E","year":"2012","unstructured":"E Katifori, MO Magnasco, Quantifying loopy network architectures. PLoS One 7, e37994 (2012).","journal-title":"PLoS One"},{"key":"e_1_3_4_26_2","volume-title":"Die Blatt-Skelete der Dikotyledonen","author":"von Ettingshausen C","year":"1861","unstructured":"C von Ettingshausen Die Blatt-Skelete der Dikotyledonen (K. K. Hof-und Staatsdruckerei, Vienna, 1861)."},{"key":"e_1_3_4_27_2","doi-asserted-by":"crossref","first-page":"607","DOI":"10.1038\/381607a0","article-title":"Emergence of simple-cell receptive field properties by learning a sparse code for natural images","volume":"381","author":"Olshausen BA","year":"1996","unstructured":"BA Olshausen, DJ Field, Emergence of simple-cell receptive field properties by learning a sparse code for natural images. Nature 381, 607\u2013609 (1996).","journal-title":"Nature"},{"key":"e_1_3_4_28_2","unstructured":"J Yang K Yu Y Gong T Huang Linear spatial pyramid matching using sparse coding for image classification IEEE Conf Comput Vision Pattern Recognit Miami June 20\u201326 2009 pp 1794\u20131801 10.1109\/CVPR.2009.5206757."},{"key":"e_1_3_4_29_2","doi-asserted-by":"crossref","first-page":"1279","DOI":"10.1073\/pnas.0910530107","article-title":"Quantification of artistic style through sparse coding analysis in the drawings of Pieter Bruegel the Elder","volume":"107","author":"Hughes JM","year":"2010","unstructured":"JM Hughes, DJ Graham, DN Rockmore, Quantification of artistic style through sparse coding analysis in the drawings of Pieter Bruegel the Elder. Proc Natl Acad Sci USA 107, 1279\u20131283 (2010).","journal-title":"Proc Natl Acad Sci USA"},{"key":"e_1_3_4_30_2","doi-asserted-by":"crossref","unstructured":"GSVS Sivaram S Krishna Nemala M Elhilali TD Tran H Hermansky Sparse coding for speech recognition IEEE Int Conf Acoustics Speech Signal Process Dallas March 14\u201319 2010 pp 4346\u20134349 10.1109\/ICASSP.2010.5495649.","DOI":"10.1109\/ICASSP.2010.5495649"},{"key":"e_1_3_4_31_2","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1023\/B:VISI.0000029664.99615.94","article-title":"Distinctive image features from scale-invariant keypoints","volume":"60","author":"Lowe DG","year":"2004","unstructured":"DG Lowe, Distinctive image features from scale-invariant keypoints. Int J Comput Vis 60, 91\u2013110 (2004).","journal-title":"Int J Comput Vis"},{"key":"e_1_3_4_32_2","doi-asserted-by":"crossref","DOI":"10.1007\/978-1-4757-3264-1","volume-title":"The Nature of Statistical Learning Theory","author":"Vapnik VN","year":"2000","unstructured":"VN Vapnik The Nature of Statistical Learning Theory (Springer, New York, New York, 2000)."},{"key":"e_1_3_4_33_2","doi-asserted-by":"crossref","first-page":"e15161","DOI":"10.1371\/journal.pone.0015161","article-title":"Paleotemperature proxies from leaf fossils reinterpreted in light of evolutionary history","volume":"5","author":"Little SA","year":"2010","unstructured":"SA Little, SW Kembel, P Wilf, Paleotemperature proxies from leaf fossils reinterpreted in light of evolutionary history. PLoS One 5, e15161 (2010).","journal-title":"PLoS One"},{"key":"e_1_3_4_34_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.3897\/phytokeys.55.8489","article-title":"A revision of Spondias L. (Anacardiaceae) in the Neotropics","volume":"55","author":"Mitchell JD","year":"2015","unstructured":"JD Mitchell, DC Daly, A revision of Spondias L. (Anacardiaceae) in the Neotropics. PhytoKeys 55, 1\u201392 (2015).","journal-title":"PhytoKeys"},{"key":"e_1_3_4_35_2","first-page":"65","article-title":"Arquitectura foliar de las especies de Myrtaceae nativas de la flora Argentina II: Grupos \u201cMyrteola\u201d y \u201cPimenta\u201d","volume":"46","author":"Gonz\u00e1lez CC","year":"2011","unstructured":"CC Gonz\u00e1lez, Arquitectura foliar de las especies de Myrtaceae nativas de la flora Argentina II: Grupos \u201cMyrteola\u201d y \u201cPimenta\u201d. Bol Soc Argent Bot 46, 65\u201384 (2011).","journal-title":"Bol Soc Argent Bot"},{"key":"e_1_3_4_36_2","volume-title":"Leaf Venation Patterns","author":"Klucking EP","year":"1986","unstructured":"EP Klucking Leaf Venation Patterns (J. Cramer, Berlin) Vols 1-8 (1986\u20131997)."},{"key":"e_1_3_4_37_2","doi-asserted-by":"crossref","first-page":"898","DOI":"10.1109\/TPAMI.2010.161","article-title":"Contour detection and hierarchical image segmentation","volume":"33","author":"Arbel\u00e1ez P","year":"2011","unstructured":"P Arbel\u00e1ez, M Maire, C Fowlkes, J Malik, Contour detection and hierarchical image segmentation. IEEE Trans Pattern Anal Mach Intell 33, 898\u2013916 (2011).","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"key":"e_1_3_4_38_2","doi-asserted-by":"crossref","unstructured":"C Vondrick A Khosla T Malisiewicz A Torralba HOGgles: Visualizing object detection features. Proc IEEE Conf Comput Vision Sydney Australia December 1\u20138 2013 pp 1-8 10.1109\/ICCV.2013.8.","DOI":"10.1109\/ICCV.2013.8"}],"container-title":["Proceedings of the National Academy of Sciences"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/www.pnas.org\/syndication\/doi\/10.1073\/pnas.1524473113","content-type":"unspecified","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/pnas.org\/doi\/pdf\/10.1073\/pnas.1524473113","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,6,14]],"date-time":"2024-06-14T21:25:13Z","timestamp":1718400313000},"score":1,"resource":{"primary":{"URL":"https:\/\/pnas.org\/doi\/full\/10.1073\/pnas.1524473113"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,3,7]]},"references-count":38,"journal-issue":{"issue":"12","published-print":{"date-parts":[[2016,3,22]]}},"alternative-id":["10.1073\/pnas.1524473113"],"URL":"https:\/\/doi.org\/10.1073\/pnas.1524473113","relation":{},"ISSN":["0027-8424","1091-6490"],"issn-type":[{"type":"print","value":"0027-8424"},{"type":"electronic","value":"1091-6490"}],"subject":[],"published":{"date-parts":[[2016,3,7]]},"assertion":[{"value":"2016-03-07","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}