{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,21]],"date-time":"2026-08-21T16:20:05Z","timestamp":1787329205557,"version":"build-2736575974"},"reference-count":93,"publisher":"Society for Industrial & Applied Mathematics (SIAM)","issue":"1","funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["BCS-1552848"],"award-info":[{"award-number":["BCS-1552848"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000893","name":"Simons Foundation","doi-asserted-by":"publisher","award":["400837"],"award-info":[{"award-number":["400837"]}],"id":[{"id":"10.13039\/100000893","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["SIAM Journal on Mathematics of Data Science"],"published-print":{"date-parts":[[2019,1]]},"abstract":"<jats:p>As a means of improving analysis of biological shapes, we propose an algorithm for sampling a Riemannian manifold by sequentially selecting points with maximum uncertainty under a Gaussian process model. This greedy strategy is known to be near-optimal in the experimental design literature, and it appears to outperform the use of user-placed landmarks in representing the geometry of biological objects in our application. In the noiseless regime, we establish an upper bound for the mean squared prediction error (MSPE) in terms of the number of samples and geometric quantities of the manifold, demonstrating that the MSPE for our proposed sequential design decays at a rate comparable to the oracle rate achievable by any sequential or nonsequential optimal design; to the best of our knowledge this is the first result of this type for sequential experimental design. The key is to link the greedy algorithm to reduced basis methods in the context of model reduction for partial differential equations (PDEs). We expect this approach will find additional applications in other fields of research.<\/jats:p>","DOI":"10.1137\/18m1184035","type":"journal-article","created":{"date-parts":[[2019,2,12]],"date-time":"2019-02-12T12:07:50Z","timestamp":1549973270000},"page":"208-236","source":"Crossref","is-referenced-by-count":26,"title":["Gaussian Process Landmarking on Manifolds"],"prefix":"10.1137","volume":"1","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0436-689X","authenticated-orcid":true,"given":"Tingran","family":"Gao","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shahar Z.","family":"Kovalsky","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ingrid","family":"Daubechies","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"351","published-online":{"date-parts":[[2019,2,12]]},"reference":[{"key":"atypb1","first-page":"126","author":"Allen-Zhu Z.","year":"2017","journal-title":"Proceedings of the International Conference on Machine Learning"},{"key":"atypb2","unstructured":"Z. Allen-Zhu, Y. Li, A. Singh, and Y. Wang,\n                      Near-Optimal Discrete Optimization for Experimental Design: A Regret Minimization Approach\n                      , preprint,https:\/\/arxiv.org\/abs\/1711.05174, 2017."},{"key":"atypb3","doi-asserted-by":"crossref","first-page":"485","DOI":"10.1145\/882262.882296","volume":"22","author":"Alliez P.","year":"2003","journal-title":"ACM Trans. Graph."},{"key":"atypb4","doi-asserted-by":"crossref","first-page":"337","DOI":"10.1090\/S0002-9947-1950-0051437-7","volume":"68","year":"1950","journal-title":"Trans. Amer. Math. Soc."},{"key":"atypb5","doi-asserted-by":"crossref","first-page":"1089","DOI":"10.1098\/rspa.2001.0913","volume":"458","author":"Atiyah M.","year":"2002","journal-title":"Proc. R. Soc. Lond. A Math. Phys. Eng. Sci."},{"key":"atypb6","doi-asserted-by":"crossref","unstructured":"A. Atkinson, A. Donev, and R. Tobias,\n                      Optimum Experimental Designs, with SAS\n                      , Oxford Statist. Sci. Ser. 34, Oxford University Press, 2007.","DOI":"10.1093\/oso\/9780199296590.003.0004"},{"key":"atypb7","doi-asserted-by":"publisher","DOI":"10.1137\/120867287"},{"key":"atypb8","doi-asserted-by":"crossref","unstructured":"C. Beard,\n                      Teilhardina,\n                      in The International Encyclopedia of Primatology, John Wiley & Sons, 2017, pp. 1369-1370,https:\/\/doi.org\/10.1002\/9781119179313.wbprim0444.","DOI":"10.1002\/9781119179313.wbprim0444"},{"key":"atypb9","doi-asserted-by":"crossref","first-page":"1373","DOI":"10.1162\/089976603321780317","volume":"15","author":"Belkin M.","year":"2003","journal-title":"Neural Comput."},{"key":"atypb10","first-page":"486","author":"Belkin M.","year":"2005","journal-title":"Springer"},{"key":"atypb11","doi-asserted-by":"crossref","first-page":"373","DOI":"10.1007\/BF01896401","volume":"4","author":"B\u00e9rard P.","year":"1994","journal-title":"Geom. Funct. Anal."},{"key":"atypb12","unstructured":"N. Berline, E. Getzler, and M. Vergne,\n                      Heat Kernels and Dirac Operators\n                      , Springer, 2004."},{"key":"atypb13","doi-asserted-by":"publisher","DOI":"10.1137\/17M1134214"},{"key":"atypb14","doi-asserted-by":"publisher","DOI":"10.1137\/100795772"},{"key":"atypb15","doi-asserted-by":"crossref","first-page":"679","DOI":"10.1016\/j.endm.2010.05.086","volume":"36","author":"Bouhtou M.","year":"2010","journal-title":"Electron. Notes Discrete Math."},{"key":"atypb16","doi-asserted-by":"crossref","first-page":"18221","DOI":"10.1073\/pnas.1112822108","volume":"108","author":"Boyer D. M.","year":"2011","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"atypb17","doi-asserted-by":"crossref","first-page":"595","DOI":"10.1051\/m2an\/2011056","volume":"46","author":"Buffa A.","year":"2012","journal-title":"ESAIM Math. Model. Numer. Anal."},{"key":"atypb18","doi-asserted-by":"crossref","first-page":"665","DOI":"10.1007\/s00440-013-0493-0","volume":"158","author":"Castillo I.","year":"2014","journal-title":"Probab. Theory Related Fields"},{"key":"atypb19","doi-asserted-by":"crossref","first-page":"1397","DOI":"10.1007\/s10589-010-9377-8","volume":"51","author":"\u010cern\u1ef3 M.","year":"2012","journal-title":"Comput. Optim. Appl."},{"key":"atypb20","doi-asserted-by":"crossref","first-page":"273","DOI":"10.1214\/ss\/1177009939","volume":"10","author":"Chaloner K.","year":"1995","journal-title":"Statist. Sci."},{"key":"atypb21","first-page":"1090","author":"Chaudhuri K.","year":"2015","journal-title":"Advances in Neural Information Processing Systems"},{"key":"atypb22","unstructured":"X. Cheng, A. Cloninger, and R. R. Coifman,\n                      Two-Sample Statistics Based on Anisotropic Kernels\n                      , preprint,https:\/\/arxiv.org\/abs\/1709.05006, 2017."},{"key":"atypb23","doi-asserted-by":"crossref","first-page":"4801","DOI":"10.1016\/j.tcs.2009.06.018","volume":"410","author":"\u00c7ivril A.","year":"2009","journal-title":"Theoret. Comput. Sci."},{"key":"atypb24","first-page":"312","author":"Cohen-Steiner D.","year":"2003","journal-title":"ACM"},{"key":"atypb25","doi-asserted-by":"crossref","first-page":"129","DOI":"10.1613\/jair.295","volume":"4","author":"Cohn D. A.","year":"1996","journal-title":"J. Artificial Intelligence Res."},{"key":"atypb26","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1016\/j.acha.2006.04.006","volume":"21","author":"Coifman R. R.","year":"2006","journal-title":"Appl. Comput. Harmon. Anal."},{"key":"atypb27","doi-asserted-by":"crossref","unstructured":"N. Cressie,\n                      Statistics for Spatial Data\n                      , Wiley Ser. Probab. Statist., John Wiley & Sons, 2015.","DOI":"10.1002\/9781118445112.stat01927"},{"key":"atypb28","doi-asserted-by":"crossref","unstructured":"N. Cristianini and J. Shawe-Taylor,\n                      An Introduction to Support Vector Machines and Other Kernel-Based Learning Methods\n                      , Cambridge University Press, 2000.","DOI":"10.1017\/CBO9780511801389"},{"key":"atypb29","doi-asserted-by":"publisher","DOI":"10.1137\/140977552"},{"key":"atypb30","unstructured":"V. De Silva and J. B. Tenenbaum,\n                      Sparse Multidimensional Scaling Using Landmark Points\n                      , Technical report, Stanford University, 2004."},{"key":"atypb31","doi-asserted-by":"crossref","first-page":"455","DOI":"10.1007\/s00365-013-9186-2","volume":"37","author":"DeVore R.","year":"2013","journal-title":"Construct. Approx."},{"key":"atypb32","first-page":"360","author":"Dhillon P.","year":"2013","journal-title":"Advances in Neural Information Processing Systems"},{"key":"atypb33","unstructured":"I. L. Dryden and K. V. Mardia,\n                      Statistical Shape Analysis\n                      , John Wiley & Sons, 1998."},{"key":"atypb34","unstructured":"V. Fedorov,\n                      Theory of Optimal Experiments\n                      , translated from the Russian and edited by W. J. Studden and E. M. Klimko, Probab. Math. Statist. 12, Academic Press, 1972."},{"key":"atypb35","doi-asserted-by":"crossref","first-page":"47","DOI":"10.1080\/00401706.2012.715835","volume":"55","author":"Fricker T. E.","year":"2013","journal-title":"Technometrics"},{"key":"atypb36","doi-asserted-by":"publisher","DOI":"10.1137\/110821846"},{"key":"atypb37","doi-asserted-by":"publisher","DOI":"10.1137\/18M1203481"},{"key":"atypb38","doi-asserted-by":"crossref","first-page":"293","DOI":"10.1016\/0304-3975(85)90224-5","volume":"38","author":"Gonzalez T. F.","year":"1985","journal-title":"Theoret. Comput. Sci."},{"key":"atypb39","doi-asserted-by":"crossref","first-page":"33","DOI":"10.1007\/BF02291478","volume":"40","author":"Gower J. C.","year":"1975","journal-title":"Psychometrika"},{"key":"atypb40","doi-asserted-by":"crossref","unstructured":"J. C. Gower and G. B. Dijksterhuis,\n                      Procrustes Problems\n                      , Oxford Statist. Sci. Ser. 3, Oxford University Press, 2004.","DOI":"10.1093\/acprof:oso\/9780198510581.001.0001"},{"key":"atypb41","doi-asserted-by":"crossref","first-page":"428","DOI":"10.1016\/j.apnum.2011.10.001","volume":"62","author":"Harbrecht H.","year":"2012","journal-title":"Appl. Numer. Math."},{"key":"atypb42","doi-asserted-by":"crossref","first-page":"174","DOI":"10.1016\/j.aim.2004.05.006","volume":"193","author":"Hardin D.","year":"2005","journal-title":"Adv. in Math."},{"key":"atypb43","doi-asserted-by":"crossref","unstructured":"N. J. Higham,\n                      Accuracy and Stability of Numerical Algorithms\n                      , 2nd ed., SIAM, 2002,https:\/\/doi.org\/10.1137\/1.9780898718027.","DOI":"10.1137\/1.9780898718027"},{"key":"atypb44","doi-asserted-by":"crossref","first-page":"1803","DOI":"10.1073\/pnas.0710175104","volume":"105","author":"Jones P. W.","year":"2008","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"atypb45","first-page":"1","author":"Kapoor A.","year":"2007","journal-title":"Proceedings of the IEEE 11th International Conference on Computer Vision, IEEE"},{"key":"atypb46","doi-asserted-by":"crossref","first-page":"87","DOI":"10.1112\/blms\/21.1.87","volume":"21","author":"Karp L.","year":"1989","journal-title":"Bull. London Math. Soc."},{"key":"atypb47","first-page":"235","volume":"9","author":"Krause A.","year":"2008","journal-title":"J. Mach. Learn. Res."},{"key":"atypb48","first-page":"3","author":"Lewis D. D.","year":"1994","journal-title":"Springer-Verlag"},{"key":"atypb49","unstructured":"D. Liang and J. Paisley,\n                      Landmarking manifolds with Gaussian processes\n                      , in Proceedings of the 32nd International Conference on Machine Learning, Vol. 37, JMLR.org, 2015, pp. 466-474."},{"key":"atypb50","unstructured":"L. Lin, M. Niu, P. Cheung, and D. Dunson,\n                      Extrinsic Gaussian Processes for Regression and Classification on Manifolds\n                      , preprint,https:\/\/arxiv.org\/abs\/1706.08757, 2017."},{"key":"atypb51","doi-asserted-by":"crossref","unstructured":"A. W. Long and A. L. Ferguson,\n                      Landmark diffusion maps (L-dMaps): Accelerated manifold learning out-of-sample extension\n                      , Appl. Comput. Harmon. Anal., published online August 31, 2017,https:\/\/doi.org\/10.1016\/j.acha.2017.08.004.","DOI":"10.1016\/j.acha.2017.08.004"},{"key":"atypb52","doi-asserted-by":"crossref","unstructured":"G. G. Lorentz, M. von Golitschek, and Y. Makovoz,\n                      Constructive Approximation: Advanced Problems\n                      , Grundlehren Math. Wiss. 304, Springer, Berlin, 1996.","DOI":"10.1007\/978-3-642-60932-9"},{"key":"atypb53","doi-asserted-by":"crossref","first-page":"529","DOI":"10.4153\/CJM-2004-024-1","volume":"56","author":"Finkelshtein A.","year":"2004","journal-title":"Canad. J. Math"},{"key":"atypb54","unstructured":"C. Moenning and N. A. Dodgson,\n                      Fast Marching Farthest Point Sampling\n                      , Tech. report, Computer Laboratory, University of Cambridge, 2003."},{"key":"atypb55","unstructured":"M. Mohri, A. Rostamizadeh, and A. Talwalkar,\n                      Foundations of Machine Learning\n                      , MIT Press, 2012."},{"key":"atypb56","first-page":"81","volume":"6","author":"Molnar S.","year":"1985","journal-title":"Ann. Univ. Sci. Budapest. Sect. Comput."},{"key":"atypb57","doi-asserted-by":"crossref","first-page":"175","DOI":"10.1007\/s00365-005-0624-7","volume":"24","author":"Narcowich F. J.","year":"2006","journal-title":"Construct. Approx."},{"key":"atypb58","first-page":"861","author":"Nikolov A.","year":"2015","journal-title":"ACM"},{"key":"atypb59","first-page":"1015","author":"Niranjan S.","year":"2010","journal-title":"Omnipress"},{"key":"atypb60","doi-asserted-by":"crossref","first-page":"751","DOI":"10.1111\/j.1467-9868.2004.05304.x","volume":"66","author":"Oakley J. E.","year":"2004","journal-title":"J. R. Statist. Soc. Ser. B Statist. Methodol."},{"key":"atypb61","doi-asserted-by":"crossref","unstructured":"A. C. \u00d6ztireli, M. Alexa, and M. Gross,\n                      Spectral sampling of manifolds\n                      , ACM Trans. Graphics (TOG), 29 (2010), 168.","DOI":"10.1145\/1882261.1866190"},{"key":"atypb62","doi-asserted-by":"crossref","unstructured":"F. Pukelsheim,\n                      Optimal Design of Experiments\n                      , Classics Appl. Math. 50, SIAM, 2006,https:\/\/doi.org\/10.1137\/1.9780898719109.","DOI":"10.1137\/1.9780898719109"},{"key":"atypb63","doi-asserted-by":"crossref","unstructured":"C. E. Rasmussen and C. K. I. Williams,\n                      Gaussian Processes for Machine Learning\n                      , Adapt. Comput. Mach. Learn., MIT Press, 2006.","DOI":"10.7551\/mitpress\/3206.001.0001"},{"key":"atypb64","unstructured":"M. Reed and B. Simon,\n                      Methods of Modern Mathematical Physics. Vol.\n                      1,\n                      Functional Analysis\n                      , Academic Press, 1980."},{"key":"atypb65","unstructured":"K. Ritter,\n                      Average-Case Analysis of Numerical Problems\n                      , Springer, 2007."},{"key":"atypb66","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1016\/j.patrec.2015.03.009","volume":"59","author":"Rodol\u00e1 E.","year":"2015","journal-title":"Pattern Recognition Lett."},{"key":"atypb67","first-page":"905","volume":"11","author":"Rosasco L.","year":"2010","journal-title":"J. Mach. Learn. Res."},{"key":"atypb68","doi-asserted-by":"crossref","unstructured":"S. Rosenberg,\n                      The Laplacian on a Riemannian Manifold: An Introduction to Analysis on Manifolds\n                      , London Math. Soc. Stud. Texts 31, Cambridge University Press, 1997.","DOI":"10.1017\/CBO9780511623783"},{"key":"atypb69","doi-asserted-by":"crossref","unstructured":"R. B. Rusu and S. Cousins,\n                      3D is here: Point Cloud Library (PCL)\n                      , in Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), IEEE, 2011.","DOI":"10.1109\/ICRA.2011.5980567"},{"key":"atypb70","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1080\/00401706.1989.10488474","volume":"31","author":"Sacks J.","year":"1989","journal-title":"Technometrics"},{"key":"atypb71","doi-asserted-by":"crossref","first-page":"702","DOI":"10.1198\/016214502388618447","volume":"97","author":"Saltelli A.","year":"2002","journal-title":"J. Amer. Statist. Assoc."},{"key":"atypb72","unstructured":"T. J. Santner, B. J. Williams, and W. I. Notz,\n                      The Design and Analysis of Computer Experiments\n                      , Springer Ser. Statist., Springer Science+Business Media, 2013."},{"key":"atypb73","doi-asserted-by":"crossref","unstructured":"B. Scholkopf and A. J. Smola,\n                      Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond\n                      , MIT Press, 2001.","DOI":"10.7551\/mitpress\/4175.001.0001"},{"key":"atypb74","unstructured":"B. Settles,\n                      Active Learning Literature Survey\n                      , Tech. report 1648, Computer Sciences, University of Wisconsin-Madison, 2010,http:\/\/burrsettles.com\/pub\/settles.activelearning.pdf."},{"key":"atypb75","doi-asserted-by":"crossref","unstructured":"M. T. Silcox,\n                      Plesiadapiform,\n                      in The International Encyclopedia of Primatology, John Wiley & Sons, 2017, pp. 999-1000,https:\/\/doi.org\/10.1002\/9781119179313.wbprim0038.","DOI":"10.1002\/9781119179313.wbprim0038"},{"key":"atypb76","doi-asserted-by":"crossref","first-page":"128","DOI":"10.1016\/j.acha.2006.03.004","volume":"21","author":"Singer A.","year":"2006","journal-title":"Appl. Comput. Harmon. Anal."},{"key":"atypb77","doi-asserted-by":"crossref","first-page":"1067","DOI":"10.1002\/cpa.21395","volume":"65","author":"Singer A.","year":"2012","journal-title":"Comm. Pure Appl. Math."},{"key":"atypb78","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1093\/biomet\/12.1-2.1","volume":"12","author":"Smith K.","year":"1918","journal-title":"Biometrika"},{"key":"atypb79","unstructured":"M. L. Stein,\n                      Interpolation of Spatial Data: Some Theory for Kriging\n                      , Springer Science+Business Media, 2012."},{"key":"atypb80","doi-asserted-by":"crossref","unstructured":"L. N. Trefethen and D. Bau III,\n                      Numerical Linear Algebra\n                      , SIAM, Philadelphia, 1997.","DOI":"10.1137\/1.9780898719574"},{"key":"atypb81","doi-asserted-by":"crossref","unstructured":"A. B. Tsybakov,\n                      Introduction to Nonparametric Estimation\n                      , Springer, 2008.","DOI":"10.1007\/b13794"},{"key":"atypb82","first-page":"200","author":"van der Vaart A. W.","year":"2008","journal-title":"Institute of Mathematical Statistics"},{"key":"atypb83","doi-asserted-by":"crossref","unstructured":"C. Wachinger and P. Golland,\n                      Diverse Landmark Sampling from Determinantal Point Processes for Scalable Manifold Learning\n                      , preprint,https:\/\/arxiv.org\/abs\/1503.03506, 2015.","DOI":"10.1007\/978-3-319-19992-4_54"},{"key":"atypb84","first-page":"2729","volume":"14","author":"Wang S.","year":"2013","journal-title":"J. Mach. Learn. Res."},{"key":"atypb85","unstructured":"W. Wang, R. Tuo, and C. F. J. Wu,\n                      Universal Convergence of Kriging\n                      , preprint,https:\/\/arxiv.org\/abs\/1710.06959v1, 2017."},{"key":"atypb86","first-page":"5238","volume":"18","author":"Wang Y.","year":"2017","journal-title":"J. Mach. Learn. Res."},{"key":"atypb87","doi-asserted-by":"crossref","unstructured":"H. Wendland,\n                      Scattered Data Approximation\n                      , Cambridge Monogr. Appl. Comput. Math. 17, Cambridge University Press, 2004.","DOI":"10.1017\/CBO9780511617539"},{"key":"atypb88","doi-asserted-by":"crossref","first-page":"1055","DOI":"10.1016\/j.aim.2016.05.023","volume":"304","author":"Wu H.-T.","year":"2017","journal-title":"Adv. in Math."},{"key":"atypb89","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1093\/imanum\/13.1.13","volume":"13","author":"Wu Z.-M.","year":"1993","journal-title":"IMA J. Numer. Anal."},{"key":"atypb90","first-page":"3108","author":"Xu H.","year":"2015","journal-title":"Association for the Advancement of Artificial Intelligence"},{"key":"atypb91","first-page":"876","volume":"44","author":"Yang Y.","year":"2016","journal-title":"Ann. Statist."},{"key":"atypb92","first-page":"593","author":"Ylvisaker D.","year":"1975","journal-title":"North-Holland"},{"key":"atypb93","unstructured":"X. Zhu, J. Lafferty, and Z. Ghahramani,\n                      Combining active learning and semi-supervised learning using Gaussian fields and harmonic functions\n                      , in Proceedings of the ICML 2003 Workshop on the Continuum from Labeled to Unlabeled Data in Machine Learning and Data Mining, Washington, DC, 2003, pp. 58-65,http:\/\/citeseerx.ist.psu.edu\/viewdoc\/summary?doi=10.1.1.5.5447."}],"container-title":["SIAM Journal on Mathematics of Data Science"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/epubs.siam.org\/doi\/pdf\/10.1137\/18M1184035","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,8,21]],"date-time":"2026-08-21T15:12:42Z","timestamp":1787325162000},"score":1,"resource":{"primary":{"URL":"https:\/\/epubs.siam.org\/doi\/10.1137\/18M1184035"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,1]]},"references-count":93,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2019,1]]}},"alternative-id":["10.1137\/18M1184035"],"URL":"https:\/\/doi.org\/10.1137\/18m1184035","relation":{},"ISSN":["2577-0187"],"issn-type":[{"value":"2577-0187","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,1]]}}}