{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,7]],"date-time":"2026-08-07T20:53:35Z","timestamp":1786136015268,"version":"3.56.0"},"reference-count":54,"publisher":"World Scientific Pub Co Pte Ltd","issue":"02","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Int. J. Neur. Syst."],"published-print":{"date-parts":[[2004,4]]},"abstract":"<jats:p>Gaussian processes (GPs) are natural generalisations of multivariate Gaussian random variables to infinite (countably or continuous) index sets. GPs have been applied in a large number of fields to a diverse range of ends, and very many deep theoretical analyses of various properties are available. This paper gives an introduction to Gaussian processes on a fairly elementary level with special emphasis on characteristics relevant in machine learning. It draws explicit connections to branches such as spline smoothing models and support vector machines in which similar ideas have been investigated.<\/jats:p><jats:p>Gaussian process models are routinely used to solve hard machine learning problems. They are attractive because of their flexible non-parametric nature and computational simplicity. Treated within a Bayesian framework, very powerful statistical methods can be implemented which offer valid estimates of uncertainties in our predictions and generic model selection procedures cast as nonlinear optimization problems. Their main drawback of heavy computational scaling has recently been alleviated by the introduction of generic sparse approximations.<jats:sup>13,78,31<\/jats:sup>The mathematical literature on GPs is large and often uses deep concepts which are not required to fully understand most machine learning applications. In this tutorial paper, we aim to present characteristics of GPs relevant to machine learning and to show up precise connections to other \"kernel machines\" popular in the community. Our focus is on a simple presentation, but references to more detailed sources are provided.<\/jats:p>","DOI":"10.1142\/s0129065704001899","type":"journal-article","created":{"date-parts":[[2004,4,22]],"date-time":"2004-04-22T13:19:46Z","timestamp":1082639986000},"page":"69-106","source":"Crossref","is-referenced-by-count":1299,"title":["GAUSSIAN PROCESSES FOR MACHINE LEARNING"],"prefix":"10.1142","volume":"14","author":[{"given":"MATTHIAS","family":"SEEGER","sequence":"first","affiliation":[{"name":"Department of EECS, University of California at Berkeley, 485 Soda Hall, Berkeley CA 94720-1776, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"219","published-online":{"date-parts":[[2011,11,21]]},"reference":[{"key":"rf2","volume-title":"Geometry of Random Fields","author":"Adler R. J.","year":"1981"},{"key":"rf3","doi-asserted-by":"publisher","DOI":"10.1090\/S0002-9947-1950-0051437-7"},{"key":"rf4","unstructured":"D.\u00a0Barber and C.\u00a0Bishop, Advances in Neural Information Processing Systems 10, eds. M.\u00a0Jordan, M.\u00a0Kearns and S.\u00a0Solla (MIT Press, 1998)\u00a0pp. 395\u2013401."},{"key":"rf6","volume-title":"Probability and Measure","volume":"3","author":"Billingsley P.","year":"1995"},{"key":"rf7","volume-title":"Convex Optimization","author":"Boyd S.","year":"2002"},{"key":"rf8","doi-asserted-by":"publisher","DOI":"10.1023\/A:1009715923555"},{"key":"rf9","volume-title":"A Course in Probability Theory","author":"Chung K. L.","year":"1974"},{"key":"rf11","doi-asserted-by":"publisher","DOI":"10.1002\/9781119115151"},{"key":"rf13","doi-asserted-by":"publisher","DOI":"10.1162\/089976602317250933"},{"key":"rf14","doi-asserted-by":"publisher","DOI":"10.1137\/0611035"},{"key":"rf15","doi-asserted-by":"crossref","DOI":"10.7551\/mitpress\/1120.001.0001","volume-title":"Advances in Neural Information Processing Systems","volume":"14","author":"Dietterich T.","year":"2002"},{"key":"rf18","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4899-4473-3"},{"key":"rf19","doi-asserted-by":"crossref","DOI":"10.1093\/oso\/9780198572237.001.0001","volume-title":"Probability and Random Processes","author":"Grimmett G.","year":"2001"},{"key":"rf20","volume-title":"Introduction to Hilbert Space and the Theory of Spectral Multiplicity","author":"Halmos P.","year":"1957"},{"key":"rf22","doi-asserted-by":"publisher","DOI":"10.1142\/9789814355827"},{"key":"rf26","volume-title":"Advances in Neural Information Processing Systems","volume":"11","author":"Kearns M.","year":"1999"},{"key":"rf27","doi-asserted-by":"publisher","DOI":"10.1214\/aoms\/1177697089"},{"key":"rf28","volume-title":"Foundations of the Theory of Probability","author":"Kolmogorov A. N.","year":"1933"},{"key":"rf30","first-page":"119","volume":"52","author":"Krige D.","journal-title":"J. Chemical, Metallurgical and Mining Society of South Africa"},{"key":"rf32","volume-title":"Advances in Neural Information Processing Systems","volume":"13","author":"Leen T.","year":"2001"},{"key":"rf34","first-page":"1053","volume":"100","author":"MacKay D.","journal-title":"ASHRAE Transactions"},{"key":"rf35","doi-asserted-by":"publisher","DOI":"10.2113\/gsecongeo.58.8.1246"},{"key":"rf36","doi-asserted-by":"publisher","DOI":"10.2307\/1425829"},{"key":"rf37","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4899-3244-0"},{"key":"rf40","first-page":"59","volume":"23","author":"Moore E. H.","journal-title":"Bull. Amer. Math. Soc."},{"key":"rf42","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4612-0745-0"},{"key":"rf44","doi-asserted-by":"publisher","DOI":"10.2307\/2344614"},{"key":"rf45","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1111\/j.2517-6161.1978.tb01643.x","volume":"40","author":"O'Hagan A.","journal-title":"J. Roy. Stat. Soc. B"},{"key":"rf46","unstructured":"A.\u00a0O'Hagan, Bayesian Statistics\u00a04, eds. J.\u00a0Bernardo (Oxford University Press, 1992)\u00a0pp. 345\u2013363."},{"key":"rf48","doi-asserted-by":"publisher","DOI":"10.1162\/089976600300014881"},{"key":"rf53","doi-asserted-by":"publisher","DOI":"10.1109\/5.58326"},{"key":"rf54","volume-title":"Numerical Recipes in C","author":"Press W. H.","year":"1992"},{"key":"rf55","doi-asserted-by":"publisher","DOI":"10.1037\/h0042519"},{"key":"rf56","doi-asserted-by":"publisher","DOI":"10.1126\/science.290.5500.2323"},{"key":"rf57","doi-asserted-by":"publisher","DOI":"10.1051\/jp1:1993129"},{"key":"rf58","volume-title":"Advances in Kernel Methods: Support Vector Learning","author":"Sch\u00f6lkopf B.","year":"1998"},{"key":"rf59","volume-title":"Learning with Kernels","author":"Sch\u00f6lkopf B.","year":"2002"},{"key":"rf60","first-page":"811","volume":"39","author":"Sch\u00f6nberg I.","journal-title":"Proc. Nat. Acad. Sci."},{"key":"rf61","first-page":"947","volume":"52","author":"Sch\u00f6nberg I. J.","journal-title":"Annals of Mathematicals"},{"key":"rf67","doi-asserted-by":"publisher","DOI":"10.1162\/153244303765208377"},{"key":"rf68","volume-title":"Advances in Large Margin Classifiers","author":"Smola A.","year":"1999"},{"key":"rf70","doi-asserted-by":"publisher","DOI":"10.1016\/S0893-6080(98)00032-X"},{"key":"rf72","volume-title":"Advances in Neural Information Processing Systems","volume":"12","author":"Solla S.","year":"2000"},{"key":"rf74","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4612-1494-6"},{"key":"rf75","first-page":"67","volume":"2","author":"Steinwart I.","journal-title":"J. Machine Learning Research"},{"key":"rf77","doi-asserted-by":"publisher","DOI":"10.1126\/science.290.5500.2319"},{"key":"rf78","first-page":"211","volume":"1","author":"Tipping M.","journal-title":"J. Machine Learning Research"},{"key":"rf80","doi-asserted-by":"publisher","DOI":"10.1137\/1.9781611970128"},{"key":"rf84","doi-asserted-by":"publisher","DOI":"10.1162\/089976698300017412"},{"key":"rf85","volume-title":"Learning in Graphical Models","author":"Williams C. K. I.","year":"1997"},{"key":"rf86","doi-asserted-by":"publisher","DOI":"10.1109\/34.735807"},{"key":"rf87","doi-asserted-by":"publisher","DOI":"10.1137\/S1052623496304712"},{"key":"rf88","volume-title":"Correlation Theory of Stationary and Related Random Functions","author":"Yaglom A.","year":"1987"},{"key":"rf89","series-title":"NATO ASI series","volume-title":"Neural Networks and Machine Learning","volume":"168","author":"Zhu H.","year":"1998"}],"container-title":["International Journal of Neural Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.worldscientific.com\/doi\/pdf\/10.1142\/S0129065704001899","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,12,16]],"date-time":"2024-12-16T03:08:03Z","timestamp":1734318483000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.worldscientific.com\/doi\/abs\/10.1142\/S0129065704001899"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2004,4]]},"references-count":54,"journal-issue":{"issue":"02","published-online":{"date-parts":[[2011,11,21]]},"published-print":{"date-parts":[[2004,4]]}},"alternative-id":["10.1142\/S0129065704001899"],"URL":"https:\/\/doi.org\/10.1142\/s0129065704001899","relation":{},"ISSN":["0129-0657","1793-6462"],"issn-type":[{"value":"0129-0657","type":"print"},{"value":"1793-6462","type":"electronic"}],"subject":[],"published":{"date-parts":[[2004,4]]}}}