{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,19]],"date-time":"2026-05-19T00:05:04Z","timestamp":1779149104671,"version":"3.51.4"},"reference-count":19,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2015,12,28]],"date-time":"2015-12-28T00:00:00Z","timestamp":1451260800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Manage. Inf. Syst."],"published-print":{"date-parts":[[2016,1,14]]},"abstract":"<jats:p>This article discusses the various algorithms that make up the Netflix recommender system, and describes its business purpose. We also describe the role of search and related algorithms, which for us turns into a recommendations problem as well. We explain the motivations behind and review the approach that we use to improve the recommendation algorithms, combining A\/B testing focused on improving member retention and medium term engagement, as well as offline experimentation using historical member engagement data. We discuss some of the issues in designing and interpreting A\/B tests. Finally, we describe some current areas of focused innovation, which include making our recommender system global and language aware.<\/jats:p>","DOI":"10.1145\/2843948","type":"journal-article","created":{"date-parts":[[2015,12,30]],"date-time":"2015-12-30T13:13:41Z","timestamp":1451481221000},"page":"1-19","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":1011,"title":["The Netflix Recommender System"],"prefix":"10.1145","volume":"6","author":[{"given":"Carlos A.","family":"Gomez-Uribe","sequence":"first","affiliation":[{"name":"Netflix, Inc."}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Neil","family":"Hunt","sequence":"additional","affiliation":[{"name":"Netflix, Inc."}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2015,12,28]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"Chris Alvino and Justin Basilico. 2015. Learning a Personalized Homepage. Retrieved December 6 2015 from http:\/\/techblog.netflix.com\/2015\/04\/learning-personalized-homepage.html.  Chris Alvino and Justin Basilico. 2015. Learning a Personalized Homepage. Retrieved December 6 2015 from http:\/\/techblog.netflix.com\/2015\/04\/learning-personalized-homepage.html."},{"key":"e_1_2_1_2_1","volume-title":"Netflix Recommendations: Beyond the 5 stars (Part 2). Retrieved","author":"Amatriain Xavier","year":"2012"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.5555\/944919.944937"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/2094072.2094078"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/2433396.2433413"},{"key":"e_1_2_1_6_1","unstructured":"Trevor Hastie Robert Tibshirani and Jerome Friedman. 2011. The Elements of Statistical Learning: Data Mining Inference and Prediction (2nd. ed.). Springer.  Trevor Hastie Robert Tibshirani and Jerome Friedman. 2011. The Elements of Statistical Learning: Data Mining Inference and Prediction (2nd. ed.). Springer."},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/1401890.1401944"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/MC.2009.263"},{"key":"e_1_2_1_9_1","unstructured":"Andriy Mnih and Ruslan Salakhutdinov. 2007. Probabilistic matrix factorization. In Advances in Neural Information Processing Systems. 1257--1264.  Andriy Mnih and Ruslan Salakhutdinov. 2007. Probabilistic matrix factorization. In Advances in Neural Information Processing Systems. 1257--1264."},{"key":"e_1_2_1_10_1","volume-title":"Machine Learning: A Probabilistic Perspective","author":"Murphy Kevin P.","year":"2012"},{"key":"e_1_2_1_11_1","unstructured":"Prasanna Padmanabhan Kedar Sadekar and Gopal Krishnan. 2015. What\u2019s trending on Netflix. Retrieved December 6 2015 from http:\/\/techblog.netflix.com\/2015\/02\/whats-trending-on-netflix.html.  Prasanna Padmanabhan Kedar Sadekar and Gopal Krishnan. 2015. What\u2019s trending on Netflix. Retrieved December 6 2015 from http:\/\/techblog.netflix.com\/2015\/02\/whats-trending-on-netflix.html."},{"key":"e_1_2_1_12_1","volume-title":"Proceedings of KDD Cup and Workshop. 5--8.","author":"Paterek Arkadiusz","year":"2007"},{"key":"e_1_2_1_13_1","unstructured":"Leo Pekelis David Walsh and Ramesh Johari. 2015. The New Stats Engine. Internet. Retrieved December 6 2015 from http:\/\/pages.optimizely.com\/rs\/optimizely\/images\/stats_engine_technical_paper.pdf.  Leo Pekelis David Walsh and Ramesh Johari. 2015. The New Stats Engine. Internet. Retrieved December 6 2015 from http:\/\/pages.optimizely.com\/rs\/optimizely\/images\/stats_engine_technical_paper.pdf."},{"key":"e_1_2_1_14_1","unstructured":"Netflix Prize. 2009. The Netflix Prize. Retrieved December 6 2015 from http:\/\/www.netflixprize.com\/.  Netflix Prize. 2009. The Netflix Prize. Retrieved December 6 2015 from http:\/\/www.netflixprize.com\/."},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDM.2010.127"},{"key":"e_1_2_1_16_1","doi-asserted-by":"crossref","unstructured":"Joseph L. Schafer. 1997. Analysis of Incomplete Multivariate Data. CRC Press Boca Raton FL.  Joseph L. Schafer. 1997. Analysis of Incomplete Multivariate Data. CRC Press Boca Raton FL.","DOI":"10.1201\/9781439821862"},{"key":"e_1_2_1_17_1","unstructured":"Barry Schwartz. 2015. The Paradox of Choice: Why More Is Less. Harper Perennial New York NY.  Barry Schwartz. 2015. The Paradox of Choice: Why More Is Less. Harper Perennial New York NY."},{"key":"e_1_2_1_18_1","volume-title":"A\/B Testing: The Most Powerful Way to Turn Clicks into Customers","author":"Gumm Bryan"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1198\/016214506000000302"}],"container-title":["ACM Transactions on Management Information Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2843948","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2843948","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T05:48:51Z","timestamp":1750225731000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2843948"}},"subtitle":["Algorithms, Business Value, and Innovation"],"short-title":[],"issued":{"date-parts":[[2015,12,28]]},"references-count":19,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2016,1,14]]}},"alternative-id":["10.1145\/2843948"],"URL":"https:\/\/doi.org\/10.1145\/2843948","relation":{},"ISSN":["2158-656X","2158-6578"],"issn-type":[{"value":"2158-656X","type":"print"},{"value":"2158-6578","type":"electronic"}],"subject":[],"published":{"date-parts":[[2015,12,28]]},"assertion":[{"value":"2015-07-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2015-11-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2015-12-28","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}