{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,9]],"date-time":"2026-03-09T23:25:22Z","timestamp":1773098722614,"version":"3.50.1"},"reference-count":45,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2023,8,10]],"date-time":"2023-08-10T00:00:00Z","timestamp":1691625600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Big Data"],"abstract":"<jats:p>For a long time, recommender systems presented their results in the form of simple item lists. In recent years, however, multi-list interfaces have become the de-facto standard in industry, presenting users with numerous collections of recommendations, one below the other, each containing items with common characteristics. Netflix's interface, for instance, shows movies from certain genres, new releases, and lists of curated content. Spotify recommends new songs and albums, podcasts on specific topics, and what similar users are listening to. Despite their popularity, research on these so-called \u201ccarousels\u201d is still limited. Few authors have investigated how to simulate the user behavior and how to optimize the recommendation process accordingly. The number of studies involving users is even smaller, with sometimes conflicting results. Consequently, little is known about how to design carousel-based interfaces for achieving the best user experience. This mini review aims to organize the existing knowledge and outlines directions that may improve the multi-list presentation of recommendations in the future.<\/jats:p>","DOI":"10.3389\/fdata.2023.1239705","type":"journal-article","created":{"date-parts":[[2023,8,10]],"date-time":"2023-08-10T11:25:54Z","timestamp":1691666754000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":5,"title":["Multi-list interfaces for recommender systems: survey and future directions"],"prefix":"10.3389","volume":"6","author":[{"given":"Benedikt","family":"Loepp","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1965","published-online":{"date-parts":[[2023,8,10]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"22","DOI":"10.1145\/3450614.3461682","article-title":"\u201cThe \u2018unreasonable' effectiveness of graphical user interfaces for recommender systems,\u201d","author":"Beel","year":"2021","journal-title":"UMAP '21: Proceedings of the 29th ACM Conference on User Modeling, Adaptation and Personalization"},{"key":"B2","doi-asserted-by":"publisher","first-page":"420","DOI":"10.1145\/3383313.3412217","article-title":"\u201cCarousel personalization in music streaming apps with contextual bandits,\u201d","author":"Bendada","year":"2020","journal-title":"RecSys '20: Proceedings of the 14th ACM Conference on Recommender Systems"},{"key":"B3","doi-asserted-by":"publisher","first-page":"63","DOI":"10.1145\/1864708.1864724","article-title":"\u201cUnderstanding choice overload in recommender systems,\u201d","author":"Bollen","year":"2010","journal-title":"RecSys '10: Proceedings of the 4th ACM Conference on Recommender Systems"},{"key":"B4","doi-asserted-by":"publisher","first-page":"375","DOI":"10.1007\/978-3-642-13470-8_35","article-title":"\u201cEye-tracking study of user behavior in recommender interfaces,\u201d","author":"Chen","year":"2010","journal-title":"UMAP '10: Proceedings of the 18th International Conference on User Modeling, Adaptation and Personalization"},{"key":"B5","doi-asserted-by":"publisher","first-page":"125","DOI":"10.1007\/s11257-011-9108-6","article-title":"Critiquing-based recommenders: survey and emerging trends","volume":"22","author":"Chen","year":"","journal-title":"User Model. User Adapt. Interact"},{"key":"B6","doi-asserted-by":"publisher","first-page":"372","DOI":"10.1080\/0144929X.2012.719034","article-title":"Experiments on user experiences with recommender interfaces","volume":"33","author":"Chen","year":"","journal-title":"Behav. Inform. Technol"},{"key":"B7","doi-asserted-by":"publisher","first-page":"333","DOI":"10.1016\/j.jcps.2014.08.002","article-title":"Choice overload: a conceptual review and meta-analysis","volume":"25","author":"Chernev","year":"2015","journal-title":"J. Cons. Psychol"},{"key":"B8","doi-asserted-by":"publisher","first-page":"87","DOI":"10.1145\/1341531.1341545","article-title":"\u201cAn experimental comparison of click position-bias models,\u201d","author":"Craswell","year":"2008","journal-title":"WSDM '08: Proceedings of the 1st ACM International Conference on Web Search and Data Mining"},{"key":"B9","doi-asserted-by":"publisher","first-page":"212","DOI":"10.1145\/3452918.3465493","article-title":"\u201cMeasuring the user satisfaction in a recommendation interface with multiple carousels,\u201d","author":"Felicioni","year":"2021","journal-title":"IMX '21: Proceedings of the 2nd ACM International Conference on Interactive Media Experiences"},{"key":"B10","doi-asserted-by":"publisher","first-page":"691","DOI":"10.1145\/3460231.3478853","article-title":"\u201cOptimizing the selection of recommendation carousels with quantum computing,\u201d","author":"Ferrari Dacrema","year":"2021","journal-title":"RecSys '21: Proceedings of the 15th ACM Conference on Recommender Systems"},{"key":"B11","doi-asserted-by":"publisher","first-page":"910030","DOI":"10.3389\/fdata.2022.910030","article-title":"Offline evaluation of recommender systems in a user interface with multiple carousels","volume":"5","author":"Ferrari Dacrema","year":"2022","journal-title":"Front. Big Data"},{"key":"B12","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/2843948","article-title":"The Netflix recommender system: algorithms, business value, and innovation","volume":"13","author":"Gomez-Uribe","year":"2015","journal-title":"ACM Trans. Manage. Inform. Syst"},{"key":"B13","doi-asserted-by":"publisher","DOI":"10.1109\/QoMEX.2016.7498940","article-title":"\u201cPersonalizing user interfaces for improving quality of experience in VoD recommender systems,\u201d","author":"Guntuku","year":"2016","journal-title":"QoMEX '16: Proceedings of the 8th International Conference on Quality of Multimedia Experience"},{"key":"B14","doi-asserted-by":"publisher","first-page":"523","DOI":"10.1080\/00223891.2015.1132426","article-title":"The development and validation of the rational and intuitive decision styles scale","volume":"98","author":"Hamilton","year":"2016","journal-title":"J. Pers. Assess"},{"key":"B15","doi-asserted-by":"publisher","first-page":"9","DOI":"10.1016\/j.eswa.2016.02.013","article-title":"Interactive recommender systems: a survey of the state of the art and future research challenges and opportunities","volume":"56","author":"He","year":"2016","journal-title":"Expert Syst. Appl"},{"key":"B16","doi-asserted-by":"publisher","first-page":"995","DOI":"10.1037\/0022-3514.79.6.995","article-title":"When choice is demotivating: can one desire too much of a good thing?","volume":"79","author":"Iyengar","year":"2000","journal-title":"J. Pers. Soc. Psychol"},{"key":"B17","doi-asserted-by":"publisher","first-page":"224","DOI":"10.1145\/3450613.3456809","article-title":"\u201cExploring multi-list user interfaces for similar-item recommendations,\u201d","author":"Jannach","year":"2021","journal-title":"UMAP '21: Proceedings of the 29th ACM Conference on User Modeling, Adaptation and Personalization"},{"key":"B18","doi-asserted-by":"publisher","first-page":"310","DOI":"10.1145\/3460231.3474248","article-title":"\u201cTop-K contextual bandits with equity of exposure,\u201d","author":"Jeunen","year":"2021","journal-title":"RecSys '21: Proceedings of the 15th ACM Conference on Recommender Systems"},{"key":"B19","doi-asserted-by":"publisher","first-page":"199","DOI":"10.1007\/s11257-019-09247-2","article-title":"Effects of personal characteristics in control-oriented user interfaces for music recommender systems","volume":"30","author":"Jin","year":"2020","journal-title":"User Model. User Adapt. Interact"},{"key":"B20","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3001837","article-title":"Interacting with recommenders-overview and research directions","volume":"10","author":"Jugovac","year":"2017","journal-title":"ACM Trans. Interact. Intell. Syst"},{"key":"B21","doi-asserted-by":"publisher","first-page":"299","DOI":"10.1145\/1743666.1743736","author":"Kammerer","year":"2010"},{"key":"B22","doi-asserted-by":"publisher","first-page":"531","DOI":"10.1145\/3473856.3473859","article-title":"\u201cModeling user interaction at the convergence of filtering mechanisms, recommender algorithms and advisory components,\u201d","author":"Kleemann","year":"2021","journal-title":"Mensch"},{"key":"B23","doi-asserted-by":"publisher","first-page":"309","DOI":"10.1007\/978-1-4899-7637-6_9","article-title":"\u201cEvaluating recommender systems with user experiments,\u201d","author":"Knijnenburg","year":"2015","journal-title":"Recommender Systems Handbook"},{"key":"B24","doi-asserted-by":"publisher","first-page":"379","DOI":"10.1145\/3301275.3302306","article-title":"\u201cPersonalized explanations for hybrid recommender systems,\u201d","author":"Kouki","year":"2019","journal-title":"IUI '19: Proceedings of the 24th International Conference on Intelligent User Interfaces"},{"key":"B25","doi-asserted-by":"publisher","first-page":"102987","DOI":"10.1016\/j.ijhcs.2022.102987","article-title":"A comparative study of item space visualizations for recommender systems","volume":"172","author":"Kunkel","year":"2023","journal-title":"Int. J. Hum. Comput. Stud"},{"key":"B26","doi-asserted-by":"publisher","first-page":"495","DOI":"10.1145\/3460231.3474242","article-title":"\u201cPage-level optimization of e-commerce item recommendations,\u201d","author":"Lo","year":"2021","journal-title":"RecSys '21: Proceedings of the 15th ACM Conference on Recommender Systems"},{"key":"B27","doi-asserted-by":"publisher","first-page":"49","DOI":"10.1145\/3240323.3240375","article-title":"\u201cImpact of item consumption on assessment of recommendations in user studies,\u201d","author":"Loepp","year":"2018","journal-title":"RecSys '18: Proceedings of the 12th ACM Conference on Recommender Systems"},{"key":"B28","doi-asserted-by":"publisher","first-page":"21","DOI":"10.1016\/j.ijhcs.2018.05.002","article-title":"Interactive recommending with tag-enhanced matrix factorization (TagMF)","volume":"121","author":"Loepp","year":"2019","journal-title":"Int. J. Hum. Comput. Stud"},{"key":"B29","doi-asserted-by":"publisher","first-page":"389","DOI":"10.1145\/1639714.1639795","article-title":"\u201cView-based recommender systems,\u201d","author":"Lousame","year":"2009","journal-title":"RecSys '09: Proceedings of the 3rd ACM Conference on Recommender Systems"},{"key":"B30","doi-asserted-by":"publisher","first-page":"31","DOI":"10.1145\/3240323.3240354","article-title":"\u201cExplore, exploit, and explain: personalizing explainable recommendations with bandits,\u201d","author":"McInerney","year":"2018","journal-title":"RecSys '18: Proceedings of the 12th ACM Conference on Recommender Systems"},{"key":"B31","doi-asserted-by":"publisher","first-page":"397","DOI":"10.1145\/3301275.3302313","article-title":"\u201cTo explain or not to explain: the effects of personal characteristics when explaining music recommendations,\u201d","author":"Millecamp","year":"2019","journal-title":"IUI '19: Proceedings of the 24th International Conference on Intelligent User Interfaces"},{"key":"B32","doi-asserted-by":"publisher","first-page":"219","DOI":"10.1007\/s00530-010-0190-0","article-title":"The effects of recommendations' presentation on persuasion and satisfaction in a movie recommender system","volume":"16","author":"Nanou","year":"2010","journal-title":"Multim. Syst"},{"key":"B33","doi-asserted-by":"publisher","first-page":"2433","DOI":"10.1145\/3485447.3512115","article-title":"\u201cChoice of implicit signal matters: Accounting for user aspirations in podcast recommendations,\u201d","author":"Nazari","year":"2022","journal-title":"WWW '22: Proceedings of the 31st ACM Web Conference"},{"key":"B34","doi-asserted-by":"publisher","first-page":"342","DOI":"10.1017\/S1930297500000486","article-title":"Maximizers vs. satisficers: decision-making styles, competence, and outcomes","volume":"2","author":"Parker","year":"2007","journal-title":"Judgm. Decis. Mak"},{"key":"B35","doi-asserted-by":"publisher","first-page":"644","DOI":"10.1145\/3523227.3551471","article-title":"\u201cHELPeR: an interactive recommender system for ovarian cancer patients and caregivers,\u201d","author":"Rahdari","year":"","journal-title":"RecSys '22: Proceedings of the 16th ACM Conference on Recommender Systems"},{"key":"B36","unstructured":"\u201cControlling personalized recommendations in two dimensions with a carousel-based interface,\u201d\n            RahdariB.\n            BrusilovskyP.\n            SabetA. J.\n          IntRS '21: Proceedings of the 8th Joint Workshop on Interfaces and Human Decision Making for Recommender Systems2021"},{"key":"B37","doi-asserted-by":"publisher","first-page":"166","DOI":"10.1145\/3511095.3531278","article-title":"\u201cThe magic of carousels: single vs. multi-list recommender systems,\u201d","author":"Rahdari","year":"","journal-title":"HT '22: Proceedings of the 33rd ACM Conference on Hypertext and Social Media"},{"key":"B38","doi-asserted-by":"publisher","first-page":"409","DOI":"10.1086\/651235","article-title":"Can there ever be too many options? A meta-analytic review of choice overload","volume":"37","author":"Scheibehenne","year":"2010","journal-title":"J. Cons. Res"},{"key":"B39","doi-asserted-by":"publisher","first-page":"633","DOI":"10.1145\/3460231.3478865","article-title":"\u201cAutomatic collection creation and recommendation,\u201d","author":"Singal","year":"2021","journal-title":"RecSys '21: Proceedings of the 15th ACM Conference on Recommender Systems"},{"key":"B40","article-title":"\u201cExamining choice overload across single-list and multi-list user interfaces,\u201d","author":"Starke","year":"2022","journal-title":"IntRS '22: Proceedings of the 8th Joint Workshop on Interfaces and Human Decision Making for Recommender Systems"},{"key":"B41","doi-asserted-by":"publisher","first-page":"124","DOI":"10.1145\/3460231.3474232","article-title":"\u201c\u2018Serving each user': Supporting different eating goals through a multi-list recommender interface,\u201d","author":"Starke","year":"2021","journal-title":"RecSys '21: Proceedings of the 15th ACM Conference on Recommender Systems"},{"key":"B42","doi-asserted-by":"publisher","DOI":"10.1145\/3581930","article-title":"Examining the user evaluation of multi-list recommender interfaces in the context of healthy recipe choices","author":"Starke","year":"2023","journal-title":"ACM Trans. Recomm. Syst"},{"key":"B43","doi-asserted-by":"publisher","first-page":"341","DOI":"10.1145\/2959100.2959174","article-title":"\u201cUsing navigation to improve recommendations in real-time,\u201d","author":"Wu","year":"2016","journal-title":"RecSys '16: Proceedings of the 10th ACM Conference on Recommender Systems"},{"key":"B44","doi-asserted-by":"publisher","first-page":"1047","DOI":"10.1145\/3437963.3441749","article-title":"\u201cToward user engagement optimization in 2d presentation,\u201d","author":"Wu","year":"2021","journal-title":"WSDM '21: Proceedings of the 14th ACM International Conference on Web Search and Data Mining"},{"key":"B45","doi-asserted-by":"publisher","first-page":"1075","DOI":"10.1145\/3539597.3570399","article-title":"\u201cA bird's-eye view of reranking: from list level to page level,\u201d","author":"Xi","year":"2023","journal-title":"WSDM '23: Proceedings of the 16th ACM International Conference on Web Search and Data Mining"}],"container-title":["Frontiers in Big Data"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fdata.2023.1239705\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,8,10]],"date-time":"2023-08-10T11:26:08Z","timestamp":1691666768000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fdata.2023.1239705\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,8,10]]},"references-count":45,"alternative-id":["10.3389\/fdata.2023.1239705"],"URL":"https:\/\/doi.org\/10.3389\/fdata.2023.1239705","relation":{},"ISSN":["2624-909X"],"issn-type":[{"value":"2624-909X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,8,10]]},"article-number":"1239705"}}