{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T04:22:15Z","timestamp":1750306935730,"version":"3.41.0"},"reference-count":38,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2013,10,1]],"date-time":"2013-10-01T00:00:00Z","timestamp":1380585600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100000943","name":"Commonwealth Scientific and Industrial Research Organisation","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100000943","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Interact. Intell. Syst."],"published-print":{"date-parts":[[2013,10]]},"abstract":"<jats:p>Personalized systems and recommender systems exploit implicitly and explicitly provided user information to address the needs and requirements of those using their services. User preference information, often in the form of interaction logs and ratings data, is used to identify similar users, whose opinions are leveraged to inform recommendations or to filter information. In this work we explore a different dimension of information trends in user bias and reasoning learned from ratings provided by users to a recommender system. Our work examines the characteristics of a dataset of 100,000 user ratings on a corpus of recipes, which illustrates stable user bias towards certain features of the recipes (cuisine type, key ingredient, and complexity). We exploit this knowledge to design and evaluate a personalized rating acquisition tool based on active learning, which leverages user biases in order to obtain ratings bearing high-value information and to reduce prediction errors with new users.<\/jats:p>","DOI":"10.1145\/2499673","type":"journal-article","created":{"date-parts":[[2013,11,6]],"date-time":"2013-11-06T14:09:19Z","timestamp":1383746959000},"page":"1-21","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["Rating Bias and Preference Acquisition"],"prefix":"10.1145","volume":"3","author":[{"given":"Jill","family":"Freyne","sequence":"first","affiliation":[{"name":"CSIRO, ICT Centre"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shlomo","family":"Berkovsky","sequence":"additional","affiliation":[{"name":"NICTA and CSIRO, ICT Centre"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Gregory","family":"Smith","sequence":"additional","affiliation":[{"name":"CSIRO, ICT Centre"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2013,10]]},"reference":[{"doi-asserted-by":"crossref","unstructured":"Adomavicius G. and Tuzhilin A. 2011. Context-aware recommender systems. In Recommender Systems Handbook. F. Ricci L. Rokach B. Shapira and P. B. Kantor Eds. Springer 217--253. Adomavicius G. and Tuzhilin A. 2011. Context-aware recommender systems. In Recommender Systems Handbook . F. Ricci L. Rokach B. Shapira and P. B. Kantor Eds. Springer 217--253.","key":"e_1_2_1_1_1","DOI":"10.1007\/978-0-387-85820-3_7"},{"doi-asserted-by":"publisher","key":"e_1_2_1_2_1","DOI":"10.1609\/aimag.v32i3.2364"},{"doi-asserted-by":"publisher","key":"e_1_2_1_3_1","DOI":"10.1145\/1639714.1639744"},{"doi-asserted-by":"publisher","key":"e_1_2_1_4_1","DOI":"10.1007\/s00779-011-0417-x"},{"doi-asserted-by":"publisher","key":"e_1_2_1_5_1","DOI":"10.1007\/s11257-008-9055-z"},{"doi-asserted-by":"publisher","key":"e_1_2_1_6_1","DOI":"10.1145\/2209310.2209312"},{"doi-asserted-by":"publisher","key":"e_1_2_1_7_1","DOI":"10.1177\/1745691610393980"},{"unstructured":"Chen L. and Pu P. 2004. Survey of preference elicitation methods. Tech. rep. No. IC\/200467 Swiss Federal Institute of Technology in Lausanne. Chen L. and Pu P. 2004. Survey of preference elicitation methods. Tech. rep. No. IC\/200467 Swiss Federal Institute of Technology in Lausanne.","key":"e_1_2_1_8_1"},{"doi-asserted-by":"publisher","key":"e_1_2_1_9_1","DOI":"10.1145\/642611.642713"},{"doi-asserted-by":"publisher","key":"e_1_2_1_10_1","DOI":"10.1145\/2365952.2366040"},{"doi-asserted-by":"crossref","unstructured":"Elahi M. Repsys V. and Ricci F. 2011. Rating elicitation strategies for collaborative filtering. In Ecommerce and Web Technologies 160--171. Elahi M. Repsys V. and Ricci F. 2011. Rating elicitation strategies for collaborative filtering. In Ecommerce and Web Technologies 160--171.","key":"e_1_2_1_11_1","DOI":"10.1007\/978-3-642-23014-1_14"},{"doi-asserted-by":"publisher","key":"e_1_2_1_12_1","DOI":"10.1145\/1719970.1720021"},{"doi-asserted-by":"publisher","key":"e_1_2_1_13_1","DOI":"10.1007\/978-3-642-13470-8_36"},{"volume-title":"Proceedings of the Conference on Artificial Intelligence in Medicine. 139--148","author":"Freyne J.","unstructured":"Freyne , J. , Berkovsky , S. , Baghaei , N. , Kimani , S. , and Smith , G . 2011a. Personalized techniques for lifestyle change . In Proceedings of the Conference on Artificial Intelligence in Medicine. 139--148 . Freyne, J., Berkovsky, S., Baghaei, N., Kimani, S., and Smith, G. 2011a. Personalized techniques for lifestyle change. In Proceedings of the Conference on Artificial Intelligence in Medicine. 139--148.","key":"e_1_2_1_14_1"},{"volume-title":"Proceedings of the Conference on User Modeling, Adaption and Personalization. 99--110","author":"Freyne J.","unstructured":"Freyne , J. , Berkovsky , S. , and Smith , G . 2011b. Recipe recommendation: Accuracy and reasoning . In Proceedings of the Conference on User Modeling, Adaption and Personalization. 99--110 . Freyne, J., Berkovsky, S., and Smith, G. 2011b. Recipe recommendation: Accuracy and reasoning. In Proceedings of the Conference on User Modeling, Adaption and Personalization. 99--110.","key":"e_1_2_1_15_1"},{"doi-asserted-by":"publisher","key":"e_1_2_1_16_1","DOI":"10.1145\/1871437.1871734"},{"key":"e_1_2_1_18_1","volume-title":"Proceedings of the 5th National Conference on Artificial Intelligence.","volume":"1","author":"Hammond K.","year":"1986","unstructured":"Hammond , K. 1986 . CHEF: A model of case-based planning . In Proceedings of the 5th National Conference on Artificial Intelligence. Vol. 1 . Hammond, K. 1986. CHEF: A model of case-based planning. In Proceedings of the 5th National Conference on Artificial Intelligence. Vol. 1."},{"doi-asserted-by":"publisher","key":"e_1_2_1_19_1","DOI":"10.1145\/963770.963772"},{"key":"e_1_2_1_20_1","volume-title":"Proceedings of the Workshop on Case-Based Reasoning.","author":"Hinrichs T.","year":"1989","unstructured":"Hinrichs , T. 1989 . Strategies for adaptation and recovery in a design problem solver . In Proceedings of the Workshop on Case-Based Reasoning. Hinrichs, T. 1989. Strategies for adaptation and recovery in a design problem solver. In Proceedings of the Workshop on Case-Based Reasoning."},{"doi-asserted-by":"publisher","key":"e_1_2_1_21_1","DOI":"10.1145\/1943403.1943500"},{"key":"e_1_2_1_22_1","volume-title":"The Human-Computer Interaction Handbook: Fundamentals, Evolving Technologies and Emerging Applications","author":"Jameson A.","unstructured":"Jameson , A. 2012. Choices and decisions of computer users . In The Human-Computer Interaction Handbook: Fundamentals, Evolving Technologies and Emerging Applications 3 rd Ed., CRC Press , Boca Raton, FL . Jameson, A. 2012. Choices and decisions of computer users. In The Human-Computer Interaction Handbook: Fundamentals, Evolving Technologies and Emerging Applications 3rd Ed., CRC Press, Boca Raton, FL.","edition":"3"},{"doi-asserted-by":"publisher","key":"e_1_2_1_23_1","DOI":"10.1145\/2209310.2209313"},{"doi-asserted-by":"publisher","key":"e_1_2_1_24_1","DOI":"10.1145\/1357054.1357127"},{"doi-asserted-by":"publisher","key":"e_1_2_1_25_1","DOI":"10.1007\/978-3-642-31454-4_27"},{"doi-asserted-by":"crossref","unstructured":"Lops P. Gemmis M. and Semeraro G. 2011. Content-based recommender systems: State of the art and trends. In Recommender Systems Handbook F. Ricci L. Rokach B. Shapira and P. B. Kantor Eds. Springer 73--105. Lops P. Gemmis M. and Semeraro G. 2011. Content-based recommender systems: State of the art and trends. In Recommender Systems Handbook F. Ricci L. Rokach B. Shapira and P. B. Kantor Eds. Springer 73--105.","key":"e_1_2_1_26_1","DOI":"10.1007\/978-0-387-85820-3_3"},{"unstructured":"Noakes M. and Clifton P. 2005. The CSIRO Total Wellbeing Diet Book. Penguin Group Australia. Noakes M. and Clifton P. 2005. The CSIRO Total Wellbeing Diet Book . Penguin Group Australia.","key":"e_1_2_1_27_1"},{"unstructured":"Noakes M. and Clifton P. 2006. The CSIRO Total Wellbeing Diet Book 2. Penguin Group Australia. Noakes M. and Clifton P. 2006. The CSIRO Total Wellbeing Diet Book 2 . Penguin Group Australia.","key":"e_1_2_1_28_1"},{"key":"e_1_2_1_29_1","doi-asserted-by":"crossref","first-page":"411","DOI":"10.1017\/S1930297500002205","article-title":"Running experiments on Amazon Mechanical Turk","volume":"5","author":"Paolacci G.","year":"2010","unstructured":"Paolacci , G. , Chandler , J. , and Ipeirotis , P. 2010 . Running experiments on Amazon Mechanical Turk . Judgment Decision Mak. 5 , 5, 411 -- 419 . Paolacci, G., Chandler, J., and Ipeirotis, P. 2010. Running experiments on Amazon Mechanical Turk. Judgment Decision Mak. 5, 5, 411--419.","journal-title":"Judgment Decision Mak."},{"doi-asserted-by":"crossref","unstructured":"Pazzani M. and Billsus D. 2007. Content-based recommendation systems. In The Adaptive Web 325--341. Pazzani M. and Billsus D. 2007. Content-based recommendation systems. In The Adaptive Web 325--341.","key":"e_1_2_1_30_1","DOI":"10.1007\/978-3-540-72079-9_10"},{"key":"e_1_2_1_31_1","volume-title":"Proceedings of the 5th Australian Joint Conference on Artificial Intelligence. 343--348","author":"Quinlan J.","year":"1992","unstructured":"Quinlan , J. 1992 . Learning with continuous classes . In Proceedings of the 5th Australian Joint Conference on Artificial Intelligence. 343--348 . Quinlan, J. 1992. Learning with continuous classes. In Proceedings of the 5th Australian Joint Conference on Artificial Intelligence. 343--348."},{"doi-asserted-by":"publisher","key":"e_1_2_1_32_1","DOI":"10.1145\/502716.502737"},{"doi-asserted-by":"publisher","key":"e_1_2_1_33_1","DOI":"10.1145\/1540276.1540302"},{"doi-asserted-by":"crossref","unstructured":"Rubens N. Kaplan D. and Sugiyama M. 2011. Active learning in recommender systems. In Recommender Systems Handbook F. Ricci L. Rokach B. Shapira and P. B. Kantor Eds. Springer 735--767. Rubens N. Kaplan D. and Sugiyama M. 2011. Active learning in recommender systems. In Recommender Systems Handbook F. Ricci L. Rokach B. Shapira and P. B. Kantor Eds. Springer 735--767.","key":"e_1_2_1_34_1","DOI":"10.1007\/978-0-387-85820-3_23"},{"doi-asserted-by":"publisher","key":"e_1_2_1_35_1","DOI":"10.1145\/365024.365130"},{"doi-asserted-by":"crossref","unstructured":"Tintarev N. and Masthoff J. 2011. Designing and evaluating explanations for recommender systems. In Recommender Systems Handbook F. Ricci L. Rokach B. Shapira and P. B. Kantor Eds. Springer 479--510. Tintarev N. and Masthoff J. 2011. Designing and evaluating explanations for recommender systems. In Recommender Systems Handbook F. Ricci L. Rokach B. Shapira and P. B. Kantor Eds. Springer 479--510.","key":"e_1_2_1_36_1","DOI":"10.1007\/978-0-387-85820-3_15"},{"doi-asserted-by":"publisher","key":"e_1_2_1_37_1","DOI":"10.1145\/1943403.1943422"},{"volume-title":"Poster Papers of the 9th European Conference on Machine Learning.","author":"Wang Y.","unstructured":"Wang , Y. and Witten , I . 1996. Induction of model trees for predicting continuous classes . In Poster Papers of the 9th European Conference on Machine Learning. Wang, Y. and Witten, I. 1996. Induction of model trees for predicting continuous classes. In Poster Papers of the 9th European Conference on Machine Learning.","key":"e_1_2_1_38_1"},{"unstructured":"Zhang Q. Hu R. MacNamee B. and Delany S. J. 2008. Back to the future: Knowledge light case base cookery. Tech. rep. Dublin Institute of Technology. Zhang Q. Hu R. MacNamee B. and Delany S. J. 2008. Back to the future: Knowledge light case base cookery. Tech. rep. Dublin Institute of Technology.","key":"e_1_2_1_39_1"}],"container-title":["ACM Transactions on Interactive Intelligent Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2499673","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2499673","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T08:35:43Z","timestamp":1750235743000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2499673"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2013,10]]},"references-count":38,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2013,10]]}},"alternative-id":["10.1145\/2499673"],"URL":"https:\/\/doi.org\/10.1145\/2499673","relation":{},"ISSN":["2160-6455","2160-6463"],"issn-type":[{"type":"print","value":"2160-6455"},{"type":"electronic","value":"2160-6463"}],"subject":[],"published":{"date-parts":[[2013,10]]},"assertion":[{"value":"2012-03-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2013-04-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2013-10-01","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}