{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,20]],"date-time":"2026-11-20T21:38:07Z","timestamp":1795210687945,"version":"4.10.3"},"reference-count":58,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2023,7,14]],"date-time":"2023-07-14T00:00:00Z","timestamp":1689292800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Recomm. Syst."],"published-print":{"date-parts":[[2023,9,30]]},"abstract":"<jats:p>Making recommendations for users in diverse organizations (<jats:italic>orgs<\/jats:italic>) is a challenging task for workplace social platforms such as Microsoft Teams and Slack. The current industry-standard model training approaches either use data from all organizations to maximize information or train organization-specific models to minimize noise. Our real-world experiments show that both approaches are poorly suited for the multi-org recommendation setting where different organizations\u2019 interaction patterns vary in their generalizability. We introduce<jats:italic>targeted training<\/jats:italic>, which improves on standard practices by automatically selecting a subset of orgs for model development whose data are cleanest and best represent global trends. We demonstrate how and when targeted training improves over global training through theoretical analysis and simulation. Our experiments on large-scale datasets from Microsoft Teams, SharePoint, Stack Exchange, DBLP, and Reddit show that in many cases targeted training can improve mean average precision (MAP) across orgs by 10\u201315% over global training, is more robust to orgs with lower data quality, and generalizes better to unseen orgs. Our training framework is applicable to a wide range of inductive recommendation models, from simple regression models to graph neural networks (GNNs).<\/jats:p>","DOI":"10.1145\/3603508","type":"journal-article","created":{"date-parts":[[2023,6,3]],"date-time":"2023-06-03T10:16:08Z","timestamp":1685787368000},"page":"1-18","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["Targeted Training for Multi-organization Recommendation"],"prefix":"10.1145","volume":"1","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0300-0845","authenticated-orcid":false,"given":"Kiran","family":"Tomlinson","sequence":"first","affiliation":[{"name":"Cornell University, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5298-1221","authenticated-orcid":false,"given":"Mengting","family":"Wan","sequence":"additional","affiliation":[{"name":"Microsoft, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0006-5244-1600","authenticated-orcid":false,"given":"Cao","family":"Lu","sequence":"additional","affiliation":[{"name":"Microsoft, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7955-0202","authenticated-orcid":false,"given":"Brent","family":"Hecht","sequence":"additional","affiliation":[{"name":"Microsoft, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2786-0209","authenticated-orcid":false,"given":"Jaime","family":"Teevan","sequence":"additional","affiliation":[{"name":"Microsoft, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6615-8615","authenticated-orcid":false,"given":"Longqi","family":"Yang","sequence":"additional","affiliation":[{"name":"Microsoft, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2023,7,14]]},"reference":[{"key":"e_1_3_2_2_2","doi-asserted-by":"publisher","DOI":"10.1016\/S0378-8733(03)00009-1"},{"key":"e_1_3_2_3_2","doi-asserted-by":"publisher","DOI":"10.1111\/j.1751-5823.2010.00103.x"},{"key":"e_1_3_2_4_2","doi-asserted-by":"publisher","DOI":"10.1214\/09-SS054"},{"key":"e_1_3_2_5_2","doi-asserted-by":"publisher","DOI":"10.1609\/icwsm.v14i1.7347"},{"key":"e_1_3_2_6_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICDM.2007.90"},{"key":"e_1_3_2_7_2","volume-title":"Proceedings of the KDD Cup and Workshop","author":"Bennett James","year":"2007","unstructured":"James Bennett and Stan Lanning. 2007. The netflix prize. In Proceedings of the KDD Cup and Workshop. Vol. 2007, New York, NY, 35."},{"key":"e_1_3_2_8_2","doi-asserted-by":"publisher","DOI":"10.1145\/3038912.3052713"},{"key":"e_1_3_2_9_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2013.03.012"},{"key":"e_1_3_2_10_2","doi-asserted-by":"publisher","DOI":"10.1145\/1864708.1864724"},{"key":"e_1_3_2_11_2","doi-asserted-by":"publisher","DOI":"10.1145\/3240323.3241726"},{"key":"e_1_3_2_12_2","doi-asserted-by":"publisher","DOI":"10.1016\/S0169-7552(98)00110-X"},{"key":"e_1_3_2_13_2","doi-asserted-by":"publisher","DOI":"10.1145\/2487575.2487638"},{"key":"e_1_3_2_14_2","doi-asserted-by":"publisher","DOI":"10.1145\/2988450.2988454"},{"key":"e_1_3_2_15_2","doi-asserted-by":"publisher","DOI":"10.1145\/2959100.2959185"},{"key":"e_1_3_2_16_2","doi-asserted-by":"publisher","DOI":"10.1145\/2959100.2959190"},{"key":"e_1_3_2_17_2","doi-asserted-by":"publisher","DOI":"10.1145\/502512.502550"},{"key":"e_1_3_2_18_2","first-page":"1","volume-title":"Proceedings of the Spanish Conference on Information Retrieval","author":"Fern\u00e1ndez-Tob\u00edas Ignacio","year":"2012","unstructured":"Ignacio Fern\u00e1ndez-Tob\u00edas, Iv\u00e1n Cantador, Marius Kaminskas, and Francesco Ricci. 2012. Cross-domain recommender systems: A survey of the state-of-the-art. In Proceedings of the Spanish Conference on Information Retrieval. 1\u201312."},{"key":"e_1_3_2_19_2","doi-asserted-by":"publisher","DOI":"10.1145\/3038912.3052569"},{"key":"e_1_3_2_20_2","doi-asserted-by":"publisher","DOI":"10.1037\/0033-2909.92.2.490"},{"key":"e_1_3_2_21_2","doi-asserted-by":"publisher","DOI":"10.1145\/2488388.2488441"},{"key":"e_1_3_2_22_2","volume-title":"Proceedings of the ICLR","author":"Kipf Thomas N.","year":"2017","unstructured":"Thomas N. Kipf and Max Welling. 2017. Semi-supervised classification with graph convolutional networks. In Proceedings of the ICLR."},{"key":"e_1_3_2_23_2","doi-asserted-by":"publisher","DOI":"10.1109\/MC.2009.263"},{"key":"e_1_3_2_24_2","doi-asserted-by":"publisher","DOI":"10.1145\/3397271.3401078"},{"key":"e_1_3_2_25_2","doi-asserted-by":"publisher","DOI":"10.1145\/2566486.2567970"},{"key":"e_1_3_2_26_2","doi-asserted-by":"publisher","DOI":"10.1109\/MSP.2020.2975749"},{"key":"e_1_3_2_27_2","doi-asserted-by":"publisher","DOI":"10.5555\/1241540.1241551"},{"key":"e_1_3_2_28_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11257-019-09231-w"},{"key":"e_1_3_2_29_2","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevLett.89.208701"},{"key":"e_1_3_2_30_2","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevE.69.026113"},{"key":"e_1_3_2_31_2","doi-asserted-by":"publisher","DOI":"10.1145\/3394486.3403250"},{"key":"e_1_3_2_32_2","volume-title":"Proceedings of the ISCIS VII), Universitat","author":"Riedmiller Martin","year":"1992","unstructured":"Martin Riedmiller and Heinrich Braun. 1992. Rprop-a fast adaptive learning algorithm. In Proceedings of the ISCIS VII), Universitat. Citeseer."},{"key":"e_1_3_2_33_2","unstructured":"Aditya Sakhuja. 2021. Building a Multi-tenant Content-based Recommender with Automated Training. Retrieved from https:\/\/pycon.blogspot.com\/2021\/05\/building-multi-tenant-content-based.html accessed 3\/1\/2023."},{"key":"e_1_3_2_34_2","doi-asserted-by":"publisher","DOI":"10.1145\/2740908.2742726"},{"key":"e_1_3_2_35_2","doi-asserted-by":"crossref","unstructured":"Anu Sivunen and Kaisa Laitinen. 2019. Digital communication environments in the workplace. In Workplace Communication Leena Mikkola and Maarit Valo (Eds.). Routledge New York NY 41\u201353.","DOI":"10.4324\/9780429196881-4"},{"key":"e_1_3_2_36_2","unstructured":"Stack Exchange Inc.2021. Stack Exchange Data Dump. Retrieved from https:\/\/archive.org\/details\/stackexchange accessed September 7 2021."},{"issue":"2","key":"e_1_3_2_37_2","doi-asserted-by":"crossref","first-page":"111","DOI":"10.1111\/j.2517-6161.1974.tb00994.x","article-title":"Cross-validatory choice and assessment of statistical predictions","volume":"36","author":"Stone Mervyn","year":"1974","unstructured":"Mervyn Stone. 1974. Cross-validatory choice and assessment of statistical predictions. Journal of the Royal Statistical Society: Series B 36, 2 (1974), 111\u2013133.","journal-title":"Journal of the Royal Statistical Society: Series B"},{"key":"e_1_3_2_38_2","doi-asserted-by":"publisher","DOI":"10.1145\/1401890.1402008"},{"key":"e_1_3_2_39_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-019-41695-z"},{"key":"e_1_3_2_40_2","doi-asserted-by":"publisher","DOI":"10.1145\/3338501.3357370"},{"key":"e_1_3_2_41_2","doi-asserted-by":"publisher","DOI":"10.1145\/2647868.2654940"},{"key":"e_1_3_2_42_2","doi-asserted-by":"publisher","DOI":"10.1038\/30918"},{"key":"e_1_3_2_43_2","doi-asserted-by":"crossref","unstructured":"Shiwen Wu Fei Sun Wentao Zhang Xu Xie and Bin Cui. 2022. Graph neural networks in recommender systems: a survey. Comput. Surveys 55 5 (2022) 1\u201337.","DOI":"10.1145\/3535101"},{"key":"e_1_3_2_44_2","doi-asserted-by":"publisher","DOI":"10.1007\/s41666-020-00082-4"},{"issue":"130","key":"e_1_3_2_45_2","first-page":"17","article-title":"Deepapf: Deep attentive probabilistic factorization for multi-site video recommendation","volume":"2","author":"Yan Huan","year":"2019","unstructured":"Huan Yan, Xiangning Chen, Chen Gao, Yong Li, and Depeng Jin. 2019. Deepapf: Deep attentive probabilistic factorization for multi-site video recommendation. TC 2, 130 (2019), 17\u2013883.","journal-title":"TC"},{"key":"e_1_3_2_46_2","doi-asserted-by":"publisher","DOI":"10.1145\/3460231.3474276"},{"key":"e_1_3_2_47_2","doi-asserted-by":"publisher","DOI":"10.1145\/1277741.1277790"},{"key":"e_1_3_2_48_2","doi-asserted-by":"publisher","DOI":"10.1145\/2939672.2939673"},{"key":"e_1_3_2_49_2","unstructured":"Muhan Zhang and Yixin Chen. 2018. Link prediction based on graph neural networks. In Advances in Neural Information Processing Systems Vol. 31."},{"key":"e_1_3_2_50_2","volume-title":"Proceedings of the ICLR","author":"Zhang Muhan","year":"2020","unstructured":"Muhan Zhang and Yixin Chen. 2020. Inductive matrix completion based on graph neural networks. In Proceedings of the ICLR."},{"key":"e_1_3_2_51_2","doi-asserted-by":"publisher","DOI":"10.1214\/aos\/1176349027"},{"key":"e_1_3_2_52_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.dss.2017.10.002"},{"key":"e_1_3_2_53_2","doi-asserted-by":"publisher","DOI":"10.1145\/3285029"},{"key":"e_1_3_2_54_2","doi-asserted-by":"publisher","DOI":"10.1145\/3077136.3080689"},{"key":"e_1_3_2_55_2","first-page":"725","volume-title":"Proceedings of the UAI","author":"Zhang Yu","year":"2010","unstructured":"Yu Zhang, Bin Cao, and Dit-Yan Yeung. 2010. Multi-domain collaborative filtering. In Proceedings of the UAI. 725\u2013732."},{"key":"e_1_3_2_56_2","doi-asserted-by":"publisher","DOI":"10.1145\/3357384.3358166"},{"key":"e_1_3_2_57_2","doi-asserted-by":"publisher","DOI":"10.1145\/3178876.3185994"},{"key":"e_1_3_2_58_2","doi-asserted-by":"publisher","DOI":"10.1145\/3018661.3018665"},{"key":"e_1_3_2_59_2","doi-asserted-by":"publisher","DOI":"10.24963\/ijcai.2021\/639"}],"container-title":["ACM Transactions on Recommender Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3603508","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3603508","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T16:46:26Z","timestamp":1750178786000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3603508"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,7,14]]},"references-count":58,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2023,9,30]]}},"alternative-id":["10.1145\/3603508"],"URL":"https:\/\/doi.org\/10.1145\/3603508","relation":{},"ISSN":["2770-6699"],"issn-type":[{"value":"2770-6699","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,7,14]]},"assertion":[{"value":"2022-11-28","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-05-21","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-07-14","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}