{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:13:28Z","timestamp":1750220008239,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":9,"publisher":"ACM","license":[{"start":{"date-parts":[[2022,10,17]],"date-time":"2022-10-17T00:00:00Z","timestamp":1665964800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2022,10,17]]},"DOI":"10.1145\/3511808.3557517","type":"proceedings-article","created":{"date-parts":[[2022,10,16]],"date-time":"2022-10-16T01:22:22Z","timestamp":1665883342000},"page":"5092-5093","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Leveraging Automated Search Relevance Evaluation to Improve System Deployment"],"prefix":"10.1145","author":[{"given":"Yizhao","family":"Ni","sequence":"first","affiliation":[{"name":"Kaiser Permanente Information Technology, Oakland, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ferosh","family":"Jacob","sequence":"additional","affiliation":[{"name":"Kaiser Permanente Information Technology, Oakland, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Priya","family":"Gopi Achuthan","sequence":"additional","affiliation":[{"name":"Kaiser Permanente Information Technology, Oakland, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hui","family":"Wu","sequence":"additional","affiliation":[{"name":"Kaiser Permanente Information Technology, Oakland, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Faizan","family":"Javed","sequence":"additional","affiliation":[{"name":"Kaiser Permanente Information Technology, Oakland, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2022,10,17]]},"reference":[{"key":"e_1_3_2_1_1_1","first-page":"2116","article-title":"Automated detection of substance use information in pediatric electronic health records","volume":"28","author":"Ni Yizhao","year":"2021","unstructured":"Yizhao Ni , Alycia Bachtel , Katie Nause , and Sarah Beal , 2021 . Automated detection of substance use information in pediatric electronic health records . JAMIA 28 , 10 (2021), 2116 -- 2127 . Yizhao Ni, Alycia Bachtel, Katie Nause, and Sarah Beal, 2021. Automated detection of substance use information in pediatric electronic health records. JAMIA 28, 10 (2021), 2116--2127.","journal-title":"JAMIA"},{"key":"e_1_3_2_1_2_1","first-page":"e26231","article-title":"Understanding pediatric surgery cancellation: geospatial analysis","volume":"23","author":"Liu Lei","year":"2021","unstructured":"Lei Liu , Yizhao Ni , Andrew Beck , , 2021 . Understanding pediatric surgery cancellation: geospatial analysis . JMIR Vol. 23 , 9 (2021), e26231 . Lei Liu, Yizhao Ni, Andrew Beck, et al., 2021. Understanding pediatric surgery cancellation: geospatial analysis. JMIR Vol. 23, 9 (2021), e26231.","journal-title":"JMIR"},{"key":"e_1_3_2_1_3_1","first-page":"555","article-title":"Designing and evaluating an automated system for real-time medication administration error detection in a neonatal intensive care unit","volume":"25","author":"Ni Yizhao","year":"2018","unstructured":"Yizhao Ni , Todd Lingren , Eric Hall , 2018 . Designing and evaluating an automated system for real-time medication administration error detection in a neonatal intensive care unit . JAMIA Vol. 25 , 5 (2018), 555 -- 563 . Yizhao Ni, Todd Lingren, Eric Hall, et al. 2018. Designing and evaluating an automated system for real-time medication administration error detection in a neonatal intensive care unit. JAMIA Vol. 25, 5 (2018), 555--563.","journal-title":"JAMIA"},{"key":"e_1_3_2_1_4_1","volume-title":"Software testing research: achievements, challenges, dreams. Future of Software Engineering (FOSE'07)","author":"Bertolino Antonia","year":"2007","unstructured":"Antonia Bertolino , 2007. Software testing research: achievements, challenges, dreams. Future of Software Engineering (FOSE'07) . 2007 , 7705--7716. Antonia Bertolino, 2007. Software testing research: achievements, challenges, dreams. Future of Software Engineering (FOSE'07). 2007, 7705--7716."},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/1076034.1076172"},{"volume-title":"Proceed-ings of ACM CIKM'16","author":"Chuklin Aleksandr","key":"e_1_3_2_1_6_1","unstructured":"Aleksandr Chuklin and Maarten de Rijke , 2016. Incorporating clicks, attention and satisfaction into a search engine result page evaluation model . In Proceed-ings of ACM CIKM'16 . ACM Press , Indianapolis, IN , 175--184. Aleksandr Chuklin and Maarten de Rijke, 2016. Incorporating clicks, attention and satisfaction into a search engine result page evaluation model. In Proceed-ings of ACM CIKM'16. ACM Press, Indianapolis, IN, 175--184."},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1561\/1500000051"},{"key":"e_1_3_2_1_8_1","volume-title":"Prabhakar Raghavan and Hinrich Sch\u00fctze","author":"Manning Christopher","year":"2009","unstructured":"Christopher Manning , Prabhakar Raghavan and Hinrich Sch\u00fctze , 2009 . Evalua-tion in information retrieval. In Introduction to Information Retrieval. Cam-bridge University Press , Cambridge, UK. Christopher Manning, Prabhakar Raghavan and Hinrich Sch\u00fctze, 2009. Evalua-tion in information retrieval. In Introduction to Information Retrieval. Cam-bridge University Press, Cambridge, UK."},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-14267-3"}],"event":{"name":"CIKM '22: The 31st ACM International Conference on Information and Knowledge Management","sponsor":["SIGWEB ACM Special Interest Group on Hypertext, Hypermedia, and Web","SIGIR ACM Special Interest Group on Information Retrieval"],"location":"Atlanta GA USA","acronym":"CIKM '22"},"container-title":["Proceedings of the 31st ACM International Conference on Information & Knowledge Management"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3511808.3557517","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3511808.3557517","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T17:51:08Z","timestamp":1750182668000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3511808.3557517"}},"subtitle":["A Case Study in Healthcare"],"short-title":[],"issued":{"date-parts":[[2022,10,17]]},"references-count":9,"alternative-id":["10.1145\/3511808.3557517","10.1145\/3511808"],"URL":"https:\/\/doi.org\/10.1145\/3511808.3557517","relation":{},"subject":[],"published":{"date-parts":[[2022,10,17]]},"assertion":[{"value":"2022-10-17","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}