{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:27:33Z","timestamp":1750220853203,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":8,"publisher":"ACM","license":[{"start":{"date-parts":[[2019,10,14]],"date-time":"2019-10-14T00:00:00Z","timestamp":1571011200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Toyota Research Institute","award":["AWD004880"],"award-info":[{"award-number":["AWD004880"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2019,10,14]]},"DOI":"10.1145\/3332167.3357122","type":"proceedings-article","created":{"date-parts":[[2019,10,18]],"date-time":"2019-10-18T12:57:15Z","timestamp":1571403435000},"page":"81-83","source":"Crossref","is-referenced-by-count":0,"title":["Towards Universal Evaluation of Image Annotation Interfaces"],"prefix":"10.1145","author":[{"given":"Andrew M.","family":"Vernier","sequence":"first","affiliation":[{"name":"University of Michigan, Ann Arbor, MI, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jean Y.","family":"Song","sequence":"additional","affiliation":[{"name":"University of Michigan, Ann Arbor, MI, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Edward","family":"Sun","sequence":"additional","affiliation":[{"name":"University of Michigan, Ann Arbor, MI, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Allison","family":"Kench","sequence":"additional","affiliation":[{"name":"University of Michigan, Ann Arbor, MI, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Walter S.","family":"Lasecki","sequence":"additional","affiliation":[{"name":"University of Michigan, Ann Arbor, MI, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2019,10,14]]},"reference":[{"key":"e_1_3_2_1_1_1","unstructured":"Sean Bell Paul Upchurch Noah Snavely and Kavita Bala. OpenSurfaces: A richly annotated catalog of surface appearance (ACM TOG '13).  Sean Bell Paul Upchurch Noah Snavely and Kavita Bala. OpenSurfaces: A richly annotated catalog of surface appearance (ACM TOG '13)."},{"key":"e_1_3_2_1_2_1","unstructured":"Aleksey Boyko and Thomas Funkhouser. Cheaper by the dozen: Group annotation of 3D data (UIST '14).  Aleksey Boyko and Thomas Funkhouser. Cheaper by the dozen: Group annotation of 3D data (UIST '14)."},{"key":"e_1_3_2_1_3_1","unstructured":"Andreas Geiger Philip Lenz and Raquel Urtasun. Are we ready for Autonomous Driving? The KITTI Vision Benchmark Suite (CVPR '12).  Andreas Geiger Philip Lenz and Raquel Urtasun. Are we ready for Autonomous Driving? The KITTI Vision Benchmark Suite (CVPR '12)."},{"key":"e_1_3_2_1_4_1","unstructured":"Sai R Gouravajhala Jinyeong Yim Karthik Desingh Yanda Huang Odest Chadwicke Jenkins and Walter S Lasecki. EURECA: Enhanced Understanding of Real Environments via Crowd Assistance (HCOMP '18).  Sai R Gouravajhala Jinyeong Yim Karthik Desingh Yanda Huang Odest Chadwicke Jenkins and Walter S Lasecki. EURECA: Enhanced Understanding of Real Environments via Crowd Assistance (HCOMP '18)."},{"key":"e_1_3_2_1_5_1","unstructured":"Bryan C Russell Antonio Torralba Kevin P Murphy and William T Freeman. LabelMe: a database and web-based tool for image annotation (IJCV '08).  Bryan C Russell Antonio Torralba Kevin P Murphy and William T Freeman. LabelMe: a database and web-based tool for image annotation (IJCV '08)."},{"key":"e_1_3_2_1_6_1","unstructured":"Jean Y. Song Raymond Fok Alan Lundgard Fan Yang Juho Kim and Walter S. Lasecki. Two Tools Are Better Than One: Tool Diversity As a Means of Improving Aggregate Crowd Performance (IUI '18).  Jean Y. Song Raymond Fok Alan Lundgard Fan Yang Juho Kim and Walter S. Lasecki. Two Tools Are Better Than One: Tool Diversity As a Means of Improving Aggregate Crowd Performance (IUI '18)."},{"key":"e_1_3_2_1_7_1","unstructured":"Jean Y. Song Stephan J. Lemmer Xieyang Liu Shiyan Yan Juho Kim Jason J. Corso and Walter S. Lasecki. Popup: Reconstructing 3D Video Using Particle Filtering to Aggregate Crowd Responses (IUI '19).  Jean Y. Song Stephan J. Lemmer Xieyang Liu Shiyan Yan Juho Kim Jason J. Corso and Walter S. Lasecki. Popup: Reconstructing 3D Video Using Particle Filtering to Aggregate Crowd Responses (IUI '19)."},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.115"}],"event":{"name":"UIST '19: The 32nd Annual ACM Symposium on User Interface Software and Technology","sponsor":["SIGGRAPH ACM Special Interest Group on Computer Graphics and Interactive Techniques","SIGCHI ACM Special Interest Group on Computer-Human Interaction"],"location":"New Orleans LA USA","acronym":"UIST '19"},"container-title":["The Adjunct Publication of the 32nd Annual ACM Symposium on User Interface Software and Technology"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3332167.3357122","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3332167.3357122","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T23:23:18Z","timestamp":1750202598000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3332167.3357122"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,10,14]]},"references-count":8,"alternative-id":["10.1145\/3332167.3357122","10.1145\/3332167"],"URL":"https:\/\/doi.org\/10.1145\/3332167.3357122","relation":{},"subject":[],"published":{"date-parts":[[2019,10,14]]}}}