{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:31:34Z","timestamp":1750221094551,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":55,"publisher":"ACM","license":[{"start":{"date-parts":[[2019,3,17]],"date-time":"2019-03-17T00:00:00Z","timestamp":1552780800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Toyota Research Institute"},{"name":"Ministry of Science and ICT","award":["NRF-2017M3C4A7065960"],"award-info":[{"award-number":["NRF-2017M3C4A7065960"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2019,3,17]]},"DOI":"10.1145\/3301275.3302305","type":"proceedings-article","created":{"date-parts":[[2019,2,19]],"date-time":"2019-02-19T20:59:18Z","timestamp":1550609958000},"page":"558-569","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":10,"title":["Popup"],"prefix":"10.1145","author":[{"given":"Jean Y.","family":"Song","sequence":"first","affiliation":[{"name":"University of Michigan"}]},{"given":"Stephan J.","family":"Lemmer","sequence":"additional","affiliation":[{"name":"University of Michigan"}]},{"given":"Michael Xieyang","family":"Liu","sequence":"additional","affiliation":[{"name":"Carnegie Mellon University"}]},{"given":"Shiyan","family":"Yan","sequence":"additional","affiliation":[{"name":"University of Michigan"}]},{"given":"Juho","family":"Kim","sequence":"additional","affiliation":[{"name":"KAIST, Daejeon, Republic of Korea"}]},{"given":"Jason J.","family":"Corso","sequence":"additional","affiliation":[{"name":"University of Michigan"}]},{"given":"Walter S.","family":"Lasecki","sequence":"additional","affiliation":[{"name":"University of Michigan"}]}],"member":"320","published-online":{"date-parts":[[2019,3,17]]},"reference":[{"key":"e_1_3_2_2_1_1","unstructured":"2017. Inside Waymo's Secret World for Training Self-Driving Cars. https:\/\/www.theatlantic.com\/technology\/archive\/2017\/08\/inside-waymos-secret-testing-and-simulation-facilities\/537648\/.  2017. Inside Waymo's Secret World for Training Self-Driving Cars. https:\/\/www.theatlantic.com\/technology\/archive\/2017\/08\/inside-waymos-secret-testing-and-simulation-facilities\/537648\/."},{"key":"e_1_3_2_2_2_1","unstructured":"2018. Waymo Has The Most Autonomous Miles By A Lot. https:\/\/www.forbes.com\/sites\/davidsilver\/2018\/07\/26\/waymo-has-the-most-autonomous-miles-by-a-lot\/.  2018. Waymo Has The Most Autonomous Miles By A Lot. https:\/\/www.forbes.com\/sites\/davidsilver\/2018\/07\/26\/waymo-has-the-most-autonomous-miles-by-a-lot\/."},{"key":"e_1_3_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/2461912.2462002"},{"key":"e_1_3_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/2047196.2047201"},{"key":"e_1_3_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/1866029.1866080"},{"key":"e_1_3_2_2_6_1","volume-title":"Davide Del Testa","author":"Bojarski Mariusz","year":"2016","unstructured":"Mariusz Bojarski , Davide Del Testa , Daniel Dworakowski, Bernhard Firner , Beat Flepp, Prasoon Goyal, Lawrence D Jackel, Mathew Monfort, Urs Muller, Jiakai Zhang, et al. 2016 . End to end learning for self-driving cars. arXiv preprint arXiv:1604.07316 (2016). Mariusz Bojarski, Davide Del Testa, Daniel Dworakowski, Bernhard Firner, Beat Flepp, Prasoon Goyal, Lawrence D Jackel, Mathew Monfort, Urs Muller, Jiakai Zhang, et al. 2016. End to end learning for self-driving cars. arXiv preprint arXiv:1604.07316 (2016)."},{"volume-title":"First AAAI conference on human computation and crowdsourcing.","author":"Bragg Jonathan","key":"e_1_3_2_2_7_1","unstructured":"Jonathan Bragg , Mausam, and Daniel S. Weld . 2013. Crowdsourcing multi-label classification for taxonomy creation . In First AAAI conference on human computation and crowdsourcing. Jonathan Bragg, Mausam, and Daniel S. Weld. 2013. Crowdsourcing multi-label classification for taxonomy creation. In First AAAI conference on human computation and crowdsourcing."},{"key":"e_1_3_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.5555\/1949767.1949885"},{"key":"e_1_3_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3026044"},{"key":"e_1_3_2_2_10_1","volume-title":"Maximum likelihood estimation of observer error-rates using the EM algorithm. Applied statistics","author":"Dawid Alexander Philip","year":"1979","unstructured":"Alexander Philip Dawid and Allan M Skene . 1979. Maximum likelihood estimation of observer error-rates using the EM algorithm. Applied statistics ( 1979 ), 20--28. Alexander Philip Dawid and Allan M Skene. 1979. Maximum likelihood estimation of observer error-rates using the EM algorithm. Applied statistics (1979), 20--28."},{"key":"e_1_3_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/2501105.2501113"},{"key":"e_1_3_2_2_12_1","volume-title":"CARLA: An open urban driving simulator. arXiv preprint arXiv:1711.03938","author":"Dosovitskiy Alexey","year":"2017","unstructured":"Alexey Dosovitskiy , German Ros , Felipe Codevilla , Antonio Lopez , and Vladlen Koltun . 2017 . CARLA: An open urban driving simulator. arXiv preprint arXiv:1711.03938 (2017). Alexey Dosovitskiy, German Ros, Felipe Codevilla, Antonio Lopez, and Vladlen Koltun. 2017. CARLA: An open urban driving simulator. arXiv preprint arXiv:1711.03938 (2017)."},{"volume-title":"Design for Teaching and Learning in a Networked World","author":"Gadiraju Ujwal","key":"e_1_3_2_2_13_1","unstructured":"Ujwal Gadiraju , Besnik Fetahu , and Ricardo Kawase . 2015. Training workers for improving performance in crowdsourcing microtasks . In Design for Teaching and Learning in a Networked World . Springer , 100--114. Ujwal Gadiraju, Besnik Fetahu, and Ricardo Kawase. 2015. Training workers for improving performance in crowdsourcing microtasks. In Design for Teaching and Learning in a Networked World. Springer, 100--114."},{"key":"e_1_3_2_2_14_1","volume-title":"The KITTI Vision Benchmark Suite. In Conference on Computer Vision and Pattern Recognition (CVPR).","author":"Geiger Andreas","year":"2012","unstructured":"Andreas Geiger , Philip Lenz , and Raquel Urtasun . 2012 . Are we ready for Autonomous Driving? The KITTI Vision Benchmark Suite. In Conference on Computer Vision and Pattern Recognition (CVPR). Andreas Geiger, Philip Lenz, and Raquel Urtasun. 2012. Are we ready for Autonomous Driving? The KITTI Vision Benchmark Suite. In Conference on Computer Vision and Pattern Recognition (CVPR)."},{"key":"e_1_3_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/2815585.2815729"},{"key":"e_1_3_2_2_16_1","volume-title":"Odest Chadwicke Jenkins, and Walter S Lasecki","author":"Gouravajhala Sai R","year":"2018","unstructured":"Sai R Gouravajhala , Jinyeong Yim , Karthik Desingh , Yanda Huang , Odest Chadwicke Jenkins, and Walter S Lasecki . 2018 . EURECA : Enhanced Understanding of Real Environments via Crowd Assistance . (2018). Sai R Gouravajhala, Jinyeong Yim, Karthik Desingh, Yanda Huang, Odest Chadwicke Jenkins, and Walter S Lasecki. 2018. EURECA: Enhanced Understanding of Real Environments via Crowd Assistance. (2018)."},{"key":"e_1_3_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/2642918.2647403"},{"key":"e_1_3_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/1837885.1837906"},{"key":"e_1_3_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.tra.2016.09.010"},{"key":"e_1_3_2_2_20_1","volume-title":"Proceedings of the 11th International Conference on Autonomous Agents and Multiagent Systems. International Foundation for Autonomous Agents and Multiagent Systems, 467--474","author":"Kamar Ece","year":"2012","unstructured":"Ece Kamar , Severin Hacker , and Eric Horvitz . 2012 . Combining human and machine intelligence in large-scale crowdsourcing . In Proceedings of the 11th International Conference on Autonomous Agents and Multiagent Systems. International Foundation for Autonomous Agents and Multiagent Systems, 467--474 . Ece Kamar, Severin Hacker, and Eric Horvitz. 2012. Combining human and machine intelligence in large-scale crowdsourcing. In Proceedings of the 11th International Conference on Autonomous Agents and Multiagent Systems. International Foundation for Autonomous Agents and Multiagent Systems, 467--474."},{"key":"e_1_3_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173685"},{"key":"e_1_3_2_2_22_1","volume-title":"Proceedings of the AAAI Conference on Human Computation (HCOMP","volume":"17","author":"Kaur Harmanpreet","year":"2017","unstructured":"Harmanpreet Kaur , Mitchell Gordon , Yiwei Yang , Jeffrey P Bigham , Jaime Teevan , Ece Kamar , and Walter S Lasecki . 2017 . Crowdmask: Using crowds to preserve privacy in crowd-powered systems via progressive filtering . In Proceedings of the AAAI Conference on Human Computation (HCOMP 2017)., HCOMP, Vol. 17 . Harmanpreet Kaur, Mitchell Gordon, Yiwei Yang, Jeffrey P Bigham, Jaime Teevan, Ece Kamar, and Walter S Lasecki. 2017. Crowdmask: Using crowds to preserve privacy in crowd-powered systems via progressive filtering. In Proceedings of the AAAI Conference on Human Computation (HCOMP 2017)., HCOMP, Vol. 17."},{"key":"e_1_3_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/2556288.2556986"},{"key":"e_1_3_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/2441776.2441923"},{"key":"e_1_3_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-016-0981-7"},{"key":"e_1_3_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/GMAI.2006.34"},{"key":"e_1_3_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702416"},{"key":"e_1_3_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/2642918.2647367"},{"key":"e_1_3_2_2_29_1","volume-title":"Architecting real-time crowd-powered systems. Human Computation 1, 1","author":"Lasecki Walter S","year":"2014","unstructured":"Walter S Lasecki , Christopher Homan , and Jeffrey P Bigham . 2014. Architecting real-time crowd-powered systems. Human Computation 1, 1 ( 2014 ). Walter S Lasecki, Christopher Homan, and Jeffrey P Bigham. 2014. Architecting real-time crowd-powered systems. Human Computation 1, 1 (2014)."},{"key":"e_1_3_2_2_30_1","volume-title":"Tuning the Diversity of Open-Ended Responses From the Crowd. In Second AAAI Conference on Human Computation and Crowdsourcing.","author":"Lasecki Walter S","year":"2014","unstructured":"Walter S Lasecki , Christopher M Homan , and Jeffrey L Bigham . 2014 . Tuning the Diversity of Open-Ended Responses From the Crowd. In Second AAAI Conference on Human Computation and Crowdsourcing. Walter S Lasecki, Christopher M Homan, and Jeffrey L Bigham. 2014. Tuning the Diversity of Open-Ended Responses From the Crowd. In Second AAAI Conference on Human Computation and Crowdsourcing."},{"key":"e_1_3_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/2047196.2047200"},{"key":"e_1_3_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/2441776.2441912"},{"key":"e_1_3_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/2501988.2502057"},{"key":"e_1_3_2_2_34_1","volume-title":"AAAI Conference on Artificial Intelligence.","author":"Lin Christopher","year":"2012","unstructured":"Christopher Lin , Mausam Mausam , and Daniel Weld . 2012 . Dynamically Switching between Synergistic workflows for Crowdsourcing . In AAAI Conference on Artificial Intelligence. Christopher Lin, Mausam Mausam, and Daniel Weld. 2012. Dynamically Switching between Synergistic workflows for Crowdsourcing. In AAAI Conference on Artificial Intelligence."},{"key":"e_1_3_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-10602-1_48"},{"key":"e_1_3_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1609\/hcomp.v1i1.13075"},{"key":"e_1_3_2_2_37_1","volume-title":"FastSLAM: A scalable method for the simultaneous localization and mapping problem in robotics","author":"Montemerlo Michael","year":"2007","unstructured":"Michael Montemerlo and Sebastian Thrun . 2007. Fast SLAM 2.0. FastSLAM: A scalable method for the simultaneous localization and mapping problem in robotics ( 2007 ), 63--90. Michael Montemerlo and Sebastian Thrun. 2007. FastSLAM 2.0. FastSLAM: A scalable method for the simultaneous localization and mapping problem in robotics (2007), 63--90."},{"key":"e_1_3_2_2_38_1","unstructured":"Michael Montemerlo Sebastian Thrun Daphne Koller Ben Wegbreit etal 2002. FastSLAM: A factored solution to the simultaneous localization and mapping problem. Aaai\/iaai 593598 (2002).   Michael Montemerlo Sebastian Thrun Daphne Koller Ben Wegbreit et al. 2002. FastSLAM: A factored solution to the simultaneous localization and mapping problem. Aaai\/iaai 593598 (2002)."},{"key":"e_1_3_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1080\/14786443208647909"},{"key":"e_1_3_2_2_40_1","unstructured":"Kenji Oka Yoichi Sato Yasuto Nakanishi and Hideki Koike. 2005. Head Pose Estimation System Based on Particle Filtering with Adaptive Diffusion Control.. In MVA. 586--589.  Kenji Oka Yoichi Sato Yasuto Nakanishi and Hideki Koike. 2005. Head Pose Estimation System Based on Particle Filtering with Adaptive Diffusion Control.. In MVA. 586--589."},{"key":"e_1_3_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/2390803.2390816"},{"key":"e_1_3_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2017.02.018"},{"key":"e_1_3_2_2_43_1","volume-title":"Proceedings of the AAAI 2018 Conference on Human Computation. ACM.","author":"Rao Akshay","year":"2018","unstructured":"Akshay Rao , Harmanpreet Kaur , and Walter S Lasecki . 2018 . Plexiglass: Multiplexing Passive and Active Tasks for More Efficient Crowdsourcing . In Proceedings of the AAAI 2018 Conference on Human Computation. ACM. Akshay Rao, Harmanpreet Kaur, and Walter S Lasecki. 2018. Plexiglass: Multiplexing Passive and Active Tasks for More Efficient Crowdsourcing. In Proceedings of the AAAI 2018 Conference on Human Computation. ACM."},{"key":"e_1_3_2_2_44_1","unstructured":"Nihar Bhadresh Shah and Denny Zhou. 2015. Double or nothing: Multiplicative incentive mechanisms for crowdsourcing. In Advances in neural information processing systems. 1--9.   Nihar Bhadresh Shah and Denny Zhou. 2015. Double or nothing: Multiplicative incentive mechanisms for crowdsourcing. In Advances in neural information processing systems. 1--9."},{"key":"e_1_3_2_2_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/3172944.3172948"},{"key":"e_1_3_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1109\/IROS.2010.5650464"},{"key":"e_1_3_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.308"},{"key":"e_1_3_2_2_48_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.177"},{"key":"e_1_3_2_2_49_1","unstructured":"Sebastian Thrun. 2000. Monte Carlo POMDPs. In Advances in neural information processing systems. 1064--1070.   Sebastian Thrun. 2000. Monte Carlo POMDPs. In Advances in neural information processing systems. 1064--1070."},{"key":"e_1_3_2_2_50_1","volume-title":"Fast Quasi-Newton Algorithms for Penalized Reconstruction in Emission Tomography and Further Improvements via Preconditioning","author":"Tsai Yu-Jung","year":"2018","unstructured":"Yu-Jung Tsai , Alexandre Bousse , Matthias J Ehrhardt , Charles W Stearns , Sangtae Ahn , Brian F Hutton , Simon Arridge , and Kris Thielemans . 2018. Fast Quasi-Newton Algorithms for Penalized Reconstruction in Emission Tomography and Further Improvements via Preconditioning . IEEE transactions on medical imaging 37, 4 ( 2018 ), 1000--1010. Yu-Jung Tsai, Alexandre Bousse, Matthias J Ehrhardt, Charles W Stearns, Sangtae Ahn, Brian F Hutton, Simon Arridge, and Kris Thielemans. 2018. Fast Quasi-Newton Algorithms for Penalized Reconstruction in Emission Tomography and Further Improvements via Preconditioning. IEEE transactions on medical imaging 37, 4 (2018), 1000--1010."},{"key":"e_1_3_2_2_51_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-012-0564-1"},{"key":"e_1_3_2_2_52_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2003.815165"},{"key":"e_1_3_2_2_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/2818052.2874339"},{"key":"e_1_3_2_2_54_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2009.5459289"},{"key":"e_1_3_2_2_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/279232.279236"}],"event":{"name":"IUI '19: 24th International Conference on Intelligent User Interfaces","sponsor":["SIGAI ACM Special Interest Group on Artificial Intelligence","SIGCHI ACM Special Interest Group on Computer-Human Interaction"],"location":"Marina del Ray California","acronym":"IUI '19"},"container-title":["Proceedings of the 24th International Conference on Intelligent User Interfaces"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3301275.3302305","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3301275.3302305","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T00:58:02Z","timestamp":1750208282000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3301275.3302305"}},"subtitle":["reconstructing 3D video using particle filtering to aggregate crowd responses"],"short-title":[],"issued":{"date-parts":[[2019,3,17]]},"references-count":55,"alternative-id":["10.1145\/3301275.3302305","10.1145\/3301275"],"URL":"https:\/\/doi.org\/10.1145\/3301275.3302305","relation":{},"subject":[],"published":{"date-parts":[[2019,3,17]]},"assertion":[{"value":"2019-03-17","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}