{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,9]],"date-time":"2026-01-09T13:01:54Z","timestamp":1767963714954,"version":"3.49.0"},"reference-count":55,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2018,1,8]],"date-time":"2018-01-08T00:00:00Z","timestamp":1515369600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["CPS-1239552"],"award-info":[{"award-number":["CPS-1239552"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100004805","name":"California Energy Commission","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100004805","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Interact. Mob. Wearable Ubiquitous Technol."],"published-print":{"date-parts":[[2018,1,8]]},"abstract":"<jats:p>As the number and heterogeneity of appliances in smart buildings increases, identifying and controlling them becomes challenging. Existing methods face various challenges when deployed in large commercial buildings. For example, voice command assistants require users to memorize many control commands. Attaching Bluetooth dongles or QR codes to appliances introduces considerable deployment overhead. In comparison, identifying an appliance by simply pointing a smartphone camera at it and controlling the appliance using a graphical overlay interface is more intuitive. We introduce SnapLink, a responsive and accurate vision-based system for mobile appliance identification and interaction using image localization. Compared to the image retrieval approaches used in previous vision-based appliance control systems, SnapLink exploits 3D models to improve identification accuracy and reduce deployment overhead via quick video captures and a simplified labeling process. We also introduce a feature sub-sampling mechanism to achieve low latency at the scale of a commercial building. To evaluate SnapLink, we collected training videos from 39 rooms to represent the scale of a modern commercial building. It achieves a 94% successful appliance identification rate among 1526 test images of 179 appliances within 120 ms average server processing time. Furthermore, we show that SnapLink is robust to viewing angle and distance differences, illumination changes, as well as daily changes in the environment. We believe the SnapLink use case is not limited to appliance control: it has the potential to enable various new smart building applications.<\/jats:p>","DOI":"10.1145\/3161173","type":"journal-article","created":{"date-parts":[[2018,1,9]],"date-time":"2018-01-09T13:26:11Z","timestamp":1515504371000},"page":"1-27","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":20,"title":["SnapLink"],"prefix":"10.1145","volume":"1","author":[{"given":"Kaifei","family":"Chen","sequence":"first","affiliation":[{"name":"University of California Berkeley, USA"}]},{"given":"Jonathan","family":"F\u00fcrst","sequence":"additional","affiliation":[{"name":"IT University of Copenhagen, Denmark"}]},{"given":"John","family":"Kolb","sequence":"additional","affiliation":[{"name":"University of California Berkeley, USA"}]},{"given":"Hyung-Sin","family":"Kim","sequence":"additional","affiliation":[{"name":"University of California Berkeley, USA"}]},{"given":"Xin","family":"Jin","sequence":"additional","affiliation":[{"name":"Johns Hopkins University, USA"}]},{"given":"David E.","family":"Culler","sequence":"additional","affiliation":[{"name":"University of California Berkeley, USA"}]},{"given":"Randy H.","family":"Katz","sequence":"additional","affiliation":[{"name":"University of California Berkeley, USA"}]}],"member":"320","published-online":{"date-parts":[[2018,1,8]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/2001269.2001293"},{"key":"e_1_2_2_2_1","volume-title":"Enabling synergy in iot: Platform to service and beyond. Journal of Network and Computer Applications","author":"Andersen Michael P","year":"2016","unstructured":"Michael P Andersen , Gabe Fierro , and David E Culler . 2016. Enabling synergy in iot: Platform to service and beyond. Journal of Network and Computer Applications ( 2016 ). Michael P Andersen, Gabe Fierro, and David E Culler. 2016. Enabling synergy in iot: Platform to service and beyond. Journal of Network and Computer Applications (2016)."},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/2993422.2993577"},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/2517351.2517370"},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1007\/11744023_32"},{"key":"e_1_2_2_6_1","volume-title":"\u201cO'Reilly Media","author":"Bradski Gary","unstructured":"Gary Bradski and Adrian Kaehler . 2008. Learning OpenCV: Computer vision with the OpenCV library. \u201cO'Reilly Media , Inc .\u201d. Gary Bradski and Adrian Kaehler. 2008. Learning OpenCV: Computer vision with the OpenCV library. \u201cO'Reilly Media, Inc.\u201d."},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/1869983.1870003"},{"key":"e_1_2_2_8_1","volume-title":"Presented as part of the 10th USENIX Symposium on Networked Systems Design and Implementation (NSDI 13). 443--457.","author":"Dawson-Haggerty Stephen","unstructured":"Stephen Dawson-Haggerty , Andrew Krioukov , Jay Taneja , Sagar Karandikar , Gabe Fierro , Nikita Kitaev , and David Culler . 2013. BOSS: building operating system services . In Presented as part of the 10th USENIX Symposium on Networked Systems Design and Implementation (NSDI 13). 443--457. Stephen Dawson-Haggerty, Andrew Krioukov, Jay Taneja, Sagar Karandikar, Gabe Fierro, Nikita Kitaev, and David Culler. 2013. BOSS: building operating system services. In Presented as part of the 10th USENIX Symposium on Networked Systems Design and Implementation (NSDI 13). 443--457."},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858177"},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"e_1_2_2_11_1","doi-asserted-by":"crossref","unstructured":"Michael Deru Kristin Field Daniel Studer Kyle Benne Brent Griffith Paul Torcellini Bing Liu Mark Halverson Dave Winiarski Michael Rosenberg etal 2011. US Department of Energy commercial reference building models of the national building stock. (2011).  Michael Deru Kristin Field Daniel Studer Kyle Benne Brent Griffith Paul Torcellini Bing Liu Mark Halverson Dave Winiarski Michael Rosenberg et al. 2011. US Department of Energy commercial reference building models of the national building stock. (2011).","DOI":"10.2172\/1009264"},{"key":"e_1_2_2_12_1","volume-title":"https:\/\/www.amazon.com\/Amazon-Echo-Bluetooth-Speaker-with-WiFi-Alexa\/dp\/B00X4WHP5E","author":"Echo Amazon","year":"2016","unstructured":"echo 2016. Amazon Echo . ( 2016 ). https:\/\/www.amazon.com\/Amazon-Echo-Bluetooth-Speaker-with-WiFi-Alexa\/dp\/B00X4WHP5E echo 2016. Amazon Echo. (2016). https:\/\/www.amazon.com\/Amazon-Echo-Bluetooth-Speaker-with-WiFi-Alexa\/dp\/B00X4WHP5E"},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/1878431.1878434"},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/2461381.2461399"},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1016\/0378-7788(94)90011-6"},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10462-012-9365-8"},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/IoTDI.2015.35"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/2668332.2668380"},{"key":"e_1_2_2_19_1","volume-title":"The usage of digital cameras as luminance meters. Germany","author":"Gabele Helke","year":"2006","unstructured":"Helke Gabele and D W\u00fcller . 2006. The usage of digital cameras as luminance meters. Germany , Cologne : University of Applied Sciences Cologne , Diploma Thesis ( 2006 ). Helke Gabele and D W\u00fcller. 2006. The usage of digital cameras as luminance meters. Germany, Cologne: University of Applied Sciences Cologne, Diploma Thesis (2006)."},{"key":"e_1_2_2_20_1","unstructured":"Fabian Gieseke Justin Heinermann Cosmin E Oancea and Christian Igel. 2014. Buffer kd Trees: Processing Massive Nearest Neighbor Queries on GPUs.. In ICML. 172--180.  Fabian Gieseke Justin Heinermann Cosmin E Oancea and Christian Igel. 2014. Buffer kd Trees: Processing Massive Nearest Neighbor Queries on GPUs.. In ICML. 172--180."},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/2699343.2699351"},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/2742647.2742666"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/2999572.2999587"},{"key":"e_1_2_2_24_1","first-page":"304","article-title":"Hamming embedding and weak geometric consistency for large scale image search","volume":"2008","author":"Jegou Herve","year":"2008","unstructured":"Herve Jegou , Matthijs Douze , and Cordelia Schmid . 2008 . Hamming embedding and weak geometric consistency for large scale image search . Computer Vision--ECCV 2008 (2008), 304 -- 317 . Herve Jegou, Matthijs Douze, and Cordelia Schmid. 2008. Hamming embedding and weak geometric consistency for large scale image search. Computer Vision--ECCV 2008 (2008), 304--317.","journal-title":"Computer Vision--ECCV"},{"key":"e_1_2_2_25_1","unstructured":"I Poupyrev H Kato Mark Billinghurst and Ivan Poupyrev. 2000. Artoolkit user manual version 2.33. Human Interface Technology Lab University of Washington 2 (2000).  I Poupyrev H Kato Mark Billinghurst and Ivan Poupyrev. 2000. Artoolkit user manual version 2.33. Human Interface Technology Lab University of Washington 2 (2000)."},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/DICTA.2011.90"},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/1971519.1971593"},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/2971648.2971651"},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/2422531.2422546"},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/TRO.2013.2242375"},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/5.726791"},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-09861-6_5"},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/2737095.2737726"},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-10584-0_40"},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/2494091.2494168"},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/1476589.1476628"},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2014.2321376"},{"key":"e_1_2_2_38_1","volume-title":"Usability engineering","author":"Nielsen Jakob","unstructured":"Jakob Nielsen . 1994. Usability engineering . Elsevier . Jakob Nielsen. 1994. Usability engineering. Elsevier."},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA.2011.5979561"},{"key":"e_1_2_2_40_1","volume-title":"UbiComp 2003: Ubiquitous Computing","author":"Patel Shwetak N","unstructured":"Shwetak N Patel and Gregory D Abowd . 2003. A 2-way laser-assisted selection scheme for handhelds in a physical environment . In UbiComp 2003: Ubiquitous Computing . Springer , 200--207. Shwetak N Patel and Gregory D Abowd. 2003. A 2-way laser-assisted selection scheme for handhelds in a physical environment. In UbiComp 2003: Ubiquitous Computing. Springer, 200--207."},{"key":"e_1_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2007.383172"},{"key":"e_1_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2008.4587635"},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/2500423.2500436"},{"key":"e_1_2_2_44_1","first-page":"774","article-title":"Linear n-point camera pose determination. Pattern Analysis and Machine Intelligence","volume":"21","author":"Quan Long","year":"1999","unstructured":"Long Quan and Zhongdan Lan . 1999 . Linear n-point camera pose determination. Pattern Analysis and Machine Intelligence , IEEE Transactions on 21 , 8 (1999), 774 -- 780 . Long Quan and Zhongdan Lan. 1999. Linear n-point camera pose determination. Pattern Analysis and Machine Intelligence, IEEE Transactions on 21, 8 (1999), 774--780.","journal-title":"IEEE Transactions on"},{"key":"e_1_2_2_45_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA.2011.5980567"},{"key":"e_1_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2011.6126302"},{"key":"e_1_2_2_47_1","volume-title":"Video Google: A text retrieval approach to object matching in videos. In null","author":"Sivic Josef","year":"2003","unstructured":"Josef Sivic and Andrew Zisserman . 2003 . Video Google: A text retrieval approach to object matching in videos. In null . IEEE , 1470. Josef Sivic and Andrew Zisserman. 2003. Video Google: A text retrieval approach to object matching in videos. In null. IEEE, 1470."},{"key":"e_1_2_2_48_1","volume-title":"https:\/\/get.google.com\/tango\/","author":"Tango Project","year":"2016","unstructured":"tango 2016. Project Tango . ( 2016 ). https:\/\/get.google.com\/tango\/ tango 2016. Project Tango. (2016). https:\/\/get.google.com\/tango\/"},{"key":"e_1_2_2_49_1","doi-asserted-by":"publisher","DOI":"10.1109\/IEMBS.2011.6091309"},{"key":"e_1_2_2_50_1","volume-title":"Computer Symposium (ICS)","author":"Shyi Chia-Nian","year":"2010","unstructured":"Jian-tung Wang, Chia-Nian Shyi , T-W Hou , and CP Fong . 2010 . Design and implementation of augmented reality system collaborating with QR code . In Computer Symposium (ICS) , 2010 International. IEEE, 414--418. Jian-tung Wang, Chia-Nian Shyi, T-W Hou, and CP Fong. 2010. Design and implementation of augmented reality system collaborating with QR code. In Computer Symposium (ICS), 2010 International. IEEE, 414--418."},{"key":"e_1_2_2_51_1","doi-asserted-by":"publisher","DOI":"10.1109\/MIC.2009.52"},{"key":"e_1_2_2_52_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2013.458"},{"key":"e_1_2_2_53_1","unstructured":"zbar 2017. ZBar bar code reader. (2017). http:\/\/zbar.sourceforge.net\/  zbar 2017. ZBar bar code reader. (2017). http:\/\/zbar.sourceforge.net\/"},{"key":"e_1_2_2_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/2659766.2659773"},{"key":"e_1_2_2_55_1","volume-title":"SIFT meets CNN: A decade survey of instance retrieval","author":"Zheng Liang","year":"2017","unstructured":"Liang Zheng , Yi Yang , and Qi Tian . 2017. SIFT meets CNN: A decade survey of instance retrieval . IEEE Transactions on Pattern Analysis and Machine Intelligence ( 2017 ). Liang Zheng, Yi Yang, and Qi Tian. 2017. SIFT meets CNN: A decade survey of instance retrieval. IEEE Transactions on Pattern Analysis and Machine Intelligence (2017)."}],"container-title":["Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3161173","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3161173","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3161173","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T02:13:30Z","timestamp":1750212810000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3161173"}},"subtitle":["Fast and Accurate Vision-Based Appliance Control in Large Commercial Buildings"],"short-title":[],"issued":{"date-parts":[[2018,1,8]]},"references-count":55,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2018,1,8]]}},"alternative-id":["10.1145\/3161173"],"URL":"https:\/\/doi.org\/10.1145\/3161173","relation":{},"ISSN":["2474-9567"],"issn-type":[{"value":"2474-9567","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,1,8]]},"assertion":[{"value":"2017-02-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2017-10-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2018-01-08","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}