{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,4]],"date-time":"2026-05-04T13:00:48Z","timestamp":1777899648181,"version":"3.51.4"},"publisher-location":"New York, NY, USA","reference-count":76,"publisher":"ACM","license":[{"start":{"date-parts":[[2024,9,11]],"date-time":"2024-09-11T00:00:00Z","timestamp":1726012800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2024,9,11]]},"DOI":"10.1145\/3650212.3680315","type":"proceedings-article","created":{"date-parts":[[2024,9,11]],"date-time":"2024-09-11T11:44:25Z","timestamp":1726055065000},"page":"717-729","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":8,"title":["Towards Automatic Oracle Prediction for AR Testing: Assessing Virtual Object Placement Quality under Real-World Scenes"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0009-0001-2084-867X","authenticated-orcid":false,"given":"Xiaoyi","family":"Yang","sequence":"first","affiliation":[{"name":"Rochester Institute of Technology, Rochester, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6484-454X","authenticated-orcid":false,"given":"Yuxing","family":"Wang","sequence":"additional","affiliation":[{"name":"Rochester Institute of Technology, Rochester, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4006-8731","authenticated-orcid":false,"given":"Tahmid","family":"Rafi","sequence":"additional","affiliation":[{"name":"University of Texas at San Antonio, San Antonio, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6995-4775","authenticated-orcid":false,"given":"Dongfang","family":"Liu","sequence":"additional","affiliation":[{"name":"Rochester Institute of Technology, Rochester, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9079-5534","authenticated-orcid":false,"given":"Xiaoyin","family":"Wang","sequence":"additional","affiliation":[{"name":"University of Texas at San Antonio, San Antonio, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3156-906X","authenticated-orcid":false,"given":"Xueling","family":"Zhang","sequence":"additional","affiliation":[{"name":"Rochester Institute of Technology, Rochester, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2024,9,11]]},"reference":[{"key":"e_1_3_2_1_1_1","unstructured":"2015. Vuforia. https:\/\/www.ptc.com\/en\/products\/vuforia"},{"key":"e_1_3_2_1_2_1","unstructured":"2015. Wikitude. https:\/\/www.wikitude.com\/"},{"key":"e_1_3_2_1_3_1","unstructured":"2018. Apple ARKit. https:\/\/developer.apple.com\/augmented-reality\/"},{"key":"e_1_3_2_1_4_1","unstructured":"2018. MarketsandMarkets. https:\/\/www.marketsandmarkets.com\/Market-Reports\/augmented-reality-virtual-reality-market-1185.html"},{"key":"e_1_3_2_1_5_1","unstructured":"2018. Microsoft Hololens. https:\/\/www.microsoft.com\/en-us\/hololens"},{"key":"e_1_3_2_1_6_1","unstructured":"2018. Oculus Rift. https:\/\/www.oculus.com\/"},{"key":"e_1_3_2_1_7_1","unstructured":"2020. Sceneform. https:\/\/developers.google.com\/sceneform\/develop"},{"key":"e_1_3_2_1_8_1","unstructured":"2020. Unity MARS. https:\/\/unity.com\/products\/unity-mars"},{"key":"e_1_3_2_1_9_1","unstructured":"2021. Google AR Core. https:\/\/developers.google.com\/ar"},{"key":"e_1_3_2_1_10_1","unstructured":"2021. Recording and playback introduction. https:\/\/developers.google.com\/ar\/develop\/recording-and-playback"},{"key":"e_1_3_2_1_11_1","unstructured":"2022. AR Apps.. http:\/\/bit.ly\/GooglePlay_ArApps"},{"key":"e_1_3_2_1_12_1","unstructured":"2022. AR Games.. http:\/\/bit.ly\/GooglePlay_ArGames"},{"key":"e_1_3_2_1_13_1","unstructured":"2023. Amazon\u2019s AR Tool is a useful way to see products before you buy them. https:\/\/www.dailydot.com\/debug\/amazon-ar-view-app\/"},{"key":"e_1_3_2_1_14_1","unstructured":"2023. Android Debug Bridge. https:\/\/developer.android.com\/tools\/adb"},{"key":"e_1_3_2_1_15_1","unstructured":"2023. Avoid The Dreaded Ikea Fight With This New App. https:\/\/www.fastcompany.com\/90143908\/avoid-killing-your-relationship-at-ikea-with-this-new-app"},{"key":"e_1_3_2_1_16_1","unstructured":"2023. Filters on Google Play. https:\/\/developer.android.com\/google\/play\/filters Google Play Filter"},{"key":"e_1_3_2_1_17_1","unstructured":"2023. Get discovered on Google Play search. https:\/\/support.google.com\/googleplay\/android-developer\/answer\/4448378?hl=en Google Play Search"},{"key":"e_1_3_2_1_18_1","unstructured":"2023. Get the lighting right. https:\/\/developers.google.com\/ar\/develop\/lighting-estimation"},{"key":"e_1_3_2_1_19_1","unstructured":"2023. Google Translate . https:\/\/play.google.com\/store\/apps\/details?id=com.google.android.apps.translate&hl=en_US&gl=US"},{"key":"e_1_3_2_1_20_1","unstructured":"2023. Hit-tests place virtual objects in the real world. https:\/\/developers.google.com\/ar\/develop\/hit-test"},{"key":"e_1_3_2_1_21_1","unstructured":"2023. HitResult. https:\/\/developers.google.com\/ar\/reference\/java\/com\/google\/ar\/core\/HitResult"},{"key":"e_1_3_2_1_22_1","unstructured":"2023. IKEA Place . https:\/\/www.ikea.com\/au\/en\/customer-service\/mobile-apps\/say-hej-to-ikea-place-pub1f8af050"},{"key":"e_1_3_2_1_23_1","unstructured":"2023. IL2CPP Overview. https:\/\/docs.unity3d.com\/Manual\/IL2CPP.html IL2CPP"},{"key":"e_1_3_2_1_24_1","unstructured":"2023. Light Meter LM-3000. https:\/\/apps.apple.com\/us\/app\/light-meter-lm-3000\/id1554264761"},{"key":"e_1_3_2_1_25_1","unstructured":"2023. Pok\u00e9mon Go . https:\/\/pokemongolive.com\/?hl=en"},{"key":"e_1_3_2_1_26_1","unstructured":"2023. Screenshot touch. https:\/\/play.google.com\/store\/apps\/details?id=com.mdiwebma.screenshot&hl=en_US&gl=US"},{"key":"e_1_3_2_1_27_1","unstructured":"2023. Snapchat Lenses . https:\/\/lens.snapchat.com\/?locale=en-US"},{"key":"e_1_3_2_1_28_1","unstructured":"2023. VOPA: Virtual Object Placement Assessment. https:\/\/sites.google.com\/view\/vopa-for-artesting\/home VOPA"},{"key":"e_1_3_2_1_29_1","unstructured":"2023. Working with Anchors. https:\/\/developers.google.com\/ar\/develop\/anchors"},{"key":"e_1_3_2_1_30_1","unstructured":"Amazon. 2005. Amazon Mechanical Turk. https:\/\/www.mturk.com"},{"key":"e_1_3_2_1_31_1","unstructured":"Amazon. 2005. Amazon Mechanical Turk. https:\/\/www.mturk.com\/"},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2014.2372785"},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"crossref","unstructured":"Ke Chen Yufei Li Yingfeng Chen Changjie Fan Zhipeng Hu and Wei Yang. 2021. Glib: towards automated test oracle for graphically-rich applications. 1093\u20131104.","DOI":"10.20944\/preprints202107.0386.v1"},{"key":"e_1_3_2_1_34_1","unstructured":"Tsong Y Chen Shing C Cheung and Shiu Ming Yiu. 2020. Metamorphic testing: a new approach for generating next test cases. arXiv preprint arXiv:2002.12543."},{"key":"e_1_3_2_1_35_1","volume-title":"Tf-blender: Temporal feature blender for video object detection. 8138\u20138147.","author":"Cui Yiming","year":"2021","unstructured":"Yiming Cui, Liqi Yan, Zhiwen Cao, and Dongfang Liu. 2021. Tf-blender: Temporal feature blender for video object detection. 8138\u20138147."},{"key":"e_1_3_2_1_36_1","first-page":"3965","article-title":"Coatnet: Marrying convolution and attention for all data sizes","volume":"34","author":"Dai Zihang","year":"2021","unstructured":"Zihang Dai, Hanxiao Liu, Quoc V Le, and Mingxing Tan. 2021. Coatnet: Marrying convolution and attention for all data sizes. Advances in Neural Information Processing Systems, 34 (2021), 3965\u20133977.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_2_1_37_1","unstructured":"Google Developers. 2021. Frame. https:\/\/developers.google.com\/ar\/reference\/java\/com\/google\/ar\/core\/Frame"},{"key":"e_1_3_2_1_38_1","unstructured":"Google Developers. 2021. Pose. https:\/\/developers.google.com\/ar\/reference\/java\/com\/google\/ar\/core\/Pose"},{"key":"e_1_3_2_1_39_1","unstructured":"Google Developers. 2022. Overview of ARCore and supported development environments. https:\/\/developers.google.com\/ar\/develop"},{"key":"e_1_3_2_1_40_1","unstructured":"Google Developers. 2022. Perform hit-tests in your Android app. https:\/\/developers.google.com\/ar\/develop\/java\/hit-test\/developer-guide"},{"key":"e_1_3_2_1_41_1","unstructured":"Google Developers. 2023. Fundamental concepts. https:\/\/developers.google.com\/ar\/develop\/fundamentals"},{"key":"e_1_3_2_1_42_1","doi-asserted-by":"crossref","unstructured":"Elizabeth Dinella Gabriel Ryan Todd Mytkowicz and Shuvendu K Lahiri. 2022. TOGA: a neural method for test oracle generation. 2130\u20132141.","DOI":"10.1145\/3510003.3510141"},{"key":"e_1_3_2_1_43_1","volume-title":"Simultaneous localization and mapping: part I","author":"Durrant-Whyte Hugh","year":"2006","unstructured":"Hugh Durrant-Whyte and Tim Bailey. 2006. Simultaneous localization and mapping: part I. IEEE robotics & automation magazine, 13, 2 (2006), 99\u2013110."},{"key":"e_1_3_2_1_44_1","doi-asserted-by":"crossref","unstructured":"Afonso Fontes and Gregory Gay. 2021. Using machine learning to generate test oracles: a systematic literature review. 1\u201310.","DOI":"10.1145\/3472675.3473974"},{"key":"e_1_3_2_1_45_1","doi-asserted-by":"crossref","unstructured":"Gordon Fraser and Andreas Zeller. 2010. Mutation-driven generation of unit tests and oracles. 147\u2013158.","DOI":"10.1145\/1831708.1831728"},{"key":"e_1_3_2_1_46_1","doi-asserted-by":"crossref","unstructured":"Henry Fuchs Mark A Livingston Ramesh Raskar Kurtis Keller Jessica R Crawford Paul Rademacher Samuel H Drake and Anthony A Meyer. 1998. Augmented reality visualization for laparoscopic surgery. 934\u2013943.","DOI":"10.1007\/BFb0056282"},{"key":"e_1_3_2_1_47_1","unstructured":"Nidhi Gowdra Roopak Sinha Stephen MacDonell and WeiQi Yan. 2021. Maximum Categorical Cross Entropy (MCCE): A noise-robust alternative loss function to mitigate racial bias in Convolutional Neural Networks (CNNs) by reducing overfitting."},{"key":"e_1_3_2_1_48_1","unstructured":"Margherita Grandini Enrico Bagli and Giorgio Visani. 2020. Metrics for multi-class classification: an overview. arXiv preprint arXiv:2008.05756."},{"key":"e_1_3_2_1_49_1","doi-asserted-by":"publisher","unstructured":"Kaiming He Xiangyu Zhang Shaoqing Ren and Jian Sun. 2015. Deep Residual Learning for Image Recognition. https:\/\/doi.org\/10.48550\/ARXIV.1512.03385 10.48550\/ARXIV.1512.03385","DOI":"10.48550\/ARXIV.1512.03385"},{"key":"e_1_3_2_1_50_1","doi-asserted-by":"crossref","unstructured":"Hirokazu Kato and Mark Billinghurst. 1999. Marker tracking and hmd calibration for a video-based augmented reality conferencing system. 85\u201394.","DOI":"10.1109\/IWAR.1999.803809"},{"key":"e_1_3_2_1_51_1","volume-title":"Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980.","author":"Kingma Diederik P","year":"2014","unstructured":"Diederik P Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980."},{"key":"e_1_3_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1109\/TR.2018.2865733"},{"key":"e_1_3_2_1_53_1","doi-asserted-by":"crossref","unstructured":"William B Langdon Shin Yoo and Mark Harman. 2017. Inferring automatic test oracles. 5\u20136.","DOI":"10.1109\/SBST.2017.1"},{"key":"e_1_3_2_1_54_1","volume-title":"Sg-net: Spatial granularity network for one-stage video instance segmentation. 9816\u20139825.","author":"Liu Dongfang","year":"2021","unstructured":"Dongfang Liu, Yiming Cui, Wenbo Tan, and Yingjie Chen. 2021. Sg-net: Spatial granularity network for one-stage video instance segmentation. 9816\u20139825."},{"key":"e_1_3_2_1_55_1","volume-title":"Densernet: Weakly supervised visual localization using multi-scale feature aggregation. 35, 6101\u20136109.","author":"Liu Dongfang","year":"2021","unstructured":"Dongfang Liu, Yiming Cui, Liqi Yan, Christos Mousas, Baijian Yang, and Yingjie Chen. 2021. Densernet: Weakly supervised visual localization using multi-scale feature aggregation. 35, 6101\u20136109."},{"key":"e_1_3_2_1_56_1","doi-asserted-by":"crossref","unstructured":"Lutz Lorenz Philipp Kerschbaum and Josef Schumann. 2014. Designing take over scenarios for automated driving: How does augmented reality support the driver to get back into the loop? 58 1681\u20131685.","DOI":"10.1177\/1541931214581351"},{"key":"e_1_3_2_1_57_1","volume-title":"Arcade: Augmented reality computing arena for digital entertainment. 1\u20139.","author":"Lyu Michael R","year":"2005","unstructured":"Michael R Lyu, Irwin King, TT Wong, Edward Yau, and PW Chan. 2005. Arcade: Augmented reality computing arena for digital entertainment. 1\u20139."},{"key":"e_1_3_2_1_58_1","volume-title":"Sapienz: Multi-objective automated testing for android applications. 94\u2013105.","author":"Mao Ke","year":"2016","unstructured":"Ke Mao, Mark Harman, and Yue Jia. 2016. Sapienz: Multi-objective automated testing for android applications. 94\u2013105."},{"key":"e_1_3_2_1_59_1","unstructured":"Winter Mason and Sidharth Suri. 2011. How to use mechanical turk for cognitive science research. 33."},{"key":"e_1_3_2_1_60_1","doi-asserted-by":"crossref","unstructured":"Zeljko Medenica Andrew L Kun Tim Paek and Oskar Palinko. 2011. Augmented reality vs. street views: a driving simulator study comparing two emerging navigation aids. 265\u2013274.","DOI":"10.1145\/2037373.2037414"},{"key":"e_1_3_2_1_61_1","doi-asserted-by":"crossref","unstructured":"Shabnam Mirshokraie Ali Mesbah and Karthik Pattabiraman. 2015. JSeft: Automated JavaScript unit test generation. 1\u201310.","DOI":"10.1109\/ICST.2015.7102595"},{"key":"e_1_3_2_1_62_1","unstructured":"Keiron O\u2019Shea and Ryan Nash. 2015. An introduction to convolutional neural networks. arXiv preprint arXiv:1511.08458."},{"key":"e_1_3_2_1_63_1","volume-title":"Advances in Computers","volume":"95","author":"Pezz\u00e8 Mauro","year":"2014","unstructured":"Mauro Pezz\u00e8 and Cheng Zhang. 2014. Chapter One - Automated Test Oracles: A Survey. Advances in Computers, Vol. 95. Elsevier, 1\u201348."},{"key":"e_1_3_2_1_64_1","doi-asserted-by":"crossref","unstructured":"Iulian Radu. 2012. Why should my students use AR? A comparative review of the educational impacts of augmented-reality. 313\u2013314.","DOI":"10.1109\/ISMAR.2012.6402590"},{"key":"e_1_3_2_1_65_1","doi-asserted-by":"crossref","unstructured":"Tahmid Rafi Xueling Zhang and Xiaoyin Wang. 2022. PredART: Towards Automatic Oracle Prediction of Object Placements in Augmented Reality Testing. 1\u201313.","DOI":"10.1145\/3551349.3561160"},{"key":"e_1_3_2_1_66_1","doi-asserted-by":"crossref","unstructured":"Hassan Ramchoun Youssef Ghanou Mohamed Ettaouil and Mohammed Amine Janati Idrissi. 2016. Multilayer perceptron: Architecture optimization and training.","DOI":"10.1145\/3090354.3090427"},{"key":"e_1_3_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1145\/2580723.2580730"},{"key":"e_1_3_2_1_68_1","doi-asserted-by":"publisher","DOI":"10.1109\/UEMCON47517.2019.8992974"},{"key":"e_1_3_2_1_69_1","unstructured":"Engineering ToolBox. 2004. Illuminance - Recommended Light Level. https:\/\/www.engineeringtoolbox.com\/light-level-rooms-d_708.html"},{"key":"e_1_3_2_1_70_1","volume-title":"Apktool-A tool for reverse engineering 3rd party, closed, binary Android apps","author":"Tumbleson Connor","unstructured":"Connor Tumbleson and Ryszard Wi\u00c5\u017bniewski. 2017. Apktool-A tool for reverse engineering 3rd party, closed, binary Android apps."},{"key":"e_1_3_2_1_71_1","doi-asserted-by":"crossref","unstructured":"Xiaoyin Wang. 2022. VRTest: an extensible framework for automatic testing of virtual reality scenes. 232\u2013236.","DOI":"10.1109\/ICSE-Companion55297.2022.9793753"},{"key":"e_1_3_2_1_72_1","unstructured":"Wikipedia. 2023. Simultaneous localization and mapping. https:\/\/en.wikipedia.org\/wiki\/Simultaneous_localization_and_mapping"},{"key":"e_1_3_2_1_73_1","volume-title":"Rebecca Roelofs, Raphael Gontijo-Lopes, Ari S Morcos, Hongseok Namkoong, Ali Farhadi, Yair Carmon, and Simon Kornblith.","author":"Wortsman Mitchell","year":"2022","unstructured":"Mitchell Wortsman, Gabriel Ilharco, Samir Ya Gadre, Rebecca Roelofs, Raphael Gontijo-Lopes, Ari S Morcos, Hongseok Namkoong, Ali Farhadi, Yair Carmon, and Simon Kornblith. 2022. Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference time. 23965\u201323998."},{"key":"e_1_3_2_1_74_1","doi-asserted-by":"crossref","unstructured":"Razieh Nokhbeh Zaeem Mukul R Prasad and Sarfraz Khurshid. 2014. Automated generation of oracles for testing user-interaction features of mobile apps. 183\u2013192.","DOI":"10.1109\/ICST.2014.31"},{"key":"e_1_3_2_1_75_1","volume-title":"Wuji: Automatic online combat game testing using evolutionary deep reinforcement learning. 772\u2013784.","author":"Zheng Yan","year":"2019","unstructured":"Yan Zheng, Xiaofei Xie, Ting Su, Lei Ma, Jianye Hao, Zhaopeng Meng, Yang Liu, Ruimin Shen, Yingfeng Chen, and Changjie Fan. 2019. Wuji: Automatic online combat game testing using evolutionary deep reinforcement learning. 772\u2013784."},{"key":"e_1_3_2_1_76_1","doi-asserted-by":"crossref","first-page":"175212","DOI":"10.1007\/s11704-022-1658-8","article-title":"Iterative Android automated testing","volume":"17","author":"Zhong Yi","year":"2023","unstructured":"Yi Zhong, Mengyu Shi, Youran Xu, Chunrong Fang, and Zhenyu Chen. 2023. Iterative Android automated testing. Frontiers of Computer Science, 17, 5 (2023), 175212.","journal-title":"Frontiers of Computer Science"}],"event":{"name":"ISSTA '24: 33rd ACM SIGSOFT International Symposium on Software Testing and Analysis","location":"Vienna Austria","acronym":"ISSTA '24","sponsor":["SIGSOFT ACM Special Interest Group on Software Engineering","AITO"]},"container-title":["Proceedings of the 33rd ACM SIGSOFT International Symposium on Software Testing and Analysis"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3650212.3680315","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3650212.3680315","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T22:50:07Z","timestamp":1750287007000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3650212.3680315"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,9,11]]},"references-count":76,"alternative-id":["10.1145\/3650212.3680315","10.1145\/3650212"],"URL":"https:\/\/doi.org\/10.1145\/3650212.3680315","relation":{},"subject":[],"published":{"date-parts":[[2024,9,11]]},"assertion":[{"value":"2024-09-11","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}