{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,14]],"date-time":"2026-02-14T04:28:41Z","timestamp":1771043321469,"version":"3.50.1"},"reference-count":65,"publisher":"Association for Computing Machinery (ACM)","issue":"6","funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["62232003 and 62172037"],"award-info":[{"award-number":["62232003 and 62172037"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100002858","name":"China Postdoctoral Science Foundation","doi-asserted-by":"crossref","award":["2023M740078"],"award-info":[{"award-number":["2023M740078"]}],"id":[{"id":"10.13039\/501100002858","id-type":"DOI","asserted-by":"crossref"}]},{"name":"China National Postdoctoral Program for Innovative Talents","award":["BX20240008"],"award-info":[{"award-number":["BX20240008"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Softw. Eng. Methodol."],"published-print":{"date-parts":[[2025,7,31]]},"abstract":"<jats:p>Mobile applications are widely used by billions of users in their daily work and life. Such GUI software is prone to bugs, potentially degrading user experience. Notably, many bugs in mobile apps are reported by end-users who cannot access the requirements of the app or test cases accompanied by explicitly specified test oracles. It may suggest that such bugs are not identified in the traditional way, i.e., by comparing the actual behaviors of the apps against their expected behaviors explicitly specified in the requirements or test cases. Instead, such bugs are often identified by comparing the actual behaviors against users\u2019 common knowledge of apps, noted as common sense. We refer to such bugs as common sense-violating bugs. Although it is well-known that common sense-violating bugs are common in mobile apps, it remains unclear how popular they are and what kind of common sense principles are violated by them, let alone the relationship among the violated common sense principles. To this end, in this paper, we conduct the first large-scale empirical study on common sense-violating bugs in open-source mobile apps. We manually analyzed 2,808 real-world bug reports across 948 open-sourced mobile apps on GitHub. Our analysis results suggest that 1,006 (35.8%) out of the 2,808 bugs pertain to common sense-violating bugs. From those common sense-violating bugs, we identified a set of common sense principles violated by the buggy behaviors, and built a taxonomy for the common sense principles. Such principles fall into three categories: UI content-related common sense principles, UI layout-related common sense principles, and interaction-related common sense principles. By analyzing the frequency of the common sense principles being violated, we observed that a small set of common sense principles were frequently violated by the majority of common sense-violating bugs: 18 common sense principles, accounting for only 5% of the violated common sense principles, were violated by more than half of the common sense-violating bugs. These findings suggest that identifying the most frequent common sense-violating bugs could be achieved by using a small set of critical common sense principles, which may significantly reduce the cost of common sense-based bug detection. Finally, to demonstrate the feasibility of automated bug detection with common sense-based test oracles, we propose an automated approach to validating whether a given test run violates the most frequently violated common sense principle: No raw error message. Our evaluation results suggest that the automated approach is accurate, whose precision and recall are 91.3% and 91.6%, respectively.<\/jats:p>","DOI":"10.1145\/3709356","type":"journal-article","created":{"date-parts":[[2024,12,21]],"date-time":"2024-12-21T09:17:51Z","timestamp":1734772671000},"page":"1-26","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["An Empirical Study on Common Sense-Violating Bugs in Mobile Apps"],"prefix":"10.1145","volume":"34","author":[{"ORCID":"https:\/\/orcid.org\/0009-0007-0256-4028","authenticated-orcid":false,"given":"Fu","family":"Fan","sequence":"first","affiliation":[{"name":"Beijing Institute of Technology, Beijing, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6404-9143","authenticated-orcid":false,"given":"Yanjie","family":"Jiang","sequence":"additional","affiliation":[{"name":"Peking University, Beijing, China"}]},{"ORCID":"https:\/\/orcid.org\/0009-0003-7238-1615","authenticated-orcid":false,"given":"Tianyi","family":"Chen","sequence":"additional","affiliation":[{"name":"Beijing Institute of Technology, Beijing, China"}]},{"ORCID":"https:\/\/orcid.org\/0009-0009-4606-1662","authenticated-orcid":false,"given":"Hengshun","family":"Zhang","sequence":"additional","affiliation":[{"name":"Beijing Institute of Technology, Beijing, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9371-5931","authenticated-orcid":false,"given":"Yuxia","family":"Zhang","sequence":"additional","affiliation":[{"name":"Computer Academy, Beijing Institute of Technology, Beijing, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5566-2368","authenticated-orcid":false,"given":"Nan","family":"Niu","sequence":"additional","affiliation":[{"name":"EECS, University of Cincinnati, Cincinnati, OH, United States"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3267-6801","authenticated-orcid":false,"given":"Hui","family":"Liu","sequence":"additional","affiliation":[{"name":"Beijing Institute of Technology, Beijing, China"}]}],"member":"320","published-online":{"date-parts":[[2025,7]]},"reference":[{"key":"e_1_3_2_2_2","unstructured":"Bug Report #127 in DiCa. 2023. Retrieved September 2023 from https:\/\/github.com\/jasoncheng\/dica\/issues\/127"},{"key":"e_1_3_2_3_2","unstructured":"Bug Report #1430 in Wikimedia Commons Android. 2023. Retrieved September 2023 from https:\/\/github.com\/commons-app\/apps-android-commons\/issues\/1430"},{"key":"e_1_3_2_4_2","unstructured":"Bug Report #1603 in QKSMS. 2023. Retrieved September 2023 from https:\/\/github.com\/moezbhatti\/qksms\/issues\/1603"},{"key":"e_1_3_2_5_2","unstructured":"Bug Report #240 in Unchained. 2023. Retrieved September 2023 from https:\/\/github.com\/LivingWithHippos\/unchained-android\/issues\/240"},{"key":"e_1_3_2_6_2","unstructured":"Bug Report #248 in Handy News Reader. 2023. Retrieved September 2023 from https:\/\/github.com\/yanus171\/Handy-News-Reader\/issues\/248"},{"key":"e_1_3_2_7_2","unstructured":"Bug Report #251 in Mifos Mobile. 2023. Retrieved September 2023 from https:\/\/github.com\/openMF\/mifos-mobile\/issues\/251"},{"key":"e_1_3_2_8_2","unstructured":"Bug Report #2622 in Zulip. 2023. Retrieved September 2023 from https:\/\/github.com\/zulip\/zulip-mobile\/issues\/2622"},{"key":"e_1_3_2_9_2","unstructured":"Bug Report #398 in CycleStreets. 2023. Retrieved September 2023 from https:\/\/github.com\/cyclestreets\/android\/issues\/398"},{"key":"e_1_3_2_10_2","unstructured":"Bug Report #435 in OpenTracks. 2023. Retrieved September 2023 from https:\/\/github.com\/OpenTracksApp\/OpenTracks\/issues\/435"},{"key":"e_1_3_2_11_2","unstructured":"Bug Report #466 in Etar Calendar. 2023. Retrieved September 2023 from https:\/\/github.com\/Etar-Group\/Etar-Calendar\/issues\/466"},{"key":"e_1_3_2_12_2","unstructured":"Bug Report #608 in Neo Backup. 2023. Retrieved September 2023 from https:\/\/github.com\/NeoApplications\/Neo-Backup\/issues\/608"},{"key":"e_1_3_2_13_2","unstructured":"Bug Report #68 in Scarlet Notes. 2023. Retrieved September 2023 from https:\/\/github.com\/BijoySingh\/Scarlet-Notes\/issues\/68"},{"key":"e_1_3_2_14_2","unstructured":"Bug Report #858 in Loop Habit Tracker. 2023. Retrieved September 2023 from https:\/\/github.com\/iSoron\/uhabits\/issues\/858"},{"key":"e_1_3_2_15_2","unstructured":"Bug Report #911 in Syncthing. 2023. Retrieved September 2023 from https:\/\/github.com\/syncthing\/syncthing-android\/issues\/911"},{"key":"e_1_3_2_16_2","unstructured":"Bug Report #9326 in KOReader. 2023. Retrieved September 2023 from https:\/\/github.com\/koreader\/koreader\/issues\/9326"},{"key":"e_1_3_2_17_2","unstructured":"Bug Report #937 in Organic Maps. 2023. Retrieved September 2023 from https:\/\/github.com\/organicmaps\/organicmaps\/issues\/937"},{"key":"e_1_3_2_18_2","unstructured":"Bug Report #95 in andOTP. 2023. Retrieved September 2023 from https:\/\/github.com\/andOTP\/andOTP\/issues\/95"},{"key":"e_1_3_2_19_2","unstructured":"Floccus. 2023. Retrieved September 2023 from https:\/\/github.com\/floccusaddon\/floccus\/"},{"key":"e_1_3_2_20_2","doi-asserted-by":"publisher","DOI":"10.1145\/2901739.2903508"},{"key":"e_1_3_2_21_2","doi-asserted-by":"publisher","DOI":"10.1145\/3540250.3549118"},{"key":"e_1_3_2_22_2","doi-asserted-by":"publisher","DOI":"10.1002\/stvr.1654"},{"key":"e_1_3_2_23_2","doi-asserted-by":"publisher","DOI":"10.1145\/3324884.3416567"},{"key":"e_1_3_2_24_2","unstructured":"Cambridge Dictionary. Common Sense. Retrieved April 1 2024 from https:\/\/dictionary.cambridge.org\/dictionary\/english\/common-sense"},{"key":"e_1_3_2_25_2","doi-asserted-by":"publisher","DOI":"10.1145\/3468264.3468586"},{"key":"e_1_3_2_26_2","doi-asserted-by":"crossref","unstructured":"Giuseppe Colavito Filippo Lanubile Nicole Novielli and Luigi Quaranta. 2024. Leveraging GPT-like LLMs to Automate Issue Labeling.","DOI":"10.1145\/3643991.3644903"},{"key":"e_1_3_2_27_2","doi-asserted-by":"publisher","DOI":"10.1109\/ESEM.2011.36"},{"key":"e_1_3_2_28_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSME46990.2020.00061"},{"key":"e_1_3_2_29_2","unstructured":"F-Droid. 2023. F-Droid - Free and Open Source Android App Repository. Retrieved September 2023 from https:\/\/f-droid.org\/"},{"key":"e_1_3_2_30_2","doi-asserted-by":"publisher","DOI":"10.1145\/3510003.3510175"},{"key":"e_1_3_2_31_2","doi-asserted-by":"publisher","DOI":"10.1109\/ASE.2017.8115644"},{"key":"e_1_3_2_32_2","unstructured":"Sidong Feng and Chunyang Chen. 2023. Prompting is all you need: Automated Android Bug replay with large language models. arXiv:2306.01987. Retrieved from https:\/\/arxiv.org\/abs\/2306.01987"},{"key":"e_1_3_2_33_2","unstructured":"Google. 2023. Fundamentals of Testing Android Apps. Retrieved September 2023 from https:\/\/developer.android.com\/training\/testing\/fundamentals"},{"key":"e_1_3_2_34_2","doi-asserted-by":"publisher","DOI":"10.1145\/79147.79161"},{"key":"e_1_3_2_35_2","unstructured":"Pengcheng He Xiaodong Liu Jianfeng Gao and Weizhu Chen. 2021. DeBERTa: Decoding-enhanced BERT with disentangled attention. arXiv:2006.03654. Retrieved from https:\/\/arxiv.org\/abs\/2006.03654"},{"key":"e_1_3_2_36_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-020-09885-w"},{"key":"e_1_3_2_37_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE.2013.6606585"},{"key":"e_1_3_2_38_2","doi-asserted-by":"publisher","DOI":"10.1145\/3236024.3236055"},{"key":"e_1_3_2_39_2","doi-asserted-by":"publisher","DOI":"10.1109\/SANER53432.2022.00048"},{"key":"e_1_3_2_40_2","doi-asserted-by":"publisher","DOI":"10.1145\/360248.360252"},{"key":"e_1_3_2_41_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICST.2015.7102609"},{"key":"e_1_3_2_42_2","doi-asserted-by":"publisher","DOI":"10.1109\/TR.2018.2865733"},{"key":"e_1_3_2_43_2","doi-asserted-by":"publisher","DOI":"10.1145\/3597503.3623344"},{"key":"e_1_3_2_44_2","unstructured":"Li Li Jun Gao M\u00e9d\u00e9ric Hurier Pingfan Kong Tegawend\u00e9 F. Bissyand\u00e9 Alexandre Bartel Jacques Klein and Yves Le Traon. 2017. AndroZoo++: Collecting millions of Android Apps and their metadata for the research community. arXiv:1709.05281. Retrieved from https:\/\/arxiv.org\/abs\/1709.05281"},{"key":"e_1_3_2_45_2","doi-asserted-by":"publisher","DOI":"10.1609\/aimag.v25i4.1785"},{"key":"e_1_3_2_46_2","doi-asserted-by":"publisher","DOI":"10.1145\/3324884.3416623"},{"key":"e_1_3_2_47_2","doi-asserted-by":"publisher","DOI":"10.1145\/3324884.3416547"},{"key":"e_1_3_2_48_2","unstructured":"OpenAI. 2023. API Reference - OpenAI API. Retrieved September 2023 from https:\/\/platform.openai.com\/docs\/api-reference\/chat"},{"key":"e_1_3_2_49_2","doi-asserted-by":"publisher","DOI":"10.1145\/3395363.3397354"},{"key":"e_1_3_2_50_2","doi-asserted-by":"publisher","DOI":"10.1145\/3395363.3397379"},{"key":"e_1_3_2_51_2","doi-asserted-by":"publisher","DOI":"10.1145\/3197231.3197241"},{"key":"e_1_3_2_52_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2016.2532875"},{"key":"e_1_3_2_53_2","doi-asserted-by":"publisher","DOI":"10.1145\/2983990.2984011"},{"key":"e_1_3_2_54_2","doi-asserted-by":"publisher","DOI":"10.1080\/01621459.1974.10480196"},{"key":"e_1_3_2_55_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2020.3013438"},{"key":"e_1_3_2_56_2","doi-asserted-by":"publisher","DOI":"10.1145\/3485533"},{"key":"e_1_3_2_57_2","doi-asserted-by":"publisher","DOI":"10.1145\/3551349.3556935"},{"key":"e_1_3_2_58_2","doi-asserted-by":"publisher","DOI":"10.1145\/3611643.3616286"},{"key":"e_1_3_2_59_2","doi-asserted-by":"publisher","DOI":"10.1145\/3460319.3464806"},{"key":"e_1_3_2_60_2","doi-asserted-by":"publisher","DOI":"10.1145\/1007512.1007526"},{"key":"e_1_3_2_61_2","doi-asserted-by":"publisher","DOI":"10.1145\/3540250.3549170"},{"key":"e_1_3_2_62_2","unstructured":"Hao Wen Hongming Wang Jiaxuan Liu and Yuanchun Li. 2023. DroidBot-GPT: GPT-powered UI Automation for Android. arXiv:2304.07061. Retrieved from https:\/\/arxiv.org\/abs\/2304.07061"},{"key":"e_1_3_2_63_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.emnlp-demos.6"},{"key":"e_1_3_2_64_2","doi-asserted-by":"publisher","DOI":"10.1145\/3597926.3598138"},{"key":"e_1_3_2_65_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICST.2014.31"},{"key":"e_1_3_2_66_2","doi-asserted-by":"publisher","DOI":"10.1145\/3485447.3511995"}],"container-title":["ACM Transactions on Software Engineering and Methodology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3709356","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,1]],"date-time":"2025-07-01T13:29:43Z","timestamp":1751376583000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3709356"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,7]]},"references-count":65,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2025,7,31]]}},"alternative-id":["10.1145\/3709356"],"URL":"https:\/\/doi.org\/10.1145\/3709356","relation":{},"ISSN":["1049-331X","1557-7392"],"issn-type":[{"value":"1049-331X","type":"print"},{"value":"1557-7392","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,7]]},"assertion":[{"value":"2024-04-02","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-12-09","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-07-01","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}