{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,18]],"date-time":"2026-07-18T16:31:05Z","timestamp":1784392265282,"version":"3.55.0"},"reference-count":98,"publisher":"Association for Computing Machinery (ACM)","issue":"OOPSLA","license":[{"start":{"date-parts":[[2021,10,15]],"date-time":"2021-10-15T00:00:00Z","timestamp":1634256000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Program. Lang."],"published-print":{"date-parts":[[2021,10,20]]},"abstract":"<jats:p>\n            Android apps are GUI-based event-driven software and have become ubiquitous in recent years. Obviously, functional correctness is critical for an app\u2019s success. However, in addition to crash bugs,\n            <jats:italic>non-crashing functional bugs<\/jats:italic>\n            (in short as \u201cnon-crashing bugs\u201d in this work) like inadvertent function failures, silent user data lost and incorrect display information are prevalent, even in popular, well-tested apps. These non-crashing functional bugs are usually caused by program logic errors and manifest themselves on the graphic user interfaces (GUIs). In practice, such bugs pose significant challenges in effectively detecting them because (1) current practices heavily rely on expensive, small-scale manual validation (\n            <jats:italic>the lack of automation<\/jats:italic>\n            ); and (2) modern\n            <jats:italic>fully automated<\/jats:italic>\n            testing has been limited to crash bugs (\n            <jats:italic>the lack of test oracles<\/jats:italic>\n            ).\n          <\/jats:p>\n          <jats:p>\n            This paper fills this gap by introducing\n            <jats:italic>independent view fuzzing<\/jats:italic>\n            ,\n            <jats:italic>a novel, fully automated approach<\/jats:italic>\n            for detecting non-crashing functional bugs in Android apps. Inspired by metamorphic testing, our key insight is to leverage the commonly-held\n            <jats:italic>independent view property<\/jats:italic>\n            of Android apps to manufacture property-preserving mutant tests from a set of seed tests that validate certain app properties. The mutated tests help exercise the tested apps under additional, adverse conditions. Any property violations indicate likely functional bugs for further manual confirmation. We have realized our approach as an automated, end-to-end functional fuzzing tool, Genie. Given an app, (1) Genie automatically detects non-crashing bugs without requiring human-provided tests and oracles (thus\n            <jats:italic>fully automated<\/jats:italic>\n            ); and (2) the detected non-crashing bugs are diverse (thus\n            <jats:italic>general and not limited to specific functional properties<\/jats:italic>\n            ), which set Genie apart from prior work.\n          <\/jats:p>\n          <jats:p>We have evaluated Genie on 12 real-world Android apps and successfully uncovered 34 previously unknown non-crashing bugs in their latest releases \u2014 all have been confirmed, and 22 have already been fixed. Most of the detected bugs are nontrivial and have escaped developer (and user) testing for at least one year and affected many app releases, thus clearly demonstrating Genie\u2019s effectiveness. According to our analysis, Genie achieves a reasonable true positive rate of 40.9%, while these 34 non-crashing bugs could not be detected by prior fully automated GUI testing tools (as our evaluation confirms). Thus, our work complements and enhances existing manual testing and fully automated testing for crash bugs.<\/jats:p>","DOI":"10.1145\/3485533","type":"journal-article","created":{"date-parts":[[2021,10,15]],"date-time":"2021-10-15T19:18:28Z","timestamp":1634325508000},"page":"1-31","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":56,"title":["Fully automated functional fuzzing of Android apps for detecting non-crashing logic bugs"],"prefix":"10.1145","volume":"5","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1628-9796","authenticated-orcid":false,"given":"Ting","family":"Su","sequence":"first","affiliation":[{"name":"East China Normal University, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yichen","family":"Yan","sequence":"additional","affiliation":[{"name":"East China Normal University, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jue","family":"Wang","sequence":"additional","affiliation":[{"name":"Nanjing University, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8437-0687","authenticated-orcid":false,"given":"Jingling","family":"Sun","sequence":"additional","affiliation":[{"name":"East China Normal University, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yiheng","family":"Xiong","sequence":"additional","affiliation":[{"name":"East China Normal University, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Geguang","family":"Pu","sequence":"additional","affiliation":[{"name":"East China Normal University, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ke","family":"Wang","sequence":"additional","affiliation":[{"name":"Visa Research, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhendong","family":"Su","sequence":"additional","affiliation":[{"name":"ETH Zurich, Switzerland"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2021,10,15]]},"reference":[{"key":"e_1_2_2_1_1","unstructured":"Accessibility. 2020. Accessibility overview. https:\/\/developer.android.com\/guide\/topics\/ui\/accessibility  Accessibility. 2020. Accessibility overview. https:\/\/developer.android.com\/guide\/topics\/ui\/accessibility"},{"key":"e_1_2_2_2_1","unstructured":"ActivityDiary. 2020. Activity Diary. https:\/\/play.google.com\/store\/apps\/details?id=de.rampro.activitydiary  ActivityDiary. 2020. Activity Diary. https:\/\/play.google.com\/store\/apps\/details?id=de.rampro.activitydiary"},{"key":"e_1_2_2_3_1","unstructured":"ActivityDiary. 2020. Activity Diary\u2019s issue #118. https:\/\/github.com\/ramack\/ActivityDiary\/issues\/118  ActivityDiary. 2020. Activity Diary\u2019s issue #118. https:\/\/github.com\/ramack\/ActivityDiary\/issues\/118"},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/2771783.2771786"},{"key":"e_1_2_2_5_1","unstructured":"ADB. 2020. Android adb. https:\/\/developer.android.com\/studio\/command-line\/adb  ADB. 2020. Android adb. https:\/\/developer.android.com\/studio\/command-line\/adb"},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/MS.2014.55"},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1002\/stvr.1654"},{"key":"e_1_2_2_8_1","unstructured":"AmazeFileManager Team. 2020. AmazeFileManager. https:\/\/github.com\/TeamAmaze\/AmazeFileManager  AmazeFileManager Team. 2020. AmazeFileManager. https:\/\/github.com\/TeamAmaze\/AmazeFileManager"},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/2393596.2393666"},{"key":"e_1_2_2_10_1","unstructured":"AnkiDroid Team. 2020. AnkiDroid. https:\/\/github.com\/ankidroid\/Anki-Android  AnkiDroid Team. 2020. AnkiDroid. https:\/\/github.com\/ankidroid\/Anki-Android"},{"key":"e_1_2_2_11_1","unstructured":"AntennaPod Team. 2020. AntennaPod. https:\/\/github.com\/AntennaPod\/AntennaPod  AntennaPod Team. 2020. AntennaPod. https:\/\/github.com\/AntennaPod\/AntennaPod"},{"key":"e_1_2_2_12_1","volume-title":"Appium: Mobile App Automation Made Awesome.","year":"2020","unstructured":"Appium. 2020 . Appium: Mobile App Automation Made Awesome. . http:\/\/appium.io\/ Appium. 2020. Appium: Mobile App Automation Made Awesome.. http:\/\/appium.io\/"},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/2509136.2509549"},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/2970276.2970313"},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2014.2372785"},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/ASE.2019.00016"},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.tcs.2004.12.030"},{"key":"e_1_2_2_18_1","volume-title":"Metamorphic testing: a new approach for generating next test cases. HKUST-CS98-01","author":"Chen Tsong Y.","unstructured":"Tsong Y. Chen , Shing C. Cheung , and Shiu Ming Yiu . 1998. Metamorphic testing: a new approach for generating next test cases. HKUST-CS98-01 , Hong Kong University of Science and Technology . Tsong Y. Chen, Shing C. Cheung, and Shiu Ming Yiu. 1998. Metamorphic testing: a new approach for generating next test cases. HKUST-CS98-01, Hong Kong University of Science and Technology."},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/3143561"},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/2509136.2509552"},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/ASE.2015.89"},{"key":"e_1_2_2_22_1","unstructured":"Compuware. 2013. Users Have Low Tolerance For Buggy Apps - Only 16% Will Try A Failing App More Than Twice. https:\/\/techcrunch.com\/2013\/03\/12\/users-have-low-tolerance-for-buggy-apps-only-16-will-try-a-failing-app-more-than-twice\/  Compuware. 2013. Users Have Low Tolerance For Buggy Apps - Only 16% Will Try A Failing App More Than Twice. https:\/\/techcrunch.com\/2013\/03\/12\/users-have-low-tolerance-for-buggy-apps-only-16-will-try-a-failing-app-more-than-twice\/"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/3377811.3380402"},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/502034.502041"},{"key":"e_1_2_2_25_1","unstructured":"Espresso. 2020. Espresso. https:\/\/developer.android.com\/training\/testing\/espresso\/  Espresso. 2020. Espresso. https:\/\/developer.android.com\/training\/testing\/espresso\/"},{"key":"e_1_2_2_26_1","unstructured":"F-Droid. 2020. F-Droid. https:\/\/f-droid.org\/en\/  F-Droid. 2020. F-Droid. https:\/\/f-droid.org\/en\/"},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/3238147.3238170"},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/3180155.3180222"},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/2642937.2642991"},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/ASE.2017.8115644"},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/3213846.3213869"},{"key":"e_1_2_2_32_1","unstructured":"FindBugs. 2020. FindBugs. http:\/\/findbugs.sourceforge.net\/  FindBugs. 2020. FindBugs. http:\/\/findbugs.sourceforge.net\/"},{"key":"e_1_2_2_33_1","unstructured":"Google Play. 2020. Google Play Store. https:\/\/play.google.com\/store\/apps  Google Play. 2020. Google Play Store. https:\/\/play.google.com\/store\/apps"},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE.2019.00042"},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/2592798.2592813"},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/3236024.3236055"},{"key":"e_1_2_2_37_1","unstructured":"Infer. 2020. Infer. https:\/\/fbinfer.com\/  Infer. 2020. Infer. https:\/\/fbinfer.com\/"},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/3368089.3409677"},{"key":"e_1_2_2_39_1","unstructured":"Jacoco Team. 2020. Jacoco. https:\/\/www.eclemma.org\/jacoco\/  Jacoco Team. 2020. Jacoco. https:\/\/www.eclemma.org\/jacoco\/"},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/2483760.2483777"},{"key":"e_1_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/3377811.3380382"},{"key":"e_1_2_2_42_1","unstructured":"K-9 Mail Team. 2020. K-9 Mail. https:\/\/github.com\/k9mail\/k-9\/  K-9 Mail Team. 2020. K-9 Mail. https:\/\/github.com\/k9mail\/k-9\/"},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICST.2015.7102609"},{"key":"e_1_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.1109\/TR.2018.2865733"},{"key":"e_1_2_2_45_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-89363-1_15"},{"key":"e_1_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1002\/stvr.1752"},{"key":"e_1_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/3243218.3243219"},{"key":"e_1_2_2_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/3133850.3133853"},{"key":"e_1_2_2_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/2594291.2594334"},{"key":"e_1_2_2_50_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE-C.2017.8"},{"key":"e_1_2_2_51_1","doi-asserted-by":"publisher","DOI":"10.1109\/ASE.2019.00015"},{"key":"e_1_2_2_52_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2014.2331982"},{"key":"e_1_2_2_53_1","unstructured":"Lint. 2020. Improve your code with lint checks. https:\/\/developer.android.com\/studio\/write\/lint.html  Lint. 2020. Improve your code with lint checks. https:\/\/developer.android.com\/studio\/write\/lint.html"},{"key":"e_1_2_2_54_1","unstructured":"Localytics. 2019. 25% of Users Abandon Apps After One Use. http:\/\/info.localytics.com\/blog\/25-of-users-abandon-apps-after-one-use  Localytics. 2019. 25% of Users Abandon Apps After One Use. http:\/\/info.localytics.com\/blog\/25-of-users-abandon-apps-after-one-use"},{"key":"e_1_2_2_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/3338906.3338980"},{"key":"e_1_2_2_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/2491411.2491450"},{"key":"e_1_2_2_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/2635868.2635896"},{"key":"e_1_2_2_58_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE.2007.41"},{"key":"e_1_2_2_59_1","doi-asserted-by":"publisher","DOI":"10.1111\/exsy.12608"},{"key":"e_1_2_2_60_1","doi-asserted-by":"publisher","DOI":"10.1145\/2931037.2931054"},{"key":"e_1_2_2_61_1","doi-asserted-by":"publisher","DOI":"10.1145\/3180155.3180162"},{"key":"e_1_2_2_62_1","unstructured":"Material Design. 2020. Material Design. https:\/\/material.io\/design  Material Design. 2020. Material Design. https:\/\/material.io\/design"},{"key":"e_1_2_2_63_1","doi-asserted-by":"publisher","DOI":"10.1109\/ASE.2003.1240304"},{"key":"e_1_2_2_64_1","doi-asserted-by":"publisher","DOI":"10.1145\/355045.355050"},{"key":"e_1_2_2_65_1","doi-asserted-by":"publisher","DOI":"10.1145\/2884781.2884853"},{"key":"e_1_2_2_66_1","doi-asserted-by":"publisher","DOI":"10.1145\/2382756.2382798"},{"key":"e_1_2_2_67_1","unstructured":"Monkey. 2020. Monkey. http:\/\/developer.android.com\/tools\/help\/monkey.html  Monkey. 2020. Monkey. http:\/\/developer.android.com\/tools\/help\/monkey.html"},{"key":"e_1_2_2_68_1","unstructured":"Motherboard. 2020. Here\u2019s the Shadow Inc. App That Failed in Iowa Last Night. https:\/\/www.vice.com\/en_us\/article\/y3m33x\/heres-the-shadow-inc-app-that-failed-in-iowa-last-night  Motherboard. 2020. Here\u2019s the Shadow Inc. App That Failed in Iowa Last Night. https:\/\/www.vice.com\/en_us\/article\/y3m33x\/heres-the-shadow-inc-app-that-failed-in-iowa-last-night"},{"key":"e_1_2_2_69_1","unstructured":"NewPipe Team. 2020. NewPipe. https:\/\/github.com\/TeamNewPipe\/NewPipe  NewPipe Team. 2020. NewPipe. https:\/\/github.com\/TeamNewPipe\/NewPipe"},{"key":"e_1_2_2_70_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.is.2015.08.004"},{"key":"e_1_2_2_71_1","unstructured":"Joao Felipe Pimentel. 2020. Python APTED algorithm for the Edit Distance. https:\/\/github.com\/JoaoFelipe\/apted  Joao Felipe Pimentel. 2020. Python APTED algorithm for the Edit Distance. https:\/\/github.com\/JoaoFelipe\/apted"},{"key":"e_1_2_2_72_1","volume-title":"Robotium: User scenario testing for Android","year":"2020","unstructured":"Robotium. 2020 . Robotium: User scenario testing for Android . http:\/\/www.robotium.org Robotium. 2020. Robotium: User scenario testing for Android. http:\/\/www.robotium.org"},{"key":"e_1_2_2_73_1","doi-asserted-by":"publisher","DOI":"10.1145\/3197231.3197241"},{"key":"e_1_2_2_74_1","doi-asserted-by":"publisher","DOI":"10.1109\/MC.2018.2141024"},{"key":"e_1_2_2_75_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2016.2532875"},{"key":"e_1_2_2_76_1","doi-asserted-by":"publisher","DOI":"10.1145\/2983990.2984011"},{"key":"e_1_2_2_77_1","unstructured":"Sixth Tone. 2019. E-Commerce App Loses \u2018Tens of Millions\u2019 From Coupon Glitches. https:\/\/www.sixthtone.com\/news\/1003483\/e-commerce-app-loses-tens-of-millions-from-coupon-glitches  Sixth Tone. 2019. E-Commerce App Loses \u2018Tens of Millions\u2019 From Coupon Glitches. https:\/\/www.sixthtone.com\/news\/1003483\/e-commerce-app-loses-tens-of-millions-from-coupon-glitches"},{"key":"e_1_2_2_78_1","doi-asserted-by":"publisher","DOI":"10.1109\/ASE.2017.8115615"},{"key":"e_1_2_2_79_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2020.3013438"},{"key":"e_1_2_2_80_1","doi-asserted-by":"publisher","DOI":"10.1145\/3106237.3106298"},{"key":"e_1_2_2_81_1","doi-asserted-by":"publisher","DOI":"10.1145\/3468264.3468620"},{"key":"e_1_2_2_82_1","doi-asserted-by":"publisher","DOI":"10.1145\/2983990.2984038"},{"key":"e_1_2_2_83_1","doi-asserted-by":"publisher","DOI":"10.1145\/3460319.3464806"},{"key":"e_1_2_2_84_1","doi-asserted-by":"publisher","DOI":"10.1145\/3180155.3180220"},{"key":"e_1_2_2_85_1","doi-asserted-by":"publisher","DOI":"10.1145\/3293882.3330567"},{"key":"e_1_2_2_86_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11219-018-9418-6"},{"key":"e_1_2_2_87_1","doi-asserted-by":"publisher","DOI":"10.1145\/2382756.2382797"},{"key":"e_1_2_2_88_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSME.2017.47"},{"key":"e_1_2_2_89_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSME.2017.27"},{"key":"e_1_2_2_90_1","doi-asserted-by":"publisher","DOI":"10.1145\/3238147.3240465"},{"key":"e_1_2_2_91_1","doi-asserted-by":"publisher","DOI":"10.1145\/3428205"},{"key":"e_1_2_2_92_1","doi-asserted-by":"publisher","DOI":"10.1145\/1189748.1189752"},{"key":"e_1_2_2_93_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2010.11.920"},{"key":"e_1_2_2_94_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-37057-1_19"},{"key":"e_1_2_2_95_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE.2007.94"},{"key":"e_1_2_2_96_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICST.2014.31"},{"key":"e_1_2_2_97_1","doi-asserted-by":"publisher","DOI":"10.1137\/0218082"},{"key":"e_1_2_2_98_1","doi-asserted-by":"publisher","DOI":"10.1145\/3238147.3240465"}],"container-title":["Proceedings of the ACM on Programming Languages"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3485533","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3485533","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:18:40Z","timestamp":1750191520000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3485533"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,10,15]]},"references-count":98,"journal-issue":{"issue":"OOPSLA","published-print":{"date-parts":[[2021,10,20]]}},"alternative-id":["10.1145\/3485533"],"URL":"https:\/\/doi.org\/10.1145\/3485533","relation":{},"ISSN":["2475-1421"],"issn-type":[{"value":"2475-1421","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,10,15]]},"assertion":[{"value":"2021-10-15","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}