{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,28]],"date-time":"2026-09-28T01:39:09Z","timestamp":1790559549331,"version":"4.1.0"},"reference-count":47,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2020,3,12]],"date-time":"2020-03-12T00:00:00Z","timestamp":1583971200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Information"],"abstract":"<jats:p>Mobile applications (apps) on IOS and Android devices are mostly maintained and updated via Apple Appstore and Google Play, respectively, where the users are allowed to provide reviews regarding their satisfaction towards particular apps. Despite the importance of user reviews towards mobile app maintenance and evolution, it is time-consuming and ineffective to dissect each individual negative review. In addition, due to the different app update strategies, it is uncertain that each update can be accepted well by the users. This study aims to provide an approach to detect the particular days during the mobile app maintenance phase when the negative reviews require developers\u2019 attention. Furthermore, the method shall facilitate the mapping of the identified abnormal days towards the updates that result in such negativity in reviews. The method\u2019s purpose is to enable app developers to respond swiftly to significant flaws reflected by user reviews in order to prevent user churns.<\/jats:p>","DOI":"10.3390\/info11030152","type":"journal-article","created":{"date-parts":[[2020,3,12]],"date-time":"2020-03-12T12:22:51Z","timestamp":1584015771000},"page":"152","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":21,"title":["A Sentiment-Statistical Approach for Identifying Problematic Mobile App Updates Based on User Reviews"],"prefix":"10.3390","volume":"11","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3767-2527","authenticated-orcid":false,"given":"Xiaozhou","family":"Li","sequence":"first","affiliation":[{"name":"Faculty of Information Technology and Communication Sciences (ITC), Tampere University, 33520 Tampere, Finland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Boyang","family":"Zhang","sequence":"additional","affiliation":[{"name":"Faculty of Information Technology and Communication Sciences (ITC), Tampere University, 33520 Tampere, Finland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zheying","family":"Zhang","sequence":"additional","affiliation":[{"name":"Faculty of Information Technology and Communication Sciences (ITC), Tampere University, 33520 Tampere, Finland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kostas","family":"Stefanidis","sequence":"additional","affiliation":[{"name":"Faculty of Information Technology and Communication Sciences (ITC), Tampere University, 33520 Tampere, Finland"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2020,3,12]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Nayebi, M., Adams, B., and Ruhe, G. (2016, January 14\u201318). Release Practices for Mobile Apps\u2013What do Users and Developers Think?. Proceedings of the 2016 IEEE 23rd International Conference on Software Analysis, Evolution, and Reengineering (Saner), Osaka, Japan.","DOI":"10.1109\/SANER.2016.116"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"70","DOI":"10.1109\/MS.2014.50","article-title":"What do mobile app users complain about?","volume":"32","author":"Khalid","year":"2014","journal-title":"IEEE Softw."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"22","DOI":"10.1016\/j.tele.2010.05.006","article-title":"Mobile application market: A developer\u2019s perspective","volume":"28","author":"Holzer","year":"2011","journal-title":"Telemat. Inf."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Galvis Carre\u00f1o, L.V., and Winbladh, K. (2013, January 18\u201326). Analysis of user comments: An approach for software requirements evolution. Proceedings of the 2013 International Conference on Software Engineering, San Francisco, CA, USA.","DOI":"10.1109\/ICSE.2013.6606604"},{"key":"ref_5","unstructured":"Chen, N., Lin, J., Hoi, S.C., Xiao, X., and Zhang, B. (31\u20137, January 31). AR-miner: Mining informative reviews for developers from mobile app marketplace. Proceedings of the 36th International Conference on Software Engineering, Hyderabad, India."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Guzman, E., and Maalej, W. (2014, January 25\u201329). How do users like this feature? a fine grained sentiment analysis of app reviews. Proceedings of the 2014 IEEE 22nd international requirements engineering conference (RE), Karlskrona, Sweden.","DOI":"10.1109\/RE.2014.6912257"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Maalej, W., and Nabil, H. (2015, January 24\u201328). Bug report, feature request, or simply praise? on automatically classifying app reviews. Proceedings of the 2015 IEEE 23rd international requirements engineering conference (RE), Ottawa, ON, Canada.","DOI":"10.1109\/RE.2015.7320414"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Panichella, S., Di Sorbo, A., Guzman, E., Visaggio, C.A., Canfora, G., and Gall, H.C. (October, January 27). How can i improve my app? classifying user reviews for software maintenance and evolution. Proceedings of the 2015 IEEE international conference on software maintenance and evolution (ICSME), Bremen, Germany.","DOI":"10.1109\/ICSM.2015.7332474"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1067","DOI":"10.1007\/s10664-015-9375-7","article-title":"Analyzing and automatically labelling the types of user issues that are raised in mobile app reviews","volume":"21","author":"McIlroy","year":"2016","journal-title":"Empir. Softw. Eng."},{"key":"ref_10","unstructured":"Li, X., Zhang, Z., and Stefanidis, K. (2018, January 14\u201318). Sentiment-aware Analysis of Mobile Apps User Reviews Regarding Particular Updates. Proceedings of the Thirteenth International Conference on Software Engineering Advances (ICSEA), Nice, France."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Fu, B., Lin, J., Li, L., Faloutsos, C., Hong, J., and Sadeh, N. (2013, January 11\u201313). Why people hate your app: Making sense of user feedback in a mobile app store. Proceedings of the 19th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Chicago, IL, USA.","DOI":"10.1145\/2487575.2488202"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"458","DOI":"10.1016\/j.procs.2014.07.013","article-title":"Sentiment analysis on reviews of mobile users","volume":"34","author":"Zhang","year":"2014","journal-title":"Procedia Comput. Sci."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Fafalios, P., Iosifidis, V., Stefanidis, K., and Ntoutsi, E. (2017, January 18\u201321). Multi-aspect Entity-Centric Analysis of Big Social Media Archives. Proceedings of the Research and Advanced Technology for Digital Libraries\u201421st International Conference on Theory and Practice of Digital Libraries TPDL, Thessaloniki, Greece.","DOI":"10.1007\/978-3-319-67008-9_21"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Stratigi, M., Li, X., Stefanidis, K., and Zhang, Z. (2019). Ratings vs. Reviews in Recommender Systems: A Case Study on the Amazon Movies Dataset. European Conference on Advances in Databases and Information Systems, Springer.","DOI":"10.1007\/978-3-030-30278-8_9"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Villarroel, L., Bavota, G., Russo, B., Oliveto, R., and Di Penta, M. (2016, January 14\u201322). Release planning of mobile apps based on user reviews. Proceedings of the 2016 IEEE\/ACM 38th International Conference on Software Engineering (ICSE), Austin, TX, USA.","DOI":"10.1145\/2884781.2884818"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Ciurumelea, A., Schaufelb\u00fchl, A., Panichella, S., and Gall, H.C. (2017, January 20\u201324). Analyzing reviews and code of mobile apps for better release planning. Proceedings of the 2017 IEEE 24th International Conference on Software Analysis, Evolution and Reengineering (SANER), Klagenfurt, Austria.","DOI":"10.1109\/SANER.2017.7884612"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Palomba, F., Salza, P., Ciurumelea, A., Panichella, S., Gall, H., Ferrucci, F., and De Lucia, A. (2017, January 20\u201328). Recommending and localizing change requests for mobile apps based on user reviews. Proceedings of the 39th International Conference on Software Engineering, Buenos Aires, Argentina.","DOI":"10.1109\/ICSE.2017.18"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Koskela, M., Simola, I., and Stefanidis, K. (2018, January 10\u201313). Open Source Software Recommendations Using Github. Proceedings of the Digital Libraries for Open Knowledge, 22nd International Conference on Theory and Practice of Digital Libraries TPDL, Porto, Portugal.","DOI":"10.1007\/978-3-030-00066-0_24"},{"key":"ref_19","unstructured":"M\u00f6ller, A., Michahelles, F., Diewald, S., Roalter, L., and Kranz, M. Update behavior in app markets and security implications: A case study in google play. Proceedings of the 14th International Conference on Human Computer Interaction with Mobile Devices and Services, San Francisco, CA, USA."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Xia, X., Shihab, E., Kamei, Y., Lo, D., and Wang, X. (2016, January 8\u20139). Predicting crashing releases of mobile applications. Proceedings of the 10th ACM\/IEEE International Symposium on Empirical Software Engineering and Measurement, Ciudad Real, Spain.","DOI":"10.1145\/2961111.2962606"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"207","DOI":"10.1016\/j.jss.2016.11.027","article-title":"A systematic literature review: Opinion mining studies from mobile app store user reviews","volume":"125","author":"Abran","year":"2017","journal-title":"J. Syst. Softw."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Gao, C., Xu, H., Hu, J., and Zhou, Y. (30\u20133, January 30). Ar-tracker: Track the dynamics of mobile apps via user review mining. Proceedings of the 2015 IEEE Symposium on Service-Oriented System Engineering, San Francisco, CA, USA.","DOI":"10.1109\/SOSE.2015.13"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Chandy, R., and Gu, H. (2012, January 16). Identifying spam in the iOS app store. Proceedings of the 2nd Joint WICOW\/AIRWeb Workshop on Web Quality, Lyon, France.","DOI":"10.1145\/2184305.2184317"},{"key":"ref_24","unstructured":"Vu, P.M., Nguyen, T.T., Pham, H.V., and Nguyen, T.T. (2015, January 9\u201313). Mining user opinions in mobile app reviews: A keyword-based approach (t). Proceedings of the 2015 30th IEEE\/ACM International Conference on Automated Software Engineering (ASE), Lincoln, NA, USA."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Iacob, C., and Harrison, R. (2013, January 18\u201319). Retrieving and analyzing mobile apps feature requests from online reviews. Proceedings of the 10th Working Conference on Mining Software Repositories, San Francisco, CA, USA.","DOI":"10.1109\/MSR.2013.6624001"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Pagano, D., and Maalej, W. (2013, January 15\u201319). User feedback in the appstore: An empirical study. Proceedings of the 2013 21st IEEE international requirements engineering conference (RE), Rio de Janeiro, Brazil.","DOI":"10.1109\/RE.2013.6636712"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Zimina, E., Nummenmaa, J., J\u00e4rvelin, K., Peltonen, J., Stefanidis, K., and Hyyr\u00f6, H. (2018, January 3\u20137). GQA: Grammatical Question Answering for RDF Data. Proceedings of the Semantic Web Challenges\u20145th SemWebEval Challenge at ESWC, Heraklion, Greece.","DOI":"10.1007\/978-3-030-00072-1_8"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Wang, S., Wang, Z., Xu, X., and Sheng, Q.Z. (2017). App Update Patterns: How Developers Act on User Reviews in Mobile App Stores. International Conference on Service-Oriented Computing, Springer.","DOI":"10.1007\/978-3-319-69035-3_9"},{"key":"ref_29","unstructured":"Li, X., Zhang, Z., and Stefanidis, K. (2018, January 26\u201328). Mobile App Evolution Analysis Based on User Reviews. Proceedings of the International Conference on Intelligent Software Methodologies, Tools, and Techniques, Granada, Spain."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"68","DOI":"10.1080\/01621459.1951.10500769","article-title":"The Kolmogorov-Smirnov test for goodness of fit","volume":"46","author":"Massey","year":"1951","journal-title":"J. Am. Stat. Assoc."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"685","DOI":"10.1080\/02664760500079464","article-title":"A generalized normal distribution","volume":"32","author":"Nadarajah","year":"2005","journal-title":"J. Appl. Stat."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"88","DOI":"10.1080\/00031305.1994.10476030","article-title":"The three sigma rule","volume":"48","author":"Pukelsheim","year":"1994","journal-title":"Am. Stat."},{"key":"ref_33","first-page":"177","article-title":"Des valeurs moyennes, Liouville\u2019s","volume":"12","author":"Chebyshev","year":"1867","journal-title":"J. Math. Pures Appl."},{"key":"ref_34","unstructured":"Hoon, L., Vasa, R., Schneider, J.G., and Grundy, J. (2013). An Analysis of the Mobile App Review Landscape: Trends And Implications, Faculty of Information and Communication Technologies, Swinburne University of Technology."},{"key":"ref_35","unstructured":"Mikolov, T., Sutskever, I., Chen, K., Corrado, G.S., and Dean, J. (2013). Distributed representations of words and phrases and their compositionality. Advances in Neural Information Processing Systems, The MIT Press."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Xue, B., Fu, C., and Shaobin, Z. (July, January 27). A study on sentiment computing and classification of sina weibo with word2vec. Proceedings of the 2014 IEEE International Congress on Big Data, Anchorage, AK, USA.","DOI":"10.1109\/BigData.Congress.2014.59"},{"key":"ref_37","unstructured":"Ramos, J. (2003, January 3\u20138). Using tf-idf to determine word relevance in document queries. Proceedings of the First Instructional Conference on Machine Learning, Piscataway, NJ, USA."},{"key":"ref_38","unstructured":"(2019, September 30). Langdetect. Available online: https:\/\/pypi.python.org\/pypi\/langdetect."},{"key":"ref_39","unstructured":"(2019, September 30). NLTK. Available online: http:\/\/www.nltk.org."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Hutto, C.J., and Gilbert, E. (2014, January 1\u20134). Vader: A parsimonious rule-based model for sentiment analysis of social media text. Proceedings of the Eighth international AAAI conference on Weblogs and Social Media, Ann Arbor, MI, USA.","DOI":"10.1609\/icwsm.v8i1.14550"},{"key":"ref_41","unstructured":"Cambria, E., Speer, R., Havasi, C., and Hussain, A. (2010, January 11\u201313). Senticnet: A publicly available semantic resource for opinion mining. Proceedings of the AAAI Fall Symposium: Commonsense Knowledge, Arlington, VA, USA."},{"key":"ref_42","unstructured":"Baccianella, S., Esuli, A., and Sebastiani, F. (2010). Sentiwordnet 3.0: An Enhanced Lexical Resource for Sentiment Analysis and Opinion Mining, Lrec."},{"key":"ref_43","unstructured":"Bradley, M.M., and Lang, P.J. (1999). Affective Norms for English Words (ANEW): Instruction Manual and Affective Ratings, Technical Report; University of Florida, The Center for Research in Psychophysiology."},{"key":"ref_44","unstructured":"Stevenson, M., and Wilks, Y. (2003). Word sense disambiguation. The Oxford Handbook of Computational Linguistics, Oxford University Press."},{"key":"ref_45","unstructured":"Li, X., Zhang, Z., and Nummenmaa, J. (2014, January 28\u201330). Models for mobile application maintenance based on update history. Proceedings of the 2014 9th International Conference on Evaluation of Novel Approaches to Software Engineering (ENASE), Lisbon, Portugal."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"225","DOI":"10.1287\/isre.2016.0664","article-title":"Logic pluralism in mobile platform ecosystems: A study of indie app developers on the iOS app store","volume":"28","author":"Qiu","year":"2017","journal-title":"Inf. Syst. Res."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"823","DOI":"10.1177\/0165551510388123","article-title":"Aspect-based sentiment analysis of movie reviews on discussion boards","volume":"36","author":"Thet","year":"2010","journal-title":"J. Inf. Sci."}],"container-title":["Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2078-2489\/11\/3\/152\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T09:06:14Z","timestamp":1760173574000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2078-2489\/11\/3\/152"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,3,12]]},"references-count":47,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2020,3]]}},"alternative-id":["info11030152"],"URL":"https:\/\/doi.org\/10.3390\/info11030152","relation":{},"ISSN":["2078-2489"],"issn-type":[{"value":"2078-2489","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,3,12]]}}}