{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T21:00:50Z","timestamp":1776114050809,"version":"3.50.1"},"reference-count":80,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2025,10,31]],"date-time":"2025-10-31T00:00:00Z","timestamp":1761868800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Software"],"abstract":"<jats:p>This study investigates how software developers discuss usability on Stack Overflow through an analysis of posts from 2008 to 2024. Despite recognizing the importance of usability for software success, there is a limited amount of research on developer engagement with usability topics. Using mixed methods that combine quantitative metric analysis and qualitative content review, we examine temporal trends, comparative engagement patterns across eight non-functional requirements, and programming context-specific usability issues. Our findings show a significant decrease in usability posts since 2010, contrasting with other non-functional requirements, such as performance and security. Despite this decline, usability posts exhibit high resolution efficiency, achieving the highest answer and acceptance rates among all topics, suggesting that the community is highly effective at resolving these specialized questions. We identify distinctive platform-specific usability concerns: web development prioritizes responsive layouts and form design; desktop applications emphasize keyboard navigation and complex controls; and mobile development focuses on touch interactions and screen constraints. These patterns indicate a transformation in the sharing of usability knowledge, reflecting the maturation of the field, its integration into frameworks, and the migration to specialized communities. This first longitudinal analysis of usability discussions on Stack Overflow provides insights into developer engagement with usability and highlights opportunities for integrating usability guidance into technical contexts.<\/jats:p>","DOI":"10.3390\/software4040027","type":"journal-article","created":{"date-parts":[[2025,11,3]],"date-time":"2025-11-03T13:55:22Z","timestamp":1762178122000},"page":"27","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["The Evolution of Software Usability in Developer Communities: An Empirical Study on Stack Overflow"],"prefix":"10.3390","volume":"4","author":[{"ORCID":"https:\/\/orcid.org\/0009-0003-9158-1575","authenticated-orcid":false,"given":"Hans","family":"Djalali","sequence":"first","affiliation":[{"name":"Department of Computer Science and Engineering, College of Engineering, University of North Texas, Denton, TX 76207, USA"}]},{"given":"Wajdi","family":"Aljedaani","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Engineering, College of Engineering, University of North Texas, Denton, TX 76207, USA"}]},{"given":"Stephanie","family":"Ludi","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Engineering, College of Engineering, University of North Texas, Denton, TX 76207, USA"}]}],"member":"1968","published-online":{"date-parts":[[2025,10,31]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Liang, J.T., Yang, C., and Myers, B.A. (2024;, January 14\u201320). A Large-Scale Survey on the Usability of AI Programming Assistants: Successes and Challenges. Proceedings of the 46th IEEE\/ACM International Conference on Software Engineering, Lisbon, Portugal. ICSE\u201924.","DOI":"10.1145\/3597503.3608128"},{"key":"ref_2","unstructured":"Diniz, L.d.N., de Souza Filho, J.C., and Carvalho, R.M. (May, January 30). Can User Reviews Indicate Usability Heuristic Issues?. Proceedings of the CHI Conference on Human Factors in Computing Systems Extended Abstracts, New Orleans, LA, USA."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Morgan, M., Ludi, S., Cook, L., and Warren, A. (2023, January 3\u20136). Impact of Usability Heuristics on User Satisfaction Among Coding Apps for Children. Proceedings of the 2023 IEEE Symposium on Visual Languages and Human-Centric Computing (VL\/HCC), Washington, DC, USA.","DOI":"10.1109\/VL-HCC57772.2023.00045"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Zheng, Q., Chen, M., Sharma, P., Tang, Y., Oswal, M., Liu, Y., and Huang, Y. (May, January 26). EvAlignUX: Advancing UX Evaluation through LLM-Supported Metrics Exploration. Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems, Yokohama, Japan. CHI\u201925.","DOI":"10.1145\/3706598.3714045"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3757703","article-title":"Who is to Blame: A Comprehensive Review of Challenges and Opportunities in Designer-Developer Collaboration","volume":"9","author":"Zhang","year":"2025","journal-title":"Proc. ACM-Hum.-Comput. Interact."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Antelmi, A., Cordasco, G., De Vinco, D., and Spagnuolo, C. (May, January 30). The Age of Snippet Programming: Toward Understanding Developer Communities in Stack Overflow and Reddit. Proceedings of the Companion Proceedings of the ACM Web Conference 2023, New York, NY, USA. WWW\u201923 Companion.","DOI":"10.1145\/3543873.3587673"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Dabbish, L., Stuart, C., Tsay, J., and Herbsleb, J. (2012, January 11\u201315). Social coding in GitHub: Transparency and collaboration in an open software repository. Proceedings of the ACM 2012 Conference on Computer Supported Cooperative Work, Seattle, WA, USA.","DOI":"10.1145\/2145204.2145396"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Shrestha, P., Sathanur, A., Maharjan, S., Saldanha, E., Arendt, D., and Volkova, S. (2020). Multiple social platforms reveal actionable signals for software vulnerability awareness: A study of GitHub, Twitter and Reddit. PLoS ONE, 15.","DOI":"10.1371\/journal.pone.0230250"},{"key":"ref_9","unstructured":"Stack Overflow (2024). Stack Overflow Developer Survey 2024, Stack Overflow. Technical report."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"619","DOI":"10.1007\/s10664-012-9231-y","article-title":"What are developers talking about? an analysis of topics and trends in stack overflow","volume":"19","author":"Barua","year":"2014","journal-title":"Empir. Softw. Eng."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1192","DOI":"10.1007\/s10664-015-9379-3","article-title":"What are mobile developers asking about? a large scale study using stack overflow","volume":"21","author":"Rosen","year":"2016","journal-title":"Empir. Softw. Eng."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Vasilescu, B., Filkov, V., and Serebrenik, A. (2013, January 8\u201314). StackOverflow and GitHub: Associations between software development and crowdsourced knowledge. Proceedings of the 2013 International Conference on Social Computing, Alexandria, VA, USA.","DOI":"10.1109\/SocialCom.2013.35"},{"key":"ref_13","first-page":"16","article-title":"Cybersecurity discussions in Stack Overflow: A developer-centred analysis of engagement and self-disclosure behaviour","volume":"14","author":"Vidoni","year":"2024","journal-title":"Soc. Netw. Anal. Min."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Bevan, N., Carter, J., and Harker, S. (2015, January 2\u20137). ISO 9241-11 revised: What have we learnt about usability since 1998?. Proceedings of the Human-Computer Interaction: Design and Evaluation: 17th International Conference, HCI International 2015, Los Angeles, CA, USA. Proceedings, Part I 17.","DOI":"10.1007\/978-3-319-20901-2_13"},{"key":"ref_15","unstructured":"(2023). Systems and Software Engineering\u2014Systems and Software Quality Requirements and Evaluation (SQuaRE)\u2014Product Quality Model (Standard No. ISO\/IEC 25010:2023)."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Nielsen, J. (1994, January 24\u201328). Enhancing the explanatory power of usability heuristics. Proceedings of the ACM CHI\u201994 Conference on Human Factors in Computing Systems, Boston, MA, USA.","DOI":"10.1145\/259963.260333"},{"key":"ref_17","unstructured":"Wharton, C., Rieman, J., Lewis, C., and Polson, P. (1994, January 3). The cognitive walkthrough method: A practitioner\u2019s guide. Proceedings of the Usability Inspection Methods, New York, NY, USA."},{"key":"ref_18","unstructured":"Norman, D.A. (2013). The Design of Everyday Things: Revised and Expanded Edition, Basic Books."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"61145","DOI":"10.1109\/ACCESS.2019.2914429","article-title":"Toward Empirically Investigating Non-Functional Requirements of iOS Developers on Stack Overflow","volume":"7","author":"Ahmad","year":"2019","journal-title":"IEEE Access"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Zou, J., Xu, L., Guo, W., Yan, M., Yang, D., and Zhang, X. (2015, January 16\u201317). Which Non-functional Requirements Do Developers Focus On? An Empirical Study on Stack Overflow Using Topic Analysis. Proceedings of the 2015 IEEE\/ACM 12th Working Conference on Mining Software Repositories, Florence, Italy.","DOI":"10.1109\/MSR.2015.60"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"34","DOI":"10.1016\/j.apergo.2015.11.016","article-title":"Establishing usability heuristics for heuristics evaluation in a specific domain: Is there a consensus?","volume":"56","author":"Hermawati","year":"2016","journal-title":"Appl. Ergon."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"109","DOI":"10.1016\/j.csi.2018.03.002","article-title":"A methodology to develop usability\/user experience heuristics","volume":"59","author":"Rusu","year":"2018","journal-title":"Comput. Stand. Interfaces"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Riahi, F., Zolaktaf, Z., Shafiei, M., and Milios, E. (2012, January 16\u201320). Finding expert users in community question answering. Proceedings of the 21st International Conference on World Wide Web, Lyon, France.","DOI":"10.1145\/2187980.2188202"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Vasilescu, B., Capiluppi, A., and Serebrenik, A. (2012, January 14\u201316). Gender, representation and online participation: A quantitative study of stackoverflow. Proceedings of the 2012 International Conference on Social Informatics, Alexandria, VA, USA.","DOI":"10.1109\/SocialInformatics.2012.81"},{"key":"ref_25","unstructured":"Parnin, C., Treude, C., Grammel, L., and Storey, M.A. (2012). Crowd Documentation: Exploring the Coverage and the Dynamics of API Discussions on Stack Overflow, Georgia Institute of Technology. Available online: http:\/\/chrisparnin.me\/pdf\/crowddoc.pdf."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Allamanis, M., and Sutton, C. (2013, January 18\u201319). Why, when, and what: Analyzing stack overflow questions by topic, type, and code. Proceedings of the 2013 10th Working Conference on Mining Software Repositories (MSR), San Francisco, CA, USA.","DOI":"10.1109\/MSR.2013.6624004"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Subramanian, S., and Holmes, R. (2013, January 18\u201319). Making sense of online code snippets. Proceedings of the 2013 10th Working Conference on Mining Software Repositories (MSR), San Francisco, CA, USA.","DOI":"10.1109\/MSR.2013.6624012"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Saha, A.K., Saha, R.K., and Schneider, K.A. (2013, January 18\u201319). A discriminative model approach for suggesting tags automatically for stack overflow questions. Proceedings of the 2013 10th Working Conference on Mining Software Repositories (MSR), San Francisco, CA, USA.","DOI":"10.1109\/MSR.2013.6624009"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Kavaler, D., Posnett, D., Gibler, C., Chen, H., Devanbu, P., and Filkov, V. (2013, January 25\u201327). Using and asking: Apis used in the android market and asked about in stackoverflow. Proceedings of the Social Informatics: 5th International Conference, SocInfo 2013, Kyoto, Japan. Proceedings 5.","DOI":"10.1007\/978-3-319-03260-3_35"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"19","DOI":"10.1016\/j.infsof.2016.12.003","article-title":"Towards comprehending the non-functional requirements through developers\u2019 eyes: An exploration of stack overflow using topic analysis","volume":"84","author":"Zou","year":"2017","journal-title":"Inf. Softw. Technol."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1007\/s10664-021-10045-x","article-title":"How do i refactor this? An empirical study on refactoring trends and topics in Stack Overflow","volume":"27","author":"Peruma","year":"2022","journal-title":"Empir. Softw. Eng."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"2258","DOI":"10.1007\/s10664-019-09758-x","article-title":"What kind of questions do developers ask on Stack Overflow? A comparison of automated approaches to classify posts into question categories","volume":"25","author":"Beyer","year":"2020","journal-title":"Empir. Softw. Eng."},{"key":"ref_33","first-page":"501","article-title":"An empirical study on how iOS developers report quality aspects on stack overflow","volume":"8","author":"Ahmad","year":"2018","journal-title":"Int. J. Mach. Learn. Comput."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Moutidis, I., and Williams, H.T.P. (2021). Community evolution on Stack Overflow. PLoS ONE, 16.","DOI":"10.1371\/journal.pone.0253010"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"101340","DOI":"10.1016\/j.cola.2025.101340","article-title":"Python\u2019s evolution on Stack Overflow: An empirical analysis of topic trends","volume":"84","author":"Hu","year":"2025","journal-title":"J. Comput. Lang."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"1951","DOI":"10.1007\/s11423-022-10152-6","article-title":"Usability research in educational technology: A state-of-the-art systematic review","volume":"70","author":"Lu","year":"2022","journal-title":"Educ. Technol. Res. Dev."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"107404","DOI":"10.1016\/j.infsof.2024.107404","article-title":"A longitudinal study on the temporal validity of software samples","volume":"168","author":"Carruthers","year":"2024","journal-title":"Inf. Softw. Technol."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"12","DOI":"10.9734\/ajrcos\/2022\/v13i430319","article-title":"Usability Evaluation of an Unpopular Restaurant Recommender Web Application Zomato","volume":"13","author":"Reddy","year":"2022","journal-title":"Asian J. Res. Comput. Sci."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"55563","DOI":"10.1109\/ACCESS.2020.2981892","article-title":"Usability of mobile applications: A systematic literature study","volume":"8","author":"Weichbroth","year":"2020","journal-title":"IEEE Access"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"1701","DOI":"10.1007\/s10209-024-01174-3","article-title":"Understanding developer challenges and trends in web accessibility: A stack overflow analysis","volume":"24","author":"Alghamdi","year":"2025","journal-title":"Univers. Access Inf. Soc."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Alghamdi, A.M., Aljedaani, W., Ludi, S., and Javed, Y. (2025, January 16\u201317). Automating accessibility compliance: Leveraging machine learning to analyze developer challenges with wcag guidelines. Proceedings of the 2025 8th International Conference on Data Science and Machine Learning Applications (CDMA), Riyadh, Saudi Arabia.","DOI":"10.1109\/CDMA61895.2025.00016"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Alghamdi, A.M., Aljedaani, W., Eler, M.M., and Ludi, S. (2024, January 13\u201314). Accessibility guidelines and standards: Analyzing stack overflow posts. Proceedings of the 21st International Web for All Conference, Singapore.","DOI":"10.1145\/3677846.3677857"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"44","DOI":"10.1145\/1897816.1897836","article-title":"Finding usability bugs with automated tests","volume":"54","author":"Harty","year":"2011","journal-title":"Commun. ACM"},{"key":"ref_44","unstructured":"Au, F.T., Baker, S., Warren, I., and Dobbie, G. (2008, January 1). Automated usability testing framework. Proceedings of the Ninth Conference on Australasian User Interface-Volume 76, Wollongong, Australia."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Baker, S., Au, F., Dobbie, G., and Warren, I. (2008, January 25\u201328). Automated usability testing using HUI analyzer. Proceedings of the 19th Australian Conference on Software Engineering (ASWEC 2008), Perth, Australia.","DOI":"10.1109\/ASWEC.2008.4483248"},{"key":"ref_46","unstructured":"Meiselwitz, G. (2018). An Experience of Textual Evaluation Using the MALTU Methodology. Social Computing and Social Media. Technologies and Analytics, Springer."},{"key":"ref_47","unstructured":"da Silva, T.H.O., Freitas, L.M., Mendes, M.S., and Furtado, E.S. (2019, January 11). Textual evaluation vs. User testing: A comparative analysis. Proceedings of the Anais do X Workshop sobre Aspectos da Intera\u00e7\u00e3o Humano-Computador para a Web Social, Porto Alegre, RS, Brasil."},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"da Silva, T.H.O., Freitas, L.M., and Mendes, M.S. (2017, January 23\u201327). Beyond Traditional Evaluations: User\u2019s View in App Stores. Proceedings of the XVI Brazilian Symposium on Human Factors in Computing Systems, New York, NY, USA. IHC 2017.","DOI":"10.1145\/3160504.3160548"},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"de Souza Filho, J.C., Brito, M.R.F., and Sampaio, A.L. (2020, January 26\u201330). Comparing Heuristic Evaluation and MALTU Model in Interaction Evaluation of Ubiquitous Systems. Proceedings of the 19th Brazilian Symposium on Human Factors in Computing Systems, New York, NY, USA. IHC\u201920.","DOI":"10.1145\/3424953.3426639"},{"key":"ref_50","first-page":"2079","article-title":"Automatic Classification of Non-Functional Requirements in App User Reviews Based on System Model","volume":"50","author":"Li","year":"2022","journal-title":"Acta Electonica Sin."},{"key":"ref_51","unstructured":"Hedegaard, S., and Simonsen, J.G. (May, January 27). Extracting Usability and User Experience Information from Online User Reviews. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Paris, France. CHI\u201913."},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Bakiu, E., and Guzman, E. (2017, January 4\u20138). Which feature is unusable? Detecting usability and user experience issues from user reviews. Proceedings of the 2017 IEEE 25th International Requirements Engineering Conference Workshops (REW), Lisbon, Portugal.","DOI":"10.1109\/REW.2017.76"},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Alqahtani, F., and Orji, R. (2019, January 9\u201312). Usability issues in mental health applications. Proceedings of the Adjunct Publication of the 27th Conference on User Modeling, Adaptation and Personalization, Larnaca, Cyprus.","DOI":"10.1145\/3314183.3323676"},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"615","DOI":"10.1007\/s13753-020-00282-x","article-title":"Modified usability framework for disaster apps: A qualitative thematic analysis of user reviews","volume":"11","author":"Tan","year":"2020","journal-title":"Int. J. Disaster Risk Sci."},{"key":"ref_55","doi-asserted-by":"crossref","unstructured":"Lobo, E.H., Abdelrazek, M., Fr\u00f8lich, A., Rasmussen, L.J., Livingston, P.M., Islam, S.M.S., Kensing, F., and Grundy, J. (2025, July 17). Detecting usability and user experience issues in stroke caregiving apps: An analysis of user reviews. Preprints, Available online: https:\/\/doi.org\/10.20944\/preprints202202.0093.v1.","DOI":"10.20944\/preprints202202.0093.v1"},{"key":"ref_56","doi-asserted-by":"crossref","unstructured":"Alagmdi, S., Albanyan, A., and Ludi, S. (2023, January 8\u201311). Investigating The Usability Issues In Mobile Applications Reviews Using A Deep Learning Model. Proceedings of the 2023 IEEE 13th Annual Computing and Communication Workshop and Conference (CCWC), Virtual.","DOI":"10.1109\/CCWC57344.2023.10099350"},{"key":"ref_57","first-page":"18","article-title":"Investigating the user experience and evaluating usability issues in ai-enabled learning mobile apps: An analysis of user reviews","volume":"14","author":"Alsanousi","year":"2023","journal-title":"Int. J. Adv. Comput. Sci. Appl."},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"e2421","DOI":"10.7717\/peerj-cs.2421","article-title":"User-centric AI: Evaluating the usability of generative AI applications through user reviews on app stores","volume":"10","author":"Alabduljabbar","year":"2024","journal-title":"Peerj Comput. Sci."},{"key":"ref_59","first-page":"949","article-title":"Hybrid Deep Learning Approach for Automating App Review Classification: Advancing Usability Metrics Classification with an Aspect-Based Sentiment Analysis Framework","volume":"82","author":"Alsaleh","year":"2025","journal-title":"Comput. Mater. Contin."},{"key":"ref_60","unstructured":"Pachabotla, L.S., and Konka, C. (2022). Comparative Study of Mobile Payment Apps: Google Pay and PayPal Using Nielsen\u2019s Usability Heuristics. [Bachelor Thesis, Blekinge Institute of Technology]."},{"key":"ref_61","doi-asserted-by":"crossref","first-page":"012019","DOI":"10.1088\/1742-6596\/1511\/1\/012019","article-title":"Observation and heuristics evaluation of student web-based application of SIPADU-STIS","volume":"1511","author":"Maghfiroh","year":"2020","journal-title":"J. Physics Conf. Ser."},{"key":"ref_62","unstructured":"Alexandrini, D.F., de Freitas, D.A.G., and In\u00e1cio, B. (2022, January 20\u201322). Comparative Evaluation Unity and Unreal, using Nielsen\u2019s 10 Heuristics as an Evaluation Parameter. Proceedings of the International Conference on Industrial Engineering and Operations Management Sydney, Australia."},{"key":"ref_63","unstructured":"Sanei, A., and Cheng, J. (2023). Characterizing Usability Issue Discussions in OSS Projects. arXiv."},{"key":"ref_64","unstructured":"Tashakkori, A., Teddlie, C., and Teddlie, C.B. (1998). Mixed Methodology: Combining Qualitative and Quantitative Approaches, Sage."},{"key":"ref_65","unstructured":"Field, A. (2013). Discovering Statistics Using IBM SPSS Statistics, SAGE Publications. [4th ed.]."},{"key":"ref_66","doi-asserted-by":"crossref","unstructured":"Mamykina, L., Manoim, B., Mittal, M., Hripcsak, G., and Hartmann, B. (2011, January 7\u201312). Design lessons from the fastest Q&A site in the west. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Vancouver, BC, USA.","DOI":"10.1145\/1978942.1979366"},{"key":"ref_67","first-page":"153","article-title":"Tag-based user modeling for expert finding in Stack Overflow","volume":"94","author":"Wang","year":"2018","journal-title":"Inf. Softw. Technol."},{"key":"ref_68","doi-asserted-by":"crossref","unstructured":"Aljedaani, W., Mkaouer, M.W., Ludi, S., Ouni, A., and Jenhani, I. (2022, January 25\u201326). On the identification of accessibility bug reports in open source systems. Proceedings of the 19th International Web for All Conference, Virtual.","DOI":"10.1145\/3493612.3520471"},{"key":"ref_69","unstructured":"Aljedaani, W., Alkahtani, M., Ludi, S., Mkaouer, M.W., Eler, M.M., Kessentini, M., and Ouni, A. (May, January 30). The state of accessibility in blackboard: Survey and user reviews case study. Proceedings of the 20th International Web for All Conference, Austin, TX, USA."},{"key":"ref_70","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1177\/001316446002000104","article-title":"A coefficient of agreement for nominal scales","volume":"20","author":"Cohen","year":"1960","journal-title":"Educ. Psychol. Meas."},{"key":"ref_71","first-page":"22","article-title":"The measurement of interrater agreement","volume":"2","author":"Fleiss","year":"1981","journal-title":"Stat. Methods Rates Proportions"},{"key":"ref_72","unstructured":"Gustafsson, E.W. (2021). Defining and Evaluating Design System Usability for Improved Developer Experience. [Master\u2019s Thesis, KTH Royal Institute of Technology, School of Electrical Engineering and Computer Science]."},{"key":"ref_73","doi-asserted-by":"crossref","first-page":"446","DOI":"10.3390\/ijgi7110446","article-title":"Building a Framework of Usability Patterns for Web Applications","volume":"7","author":"Falke","year":"2018","journal-title":"Isprs Int. J.-Geo-Inf."},{"key":"ref_74","doi-asserted-by":"crossref","first-page":"3803","DOI":"10.32628\/CSEIT25112855","article-title":"AI-Assisted Product Management: Transforming the Product Development Lifecycle","volume":"11","author":"Sarabu","year":"2025","journal-title":"Int. J. Sci. Res. Comput. Sci. Eng. Inf. Technol."},{"key":"ref_75","unstructured":"Devlin, J., Chang, M.W., Lee, K., and Toutanova, K. (2019, January 2\u20137). BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT), Minneapolis, MN, USA."},{"key":"ref_76","first-page":"993","article-title":"Latent Dirichlet Allocation","volume":"3","author":"Blei","year":"2003","journal-title":"J. Mach. Learn. Res."},{"key":"ref_77","unstructured":"Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, L., and Polosukhin, I. (2017, January 4\u20139). Attention Is All You Need. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), Long Beach, CA, USA."},{"key":"ref_78","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3274404","article-title":"Information needs in contemporary code review","volume":"2","author":"Pascarella","year":"2018","journal-title":"Proc. ACM-Hum.-Comput. Interact."},{"key":"ref_79","unstructured":"Commons, C. (2025, July 17). Creative Commons Attribution-ShareAlike 4.0 International License. Creative Commons. Available online: https:\/\/creativecommons.org\/licenses\/by-sa\/4.0\/."},{"key":"ref_80","unstructured":"Protection of Human Subjects (2025, July 17). 45 CFR 46.102, Available online: https:\/\/www.hhs.gov\/ohrp\/regulations-and-policy\/regulations\/45-cfr-46\/index.html."}],"container-title":["Software"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2674-113X\/4\/4\/27\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,11,3]],"date-time":"2025-11-03T14:53:39Z","timestamp":1762181619000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2674-113X\/4\/4\/27"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,10,31]]},"references-count":80,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2025,12]]}},"alternative-id":["software4040027"],"URL":"https:\/\/doi.org\/10.3390\/software4040027","relation":{},"ISSN":["2674-113X"],"issn-type":[{"value":"2674-113X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,10,31]]}}}