{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,8]],"date-time":"2026-10-08T11:34:15Z","timestamp":1791459255909,"version":"4.3.4"},"reference-count":89,"publisher":"Association for Computing Machinery (ACM)","issue":"5","funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["62232003 and 62272295"],"award-info":[{"award-number":["62232003 and 62272295"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"name":"National Science Foundation","award":["NSF-2006278"],"award-info":[{"award-number":["NSF-2006278"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Softw. Eng. Methodol."],"published-print":{"date-parts":[[2026,5,31]]},"abstract":"<jats:p>In software development, many documents (e.g., tutorials for tools and mobile application websites) contain screenshots of GUIs to illustrate functionalities. Although screenshots are critical in such documents, screenshots can become outdated, especially if document developers forget to update them. Outdated screenshots can mislead users and diminish the credibility of documentation. Identifying screenshots manually is tedious and error-prone, especially when documents are numerous. However, no existing tools are proposed to detect outdated screenshots in GUI documents.<\/jats:p>\n                  <jats:p>\n                    To mitigate manual efforts, we propose\n                    <jats:sc>DOSUD<\/jats:sc>\n                    , a novel approach for detecting outdated screenshots. It is challenging to identify outdated screenshots since the differences are subtle and only specific areas are useful to identify such screenshots. To address the challenges,\n                    <jats:sc>DOSUD<\/jats:sc>\n                    automatically extracts and labels screenshots and trains a classification model to identify outdated screenshots. As the first exploration, we focus on Android applications and the most popular IDE, VS Code. We evaluated\n                    <jats:sc>DOSUD<\/jats:sc>\n                    on a benchmark comprising 10 popular applications, achieving high F1-scores. When applied in the wild,\n                    <jats:sc>DOSUD<\/jats:sc>\n                    identified 20 outdated screenshots across 50 Android application websites and 17 outdated screenshots in VS Code documentation. VS Code developers have confirmed and fixed all our bug reports.\n                  <\/jats:p>","DOI":"10.1145\/3750041","type":"journal-article","created":{"date-parts":[[2025,7,23]],"date-time":"2025-07-23T16:19:33Z","timestamp":1753287573000},"page":"1-26","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":3,"title":["Detecting Outdated Screenshot from GUI Document"],"prefix":"10.1145","volume":"35","author":[{"ORCID":"https:\/\/orcid.org\/0009-0000-1642-1377","authenticated-orcid":false,"given":"Ye","family":"Tang","sequence":"first","affiliation":[{"name":"Shanghai Jiao Tong University, Shanghai, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0006-9744-1647","authenticated-orcid":false,"given":"Aoyang","family":"Yan","sequence":"additional","affiliation":[{"name":"Shanghai Jiao Tong University, Shanghai, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3267-6801","authenticated-orcid":false,"given":"Hui","family":"Liu","sequence":"additional","affiliation":[{"name":"Beijing Institute of Technology, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0230-5524","authenticated-orcid":false,"given":"Na","family":"Meng","sequence":"additional","affiliation":[{"name":"Virginia Tech, Blacksburg, Virginia, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4302-9183","authenticated-orcid":false,"given":"Hao","family":"Zhong","sequence":"additional","affiliation":[{"name":"Shanghai Jiao Tong University, Shanghai, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2026,4,24]]},"reference":[{"key":"e_1_3_2_2_2","unstructured":"Scikit-learn developers. 2020. K-Folds Cross-Validator. Retrieved from https:\/\/scikit-learn.org\/stable\/modules\/generated\/sklearn.model_selection.KFold.html"},{"key":"e_1_3_2_3_2","unstructured":"Microsoft Azure Documentation. 2021. Content Is Inconsistent with Images. Retrieved from https:\/\/github.com\/MicrosoftDocs\/azure-docs\/issues\/73030"},{"key":"e_1_3_2_4_2","unstructured":"Microsoft Documentation Team. 2021. Microsoft Documentation. Retrieved from https:\/\/github.com\/MicrosoftDocs\/"},{"key":"e_1_3_2_5_2","unstructured":"Backslash. 2021. Remote for Samsung TV\u2014Smart & WiFi Direct. Retrieved from https:\/\/play.google.com\/store\/apps\/details?id=smart.tv.wifi.remote.control.samcontrol"},{"key":"e_1_3_2_6_2","unstructured":"Visual Studio Code Documentation. 2023. \/docs\/azure\/remote-debugging.md Has Outdated Screenshot. Retrieved from https:\/\/github.com\/microsoft\/vscode-docs\/issues\/6866"},{"key":"e_1_3_2_7_2","unstructured":"Visual Studio Code Documentation. 2023. \/docs\/datascience\/jupyter-notebooks.md Has Outdated Screenshots. Retrieved from https:\/\/github.com\/microsoft\/vscode-docs\/issues\/6878"},{"key":"e_1_3_2_8_2","unstructured":"Visual Studio Code Documentation. 2023. \/docs\/editor\/accessibility.md Has Outdated Screenshot. Retrieved from https:\/\/github.com\/microsoft\/vscode-docs\/issues\/6883"},{"key":"e_1_3_2_9_2","unstructured":"Visual Studio Code Documentation. 2023. \/docs\/editor\/extension-marketplace.md Has Outdated Screenshot. Retrieved from https:\/\/github.com\/microsoft\/vscode-docs\/issues\/6884"},{"key":"e_1_3_2_10_2","unstructured":"Visual Studio Code Documentation. 2023. Ignoring Recommendations. Retrieved from https:\/\/github.com\/microsoft\/vscode-docs\/blob\/main\/docs\/editor\/extension-marketplace.md#ignoring-recommendations"},{"key":"e_1_3_2_11_2","unstructured":"Visual Studio Code Documentation. 2023. Install the Extension. Retrieved from https:\/\/github.com\/microsoft\/vscode-docs\/blob\/main\/docs\/azure\/remote-debugging.md#install-the-extension"},{"key":"e_1_3_2_12_2","unstructured":"Open Broadcaster Software. 2023. Open Broadcaster Software (OBS). Retrieved from https:\/\/obsproject.com\/"},{"key":"e_1_3_2_13_2","unstructured":"Stack Overflow. 2023. Stack Overflow 2023 Developer Survey. Retrieved from https:\/\/survey.stackoverflow.co\/2023\/"},{"key":"e_1_3_2_14_2","unstructured":"Visual Studio Code Documentation. 2023. Update High-Contrast Theme Image. Retrieved from https:\/\/github.com\/microsoft\/vscode-docs\/pull\/6893"},{"key":"e_1_3_2_15_2","unstructured":"Visual Studio Code Documentation. 2023. Visual Studio Code Documentation. Retrieved from https:\/\/github.com\/microsoft\/vscode-docs"},{"key":"e_1_3_2_16_2","unstructured":"Visual Studio Code Documentation. 2024. \/docs\/azure\/mongodb.md Has Outdated Screenshot. Retrieved from https:\/\/github.com\/microsoft\/vscode-docs\/issues\/7285"},{"key":"e_1_3_2_17_2","unstructured":"Visual Studio Code Documentation. 2024. \/docs\/supporting\/troubleshoot-terminal-launch.md Has Outdated Screenshot. Retrieved from https:\/\/github.com\/microsoft\/vscode-docs\/issues\/7204"},{"key":"e_1_3_2_18_2","unstructured":"Visual Studio Code Documentation. 2024. Focus Is Not Visible for the Dismiss This Update Button in the Version Info Bar. Retrieved from https:\/\/github.com\/microsoft\/vscode-docs\/issues\/7418"},{"key":"e_1_3_2_19_2","unstructured":"Visual Studio Code Documentation. 2024. Milestones. Retrieved April 2024 from https:\/\/github.com\/microsoft\/vscode-docs\/milestone\/131?closed=1"},{"key":"e_1_3_2_20_2","unstructured":"Visual Studio Code Documentation. 2024. Outdated Gif for \u201cAdd a Jar.\u201d. Retrieved from https:\/\/github.com\/microsoft\/vscode-docs\/issues\/4948"},{"key":"e_1_3_2_21_2","unstructured":"Visual Studio Code Documentation. 2024. Outdated Screenshot in Word Count Extension Tutorial. Retrieved from https:\/\/github.com\/microsoft\/vscode-docs\/issues\/1405"},{"key":"e_1_3_2_22_2","unstructured":"Visual Studio Code Documentation. 2024. Refresh Azure Remote Debugging Content. Retrieved from https:\/\/github.com\/microsoft\/vscode-docs\/pull\/7222"},{"key":"e_1_3_2_23_2","unstructured":"Visual Studio Code Documentation. 2024. Refresh azure\/mongodb Screenshots. Retrieved from https:\/\/github.com\/microsoft\/vscode-docs\/pull\/7318"},{"key":"e_1_3_2_24_2","unstructured":"Visual Studio Code Documentation. 2024. Refresh Extensions Marketplace Screenshots & Content. Retrieved from https:\/\/github.com\/microsoft\/vscode-docs\/pull\/7024"},{"key":"e_1_3_2_25_2","unstructured":"Visual Studio Code Documentation. 2024. Refresh Notebooks Screenshots. Retrieved from https:\/\/github.com\/microsoft\/vscode-docs\/pull\/7435"},{"key":"e_1_3_2_26_2","unstructured":"scikit-learn developers. 2024. Scikit-Learn: Machine Learning in Python. Retrieved from https:\/\/scikit-learn.org\/"},{"key":"e_1_3_2_27_2","unstructured":"S. Moir. 2024. Should You Add Screenshots to Documentation? Retrieved from https:\/\/news.ycombinator.com\/item?id=38639629"},{"key":"e_1_3_2_28_2","unstructured":"Visual Studio Code Documentation. 2024. Update Terminal Troubleshooting Screenshots. Retrieved from https:\/\/github.com\/microsoft\/vscode-docs\/pull\/7260"},{"key":"e_1_3_2_29_2","unstructured":"Visual Studio Code Documentation. 2024. Update Website Main Screenshots. Retrieved from https:\/\/github.com\/microsoft\/vscode-docs\/issues\/1124"},{"key":"e_1_3_2_30_2","unstructured":"Visual Studio Code Documentation. 2024. Vs code 1.69 Release Notes\u2014Emmet\u2014Inline Completions Setting\u2014Incorrect Setting Name. Retrieved from https:\/\/github.com\/microsoft\/vscode-docs\/issues\/5465"},{"key":"e_1_3_2_31_2","unstructured":"Visual Studio Code. 2024. Vs Code Microsoft Software License Terms. Retrieved from https:\/\/code.visualstudio.com\/License"},{"key":"e_1_3_2_32_2","unstructured":"Visual Studio Code Documentation. 2024. Vscecli Doc Outdated. Retrieved from https:\/\/github.com\/microsoft\/vscode-docs\/issues\/550"},{"key":"e_1_3_2_33_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.compbiomed.2018.10.034"},{"key":"e_1_3_2_34_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-013-9293-5"},{"key":"e_1_3_2_35_2","doi-asserted-by":"publisher","DOI":"10.1109\/TG.2019.2947597"},{"key":"e_1_3_2_36_2","doi-asserted-by":"publisher","DOI":"10.1007\/11744023_32"},{"key":"e_1_3_2_37_2","doi-asserted-by":"publisher","DOI":"10.1023\/A:1010933404324"},{"key":"e_1_3_2_38_2","first-page":"93","volume-title":"Proceedings of the IEEE\/ACM 1st International Conference on Automation of Software Test (AST)","author":"Cai T.","year":"2020","unstructured":"T. Cai, Z. Zhang, and P. Yang. 2020. Fastbot: A multi-agent model-based test generation system. In Proceedings of the IEEE\/ACM 1st International Conference on Automation of Software Test (AST), 93\u201396."},{"key":"e_1_3_2_39_2","doi-asserted-by":"publisher","DOI":"10.1145\/3324884.3415300"},{"key":"e_1_3_2_40_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-24412-4_17"},{"key":"e_1_3_2_41_2","doi-asserted-by":"publisher","DOI":"10.1145\/3106237.3106285"},{"key":"e_1_3_2_42_2","doi-asserted-by":"publisher","DOI":"10.1145\/3639478.3643075"},{"key":"e_1_3_2_43_2","first-page":"3717","article-title":"Natural language processing: State of the art, current trends and challenges","author":"Khurana A.","year":"2023","unstructured":"D. Khurana, A. Koli, K. Khatter, and S. Singh. 2023. Natural language processing: State of the art, current trends and challenges. Multimedia Tools and Applications 82, 3 (2023), 3717\u20133744.","journal-title":"Multimedia Tools and Applications"},{"key":"e_1_3_2_44_2","first-page":"957","volume-title":"Proceedings of the 2021 IEEE\/ACM 43rd International Conference on Software Engineering (ICSE)","author":"Cooper N.","year":"2021","unstructured":"N. Cooper, C. Bernal-C\u00e1rdenas, O. Chaparro, K. Moran, and D. Poshyvanyk. 2021. It takes two to Tango: Combining visual and textual information for detecting duplicate video-based bug reports. In Proceedings of the 2021 IEEE\/ACM 43rd International Conference on Software Engineering (ICSE), 957\u2013969. IEEE."},{"key":"e_1_3_2_45_2","doi-asserted-by":"publisher","DOI":"10.1145\/3126594.3126651"},{"key":"e_1_3_2_46_2","doi-asserted-by":"publisher","DOI":"10.1175\/1520-0450(1979)018<1016:LFIOAT>2.0.CO;2"},{"key":"e_1_3_2_47_2","doi-asserted-by":"publisher","DOI":"10.1201\/9780429246593"},{"key":"e_1_3_2_48_2","doi-asserted-by":"publisher","DOI":"10.1016\/S0165-1684(02)00421-8"},{"key":"e_1_3_2_49_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10618-019-00619-1"},{"key":"e_1_3_2_50_2","doi-asserted-by":"publisher","DOI":"10.1023\/B:VISI.0000022288.19776.77"},{"key":"e_1_3_2_51_2","doi-asserted-by":"publisher","DOI":"10.1145\/3582273"},{"key":"e_1_3_2_52_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2025.112527"},{"key":"e_1_3_2_53_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2017.2770124"},{"key":"e_1_3_2_54_2","doi-asserted-by":"publisher","DOI":"10.1145\/3611643.3613885"},{"key":"e_1_3_2_55_2","doi-asserted-by":"publisher","DOI":"10.1109\/HICSS.2014.608"},{"key":"e_1_3_2_56_2","doi-asserted-by":"publisher","DOI":"10.1109\/PROC.1977.10771"},{"key":"e_1_3_2_57_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2003.813431"},{"key":"e_1_3_2_58_2","doi-asserted-by":"publisher","DOI":"10.1109\/WF-IoT.2014.6803110"},{"key":"e_1_3_2_59_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neunet.2005.02.003"},{"key":"e_1_3_2_60_2","doi-asserted-by":"publisher","DOI":"10.1016\/S0098-1354(03)00188-1"},{"key":"e_1_3_2_61_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2019.2901459"},{"key":"e_1_3_2_62_2","doi-asserted-by":"publisher","DOI":"10.1109\/TDSC.2020.2984505"},{"key":"e_1_3_2_63_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.1999.790410"},{"key":"e_1_3_2_64_2","doi-asserted-by":"publisher","DOI":"10.1109\/42.7784"},{"key":"e_1_3_2_65_2","doi-asserted-by":"publisher","DOI":"10.1145\/3597503.3608139"},{"key":"e_1_3_2_66_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-019-09706-9"},{"key":"e_1_3_2_67_2","unstructured":"S. Moir. 2023. Should You Add Screenshots to Documentation? Retrieved from https:\/\/thisisimportant.net\/posts\/screenshots-in-documentation\/"},{"key":"e_1_3_2_68_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-47426-3_54"},{"key":"e_1_3_2_69_2","doi-asserted-by":"publisher","DOI":"10.1109\/IJCNN.2019.8851923"},{"key":"e_1_3_2_70_2","doi-asserted-by":"publisher","DOI":"10.1049\/sfw2.12123"},{"key":"e_1_3_2_71_2","doi-asserted-by":"publisher","DOI":"10.15680\/IJIRCCE.2014.0212024"},{"key":"e_1_3_2_72_2","first-page":"729","volume-title":"Proceedings of the 28th USENIX Security Symposium (USENIX Security \u201919)","author":"Pendlebury F.","year":"2019","unstructured":"F. Pendlebury, F. Pierazzi, R. Jordaney, J. Kinder, and L. Cavallaro. 2019. TESSERACT: Eliminating experimental bias in malware classification across space and time. In Proceedings of the 28th USENIX Security Symposium (USENIX Security \u201919), 729\u2013746."},{"key":"e_1_3_2_73_2","doi-asserted-by":"publisher","DOI":"10.5555\/1639537.1639542"},{"key":"e_1_3_2_74_2","doi-asserted-by":"publisher","DOI":"10.5555\/2486788.2486897"},{"key":"e_1_3_2_75_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSAW.2017.6"},{"key":"e_1_3_2_76_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE-NIER.2017.10"},{"key":"e_1_3_2_77_2","article-title":"Understanding mirror bugs in multiple-language projects","author":"Tang Y.","year":"2025","unstructured":"Y. Tang, H. Chen, Z. He, and H. Zhong. 2025. Understanding mirror bugs in multiple-language projects. ACM Transactions on Software Engineering and Methodology.","journal-title":"ACM Transactions on Software Engineering and Methodology."},{"key":"e_1_3_2_78_2","first-page":"147","article-title":"Filters for common resampling tasks","author":"Turkowski K.","unstructured":"K. Turkowski. 1990. Filters for common resampling tasks. In Graphics Gems I. Andrew S. Glassner (Ed.), Academic Press, 147\u2013165.","journal-title":"Graphics Gems I"},{"key":"e_1_3_2_79_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2019.03.003"},{"key":"e_1_3_2_80_2","doi-asserted-by":"publisher","DOI":"10.1145\/3597503.3639163"},{"key":"e_1_3_2_81_2","doi-asserted-by":"publisher","DOI":"10.1145\/1622176.1622213"},{"key":"e_1_3_2_82_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE43902.2021.00090"},{"key":"e_1_3_2_83_2","doi-asserted-by":"publisher","DOI":"10.1145\/3597503.3623322"},{"key":"e_1_3_2_84_2","doi-asserted-by":"publisher","DOI":"10.1145\/954339.954342"},{"key":"e_1_3_2_85_2","doi-asserted-by":"publisher","DOI":"10.1145\/3551349.3556894"},{"key":"e_1_3_2_86_2","doi-asserted-by":"publisher","DOI":"10.1145\/2509136.2509523"},{"key":"e_1_3_2_87_2","doi-asserted-by":"publisher","DOI":"10.1109\/ASE.2009.94"},{"key":"e_1_3_2_88_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE-Companion.2019.00052"},{"key":"e_1_3_2_89_2","doi-asserted-by":"publisher","DOI":"10.1145\/3551349.3556963"},{"key":"e_1_3_2_90_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2021.3131753"}],"container-title":["ACM Transactions on Software Engineering and Methodology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3750041","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,25]],"date-time":"2026-04-25T06:32:56Z","timestamp":1777098776000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3750041"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,4,24]]},"references-count":89,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2026,5,31]]}},"alternative-id":["10.1145\/3750041"],"URL":"https:\/\/doi.org\/10.1145\/3750041","relation":{},"ISSN":["1049-331X","1557-7392"],"issn-type":[{"value":"1049-331X","type":"print"},{"value":"1557-7392","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,4,24]]},"assertion":[{"value":"2024-12-13","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-07-09","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-04-24","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}