{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,2]],"date-time":"2026-06-02T01:22:55Z","timestamp":1780363375058,"version":"3.54.1"},"update-to":[{"DOI":"10.1371\/journal.pcbi.1009650","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2021,12,23]],"date-time":"2021-12-23T00:00:00Z","timestamp":1640217600000}}],"reference-count":62,"publisher":"Public Library of Science (PLoS)","issue":"12","license":[{"start":{"date-parts":[[2021,12,13]],"date-time":"2021-12-13T00:00:00Z","timestamp":1639353600000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000016","name":"U.S. Department of Health and Human Services","doi-asserted-by":"publisher","award":["ORIIR180041"],"award-info":[{"award-number":["ORIIR180041"]}],"id":[{"id":"10.13039\/100000016","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000016","name":"U.S. Department of Health and Human Services","doi-asserted-by":"publisher","award":["ORIIIR190049"],"award-info":[{"award-number":["ORIIIR190049"]}],"id":[{"id":"10.13039\/100000016","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["www.ploscompbiol.org"],"crossmark-restriction":false},"short-container-title":["PLoS Comput Biol"],"abstract":"<jats:p>Academic graphs are essential for communicating complex scientific ideas and results. To ensure that these graphs truthfully reflect underlying data and relationships, visualization researchers have proposed several principles to guide the graph creation process. However, the extent of violations of these principles in academic publications is unknown. In this work, we develop a deep learning-based method to accurately measure violations of the proportional ink principle (AUC = 0.917), which states that the size of shaded areas in graphs should be consistent with their corresponding quantities. We apply our method to analyze a large sample of bar charts contained in 300K figures from open access publications. Our results estimate that 5% of bar charts contain proportional ink violations. Further analysis reveals that these graphical integrity issues are significantly more prevalent in some research fields, such as psychology and computer science, and some regions of the globe. Additionally, we find no temporal and seniority trends in violations. Finally, apart from openly releasing our large annotated dataset and method, we discuss how computational research integrity could be part of peer-review and the publication processes.<\/jats:p>","DOI":"10.1371\/journal.pcbi.1009650","type":"journal-article","created":{"date-parts":[[2021,12,13]],"date-time":"2021-12-13T18:35:57Z","timestamp":1639420557000},"page":"e1009650","update-policy":"https:\/\/doi.org\/10.1371\/journal.pcbi.corrections_policy","source":"Crossref","is-referenced-by-count":12,"title":["Graphical integrity issues in open access publications: Detection and patterns of proportional ink violations"],"prefix":"10.1371","volume":"17","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8076-6660","authenticated-orcid":true,"given":"Han","family":"Zhuang","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5357-1267","authenticated-orcid":true,"given":"Tzu-Yang","family":"Huang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7765-1595","authenticated-orcid":true,"given":"Daniel E.","family":"Acuna","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"340","published-online":{"date-parts":[[2021,12,13]]},"reference":[{"key":"pcbi.1009650.ref001","article-title":"Definition of Research Misconduct | ORI\u2014The Office of Research Integrity","author":"Office of Research Integrity","year":"2021"},{"key":"pcbi.1009650.ref002","article-title":"Prevalence of questionable research practices, research misconduct and their potential explanatory factors: a survey among academic researchers in The Netherlands","author":"G Gopalakrishna","year":"2021","journal-title":"MetaArXiv"},{"key":"pcbi.1009650.ref003","doi-asserted-by":"crossref","first-page":"980","DOI":"10.1038\/453980a","article-title":"Repairing research integrity","volume":"453","author":"SL Titus","year":"2008","journal-title":"Nature"},{"key":"pcbi.1009650.ref004","doi-asserted-by":"crossref","first-page":"129","DOI":"10.1038\/nj7405-129a","article-title":"Publishing: Foreign tongues","volume":"487","author":"K. Powell","year":"2012","journal-title":"Nature"},{"key":"pcbi.1009650.ref005","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-642-39961-9","volume-title":"False Feathers: A Perspective on Academic Plagiarism","author":"D. Weber-Wulff","year":"2014"},{"key":"pcbi.1009650.ref006","doi-asserted-by":"crossref","first-page":"46","DOI":"10.1186\/s41239-020-00192-4","article-title":"Testing of support tools for plagiarism detection","volume":"17","author":"T Folt\u00fdnek","year":"2020","journal-title":"Int J Educ Technol High Educ"},{"key":"pcbi.1009650.ref007","author":"TS Beck","year":"2016","journal-title":"Shaping Images. Shaping Images. De Gruyter Saur"},{"key":"pcbi.1009650.ref008","first-page":"7","article-title":"The Prevalence of Inappropriate Image Duplication in Biomedical Research Publications.","author":"EM Bik","year":"2016","journal-title":"mBio"},{"key":"pcbi.1009650.ref009","doi-asserted-by":"crossref","first-page":"639","DOI":"10.1007\/s11948-010-9201-y","article-title":"Avoiding Twisted Pixels: Ethical Guidelines for the Appropriate Use and Manipulation of Scientific Digital Images","volume":"16","author":"DW Cromey","year":"2010","journal-title":"Sci Eng Ethics"},{"key":"pcbi.1009650.ref010","doi-asserted-by":"crossref","first-page":"441","DOI":"10.1080\/13645579.2012.759333","article-title":"Research integrity, image manipulation, and anonymizing photographs in visual social science research","volume":"17","author":"SR Jordan","year":"2014","journal-title":"Int J Soc Res Methodol"},{"key":"pcbi.1009650.ref011","author":"D Acuna","year":"2018","journal-title":"Bioscience-scale automated detection of figure element reuse"},{"key":"pcbi.1009650.ref012","article-title":"Scientific Image Tampering Detection Based On Noise Inconsistencies: A Method And Datasets","author":"Z Xiang","year":"2020","journal-title":"ArXiv200107799 Cs Eess"},{"key":"pcbi.1009650.ref013","article-title":"Truncating Bar Graphs Persistently Misleads Viewers","author":"BW Yang","year":"2021","journal-title":"J Appl Res Mem Cogn"},{"key":"pcbi.1009650.ref014","author":"AA Larkin","year":"1990","journal-title":"Misleading Graphics: Can Decision Makers Be Affected By Their Use"},{"key":"pcbi.1009650.ref015","first-page":"23","article-title":"Mitigating the Effects of Misleading Graphs on Decisions by Educating Users about the Principles of Graph Design.","volume":"22","author":"RL Raschke","year":"2008","journal-title":"J Inf Syst"},{"key":"pcbi.1009650.ref016","author":"ER Tufte","year":"2001"},{"key":"pcbi.1009650.ref017","volume-title":"Calling Bullshit: The Art of Skepticism in a Data-Driven World","author":"CT Bergstrom","year":"2020"},{"key":"pcbi.1009650.ref018","volume-title":"Semiology of Graphics: Diagrams, Networks, Maps","author":"J. Bertin","year":"2011"},{"key":"pcbi.1009650.ref019","article-title":"Information Visualization: Perception for Design: Second Edition","author":"C. Ware","year":"2004","journal-title":"Information Visualization: Perception for Design: Second Edition."},{"key":"pcbi.1009650.ref020","doi-asserted-by":"crossref","first-page":"291","DOI":"10.1080\/00014788.1992.9729446","article-title":"The use and abuse of graphs in annual reports: a theoretical framework and an empirical study","volume":"22","author":"V Beattie","year":"1992","journal-title":"Account Bus Res"},{"key":"pcbi.1009650.ref021","first-page":"269","article-title":"Corporate annual report graphical communication in Hong Kong: effective or misleading?","volume":"34","author":"JK Courtis","year":"1997","journal-title":"J Bus Commun 1973"},{"key":"pcbi.1009650.ref022","article-title":"Measurement distortion of graphs in corporate reports: an experimental study","author":"V Beattie","year":"2002","journal-title":"Account Audit Account J."},{"key":"pcbi.1009650.ref023","first-page":"118","article-title":"Misinformation in and about science","author":"JD West","year":"2021","journal-title":"Proc Natl Acad Sci"},{"key":"pcbi.1009650.ref024","doi-asserted-by":"crossref","first-page":"e14618","DOI":"10.1371\/journal.pone.0014618","article-title":"Misrepresentation of Neuroscience Data Might Give Rise to Misleading Conclusions in the Media: The Case of Attention Deficit Hyperactivity Disorder.","volume":"6","author":"F Gonon","year":"2011","journal-title":"PLOS ONE"},{"key":"pcbi.1009650.ref025","doi-asserted-by":"crossref","first-page":"g7015","DOI":"10.1136\/bmj.g7015","article-title":"The association between exaggeration in health related science news and academic press releases: retrospective observational study","volume":"349","author":"P Sumner","year":"2014","journal-title":"BMJ"},{"key":"pcbi.1009650.ref026","doi-asserted-by":"crossref","first-page":"3799","DOI":"10.1109\/TPAMI.2020.2992028","article-title":"Chart Mining: A Survey of Methods for Automated Chart Analysis","volume":"43","author":"K Davila","year":"2021","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"key":"pcbi.1009650.ref027","doi-asserted-by":"crossref","first-page":"117","DOI":"10.1109\/TBDATA.2017.2689038","article-title":"Viziometrics: Analyzing Visual Information in the Scientific Literature","volume":"4","author":"P Lee","year":"2018","journal-title":"IEEE Trans Big Data"},{"key":"pcbi.1009650.ref028","doi-asserted-by":"crossref","first-page":"135","DOI":"10.1007\/978-3-319-71249-9_9","volume-title":"Machine Learning and Knowledge Discovery in Databases","author":"M Cliche","year":"2017"},{"key":"pcbi.1009650.ref029","first-page":"1917","author":"J Luo","year":"2021","journal-title":"ChartOCR: Data Extraction From Charts Images via a Deep Hybrid Framework"},{"key":"pcbi.1009650.ref030","doi-asserted-by":"crossref","first-page":"353","DOI":"10.1111\/cgf.13193","article-title":"Reverse-engineering visualizations: Recovering visual encodings from chart images","author":"J Poco","year":"2017","journal-title":"Computer Graphics Forum. Wiley Online Library"},{"key":"pcbi.1009650.ref031","first-page":"143","article-title":"PDFFigures 2.0: Mining figures from research papers.","author":"C Clark","year":"2016","journal-title":"2016 IEEE\/ACM Joint Conference on Digital Libraries (JCDL)."},{"key":"pcbi.1009650.ref032","doi-asserted-by":"crossref","first-page":"4381","DOI":"10.1093\/bioinformatics\/btz228","article-title":"Figure and caption extraction from biomedical documents","volume":"35","author":"P Li","year":"2019","journal-title":"Bioinformatics"},{"key":"pcbi.1009650.ref033","first-page":"223","article-title":"Extracting Scientific Figures with Distantly Supervised Neural Networks. Proceedings of the 18th ACM\/IEEE on Joint Conference on Digital Libraries. New York, NY","author":"N Siegel","year":"2018","journal-title":"USA: Association for Computing Machinery"},{"key":"pcbi.1009650.ref034","article-title":"Overview of the ImageCLEF 2016 medical task. Working Notes of CLEF 2016 (Cross Language Evaluation Forum)","author":"A Garc\u00eda Seco de Herrera","year":"2016"},{"key":"pcbi.1009650.ref035","doi-asserted-by":"crossref","first-page":"519","DOI":"10.1007\/s11042-016-4237-x","article-title":"Automatic separation of compound figures in scientific articles","volume":"77","author":"M Taschwer","year":"2018","journal-title":"Multimed Tools Appl"},{"key":"pcbi.1009650.ref036","doi-asserted-by":"crossref","first-page":"162","DOI":"10.1007\/978-3-319-27671-7_14","volume-title":"MultiMedia Modeling","author":"M Taschwer","year":"2016"},{"key":"pcbi.1009650.ref037","doi-asserted-by":"crossref","first-page":"1031","DOI":"10.1049\/iet-ipr.2017.0800","article-title":"Biomedical compound figure detection using deep learning and fusion techniques","volume":"12","author":"SL Lee","year":"2018","journal-title":"IET Image Process"},{"key":"pcbi.1009650.ref038","doi-asserted-by":"crossref","first-page":"364","DOI":"10.1016\/B978-155860915-0\/50046-9","volume-title":"The Craft of Information Visualization","author":"B. Shneiderman","year":"2003"},{"key":"pcbi.1009650.ref039","doi-asserted-by":"crossref","first-page":"85","DOI":"10.1109\/CBMI.2007.385396","article-title":"Classifying Computer Generated Charts","author":"VSN Prasad","year":"2007","journal-title":"2007 International Workshop on Content-Based Multimedia Indexing"},{"key":"pcbi.1009650.ref040","first-page":"1","article-title":"Evaluation of Convolutional Neural Network Architectures for Chart Image Classification.","author":"P Chagas","year":"2018","journal-title":"2018 International Joint Conference on Neural Networks (IJCNN)."},{"key":"pcbi.1009650.ref041","author":"RA Al-Zaidy","year":"2017","journal-title":"A Machine Learning Approach for Semantic Structuring of Scientific Charts in Scholarly Documents"},{"key":"pcbi.1009650.ref042","first-page":"1","volume-title":"Proceedings of the International Workshop on Semantic Big Data","author":"SR Choudhury","year":"2016"},{"key":"pcbi.1009650.ref043","doi-asserted-by":"crossref","first-page":"139","DOI":"10.1134\/S1054661813010112","article-title":"Text detection in chart images","volume":"23","author":"N Vassilieva","year":"2013","journal-title":"Pattern Recognit Image Anal"},{"key":"pcbi.1009650.ref044","doi-asserted-by":"crossref","first-page":"796","DOI":"10.1109\/ICDAR.2015.7333871","article-title":"Automated analysis of line plots in documents","author":"RR Nair","year":"2015","journal-title":"2015 13th International Conference on Document Analysis and Recognition (ICDAR)."},{"key":"pcbi.1009650.ref045","article-title":"S2ORC: The Semantic Scholar Open Research Corpus","author":"K Lo","year":"2020","journal-title":"ArXiv191102782 Cs"},{"key":"pcbi.1009650.ref046","doi-asserted-by":"crossref","first-page":"243","DOI":"10.1145\/2740908.2742839","volume-title":"Proceedings of the 24th International Conference on World Wide Web","author":"A Sinha","year":"2015"},{"key":"pcbi.1009650.ref047","unstructured":"PMC Overview. 2021 [cited 30 Apr 2021]. Available: https:\/\/www.ncbi.nlm.nih.gov\/pmc\/about\/intro\/"},{"key":"pcbi.1009650.ref048","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1177\/001316446002000104","article-title":"A Coefficient of Agreement for Nominal Scales","volume":"20","author":"J. Cohen","year":"1960","journal-title":"Educ Psychol Meas"},{"key":"pcbi.1009650.ref049","doi-asserted-by":"crossref","first-page":"159","DOI":"10.2307\/2529310","article-title":"The Measurement of Observer Agreement for Categorical Data","volume":"33","author":"JR Landis","year":"1977","journal-title":"Biometrics"},{"key":"pcbi.1009650.ref050","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3440756","article-title":"Text Recognition in the Wild: A Survey","volume":"54","author":"X Chen","year":"2021","journal-title":"ACM Comput Surv"},{"key":"pcbi.1009650.ref051","article-title":"YOLOv4: Optimal Speed and Accuracy of Object Detection","author":"A Bochkovskiy","year":"2020","journal-title":"ArXiv200410934 Cs Eess"},{"key":"pcbi.1009650.ref052","first-page":"2963","article-title":"Detecting text in natural scenes with stroke width transform.","author":"B Epshtein","year":"2010","journal-title":"2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition"},{"key":"pcbi.1009650.ref053","doi-asserted-by":"crossref","first-page":"393","DOI":"10.1145\/2047196.2047247","volume-title":"Proceedings of the 24th annual ACM symposium on User interface software and technology\u2014UIST \u201811","author":"M Savva","year":"2011"},{"key":"pcbi.1009650.ref054","author":"C Bergstrom","year":"2021","journal-title":"Tools\u2014Proportional Ink and Logarithmic Scales"},{"key":"pcbi.1009650.ref055","doi-asserted-by":"crossref","first-page":"160","DOI":"10.1016\/B978-1-55860-036-2.50047-3","volume-title":"Proceedings of the Sixth International Workshop on Machine Learning","author":"KA Spackman","year":"1989"},{"key":"pcbi.1009650.ref056","author":"H Sch\u00fctze","year":"2008"},{"key":"pcbi.1009650.ref057","doi-asserted-by":"crossref","first-page":"e0210599","DOI":"10.1371\/journal.pone.0210599","article-title":"Perceptions of research integrity climate differ between academic ranks and disciplinary fields: Results from a survey among academic researchers in Amsterdam","volume":"14","author":"TL Haven","year":"2019","journal-title":"PLOS ONE"},{"key":"pcbi.1009650.ref058","doi-asserted-by":"crossref","first-page":"219","DOI":"10.1087\/095315104323159649","article-title":"Authors and open access publishing","volume":"17","author":"A Swan","year":"2004","journal-title":"Learn Publ"},{"key":"pcbi.1009650.ref059","doi-asserted-by":"crossref","first-page":"e3001161","DOI":"10.1371\/journal.pbio.3001161","article-title":"Creating clear and informative image-based figures for scientific publications","volume":"19","author":"H Jambor","year":"2021","journal-title":"PLOS Biol"},{"key":"pcbi.1009650.ref060","doi-asserted-by":"crossref","first-page":"111","DOI":"10.1007\/s10032-008-0065-5","article-title":"Recognition and quality assessment of data charts in mixed-mode documents","volume":"11","author":"S Shukla","year":"2008","journal-title":"Int J Doc Anal Recognit IJDAR"},{"key":"pcbi.1009650.ref061","unstructured":"Committee on Publication Ethics. Core practices | COPE: Committee on Publication Ethics. 2021 [cited 9 Jun 2021]. Available: https:\/\/publicationethics.org\/core-practices"},{"key":"pcbi.1009650.ref062","doi-asserted-by":"crossref","first-page":"e3000737","DOI":"10.1371\/journal.pbio.3000737","article-title":"The Hong Kong Principles for assessing researchers: Fostering research integrity","volume":"18","author":"D Moher","year":"2020","journal-title":"PLOS Biol"}],"updated-by":[{"DOI":"10.1371\/journal.pcbi.1009650","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2021,12,23]],"date-time":"2021-12-23T00:00:00Z","timestamp":1640217600000}}],"container-title":["PLOS Computational Biology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1009650","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,12,23]],"date-time":"2021-12-23T18:57:40Z","timestamp":1640285860000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1009650"}},"subtitle":[],"editor":[{"given":"Feilim","family":"Mac Gabhann","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"editor"}]}],"short-title":[],"issued":{"date-parts":[[2021,12,13]]},"references-count":62,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2021,12,13]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pcbi.1009650","relation":{"new_version":[{"id-type":"doi","id":"10.1371\/journal.pcbi.1009650","asserted-by":"object"}]},"ISSN":["1553-7358"],"issn-type":[{"value":"1553-7358","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,12,13]]}}}