{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,7]],"date-time":"2026-07-07T15:38:13Z","timestamp":1783438693401,"version":"3.54.6"},"reference-count":0,"publisher":"IOS Press","isbn-type":[{"value":"9781643685489","type":"electronic"}],"license":[{"start":{"date-parts":[[2024,10,16]],"date-time":"2024-10-16T00:00:00Z","timestamp":1729036800000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2024,10,16]]},"abstract":"<jats:p>Flowcharts are graphical tools for representing complex concepts in concise visual representations. This paper introduces the FlowLearn dataset, a resource tailored to enhance the understanding of flowcharts. FlowLearn contains complex scientific flowcharts and simulated flowcharts. The scientific subset contains 3,858 flowcharts sourced from scientific literature and the simulated subset contains 10,000 flowcharts created using a customizable script. The dataset is enriched with annotations for visual components, OCR, Mermaid code representation, and VQA question-answer pairs. Despite the proven capabilities of Large Vision-Language Models (LVLMs) in various visual understanding tasks, their effectiveness in decoding flowcharts\u2014a crucial element of scientific communication\u2014has yet to be thoroughly investigated. The FlowLearn test set is crafted to assess the performance of LVLMs in flowchart comprehension. Our study thoroughly evaluates state-of-the-art LVLMs, identifying existing limitations and establishing a foundation for future enhancements in this relatively underexplored domain. For instance, in tasks involving simulated flowcharts, GPT-4V achieved the highest accuracy (58%) in counting the number of nodes, while Claude recorded the highest accuracy (83%) in OCR tasks. Notably, no single model excels in all tasks within the FlowLearn framework, highlighting significant opportunities for further development.<\/jats:p>","DOI":"10.3233\/faia240473","type":"book-chapter","created":{"date-parts":[[2024,10,17]],"date-time":"2024-10-17T12:36:31Z","timestamp":1729168591000},"source":"Crossref","is-referenced-by-count":8,"title":["FlowLearn: Evaluating Large Vision-Language Models on Flowchart Understanding"],"prefix":"10.3233","author":[{"given":"Huitong","family":"Pan","sequence":"first","affiliation":[{"name":"Dept. of Computer and Information Sciences, Temple University, Philadelphia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Qi","family":"Zhang","sequence":"additional","affiliation":[{"name":"Dept. of Computer and Information Sciences, Temple University, Philadelphia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Cornelia","family":"Caragea","sequence":"additional","affiliation":[{"name":"Dept. of Computer Science, University of Illinois Chicago"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Eduard","family":"Dragut","sequence":"additional","affiliation":[{"name":"Dept. of Computer and Information Sciences, Temple University, Philadelphia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Longin","family":"Jan Latecki","sequence":"additional","affiliation":[{"name":"Dept. of Computer and Information Sciences, Temple University, Philadelphia"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"7437","container-title":["Frontiers in Artificial Intelligence and Applications","ECAI 2024"],"original-title":[],"link":[{"URL":"https:\/\/ebooks.iospress.nl\/pdf\/doi\/10.3233\/FAIA240473","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,10,17]],"date-time":"2024-10-17T12:36:31Z","timestamp":1729168591000},"score":1,"resource":{"primary":{"URL":"https:\/\/ebooks.iospress.nl\/doi\/10.3233\/FAIA240473"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,10,16]]},"ISBN":["9781643685489"],"references-count":0,"URL":"https:\/\/doi.org\/10.3233\/faia240473","relation":{},"ISSN":["0922-6389","1879-8314"],"issn-type":[{"value":"0922-6389","type":"print"},{"value":"1879-8314","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,10,16]]}}}