{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,13]],"date-time":"2026-06-13T01:58:54Z","timestamp":1781315934079,"version":"3.54.1"},"reference-count":43,"publisher":"China Science Publishing & Media Ltd.","issue":"2","content-domain":{"domain":["engine.scichina.com"],"crossmark-restriction":false},"short-container-title":["DI"],"published-print":{"date-parts":[[2026,6,1]]},"DOI":"10.3724\/2096-7004.di.2025.0014","type":"journal-article","created":{"date-parts":[[2025,3,26]],"date-time":"2025-03-26T05:30:06Z","timestamp":1742967006000},"page":"20250014","update-policy":"https:\/\/doi.org\/10.1360\/scp-crossmark-policy-page","source":"Crossref","is-referenced-by-count":0,"title":["MLLM-CTT: A Multimodal Large Language Model for Chart-to-Text Generation Based on LoRA Fine-Tuning"],"prefix":"10.3724","volume":"8","author":[{"given":"Kunmin","family":"Zhou","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Songlin","family":"Chen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"YaJun","family":"Du","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"XiaoLiang","family":"Chen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"2026","published-online":{"date-parts":[[2025,3,1]]},"reference":[{"key":"null","unstructured":"R. Mao, G. Chen, X. Zhang, F. Guerin, E. Cambria, GPTEval: A survey on assessments of ChatGPT and GPT-4, in: Proceedings of the 2024 Joint International Conference on Computational Linguistics, Torino, Italia, 2024, pp. 7844\u20137866."},{"key":"null","unstructured":"O. Ma\u00f1as, B. Krojer, A. Agrawal, Improving automatic VQA evaluation using large language models, in: Proceedings of Thirty-Eighth AAAI Conference on Artificial Intelligence, Vancouver, Canada, 2024, pp. 4171\u20134179."},{"key":"null","unstructured":"F. Jia, K. Wang, Y. Zheng, D. Cao, Y. Liu, GPT4MTS: prompt-based large language model for multimodal time-series forecasting, in: Proceedings of Thirty-Eighth AAAI Conference on Artificial Intelligence, Vancouver, Canada, 2024, pp. 23343\u201323351."},{"key":"null","unstructured":"Z. Du, Y. Qian, X. Liu, M. Ding, J. Qiu, Z. Yang, J. Tang, GLM: General language model pretraining with autoregressive blank infilling, in: Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics, Dublin, Ireland, 2022, pp. 320\u2013335."},{"key":"null","unstructured":"L. Proietti, S. Perrella, S. Tedeschi, G. Vulpis, L. Lavalle, A. Sanchietti, A. Ferrari, R. Navigli, Analyzing homonymy disambiguation capabilities of pretrained language models, in: Proceedings of the 2024 Joint International Conference on Computational Linguistics, Torino, Italia, 2024, pp. 924\u2013938."},{"key":"null","unstructured":"H. Zhang, X. Wang, J. Liu, L. Zhang, L. Ji, Chinese named entity recognition method for the finance domain based on enhanced features and pretrained language models, Information Sciences 625 (2023) 385\u2013400."},{"key":"null","unstructured":"W. Liu, X. Zhao, Z. Zhao, Q. Ju, X. Yang, W. Lu, An empirical study on adaptive inference for pretrained language model, IEEE Transactions on Neural Networks and Learning Systems 34 (8) (2023) 4321\u20134331."},{"key":"null","unstructured":"L. Floridi, M. Chiriatti, Gpt-3: Its nature, scope, limits, and consequences, Minds and Machines 30 (2020) 681\u2013694."},{"key":"null","unstructured":"B. Ji, H. Liu, M. Du, S. Ng, Chain-of-thought improves text generation with citations in large language models, in: Proceedings of Thirty-Eighth AAAI Conference on Artificial Intelligence, Vancouver, Canada, 2024, pp. 18345\u201318353."},{"key":"null","unstructured":"X. Zheng, Y. Du, X. Qin, Multi-level semantics-aware and multi-granularity knowledge-infused model for emotional support conversation, Information Fusion (2025) 103968."},{"key":"null","unstructured":"Q. Cao, T. Kojima, Y. Matsuo, Y. Iwasawa, Unnatural error correction: GPT-4 can almost perfectly handle unnatural scrambled text, in: Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, Singapore, 2023, pp. 8898\u20138913."},{"key":"null","unstructured":"J. Han, R. Zhang, W. Shao, P. Gao, P. Xu, H. Xiao, K. Zhang, C. Liu, S. Wen, Z. Guo, X. Lu, S. Ren, Y. Wen, X. Chen, X. Yue, H. Li, Y. Qiao, Imagebind-llm: Multi-modality instruction tuning[J]. arXiv preprint arXiv: 2309. 03905, 2023."},{"key":"null","unstructured":"H. Vo-Hoang, L. Pham, M. Dao, Detecting out-of-context media with llama-adapter V2 and roberta: An effective method for cheapfakes detection, in: Proceedings of the 2024 International Conference on Multimedia Retrieval, Phuket, Thailand, 2024, pp. 1282\u20131287."},{"key":"null","unstructured":"Y. Su, T. Lan, H. Li, J. Xu, Y. Wang, D. Cai, Pandagpt: One model to instruction-follow them all, CoRR abs\/2305.16355 (2023)."},{"key":"null","unstructured":"J. Obeid, E. Hoque, Chart-to-text: Generating natural language descriptions for charts by adapting the transformer model, in: Proceedings of the 13th International Conference on Natural Language Generation, Dublin, Ireland,, 2020, pp. 138\u2013147."},{"key":"null","unstructured":"S. Demir, S. Carberry, K. F. McCoy, Summarizing information graphics textually, Computational Linguistics 38 (3) (2012) 527\u2013574."},{"key":"null","unstructured":"P. Liang, M. Jordan, D. Klein, Learning semantic correspondences with less supervision, in: Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP, Suntec, Singapore, 2009, pp. 91\u201399."},{"key":"null","unstructured":"L. Gong, J. M. Crego, J. Senellart, Enhanced transformer model for data-to-text generation, in: Proceedings of the 3rd Workshop on Neural Generation and Translation, Hong Kong, China, 2019, pp. 148\u2013156."},{"key":"null","unstructured":"S. Wiseman, S. Shieber, A. Rush, Challenges in data-to-document generation, in: Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing, Copenhagen, Denmark, 2017, pp. 2253\u20132263."},{"key":"null","unstructured":"S. Kantharaj, R. T. Leong, X. Lin, A. Masry, M. Thakkar, E. Hoque, S. Joty, Chart-to-text: A large-scale benchmark for chart summarization, in: Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics, Dublin, Ireland, 2022, pp. 4005\u20134023."},{"key":"null","unstructured":"Y. Zhang, S. Sun, M. Galley, Y.-C. Chen, C. Brockett, X. Gao, J. Gao, J. Liu, B. Dolan, DIALOGPT : Large-scale generative pre-training for conversational response generation, in: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics: System Demonstrations, Online, 2020, pp. 270\u2013278."},{"key":"null","unstructured":"W. Hu, Y. Xu, Y. Li, W. Li, Z. Chen, Z. Tu, BLIVA: A simple multimodal LLM for better handling of text-rich visual questions, in: Proceedings of Thirty-Eighth AAAI Conference on Artificial Intelligence, Vancouver, Canada, 2024, pp. 2256\u20132264."},{"key":"null","unstructured":"E. Tanwar, S. Dutta, M. Borthakur, T. Chakraborty, Multilingual LLMs are better cross-lingual in-context learners with alignment, in: Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics, Toronto, Canada, 2023, pp. 6292\u20136307."},{"key":"null","unstructured":"S. Qi, Z. Cao, J. Rao, L. Wang, J. Xiao, X. Wang, What is the limitation of multimodal llms? a deeper look into multimodal llms through prompt probing, Information Processing and Management 60 (2023) 103510."},{"key":"null","unstructured":"L. Silva, L. Barbosa, Improving dense retrieval models with llm augmented data for dataset search, Knowledge- Based Systems 294 (2024) 111740."},{"key":"null","unstructured":"H. Touvron, L. Martin, et al., Llama 2: Open foundation and fine-tuned chat models[J]. arXiv preprint arXiv: 2307. 09288, 2023. CoRR abs\/2307.09288 (2023)."},{"key":"null","unstructured":"D. Chen, J. Liu, W. Dai, B. Wang, Visual instruction tuning with polite flamingo, in: Proceedings of Thirty-Eighth AAAI Conference on Artificial Intelligence, Vancouver, Canada, 2024, pp. 17745\u201317753."},{"key":"null","unstructured":"H. Zhang, X. Li, L. Bing, Video-LLaMA: An instruction-tuned audio-visual language model for video understanding, in: Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, Singapore, 2023, pp. 543\u2013553."},{"key":"null","unstructured":"J. Gao, J. Ruan, S. Xiang, Z. Yu, K. Ji, M. Xie, T. Liu, Y. Fu, LAMM: label alignment for multi-modal prompt learning, in: M. J. Wooldridge, J. G. Dy, S. Natarajan (Eds.), Proceedings of Thirty-Eighth AAAI Conference on Artificial Intelligence, Vancouver, Canada, 2024, pp. 1815\u20131823."},{"key":"null","unstructured":"K. Ueki, Y. Suzuki, H. Takushima, T. Hori, Improving video retrieval performance with query expansion using chatgpt, in: Proceedings of the 7th International Conference on Image and Graphics Processing, Beijing, China, 2024, pp. 431\u2013436."},{"key":"null","unstructured":"J. Li, D. Li, S. Savarese, S. C. H. Hoi, BLIP-2: bootstrapping language-image pre-training with frozen image encoders and large language models, in: Proceedings of International Conference on Machine Learning, Hawaii, USA, 2023, pp. 19730\u201319742."},{"key":"null","unstructured":"E. J. Hu, Y. Shen, P. Wallis, Z. Allen-Zhu, Y. Li, S. Wang, L. Wang, W. Chen, Lora: Low-rank adaptation of large language models, in: Proceedings of The Tenth International Conference on Learning Representations, Online, 2022."},{"key":"null","unstructured":"A. Newell, J. C. Shaw, H. A. Simon, Report on a general problem solving program, in: Proceedings of the 1st International Conference on Information Processing, Paris, 1959, pp. 256\u2013264."},{"key":"null","unstructured":"A. R\u00fcckl\u00e9, G. Geigle, M. Glockner, T. Beck, J. Pfeiffer, N. Reimers, I. Gurevych, AdapterDrop: On the efficiency of adapters in transformers, in: Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, Punta Cana, Dominican Republic, 2021, pp. 7930\u20137946."},{"key":"null","unstructured":"J. Pfeiffer, A. Kamath, A. R\u00fcckl\u00e9, K. Cho, I. Gurevych, AdapterFusion: Non-destructive task composition for transfer learning, in: Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics, Online, 2021, pp. 487\u2013503."},{"key":"null","unstructured":"J. Wei, X. Wang, D. Schuurmans, M. Bosma, B. Ichter, F. Xia, E. H. Chi, Q. V. Le, D. Zhou, Chain-of-thought prompting elicits reasoning in large language models, in: Proceedings of the 36th International Conference on Neural Information Processing Systems, Red Hook, NY, USA, 2022."},{"key":"null","unstructured":"D. Mondal, S. Modi, S. Panda, R. Singh, G. S. Rao, Kam-cot: Knowledge augmented multimodal chain-of-thoughts reasoning, in: Proceedings of Thirty-Eighth AAAI Conference on Artificial Intelligence, Vancouver, Canada, 2024, pp. 18798\u201318806."},{"key":"null","unstructured":"R. Zhao, X. Li, S. Joty, C. Qin, L. Bing, Verify-and-edit: A knowledge-enhanced chain-of-thought framework, in: Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics, Toronto, Canada, 2023, pp. 5823\u20135840."},{"key":"null","unstructured":"A. Chowdhery, S. Narang, J. et al., Palm: Scaling language modeling with pathways, Journal Of Machine Learning Research 24 (2023) 240:1\u2013240:113."},{"key":"null","unstructured":"S. Yao, D. Yu, J. Zhao, I. Shafran, T. Griffiths, Y. Cao, K. Narasimhan, Tree of thoughts: Deliberate problem solving with large language models, in: Proceedings of Annual Conference on Neural Information Processing Systems, New Orleans, LA, USA, 2023."},{"key":"null","unstructured":"M. Post, A call for clarity in reporting BLEU scores, in: Proceedings of the Third Conference on Machine Translation: Research Papers, Belgium, Brussels, 2018, pp. 186\u2013191."},{"key":"null","unstructured":"C. Y. Lin, ROUGE: A package for automatic evaluation of summaries, in: Text Summarization Branches Out, Barcelona, Spain, 2004, pp. 74\u201381."},{"key":"null","unstructured":"A. Radford, J. Wu, I. Child, et al., Language models are unsupervised multitask learners, OpenAI blog 1 (2019) 1\u2013249."}],"container-title":["Data Intelligence"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.sciengine.com\/sci-open\/api\/v1\/open\/file\/pdf\/299D3292175A4C57A57A8DD1519647ED","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.sciengine.com\/doi\/10.3724\/2096-7004.di.2025.0014","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.sciengine.com\/sci-open\/api\/v1\/open\/file\/pdf\/299D3292175A4C57A57A8DD1519647ED","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,6,13]],"date-time":"2026-06-13T01:13:12Z","timestamp":1781313192000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.sciengine.com\/doi\/10.3724\/2096-7004.di.2025.0014"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,3,1]]},"references-count":43,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2025,3,1]]},"published-print":{"date-parts":[[2026,6,1]]}},"URL":"https:\/\/doi.org\/10.3724\/2096-7004.di.2025.0014","relation":{},"ISSN":["2096-7004"],"issn-type":[{"value":"2096-7004","type":"print"}],"subject":[],"published":{"date-parts":[[2025,3,1]]}}}