{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,11]],"date-time":"2026-06-11T08:01:30Z","timestamp":1781164890806,"version":"3.54.1"},"reference-count":49,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2026,6,11]],"date-time":"2026-06-11T00:00:00Z","timestamp":1781136000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Science and Technology Project of State Grid Zhejiang Electric Power Co., Ltd.","award":["5211SX250007"],"award-info":[{"award-number":["5211SX250007"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Informatics"],"abstract":"<jats:p>Power system testing and inspection documents are multimodal and highly structured, making content-level audit labeling challenging due to scattered evidence and cross-component dependencies. We propose EviCal, an evidence-grounded consistency calibration framework under a predefined label space. EviCal decomposes documents into atomic units (text segments, table rows, and figure captions), grounds each label to minimal supporting evidence via label-aware semantic focusing, calibrates local decisions against global causal and logical constraints imposed on symbolic intermediate states, and produces explicit confidence estimates. Experiments on two real-world power-system datasets show that EviCal achieves up to 93.97% accuracy and 81.22 F1, and attains a human score of up to 4.58\/5, outperforming strong multimodal baselines and delivering more reliable, interpretable audit predictions.<\/jats:p>","DOI":"10.3390\/informatics13060086","type":"journal-article","created":{"date-parts":[[2026,6,11]],"date-time":"2026-06-11T06:57:17Z","timestamp":1781161037000},"page":"86","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["EviCal: Evidence-Grounded Consistency Calibration for Content-Level Multimodal Labeling"],"prefix":"10.3390","volume":"13","author":[{"given":"Xiaofeng","family":"Zhang","sequence":"first","affiliation":[{"name":"State Grid Zhejiang Electric Power Co., Ltd., Shaoxing Power Supply Company, Shaoxing 312021, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Baoli","family":"Han","sequence":"additional","affiliation":[{"name":"State Grid Zhejiang Electric Power Co., Ltd., Shaoxing Power Supply Company, Shaoxing 312021, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yufeng","family":"Yuan","sequence":"additional","affiliation":[{"name":"State Grid Zhejiang Electric Power Co., Ltd., Shaoxing Power Supply Company, Shaoxing 312021, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Guangyao","family":"Zhu","sequence":"additional","affiliation":[{"name":"State Grid Zhejiang Electric Power Co., Ltd., Shaoxing Power Supply Company, Shaoxing 312021, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Huibo","family":"Song","sequence":"additional","affiliation":[{"name":"State Grid Zhejiang Electric Power Co., Ltd., Shaoxing Power Supply Company, Shaoxing 312021, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Weixing","family":"Qiu","sequence":"additional","affiliation":[{"name":"State Grid Zhejiang Electric Power Co., Ltd., Shaoxing Power Supply Company, Shaoxing 312021, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Li","family":"Ni","sequence":"additional","affiliation":[{"name":"State Grid Zhejiang Electric Power Co., Ltd., Shengzhou Power Supply Company, Shengzhou 312499, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2026,6,11]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"51922","DOI":"10.1109\/ACCESS.2022.3172697","article-title":"Power System Reliability and Maintenance Evolution: A Critical Review and Future Perspectives","volume":"10","author":"Donaldson","year":"2022","journal-title":"IEEE Access"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Huang, Y., Lv, T., Cui, L., Lu, Y., and Wei, F. (2022). LayoutLMv3: Pre-training for Document AI with Unified Text and Image Masking. Proceedings of the 30th ACM International Conference on Multimedia MM \u201922, Association for Computing Machinery.","DOI":"10.1145\/3503161.3548112"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Appalaraju, S., Jasani, B., Kota, B.U., Xie, Y., and Manmatha, R. (2021, January 10\u201317). DocFormer: End-to-End Transformer for Document Understanding. Proceedings of the 2021 IEEE\/CVF International Conference on Computer Vision (ICCV), Montreal, QC, Canada.","DOI":"10.1109\/ICCV48922.2021.00103"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Li, C., Bi, B., Yan, M., Wang, W., Huang, S., Huang, F., and Si, L. (2021, January 1\u20136). StructuralLM: Structural Pre-training for Form Understanding. Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics, Online.","DOI":"10.18653\/v1\/2021.acl-long.493"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Wang, D., Raman, N., Sibue, M., Ma, Z., Babkin, P., Kaur, S., Pei, Y., Nourbakhsh, A., and Liu, X. (2024, January 11\u201316). Docllm: A layout-aware generative language model for multimodal document understanding. Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Bangkok, Thailand.","DOI":"10.18653\/v1\/2024.acl-long.463"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Tang, Z., Yang, Z., Wang, G., Fang, Y., Liu, Y., Zhu, C., Zeng, M., Zhang, C., and Bansal, M. (2023, January 18\u201322). Unifying vision, text, and layout for universal document processing. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Vancouver, BC, Canada.","DOI":"10.1109\/CVPR52729.2023.01845"},{"key":"ref_7","unstructured":"Liu, Y., Yang, B., Liu, Q., Li, Z., Ma, Z., Zhang, S., and Bai, X. (2024). Textmonkey: An ocr-free large multimodal model for understanding document. arXiv."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Kim, G., Hong, T., Yim, M., Nam, J., Park, J., Yim, J., Hwang, W., Yun, S., Han, D., and Park, S. (2022, January 23\u201327). OCR-free Document Understanding Transformer. Proceedings of the European Conference on Computer Vision (ECCV), Tel Aviv, Israel.","DOI":"10.1007\/978-3-031-19815-1_29"},{"key":"ref_9","unstructured":"Ye, J., Hu, A., Xu, H., Ye, Q., Yan, M., Dan, Y., Zhao, C., Xu, G., Li, C., and Tian, J. (2023). mplug-docowl: Modularized multimodal large language model for document understanding. arXiv."},{"key":"ref_10","unstructured":"Zhang, Y., Zhang, R., Gu, J., Zhou, Y., Lipka, N., Yang, D., and Sun, T. (2023). Llavar: Enhanced visual instruction tuning for text-rich image understanding. arXiv."},{"key":"ref_11","first-page":"4207","article-title":"A federated named entity recognition model with explicit relation for power grid","volume":"75","author":"Luo","year":"2023","journal-title":"Comput. Mater. Contin."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Tang, W., Zhang, Y., Mao, X., Shan, M., Lv, K., Sun, X., and Ding, Z. (2025). Enhanced Named Entity Recognition and Event Extraction for Power Grid Outage Scheduling Using a Universal Information Extraction Framework. Energies, 18.","DOI":"10.3390\/en18143617"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Meng, L., Wang, Y., Huang, Y., Ma, D., Zhu, X., and Zhang, S. (2025). A Named Entity Recognition Model for Chinese Electricity Violation Descriptions Based on Word-Character Fusion and Multi-Head Attention Mechanisms. Energies, 18.","DOI":"10.3390\/en18020401"},{"key":"ref_14","first-page":"654","article-title":"Systematically modeling and extracting bibliographic metadata of power grid standard documents with LLMs","volume":"30","author":"Chen","year":"2025","journal-title":"Inf. Res. Int. Electron. J."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Yao, J., She, Y., and Shi, K. (2025, January 5\u20137). Domain Knowledge Graph Construction and Troubleshooting Method for Intelligent Diagnosis of Power Transformer Defects. Proceedings of the 2025 IEEE 7th Advanced Information Management, Communicates, Electronic and Automation Control Conference (IMCEC), Chongqing, China.","DOI":"10.1109\/IMCEC66174.2025.11332008"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1","DOI":"10.32604\/ee.2025.069438","article-title":"Defect Identification Method of Power Grid Secondary Equipment Based on Coordination of Knowledge Graph and Bayesian Network Fusion","volume":"123","author":"Xiong","year":"2026","journal-title":"Energy Eng."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Liu, P., Tian, B., Liu, X., Gu, S., Yan, L., Bullock, L., Ma, C., Liu, Y., and Zhang, W. (2022). Construction of Power Fault Knowledge Graph Based on Deep Learning. Appl. Sci., 12.","DOI":"10.3390\/app12146993"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Liu, W., Gu, Y., Zeng, Z., Qi, D., Li, D., Luo, Y., Li, Q., and Wei, S. (2024). Automated Equipment Defect Knowledge Graph Construction for Power Grid Regulation. Electronics, 13.","DOI":"10.3390\/electronics13224430"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Zhang, L., Kuang, J., Teng, Y., Xiang, S., Li, L., and Zhou, Y. (2025). A Lightweight Infrared and Visible Light Multimodal Fusion Method for Object Detection in Power Inspection. Processes, 13.","DOI":"10.3390\/pr13092720"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"114792","DOI":"10.1016\/j.knosys.2025.114792","article-title":"A decoupled scene-equipment fusion method for power substation equipment detection","volume":"331","author":"Guo","year":"2025","journal-title":"Knowl.-Based Syst."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"111696","DOI":"10.1016\/j.ijepes.2026.111696","article-title":"Multimodal knowledge-guided method for power transmission line fault detection using a vision-language model","volume":"176","author":"Zhang","year":"2026","journal-title":"Int. J. Electr. Power Energy Syst."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"113939","DOI":"10.1016\/j.asoc.2025.113939","article-title":"PowerGPT: A multimodal foundation model for power inspection","volume":"186","author":"Zhong","year":"2025","journal-title":"Appl. Soft Comput."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Wang, J., Li, M., Luo, H., Zhu, J., Yang, A., Rong, M., and Wang, X. (2024). Power-LLaVA: Large Language and Vision Assistant for Power Transmission Line Inspection. arXiv.","DOI":"10.1109\/ICIP51287.2024.10648271"},{"key":"ref_24","first-page":"24824","article-title":"Chain-of-thought prompting elicits reasoning in large language models","volume":"35","author":"Wei","year":"2022","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_25","first-page":"11809","article-title":"Tree of thoughts: Deliberate problem solving with large language models","volume":"36","author":"Yao","year":"2023","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_26","unstructured":"Wang, X., Wei, J., Schuurmans, D., Le, Q., Chi, E., Narang, S., Chowdhery, A., and Zhou, D. (2023, January 1\u20135). Self-Consistency Improves Chain of Thought Reasoning in Language Models. Proceedings of the International Conference on Learning Representations (ICLR), Kigali, Rwanda."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"96640","DOI":"10.52202\/079017-3064","article-title":"Unveiling causal reasoning in large language models: Reality or mirage?","volume":"37","author":"Chi","year":"2024","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_28","unstructured":"Kiciman, E., Ness, R., Sharma, A., and Tan, C. (2023). Causal reasoning and large language models: Opening a new frontier for causality. Trans. Mach. Learn. Res., Available online: https:\/\/par.nsf.gov\/biblio\/10574854."},{"key":"ref_29","first-page":"31038","article-title":"Cladder: Assessing causal reasoning in language models","volume":"36","author":"Jin","year":"2023","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"3580","DOI":"10.1109\/TKDE.2024.3352100","article-title":"Unifying large language models and knowledge graphs: A roadmap","volume":"36","author":"Pan","year":"2024","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Yang, K., Deng, J., and Chen, D. (2022). Generating Natural Language Proofs with Verifier-Guided Search. Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, EMNLP 2022, Association for Computational Linguistics (ACL).","DOI":"10.18653\/v1\/2022.emnlp-main.7"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Liu, X., Xu, P., Wu, J., Yuan, J., Yang, Y., Zhou, Y., Liu, F., Guan, T., Wang, H., and Yu, T. (2025). Large language models and causal inference in collaboration: A comprehensive survey. Findings of the Association for Computational Linguistics: NAACL 2025, Association for Computational Linguistics.","DOI":"10.18653\/v1\/2025.findings-naacl.427"},{"key":"ref_33","unstructured":"Gao, Y., Xiong, Y., Gao, X., Jia, K., Pan, J., Bi, Y., Dai, Y., Sun, J., Wang, H., and Wang, H. (2023). Retrieval-augmented generation for large language models: A survey. arXiv."},{"key":"ref_34","unstructured":"Nakano, R., Hilton, J., Balaji, S., Wu, J., Ouyang, L., Kim, C., Hesse, C., Jain, S., Kosaraju, V., and Saunders, W. (2021). WebGPT: Browser-assisted question-answering with human feedback. arXiv."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Gao, T., Yen, H., Yu, J., and Chen, D. (2023). Enabling Large Language Models to Generate Text with Citations. Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, Association for Computational Linguistics.","DOI":"10.18653\/v1\/2023.emnlp-main.398"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Min, S., Krishna, K., Lyu, X., Lewis, M., Yih, W.t., Koh, P., Iyyer, M., Zettlemoyer, L., and Hajishirzi, H. (2023, January 6\u201310). Factscore: Fine-grained atomic evaluation of factual precision in long form text generation. Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, Singapore.","DOI":"10.18653\/v1\/2023.emnlp-main.741"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Manakul, P., Liusie, A., and Gales, M. (2023, January 6\u201310). Selfcheckgpt: Zero-resource black-box hallucination detection for generative large language models. Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, Singapore.","DOI":"10.18653\/v1\/2023.emnlp-main.557"},{"key":"ref_38","unstructured":"Kuhn, L., Gal, Y., and Farquhar, S. (2023, January 1\u20135). Semantic Uncertainty: Linguistic Invariances for Uncertainty Estimation in Large Language Models. Proceedings of the International Conference on Learning Representations (ICLR), Kigali, Rwanda."},{"key":"ref_39","first-page":"27730","article-title":"Training language models to follow instructions with human feedback","volume":"35","author":"Ouyang","year":"2022","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_40","unstructured":"Wang, T., Yu, P., Tan, X.E., O\u2019Brien, S., Pasunuru, R., Dwivedi-Yu, J., Golovneva, O., Zettlemoyer, L., Fazel-Zarandi, M., and Celikyilmaz, A. (2023). Shepherd: A critic for language model generation. arXiv."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Gao, L., Dai, Z., Pasupat, P., Chen, A., Chaganty, A.T., Fan, Y., Zhao, V., Lao, N., Lee, H., and Juan, D.C. (2023, January 9\u201314). Rarr: Researching and revising what language models say, using language models. Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Toronto, ON, Canada.","DOI":"10.18653\/v1\/2023.acl-long.910"},{"key":"ref_42","first-page":"1","article-title":"A survey on hallucination in large language models: Principles, taxonomy, challenges, and open questions","volume":"43","author":"Huang","year":"2025","journal-title":"ACM Trans. Inf. Syst."},{"key":"ref_43","unstructured":"Poznanski, J., Borchardt, J., Dunkelberger, J., Huff, R., Lin, D., Rangapur, A., Wilhelm, C., Lo, K., and Soldaini, L. (2025). olmOCR: Unlocking Trillions of Tokens in PDFs with Vision Language Models. arXiv, Available online: http:\/\/arxiv.org\/abs\/2502.18443."},{"key":"ref_44","unstructured":"Team, Q. (2025). Qwen2.5-VL Technical Report. arXiv."},{"key":"ref_45","unstructured":"(2024). DeepSeek-V3 Technical Report. arXiv."},{"key":"ref_46","unstructured":"OpenAI (2026, March 19). Hello GPT-4o. Available online: https:\/\/openai.com\/index\/hello-gpt-4o."},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Li, Z., Li, Y., Kang, L., Karatzas, D., and Ma, W. (2025). AVIR: Adaptive Visual In-Document Retrieval for Efficient Multi-Page Document Question Answering. Proceedings of the 7th ACM International Conference on Multimedia in Asia, Association for Computing Machinery.","DOI":"10.1145\/3743093.3771020"},{"key":"ref_48","unstructured":"Mo, Y., Shao, Z., Ye, K., Mao, X., Zhang, B., Xing, H., Ye, P., Huang, G., Chen, K., and Huan, Z. (2025). Doc-CoB: Enhancing Multi-Modal Document Understanding with Visual Chain-of-Boxes Reasoning. arXiv."},{"key":"ref_49","first-page":"61424","article-title":"ColPali: Efficient Document Retrieval with Vision Language Models","volume":"Volume 2025","author":"Yue","year":"2025","journal-title":"Proceedings of the International Conference on Learning Representations"}],"container-title":["Informatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2227-9709\/13\/6\/86\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,6,11]],"date-time":"2026-06-11T07:40:52Z","timestamp":1781163652000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2227-9709\/13\/6\/86"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,6,11]]},"references-count":49,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2026,6]]}},"alternative-id":["informatics13060086"],"URL":"https:\/\/doi.org\/10.3390\/informatics13060086","relation":{},"ISSN":["2227-9709"],"issn-type":[{"value":"2227-9709","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,6,11]]}}}