{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,22]],"date-time":"2026-04-22T06:22:44Z","timestamp":1776838964924,"version":"3.51.2"},"reference-count":46,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2025,6,12]],"date-time":"2025-06-12T00:00:00Z","timestamp":1749686400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["72104219"],"award-info":[{"award-number":["72104219"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["21YJC870013"],"award-info":[{"award-number":["21YJC870013"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"The MOE Project of Humanities and Social Sciences","award":["72104219"],"award-info":[{"award-number":["72104219"]}]},{"name":"The MOE Project of Humanities and Social Sciences","award":["21YJC870013"],"award-info":[{"award-number":["21YJC870013"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JTAER"],"abstract":"<jats:p>Images contain more visual semantic information. Consumers first view multimodal online reviews with images. Research on the helpfulness of reviews on e-commerce platforms mainly focuses on text, lacking insights into the product attributes reflected by review images and the relationship between images and text. Studying the relationship between images and text in online reviews can better explain consumer behavior and help consumers make purchasing decisions. Taking multimodal online review data from shopping platforms as the research object, this study proposes a research framework based on the Cognitive Theory of Multimedia Learning (CTML). It utilizes multiple pre-trained models, such as BLIP2 and machine learning methods, to construct metrics. A fuzzy-set qualitative comparative analysis (fsQCA) is conducted to explore the configurational effects of antecedent variables of multimodal online reviews on review helpfulness. The study identifies five configurational paths that lead to high review helpfulness. Specific review cases are used to examine the contribution paths of these configurations to perceived helpfulness, providing a new perspective for future research on multimodal online reviews. Targeted recommendations are made for operators and merchants based on the research findings, offering theoretical support for platforms to fully leverage the potential value of user-generated content.<\/jats:p>","DOI":"10.3390\/jtaer20020144","type":"journal-article","created":{"date-parts":[[2025,6,12]],"date-time":"2025-06-12T06:42:48Z","timestamp":1749710568000},"page":"144","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["When Pixels Speak Louder: Unravelling the Synergy of Text\u2013Image Integration in Multimodal Review Helpfulness"],"prefix":"10.3390","volume":"20","author":[{"given":"Chao","family":"Ma","sequence":"first","affiliation":[{"name":"College of Economics and Management, Zhejiang Normal University, Jinhua 321000, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chen","family":"Yang","sequence":"additional","affiliation":[{"name":"College of Economics and Management, Zhejiang Normal University, Jinhua 321000, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ying","family":"Yu","sequence":"additional","affiliation":[{"name":"College of Economics and Management, Zhejiang Normal University, Jinhua 321000, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2025,6,12]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"113162","DOI":"10.1016\/j.dss.2019.113162","article-title":"How do consumers in the sharing economy value sharing? Evidence from online reviews","volume":"128","author":"Xu","year":"2020","journal-title":"Decis. Support Syst."},{"key":"ref_2","unstructured":"Paget, S. (2024, September 04). Local Consumer Review Survey 2024: Trends, Behaviors, and Platforms Explored. Available online: https:\/\/www.brightlocal.com\/research\/local-consumer-review-survey\/."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"463","DOI":"10.1108\/AJIM-11-2019-0308","article-title":"How online reviews affect purchase intention: A new model based on the stimulus-organism-response (S-O-R) framework","volume":"72","author":"Zhu","year":"2020","journal-title":"Aslib. J. Inf. Manag."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"102771","DOI":"10.1016\/j.jretconser.2021.102771","article-title":"Creating and detecting fake reviews of online products","volume":"64","author":"Salminen","year":"2022","journal-title":"J. Retail. Consum. Serv."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1968206","DOI":"10.1080\/23311975.2021.1968206","article-title":"The impact of online shopping attributes on customer satisfaction and loyalty: Moderating effects of e-commerce experience","volume":"8","author":"Mofokeng","year":"2021","journal-title":"Cogent Bus. Manag."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1016\/j.jretai.2023.09.001","article-title":"The effect of review images on review helpfulness: A contingency approach","volume":"100","author":"Lobschat","year":"2024","journal-title":"J. Retail."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"134","DOI":"10.1016\/j.jbusres.2021.09.050","article-title":"How much is a picture worth? Online review picture background and its impact on purchase intention","volume":"139","author":"Zhang","year":"2022","journal-title":"J. Bus. Res."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1177\/00222437231169711","article-title":"Words Meet Photos: When and Why Photos Increase Review Helpfulness","volume":"61","author":"Ceylan","year":"2024","journal-title":"J. Mark. Res."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"101232","DOI":"10.1016\/j.elerap.2022.101232","article-title":"Effect of user-generated image on review helpfulness: Perspectives from object detection","volume":"57","author":"Yang","year":"2023","journal-title":"Electron. Commer. Res. Appl."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"185","DOI":"10.2307\/20721420","article-title":"Research Note: What Makes a Helpful Online Review? A Study of Customer Reviews on Amazon.com","volume":"34","author":"Mudambi","year":"2010","journal-title":"MIS Q."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"4387","DOI":"10.1007\/s00521-018-3865-7","article-title":"How textual quality of online reviews affect classification performance: A case of deep learning sentiment analysis","volume":"32","author":"Li","year":"2020","journal-title":"Neural Comput. Appl."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1341","DOI":"10.1007\/s10796-020-10045-0","article-title":"What Affects Usage Satisfaction in Mobile Payments? Modelling User Generated Content to Develop the \u201cDigital Service Usage Satisfaction Model\u201d","volume":"23","author":"Kar","year":"2021","journal-title":"Inf. Syst. Front."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"2421","DOI":"10.1257\/aer.104.8.2421","article-title":"Promotional Reviews: An Empirical Investigation of Online Review Manipulation","volume":"104","author":"Mayzlin","year":"2014","journal-title":"Am. Econ. Rev."},{"key":"ref_14","first-page":"16","article-title":"Identifying Reviews with More Positive Votes\u2014Case Study of Amazon.cn","volume":"1","author":"Jiang","year":"2017","journal-title":"Data Anal. Knowl. Discov."},{"key":"ref_15","first-page":"437","article-title":"Product competitiveness analysis from the perspective of customer perceived helpfulness: A novel method of information fusion research","volume":"57","author":"Wang","year":"2023","journal-title":"Data Technol. Appl."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.elerap.2017.10.008","article-title":"Predicting the helpfulness of online product reviews: A multilingual approach","volume":"27","author":"Zhang","year":"2018","journal-title":"Electron. Commer. Res. Appl."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"120767","DOI":"10.1016\/j.eswa.2023.120767","article-title":"Combined Text-Mining\/DEA method for measuring level of customer satisfaction from online reviews","volume":"232","author":"Park","year":"2023","journal-title":"Expert Syst. Appl."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"102656","DOI":"10.1016\/j.ipm.2021.102656","article-title":"A machine learning-based sentiment analysis of online product reviews with a novel term weighting and feature selection approach","volume":"58","author":"Zhao","year":"2021","journal-title":"Inf. Process. Manag."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"102521","DOI":"10.1016\/j.ipm.2021.102521","article-title":"Do topic consistency and linguistic style similarity affect online review helpfulness? An elaboration likelihood model perspective","volume":"58","author":"Yang","year":"2021","journal-title":"Inf. Process. Manag."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"87","DOI":"10.1080\/10548408.2022.2044970","article-title":"Can the amount of information and information presentation reduce choice overload? An empirical study of online hotel booking","volume":"39","author":"Guo","year":"2022","journal-title":"J. Travel Tour. Mark."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"51","DOI":"10.1016\/j.tourman.2016.10.001","article-title":"A comparative analysis of major online review platforms: Implications for social media analytics in hospitality and tourism","volume":"58","author":"Xiang","year":"2017","journal-title":"Tour. Manag."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1425","DOI":"10.1016\/j.ipm.2018.04.003","article-title":"Examining the relationship between specific negative emotions and the perceived helpfulness of online reviews","volume":"56","author":"Ren","year":"2019","journal-title":"Inf. Process. Manag."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"424","DOI":"10.1016\/j.inffus.2022.09.025","article-title":"Multimodal sentiment analysis: A systematic review of history, datasets, multimodal fusion methods, applications, challenges and future directions","volume":"91","author":"Gandhi","year":"2023","journal-title":"Inf. Fusion"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1177\/0022243719881113","article-title":"Is a Picture Worth a Thousand Words? An Empirical Study of Image Content and Social Media Engagement","volume":"57","author":"Li","year":"2020","journal-title":"J. Mark. Res."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"103748","DOI":"10.1016\/j.jretconser.2024.103748","article-title":"What are the significant determinants of helpfulness of online review? An exploration across product-types","volume":"78","author":"Ganguly","year":"2024","journal-title":"J. Retail. Consum. Serv."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"8","DOI":"10.1007\/s10648-023-09842-1","article-title":"The Past, Present, and Future of the Cognitive Theory of Multimedia Learning","volume":"36","author":"Mayer","year":"2024","journal-title":"Educ. Psychol. Rev."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1","DOI":"10.2224\/sbp.12075","article-title":"The effect of image-text matching on consumer engagement in social media advertising","volume":"50","author":"Zhao","year":"2022","journal-title":"Soc. Behav. Personal. Int. J."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"121599","DOI":"10.1016\/j.techfore.2022.121599","article-title":"Fuzzy-set qualitative comparative analysis (fsQCA) in business and management research: A contemporary overview","volume":"178","author":"Kumar","year":"2022","journal-title":"Technol. Forecast. Soc. Change"},{"key":"ref_29","unstructured":"Nikou, S., Molinari, A., and Widen, G. (2024, September 06). The Interplay Between Literacy and Digital Technology: A Fuzzy-Set Qualitative Comparative Analysis Approach. Available online: https:\/\/informationr.net\/ir\/25-4\/isic2020\/isic2016.html."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"4241","DOI":"10.1007\/s11135-024-01849-2","article-title":"Applying qualitative comparative analysis in large-N studies: A scoping review of good practices before, during, and after the analytic moment","volume":"58","author":"Elgin","year":"2024","journal-title":"Qual. Quant."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"103793","DOI":"10.1016\/j.ijhm.2024.103793","article-title":"An fsQCA analysis of service quality for hotel customer satisfaction","volume":"122","year":"2024","journal-title":"Int. J. Hosp. Manag."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1607","DOI":"10.1080\/1528008X.2023.2167761","article-title":"Understanding Online Reviews in All-Inclusive Hotels Servicescape: A Fuzzy Set Approach","volume":"25","author":"Rassal","year":"2024","journal-title":"J. Qual. Assur. Hosp. Tour."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1016\/j.elerap.2018.05.004","article-title":"Information search in the internet markets: Experience versus search goods","volume":"30","author":"Basu","year":"2018","journal-title":"Electron. Commer. Res. Appl."},{"key":"ref_34","first-page":"19730","article-title":"BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Models","volume":"Volume 202","author":"Andreas","year":"2023","journal-title":"Proceedings of the 40th International Conference on Machine Learning"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"11019","DOI":"10.1109\/TKDE.2022.3230975","article-title":"A Survey on Aspect-Based Sentiment Analysis: Tasks, Methods, and Challenges","volume":"35","author":"Zhang","year":"2023","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"113117","DOI":"10.1016\/j.dss.2019.113117","article-title":"A semantic measure of online review helpfulness and the importance of message entropy","volume":"125","author":"Fresneda","year":"2019","journal-title":"Decis. Support Syst."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"892","DOI":"10.1080\/02650487.2019.1703386","article-title":"eWOM anatomy of online product reviews: Interaction effects of review number, valence, and star ratings on perceived credibility","volume":"39","author":"Hong","year":"2020","journal-title":"Int. J. Advert."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"699","DOI":"10.1177\/0047287520916785","article-title":"Extremely Negative Ratings and Online Consumer Review Helpfulness: The Moderating Role of Product Quality Signals","volume":"60","author":"Filieri","year":"2021","journal-title":"J. Travel Res."},{"key":"ref_39","first-page":"176","article-title":"Research on Helpfulness of E-commerce Platform Reviews Based on Multi-dimensional Text Features","volume":"25","author":"Sun","year":"2023","journal-title":"J. Beijing Inst. Technol. (Soc. Sci. Ed.)"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"82","DOI":"10.1016\/j.jretconser.2018.05.007","article-title":"Comparative advertising for goods versus services: Effects of different types of product attributes through consumer reactance and activation on consumer response","volume":"44","author":"Heinzle","year":"2018","journal-title":"J. Retail. Consum. Serv."},{"key":"ref_41","first-page":"127","article-title":"Ecosystem of doing business, total factor productivity and multiple patterns of high-quality development of Chinese cities: A configurational research based on complex system view","volume":"38","author":"Du","year":"2022","journal-title":"J. Manag. World"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"246","DOI":"10.1057\/jibs.2009.36","article-title":"Mapping the institutional capital of high-tech firms: A fuzzy-set analysis of capitalist variety and export performance","volume":"41","author":"Schneider","year":"2009","journal-title":"J. Int. Bus. Stud."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"100215","DOI":"10.1016\/j.jik.2022.100215","article-title":"What kinds of countries have better innovation performance?\u2013A country-level fsQCA and NCA study","volume":"7","author":"Ding","year":"2022","journal-title":"J. Innov. Knowl."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"279","DOI":"10.1177\/0049124117701487","article-title":"Often Trusted but Never (Properly) Tested: Evaluating Qualitative Comparative Analysis","volume":"49","author":"Baumgartner","year":"2017","journal-title":"Sociol. Methods Res."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"103859","DOI":"10.1016\/j.jretconser.2024.103859","article-title":"Showing usage behavior or not? The effect of virtual influencers\u2019 product usage behavior on consumers","volume":"79","author":"Yang","year":"2024","journal-title":"J. Retail. Consum. Serv."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"293","DOI":"10.1007\/s10648-019-09461-9","article-title":"Cognitive load theory and human movement: Towards an integrated model of working memory","volume":"31","author":"Sepp","year":"2019","journal-title":"Educ. Psychol. Rev."}],"container-title":["Journal of Theoretical and Applied Electronic Commerce Research"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/0718-1876\/20\/2\/144\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,9]],"date-time":"2025-10-09T17:50:40Z","timestamp":1760032240000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/0718-1876\/20\/2\/144"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,6,12]]},"references-count":46,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2025,6]]}},"alternative-id":["jtaer20020144"],"URL":"https:\/\/doi.org\/10.3390\/jtaer20020144","relation":{},"ISSN":["0718-1876"],"issn-type":[{"value":"0718-1876","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,6,12]]}}}