{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,6]],"date-time":"2026-06-06T05:00:39Z","timestamp":1780722039263,"version":"3.54.1"},"reference-count":56,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2026,6,4]],"date-time":"2026-06-04T00:00:00Z","timestamp":1780531200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100019081","name":"Hunan Science and Technology Innovation Project","doi-asserted-by":"crossref","award":["2025JJ60818"],"award-info":[{"award-number":["2025JJ60818"]}],"id":[{"id":"10.13039\/501100019081","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Science and Technology Innovation Program of Hunan Province","award":["2025RC1029"],"award-info":[{"award-number":["2025RC1029"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Systems"],"abstract":"<jats:p>Large-scale online reviews provide a valuable source of user feedback, yet existing methods still offer limited support for transforming massive review corpora into structured and decision-relevant requirement knowledge. Rule-based and manually intensive approaches are difficult to scale, while direct end-to-end use of large language models often faces challenges in maintaining stable requirement structures and practical large-scale deployment. To address these limitations, this study proposes a staged framework for mining user requirements from vehicle online reviews, with a particular focus on supporting early-stage requirement engineering. The framework uses large language models for requirement taxonomy construction and automatic annotation and transfers large-scale requirement categorization to a BERT classifier to balance semantic capability with deployment efficiency. A mini-batch iterative strategy is further introduced to progressively induce requirement categories from review data rather than fully predefining them in advance. In addition, sentiment weighting is incorporated to prioritize requirement categories and better reflect user pain points in subsequent analysis and decision support. Experiments on 467,962 review texts show that the proposed method outperforms several conventional machine learning and deep learning baselines on the studied dataset. Beyond quantitative evaluation, the study also examines the structural characteristics of online review-based requirement identification and explores the applicability of the framework in other review scenarios. Overall, the proposed framework provides a practical systems-oriented workflow for large-scale requirement analysis and contributes a review-based approach to early-stage requirement engineering, including requirement identification, categorization, prioritization, and interpretation.<\/jats:p>","DOI":"10.3390\/systems14060645","type":"journal-article","created":{"date-parts":[[2026,6,5]],"date-time":"2026-06-05T01:23:21Z","timestamp":1780622601000},"page":"645","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["A Staged Framework for Mining User Requirements from Vehicle Online Reviews Based on Large Language Models and Sentiment Weighting"],"prefix":"10.3390","volume":"14","author":[{"given":"Zuo","family":"You","sequence":"first","affiliation":[{"name":"School of Design, Hunan University, Changsha 410082, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shenglan","family":"Peng","sequence":"additional","affiliation":[{"name":"School of Design, Hunan University, Changsha 410082, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wei","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Design, Hunan University, Changsha 410082, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4013-417X","authenticated-orcid":false,"given":"Hao","family":"Tan","sequence":"additional","affiliation":[{"name":"School of Design, Hunan University, Changsha 410082, China"},{"name":"State Key Laboratory of Advanced Design and Manufacturing for Vehicle Body, Hunan University, Changsha 410082, China"},{"name":"Institute of Culture and Media Computing, Hunan University, Changsha 410082, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2026,6,4]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"104380","DOI":"10.1016\/j.compind.2025.104380","article-title":"From user-generated content to quality improvement: A multi-granularity analysis of customer satisfaction and attention in new energy vehicles using deep learning","volume":"173","author":"Xu","year":"2025","journal-title":"Comput. Ind."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"102861","DOI":"10.1016\/j.aei.2024.102861","article-title":"User requirement modeling and evolutionary analysis based on review data: Supporting the design upgrade of product attributes","volume":"62","author":"Zhang","year":"2024","journal-title":"Adv. Eng. Inform."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"101174","DOI":"10.1016\/j.aei.2020.101174","article-title":"Dynamical mining of ever-changing user requirements: A product design and improvement perspective","volume":"46","author":"Sun","year":"2020","journal-title":"Adv. Eng. Inform."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"703","DOI":"10.1016\/j.ijhcs.2013.02.002","article-title":"Modelling human tutors' feedback to inform natural language interfaces for learning","volume":"71","author":"Mellish","year":"2013","journal-title":"Int. J. Hum.-Comput. Stud."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"102630","DOI":"10.1016\/j.ijhcs.2021.102630","article-title":"The human side of human-chatbot interaction: A systematic literature review of ten years of research on text-based chatbots","volume":"151","author":"Rapp","year":"2021","journal-title":"Int. J. Hum.-Comput. Stud."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"110391","DOI":"10.1016\/j.cie.2024.110391","article-title":"A novel requirement elicitation and evaluation framework for product-service systems based on contextual matching and hybrid decision-making","volume":"194","author":"Xiang","year":"2024","journal-title":"Comput. Ind. Eng."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1297","DOI":"10.1016\/j.asoc.2016.07.048","article-title":"Extracting features from online software reviews to aid requirements reuse","volume":"49","author":"Bakar","year":"2016","journal-title":"Appl. Soft Comput."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"124232","DOI":"10.1016\/j.techfore.2025.124232","article-title":"Proactive social learning and green product consumption: Evidence from new energy vehicle sales in China","volume":"219","author":"Jiang","year":"2025","journal-title":"Technol. Forecast. Soc. Change"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"133134","DOI":"10.1016\/j.energy.2024.133134","article-title":"User requirements analysis of new energy vehicles based on improved Kano model","volume":"309","author":"Yang","year":"2024","journal-title":"Energy"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"101953","DOI":"10.1016\/j.aei.2023.101953","article-title":"A small sample data-driven method: User needs elicitation from online reviews in new product iteration","volume":"56","author":"Cong","year":"2023","journal-title":"Adv. Eng. Inform."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Peng, S., Ye, D., and Tan, H. (2026). Modeling User Requirement for Value-Oriented Design: A Multi-Dimensional Perception Evidence from the Automobile Market. Systems, 14.","DOI":"10.3390\/systems14030251"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"112836","DOI":"10.1016\/j.jss.2026.112836","article-title":"A systematic literature review on model-based requirements engineering","volume":"237","author":"Zhao","year":"2026","journal-title":"J. Syst. Softw."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"110579","DOI":"10.1016\/j.cie.2024.110579","article-title":"Leveraging online reviews and expert opinions for electric vehicle type prioritization","volume":"197","author":"Wang","year":"2024","journal-title":"Comput. Ind. Eng."},{"key":"ref_14","first-page":"101070","article-title":"Conceptualising user comfort in automated driving: Findings from an expert group workshop","volume":"24","author":"Peng","year":"2024","journal-title":"Transp. Res. Interdiscip. Perspect."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"227","DOI":"10.1080\/10447318.2021.1937875","article-title":"Eliciting User Needs and Design Requirements for User Experience in Fully Automated Vehicles","volume":"38","author":"Lee","year":"2022","journal-title":"Int. J. Hum.-Comput. Interact."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"111878","DOI":"10.1016\/j.cie.2026.111878","article-title":"Parsing and prioritizing users\u2019 evolving requirements with large language models: A case study in personalized rehabilitation assistive devices design","volume":"214","author":"Zhuang","year":"2026","journal-title":"Comput. Ind. Eng."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"11996","DOI":"10.1080\/10447318.2025.2450415","article-title":"Introducing the Fundamental User Needs (FUN) Scales: Assessing Need Satisfaction and Frustration in Design-Mediated Interactions","volume":"41","author":"Huang","year":"2025","journal-title":"Int. J. Hum.-Comput. Interact."},{"key":"ref_18","first-page":"791","article-title":"Lead users: A source of novel product concepts","volume":"32","year":"1986","journal-title":"Manag. Sci."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"124","DOI":"10.1145\/3763002","article-title":"Advances in Pre-trained Language Models for Domain-Specific Text Classification: A Systematic Review","volume":"16","author":"Rostam","year":"2025","journal-title":"ACM Trans. Intell. Syst. Technol."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"100644","DOI":"10.1016\/j.dajour.2025.100644","article-title":"An analytical assessment of sentiment analysis trends and methods through systematic review and topic modeling","volume":"17","author":"Hill","year":"2025","journal-title":"Decis. Anal. J."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"100664","DOI":"10.1016\/j.cosrev.2024.100664","article-title":"A comprehensive survey of text classification techniques and their research applications: Observational and experimental insights","volume":"54","author":"Taha","year":"2024","journal-title":"Comput. Sci. Rev."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"103740","DOI":"10.1016\/j.ijhcs.2026.103740","article-title":"When trust collides: Exploring human-LLM cooperation intention through the prisoner\u2019s dilemma","volume":"209","author":"Jiang","year":"2026","journal-title":"Int. J. Hum.-Comput. Stud."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"114722","DOI":"10.1016\/j.asoc.2026.114722","article-title":"Interpretable fake review detection based on multimodal information and human\u2013computer collaboration","volume":"191","author":"Xu","year":"2026","journal-title":"Appl. Soft Comput."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"167","DOI":"10.1016\/j.future.2024.04.037","article-title":"Prioritizing user requirements for digital products using explainable artificial intelligence: A data-driven analysis on video conferencing apps","volume":"158","author":"Bai","year":"2024","journal-title":"Future Gener. Comput. Syst."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"113568","DOI":"10.1016\/j.engappai.2025.113568","article-title":"Semantic Text Kernels: A hybrid interpretable framework for deep semantic analysis in textual data","volume":"166","author":"Chandran","year":"2026","journal-title":"Eng. Appl. Artif. Intell."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"108641","DOI":"10.1016\/j.ijpe.2022.108641","article-title":"Using neutral sentiment reviews to improve customer requirement identification and product design strategies","volume":"254","author":"Zhang","year":"2022","journal-title":"Int. J. Prod. Econ."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Groen, E.C., Kopczy\u0144ska, S., Hauer, M.P., Krafft, T.D., and Doerr, J. (2017). Users\u2014The hidden software product quality experts?: A study on how app users report quality aspects in online reviews. Proceedings of the 2017 IEEE 25th International Requirements Engineering Conference (RE), IEEE.","DOI":"10.1109\/RE.2017.73"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"311","DOI":"10.1007\/s00766-016-0251-9","article-title":"On the automatic classification of app reviews","volume":"21","author":"Maalej","year":"2016","journal-title":"Requir. Eng."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"112348","DOI":"10.1016\/j.knosys.2024.112348","article-title":"An explainable machine learning model for sentiment analysis of online reviews","volume":"302","author":"Jaouad","year":"2024","journal-title":"Knowl.-Based Syst."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Subedi, I.M., Singh, M., Ramasamy, V., and Walia, G.S. (2021). Classification of Testable and Valuable User Stories by using Supervised Machine Learning Classifiers. Proceedings of the 2021 IEEE International Symposium on Software Reliability Engineering Workshops (ISSREW), Wuhan, China, 25\u201328 October 2021, IEEE.","DOI":"10.1109\/ISSREW53611.2021.00111"},{"key":"ref_31","first-page":"993","article-title":"Latent dirichlet allocation","volume":"3","author":"Blei","year":"2003","journal-title":"J. Mach. Learn. Res."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"87","DOI":"10.1186\/s40537-024-00943-4","article-title":"Data oversampling and imbalanced datasets: An investigation of performance for machine learning and feature engineering","volume":"11","author":"Mujahid","year":"2024","journal-title":"J. Big Data"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"271","DOI":"10.1016\/j.ins.2020.08.051","article-title":"Two-stage three-way enhanced technique for ensemble learning in inclusive policy text classification","volume":"547","author":"Liang","year":"2021","journal-title":"Inf. Sci."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"128617","DOI":"10.1016\/j.neucom.2024.128617","article-title":"Weakly supervised text classification framework for noisy-labeled imbalanced samples","volume":"610","author":"Zhang","year":"2024","journal-title":"Neurocomputing"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"102711","DOI":"10.1016\/j.ipm.2021.102711","article-title":"A GA-based algorithm meets the fair ranking problem","volume":"58","author":"Tahery","year":"2021","journal-title":"Inf. Process. Manag."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3605943","article-title":"Recent Advances in Natural Language Processing via Large Pre-trained Language Models: A Survey","volume":"56","author":"Min","year":"2023","journal-title":"ACM Comput. Surv."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"13755","DOI":"10.1038\/s41598-025-98483-1","article-title":"Industrial applications of large language models","volume":"15","author":"Raza","year":"2025","journal-title":"Sci. Rep."},{"key":"ref_38","unstructured":"Kojima, T., Gu, S., Reid, M., Matsuo, Y., and Iwasawa, Y. (2022). Large Language Models are Zero-Shot Reasoners. arXiv."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"106","DOI":"10.1145\/3744746","article-title":"A Comprehensive Overview of Large Language Models","volume":"16","author":"Naveed","year":"2025","journal-title":"ACM Trans. Intell. Syst. Technol."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"102517","DOI":"10.1016\/j.aei.2024.102517","article-title":"Pre-training enhanced unsupervised contrastive domain adaptation for industrial equipment remaining useful life prediction","volume":"60","author":"Li","year":"2024","journal-title":"Adv. Eng. Inform."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"107521","DOI":"10.1016\/j.infsof.2024.107521","article-title":"Towards assessing the quality of knowledge graphs via differential testing","volume":"174","author":"Tan","year":"2024","journal-title":"Inf. Softw. Technol."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"5572","DOI":"10.1287\/mnsc.2023.00920","article-title":"A minibatch stochastic gradient descent-based learning metapolicy for inventory systems with myopic optimal policy","volume":"71","author":"Lyu","year":"2025","journal-title":"Manag. Sci."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"1418","DOI":"10.1038\/s41467-024-45563-x","article-title":"Structured information extraction from scientific text with large language models","volume":"15","author":"Dagdelen","year":"2024","journal-title":"Nat. Commun."},{"key":"ref_44","unstructured":"Devlin, J., Chang, M.-W., Lee, K., and Toutanova, K. (2019). Bert: Pre-training of deep bidirectional transformers for language understanding. Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), Association for Computational Linguistics."},{"key":"ref_45","unstructured":"Zhang, J., Gan, R., Wang, J., Zhang, Y., Zhang, L., Yang, P., Gao, X., Wu, Z., Dong, X., and He, J. (2022). Fengshenbang 1.0: Being the foundation of chinese cognitive intelligence. arXiv."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"5570","DOI":"10.1080\/10447318.2025.2545463","article-title":"Human\u2013AI Interaction and User Satisfaction: Empirical Evidence from Online Reviews of AI Products","volume":"42","author":"Pasch","year":"2026","journal-title":"Int. J. Hum.-Comput. Interact."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"220","DOI":"10.1145\/3695988","article-title":"Large Language Models for Software Engineering: A Systematic Literature Review","volume":"33","author":"Hou","year":"2024","journal-title":"ACM Trans. Softw. Eng. Methodol."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"107202","DOI":"10.1016\/j.infsof.2023.107202","article-title":"Zero-shot learning for requirements classification: An exploratory study","volume":"159","author":"Alhoshan","year":"2023","journal-title":"Inf. Softw. Technol."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"111110","DOI":"10.1016\/j.engappai.2025.111110","article-title":"Automatic requirements elicitation from user-generated content: A review of data, methods, and representations","volume":"156","author":"Cai","year":"2025","journal-title":"Eng. Appl. Artif. Intell."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"4910","DOI":"10.1080\/10447318.2024.2356356","article-title":"SES-Net: A Novel Multi-Task Deep Neural Network Model for Analyzing E-learning Users\u2019 Satisfaction via Sentiment, Emotion, and Semantic","volume":"41","author":"Sandiwarno","year":"2025","journal-title":"Int. J. Hum.-Comput. Interact."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"103484","DOI":"10.1016\/j.ijhcs.2025.103484","article-title":"The role of user feedback in enhancing understanding and trust in counterfactual explanations for explainable AI","volume":"199","author":"Suffian","year":"2025","journal-title":"Int. J. Hum.-Comput. Stud."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"103634","DOI":"10.1016\/j.ijhcs.2025.103634","article-title":"Engaging with ethics in the HCI design process: A study of ethical design practice in different work contexts","volume":"205","author":"Tejo","year":"2025","journal-title":"Int. J. Hum.-Comput. Stud."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"94","DOI":"10.1016\/j.jbusres.2021.01.060","article-title":"A socio-technical view of platform ecosystems: Systematic review and research agenda","volume":"128","author":"Kapoor","year":"2021","journal-title":"J. Bus. Res."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1111\/j.1365-2575.2009.00338.x","article-title":"Who are the users? Who are the developers? Webs of users and developers in the development process of a technical standard","volume":"20","author":"Millerand","year":"2010","journal-title":"Inf. Syst. J."},{"key":"ref_55","first-page":"173","article-title":"Exploiting user experience from online customer reviews for product design","volume":"46","author":"Yang","year":"2019","journal-title":"Int. J. Inf. Manag."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"6708","DOI":"10.1080\/00207543.2021.1949641","article-title":"Mining online reviews with a Kansei-integrated Kano model for innovative product design","volume":"60","author":"Jin","year":"2022","journal-title":"Int. J. Prod. Res."}],"container-title":["Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2079-8954\/14\/6\/645\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,6,6]],"date-time":"2026-06-06T04:15:07Z","timestamp":1780719307000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2079-8954\/14\/6\/645"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,6,4]]},"references-count":56,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2026,6]]}},"alternative-id":["systems14060645"],"URL":"https:\/\/doi.org\/10.3390\/systems14060645","relation":{},"ISSN":["2079-8954"],"issn-type":[{"value":"2079-8954","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,6,4]]}}}