{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,2]],"date-time":"2026-05-02T06:56:56Z","timestamp":1777705016997,"version":"3.51.4"},"reference-count":33,"publisher":"SAGE Publications","issue":"1","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IFS"],"published-print":{"date-parts":[[2021,8,11]]},"abstract":"<jats:p>Evaluating the quality of the user experience (UX) of existing products is important for new product development. Conventional UX evaluation methods, such as questionnaire, have the disadvantages of the great subjective influence of investigators and limited number of participants. Meanwhile, online product reviews on e-commerce platforms express user evaluations of product UX. Because the reviews objectively reflect the user opinions and contain a large amount of data, they have potential as an information source for UX evaluation. In this context, this study explores how to evaluate product UX through using online product reviews. A pilot study is conducted to define the key elements of a review. Then, a systematic method of product UX evaluation based on reviews is proposed. The method includes three parts: extraction of key elements, integration of key elements, and quantitative evaluation based on rough number. The effectiveness of the proposed method is demonstrated by a case study using reviews of a wireless vacuum cleaner. Based on the proposed method, designers can objectively evaluate the UX quality of existing products and obtain detailed suggestions for product improvement.<\/jats:p>","DOI":"10.3233\/jifs-210564","type":"journal-article","created":{"date-parts":[[2021,6,22]],"date-time":"2021-06-22T14:31:05Z","timestamp":1624372265000},"page":"1791-1805","source":"Crossref","is-referenced-by-count":14,"title":["User experience evaluation method based on online product reviews"],"prefix":"10.1177","volume":"41","author":[{"given":"Fangmin","family":"Cheng","sequence":"first","affiliation":[{"name":"Shaanxi Engineering Laboratory for Industrial Design, Northwestern Polytechnical University, Xi\u2019an, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Suihuai","family":"Yu","sequence":"additional","affiliation":[{"name":"Shaanxi Engineering Laboratory for Industrial Design, Northwestern Polytechnical University, Xi\u2019an, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shengfeng","family":"Qin","sequence":"additional","affiliation":[{"name":"School of Design, Northumbria University, Newcastle upon Tyne, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jianjie","family":"Chu","sequence":"additional","affiliation":[{"name":"Shaanxi Engineering Laboratory for Industrial Design, Northwestern Polytechnical University, Xi\u2019an, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jian","family":"Chen","sequence":"additional","affiliation":[{"name":"College of Design and Art, Shaanxi University of Science & Technology, Xian, Shaanxi, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"179","reference":[{"key":"10.3233\/JIFS-210564_ref2","doi-asserted-by":"crossref","first-page":"419","DOI":"10.1016\/j.intcom.2008.03.001","article-title":"Modelling user experience with web sites: Usability, hedonic value, beauty and goodness","volume":"20","author":"van Schaik","year":"2008","journal-title":"Interacting with Computers"},{"key":"10.3233\/JIFS-210564_ref3","unstructured":"Hassenzahl M. , The thing and I: understanding the relationship between user and product, in: Funology: from usability to enjoyment, Kluwer Academic Publishers, (2005), 31\u201342."},{"key":"10.3233\/JIFS-210564_ref4","doi-asserted-by":"crossref","first-page":"160","DOI":"10.1016\/j.destud.2013.10.001","article-title":"A framework for user experience, needs and affordances","volume":"35","author":"Pucillo","year":"2014","journal-title":"Design Studies"},{"key":"10.3233\/JIFS-210564_ref5","doi-asserted-by":"crossref","first-page":"526","DOI":"10.1016\/j.ijhcs.2013.09.006","article-title":"Attitudes towards user experience (UX) measurement","volume":"72","author":"Law","year":"2014","journal-title":"International Journal of Human-Computer Studies"},{"key":"10.3233\/JIFS-210564_ref6","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1080\/23311916.2017.1421006","article-title":"User experience framework that combines aspects, dimensions, and measurement methods","volume":"4","author":"Zarour","year":"2017","journal-title":"Cogent Engineering"},{"key":"10.3233\/JIFS-210564_ref7","doi-asserted-by":"crossref","first-page":"500","DOI":"10.1016\/j.eswa.2012.07.070","article-title":"Improving user experience with case-based reasoning systems using text mining and Web 2.0","volume":"40","author":"He","year":"2013","journal-title":"Expert Systems with Applications"},{"key":"10.3233\/JIFS-210564_ref8","doi-asserted-by":"crossref","first-page":"3019","DOI":"10.1080\/00207543.2016.1154208","article-title":"Understanding big consumer opinion data for market-driven product design","volume":"54","author":"Jin","year":"2016","journal-title":"International Journal of Production Research"},{"key":"10.3233\/JIFS-210564_ref9","doi-asserted-by":"crossref","first-page":"663","DOI":"10.1080\/10447318.2014.930311","article-title":"Usability: Lessons Learned ... and Yet to Be Learned","volume":"30","author":"Lewis","year":"2014","journal-title":"International Journal of Human \u2013 Computer Interaction"},{"key":"10.3233\/JIFS-210564_ref12","doi-asserted-by":"crossref","first-page":"40","DOI":"10.9781\/ijimai.2017.445","article-title":"Construction of a Benchmark for the User Experience Questionnaire (UEQ)","volume":"4","author":"Schrepp","year":"2017","journal-title":"International Journal of Interactive Multimedia and Artificial Intelligence"},{"key":"10.3233\/JIFS-210564_ref13","doi-asserted-by":"crossref","first-page":"1055","DOI":"10.1016\/j.intcom.2006.01.002","article-title":"The influence of hedonic quality on the attractiveness of user interfaces of business management software","volume":"18","author":"Schrepp","year":"2006","journal-title":"Interacting with Computers"},{"key":"10.3233\/JIFS-210564_ref16","doi-asserted-by":"crossref","first-page":"484","DOI":"10.1080\/10447318.2015.1064648","article-title":"Assessing User Satisfaction in the Era of User Experience: Comparison of the SUS, UMUX, and UMUX-LITE as a Function of Product Experience","volume":"31","author":"Borsci","year":"2015","journal-title":"International Journal of Human-Computer Interaction"},{"key":"10.3233\/JIFS-210564_ref18","doi-asserted-by":"crossref","first-page":"336","DOI":"10.1016\/j.intcom.2010.04.005","article-title":"More than a feeling: Measurement of sonic user experience and psychophysiology in a first-person shooter game","volume":"22","author":"Nacke","year":"2010","journal-title":"Interacting with Computers"},{"key":"10.3233\/JIFS-210564_ref19","doi-asserted-by":"crossref","first-page":"2432","DOI":"10.3390\/su11082432","article-title":"An Empirical Study on User Experience Evaluation and Identification of Critical UX Issues","volume":"11","author":"Feng","year":"2019","journal-title":"Sustainability"},{"key":"10.3233\/JIFS-210564_ref20","doi-asserted-by":"crossref","first-page":"279","DOI":"10.1002\/hfm.20316","article-title":"Developing Elements of User Experience for Mobile Phones and Services: Survey, Interview, and Observation Approaches","volume":"23","author":"Park","year":"2013","journal-title":"Human Factors in Ergonomics & Manufacturing"},{"key":"10.3233\/JIFS-210564_ref21","doi-asserted-by":"crossref","first-page":"353","DOI":"10.1016\/j.intcom.2010.04.002","article-title":"Needs, affect, and interactive products \u2013Facets of user experience","volume":"22","author":"Hassenzahl","year":"2010","journal-title":"Interacting with Computers"},{"key":"10.3233\/JIFS-210564_ref22","doi-asserted-by":"crossref","first-page":"547","DOI":"10.1016\/j.destud.2004.03.001","article-title":"Seeing things: consumer response to the visual domain in product design","volume":"25","author":"Crilly","year":"2004","journal-title":"Design Studies"},{"key":"10.3233\/JIFS-210564_ref23","doi-asserted-by":"crossref","first-page":"216","DOI":"10.1016\/j.ergon.2018.05.017","article-title":"Development of a web-based user experience evaluation system for home appliances","volume":"67","author":"Park","year":"2018","journal-title":"International Journal of Industrial Ergonomics"},{"key":"10.3233\/JIFS-210564_ref25","doi-asserted-by":"crossref","first-page":"97","DOI":"10.1109\/TPC.2013.2257212","article-title":"Identifying User Experience Dimensions for Mobile Incident Reporting in Urban Contexts","volume":"56","author":"Winckler","year":"2013","journal-title":"IEEE Transactions on Professional Communication"},{"key":"10.3233\/JIFS-210564_ref27","doi-asserted-by":"crossref","first-page":"220","DOI":"10.1080\/10447310802629827","article-title":"Learning Online Brand Personality and Satisfaction: The Moderating Effects of Gaming Engagement","volume":"25","author":"Lin","year":"2009","journal-title":"International Journal of Human-Computer Interaction"},{"key":"10.3233\/JIFS-210564_ref29","doi-asserted-by":"crossref","first-page":"414","DOI":"10.1057\/s41303-017-0045-2","article-title":"Online product review as an indicator of users\u2019 degree of innovativeness and product adoption time: a longitudinal analysis of text reviews","volume":"26","author":"Safi","year":"2017","journal-title":"European Journal of Information Systems"},{"key":"10.3233\/JIFS-210564_ref30","doi-asserted-by":"crossref","first-page":"202","DOI":"10.1016\/j.ijinfomgt.2016.08.004","article-title":"Analyzing electronic word of mouth: A social commerce construct","volume":"37","author":"Ahmad","year":"2017","journal-title":"International Journal of Information Management"},{"key":"10.3233\/JIFS-210564_ref31","doi-asserted-by":"crossref","first-page":"951","DOI":"10.1016\/j.im.2016.06.002","article-title":"Mining customer requirements from online reviews: A product improvement perspective","volume":"53","author":"Qi","year":"2016","journal-title":"Information & Management"},{"key":"10.3233\/JIFS-210564_ref32","doi-asserted-by":"crossref","first-page":"670","DOI":"10.1080\/0951192X.2019.1571240","article-title":"Extraction of affective responses from customer reviews: an opinion mining and machine learning approach","volume":"33","author":"Li","year":"2019","journal-title":"International Journal of Computer Integrated Manufacturing"},{"key":"10.3233\/JIFS-210564_ref33","doi-asserted-by":"crossref","first-page":"38","DOI":"10.1016\/j.engappai.2015.05.006","article-title":"What makes consumers unsatisfied with your products: Review analysis at a fine-grained level","volume":"47","author":"Jin","year":"2016","journal-title":"Engineering Applications of Artificial Intelligence"},{"key":"10.3233\/JIFS-210564_ref34","doi-asserted-by":"crossref","first-page":"61","DOI":"10.1016\/j.engappai.2015.12.005","article-title":"Identifying comparative customer requirements from product online reviews for competitor analysis","volume":"49","author":"Jin","year":"2016","journal-title":"Engineering Applications of Artificial Intelligence"},{"key":"10.3233\/JIFS-210564_ref35","doi-asserted-by":"crossref","first-page":"3957","DOI":"10.3233\/JIFS-200057","article-title":"Identification of key customer requirements based on online reviews","volume":"39","author":"Li","year":"2020","journal-title":"Journal of Intelligent & Fuzzy Systems"},{"key":"10.3233\/JIFS-210564_ref36","doi-asserted-by":"crossref","first-page":"173","DOI":"10.1016\/j.ijinfomgt.2018.12.006","article-title":"Exploiting user experience from online customer reviews for product design","volume":"46","author":"Yang","year":"2019","journal-title":"International Journal of Information Management"},{"key":"10.3233\/JIFS-210564_ref37","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1561\/1500000011","article-title":"Opinion Mining and Sentiment Analysis","volume":"2","author":"Pang","year":"2008","journal-title":"Foundations & Trends in Information Retrieval"},{"key":"10.3233\/JIFS-210564_ref38","doi-asserted-by":"crossref","first-page":"147","DOI":"10.1016\/j.aei.2010.07.005","article-title":"A methodology for building a semantically annotated multi-faceted ontology for product family modelling","volume":"25","author":"Lim","year":"2011","journal-title":"Advanced Engineering Informatics"},{"key":"10.3233\/JIFS-210564_ref39","doi-asserted-by":"crossref","first-page":"487","DOI":"10.1007\/s12559-014-9316-6","article-title":"Concept-Level Sentiment Analysis with Dependency-Based Semantic Parsing: A Novel Approach","volume":"7","author":"Agarwal","year":"2015","journal-title":"Cognitive Computation"},{"key":"10.3233\/JIFS-210564_ref40","doi-asserted-by":"crossref","first-page":"10283","DOI":"10.1016\/j.eswa.2012.02.166","article-title":"Weakness Finder: Find product weakness from Chinese reviews by using aspects based sentiment analysis","volume":"39","author":"Zhang","year":"2012","journal-title":"Expert Systems with Applications"},{"key":"10.3233\/JIFS-210564_ref42","doi-asserted-by":"crossref","first-page":"222","DOI":"10.1016\/j.aei.2008.10.010","article-title":"A rough set based QFD approach to the management of imprecise design information in product development","volume":"23","author":"Zhai","year":"2009","journal-title":"Advanced Engineering Informatics"},{"key":"10.3233\/JIFS-210564_ref43","doi-asserted-by":"crossref","first-page":"1562","DOI":"10.1016\/j.jbusres.2015.10.017","article-title":"Effects of big data analytics and traditional marketing analytics on new product success: A knowledge fusion perspective","volume":"69","author":"Xu","year":"2016","journal-title":"Journal of Business Research"}],"container-title":["Journal of Intelligent &amp; Fuzzy Systems"],"original-title":[],"link":[{"URL":"https:\/\/content.iospress.com\/download?id=10.3233\/JIFS-210564","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T09:42:41Z","timestamp":1777455761000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/full\/10.3233\/JIFS-210564"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,8,11]]},"references-count":33,"journal-issue":{"issue":"1"},"URL":"https:\/\/doi.org\/10.3233\/jifs-210564","relation":{},"ISSN":["1064-1246","1875-8967"],"issn-type":[{"value":"1064-1246","type":"print"},{"value":"1875-8967","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,8,11]]}}}