{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,21]],"date-time":"2026-01-21T11:15:11Z","timestamp":1768994111940,"version":"3.49.0"},"reference-count":22,"publisher":"Emerald","issue":"1","license":[{"start":{"date-parts":[[2020,11,18]],"date-time":"2020-11-18T00:00:00Z","timestamp":1605657600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/www.emerald.com\/insight\/site-policies"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IJWIS"],"published-print":{"date-parts":[[2021,1,23]]},"abstract":"<jats:sec>\n<jats:title content-type=\"abstract-subheading\">Purpose<\/jats:title>\n<jats:p>The purpose of this paper is to show the importance of validity process in survey questionnaire instrument development. It is to confirm all items chosen are valid in the context of study, especially in assessing municipal website Web user behaviours. The quality of measurement also can be assured.<\/jats:p>\n<\/jats:sec>\n<jats:sec>\n<jats:title content-type=\"abstract-subheading\">Design\/methodology\/approach<\/jats:title>\n<jats:p>Several methods used to assess validity of the survey instrument in this study, such as face validity, content validity index (CVI) and construct validity. CVI assessment is widely used to examine each item in the survey instrument exact measures what is supposed to be measured. Prolific items used to evaluate web aesthetic, usability, navigation, content organization, interactivity and user engagement.<\/jats:p>\n<\/jats:sec>\n<jats:sec>\n<jats:title content-type=\"abstract-subheading\">Findings<\/jats:title>\n<jats:p>Several items were rephrased and simplified during face validity assessment, while three items from user engagement construct were excluded after the CVI assessment. Reliability and redundancy analysis had shown good results for each item and construct for both dependent and independent variables. None of the items in any construct need to be eliminated.<\/jats:p>\n<\/jats:sec>\n<jats:sec>\n<jats:title content-type=\"abstract-subheading\">Research limitations\/implications<\/jats:title>\n<jats:p>The face validity, content validity and construct validity assessments are sufficient to assure the consistency of the conceptual framework, the content of items and overall measurement approach reflecting the setting or context of study which are web users.<\/jats:p>\n<\/jats:sec>\n<jats:sec>\n<jats:title content-type=\"abstract-subheading\">Practical implications<\/jats:title>\n<jats:p>The validated survey instrument provides practical guidelines for government municipal website owners on how to stimulate website user to keep engaged on the government municipal website. Identified website content that acts as credibility cues can be as object attention when planning the strategy of Web content management. Through proper design and attracting touch up, the credibility cues can attract website user and force the user to engage deeper on the government municipal website content, believe it as the main source of information and recognize it as authoritative organization.<\/jats:p>\n<\/jats:sec>\n<jats:sec>\n<jats:title content-type=\"abstract-subheading\">Originality\/value<\/jats:title>\n<jats:p>The measurement model of this study that consists of formative construct of surface credibility, and user engagement is proposed to be tested in a different context of this study.<\/jats:p>\n<\/jats:sec>","DOI":"10.1108\/ijwis-08-2020-0050","type":"journal-article","created":{"date-parts":[[2020,11,18]],"date-time":"2020-11-18T04:46:42Z","timestamp":1605674802000},"page":"18-28","source":"Crossref","is-referenced-by-count":7,"title":["Measuring validity and reliability of website credibility factors in influencing user engagement questionnaire"],"prefix":"10.1108","volume":"17","author":[{"given":"Farrah Diana","family":"Saiful Bahry","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Maslin","family":"Masrom","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mohamad Noorman","family":"Masrek","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"140","published-online":{"date-parts":[[2020,11,18]]},"reference":[{"key":"key2021043009174576500_ref001","first-page":"9","article-title":"Towards a science of user engagement (position paper)","year":"2011"},{"issue":"4","key":"key2021043009174576500_ref002","doi-asserted-by":"crossref","first-page":"805","DOI":"10.2307\/25148755","article-title":"Influence processes for information technology acceptance: an elaboration likelihood model","volume":"30","year":"2006","journal-title":"MIS Quarterly"},{"issue":"3","key":"key2021043009174576500_ref003","doi-asserted-by":"crossref","first-page":"228","DOI":"10.1287\/isre.1060.0096","article-title":"Reconceptualizing system usage","volume":"17","year":"2006","journal-title":"Information Systems Research"},{"issue":"1","key":"key2021043009174576500_ref004","first-page":"1","article-title":"Commentary: issues and opinion on structural equation modelling","volume":"22","year":"1998","journal-title":"MIS Quarterly"},{"issue":"1","key":"key2021043009174576500_ref005","doi-asserted-by":"crossref","first-page":"64","DOI":"10.1177\/002224377901600110","article-title":"A paradigm for developing better measures of marketing constructs","volume":"16","year":"1979","journal-title":"Journal of Marketing Research"},{"key":"key2021043009174576500_ref006","volume-title":"A Primer on Partial Least Squares Structural Equation Modeling (PLS-SEM)","year":"2014"},{"issue":"4","key":"key2021043009174576500_ref007","doi-asserted-by":"crossref","first-page":"635","DOI":"10.1086\/266350","article-title":"The influence of source credibility on communication effectiveness","volume":"15","year":"1951","journal-title":"Public Opinion Quarterly"},{"issue":"7","key":"key2021043009174576500_ref008","first-page":"10","article-title":"Content validity index and intra-and inter-rater reliability of a new muscle strength\/endurance test battery for Swedish soldiers","volume":"10","year":"2015","journal-title":"PloS One"},{"issue":"2","key":"key2021043009174576500_ref009","doi-asserted-by":"crossref","first-page":"123","DOI":"10.1109\/TPC.2014.2312452","article-title":"Partial least squares (PLS) structural equation modeling (SEM) for building and testing behavioral causal theory: when to choose it and how to use it","volume":"57","year":"2014","journal-title":"IEEE Transactions on Professional Communication"},{"issue":"6","key":"key2021043009174576500_ref010","first-page":"382","article-title":"Determination and quantification of content validity","volume":"35","year":"1986","journal-title":"Nursing Research"},{"issue":"2","key":"key2021043009174576500_ref011","doi-asserted-by":"crossref","first-page":"293","DOI":"10.2307\/23044045","article-title":"Construct measurement and validation procedures in MIS and behavioral research: integrating new and existing techniques","volume":"35","year":"2011","journal-title":"MIS Quarterly"},{"issue":"6","key":"key2021043009174576500_ref012","doi-asserted-by":"crossref","first-page":"938","DOI":"10.1002\/asi.20801","article-title":"What is user engagement? A conceptual framework for defining user engagement with technology","volume":"59","year":"2008","journal-title":"Journal of the American Society for Information Science and Technology"},{"issue":"4","key":"key2021043009174576500_ref013","doi-asserted-by":"crossref","first-page":"413","DOI":"10.1016\/j.ipm.2015.03.003","article-title":"An empirical evaluation of the user engagement scale (UES) in online news environments","volume":"51","year":"2015","journal-title":"Information Processing and Management"},{"key":"key2021043009174576500_ref014","doi-asserted-by":"crossref","first-page":"54","DOI":"10.1016\/j.chb.2015.07.038","article-title":"Factors driving young users' engagement with Facebook: evidence from Brazil","volume":"54","year":"2016","journal-title":"Computers in Human Behavior"},{"issue":"2","key":"key2021043009174576500_ref015","doi-asserted-by":"publisher","first-page":"391","DOI":"10.5901\/jesr.2012.v2n2.391","article-title":"Validity and reliability issues in educational research","volume":"2","year":"2012","journal-title":"Journal of Educational and Social Research"},{"issue":"5","key":"key2021043009174576500_ref016","doi-asserted-by":"crossref","first-page":"489","DOI":"10.1002\/nur.20147","article-title":"The content validity index: are you sure you know what's being reported? Critique and recommendations","volume":"29","year":"2006","journal-title":"Research in Nursing and Health"},{"key":"key2021043009174576500_ref017","volume-title":"Partial Least Squares Structural Equation Modeling (PLS-SEM) Using SmartPLS 3.0: An Updated Guide and Practical Guide to Statistical Analysis","year":"2016","edition":"1st ed."},{"issue":"3","key":"key2021043009174576500_ref018","doi-asserted-by":"crossref","first-page":"354","DOI":"10.1016\/j.giq.2010.09.006","article-title":"Benchmarking e-Government: a comparison of frameworks for computing e-Government index and ranking","volume":"28","year":"2011","journal-title":"Government Information Quarterly"},{"issue":"2","key":"key2021043009174576500_ref019","doi-asserted-by":"crossref","first-page":"134","DOI":"10.1002\/asi.10016","article-title":"Believe it or not factors influencing credibility on the web","volume":"53","year":"2002","journal-title":"Journal of the American Society for Information Science and Technology"},{"issue":"1","key":"key2021043009174576500_ref020","first-page":"25","article-title":"Content validity and its estimation","volume":"3","year":"2003","journal-title":"Journal of Medical Education"},{"issue":"2","key":"key2021043009174576500_ref021","doi-asserted-by":"crossref","first-page":"99","DOI":"10.5243\/jsswr.2010.8","article-title":"Author guidelines for reporting scale development and validation results in the journal of the society for social work and research","volume":"1","year":"2010","journal-title":"Journal of the Society for Social Work and Research"},{"issue":"2","key":"key2021043009174576500_ref022","doi-asserted-by":"crossref","first-page":"147","DOI":"10.1177\/1094428103251541","article-title":"A review and evaluation of exploratory factor analysis practices in organizational research","volume":"6","year":"2003","journal-title":"Organizational Research Methods"}],"container-title":["International Journal of Web Information Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/IJWIS-08-2020-0050\/full\/xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/IJWIS-08-2020-0050\/full\/html","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,24]],"date-time":"2025-07-24T22:24:14Z","timestamp":1753395854000},"score":1,"resource":{"primary":{"URL":"http:\/\/www.emerald.com\/ijwis\/article\/17\/1\/18-28\/163920"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,11,18]]},"references-count":22,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2020,11,18]]},"published-print":{"date-parts":[[2021,1,23]]}},"alternative-id":["10.1108\/IJWIS-08-2020-0050"],"URL":"https:\/\/doi.org\/10.1108\/ijwis-08-2020-0050","relation":{},"ISSN":["1744-0084","1744-0084"],"issn-type":[{"value":"1744-0084","type":"print"},{"value":"1744-0084","type":"print"}],"subject":[],"published":{"date-parts":[[2020,11,18]]}}}