{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,23]],"date-time":"2026-10-23T20:59:05Z","timestamp":1792789145542,"version":"4.5.0"},"reference-count":57,"publisher":"MDPI AG","issue":"9","license":[{"start":{"date-parts":[[2026,9,16]],"date-time":"2026-09-16T00:00:00Z","timestamp":1789516800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Istanbul Atlas University","id":[{"id":"https:\/\/ror.org\/02jqzm779","id-type":"ROR","asserted-by":"crossref"}]},{"id":[{"id":"https:\/\/ror.org\/02jqzm779","id-type":"ROR","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Behav. Sci.","Behavioral Sciences"],"abstract":"<jats:p>Violence against nurses is a global occupational health and safety issue, yet instruments that assess nurses\u2019 attitudes towards violence from patients and their relatives are limited. This methodological study involved the development and evaluation of the Nurses\u2019 Attitudes Towards Violence by Patients and Patients\u2019 Relatives Scale. In the qualitative phase, 39 nurses were interviewed in depth until data saturation was reached, generating a pool of 61 items. Content validity with 15 experts (CVI = 0.90) yielded a draft of 57 items. The original quantitative sample (N = 608) was randomly divided into exploratory (n = 304) and confirmatory (n = 304) subsamples. Principal axis factoring with ProMax rotation supported a 36-item, three-factor solution that explained 52.3% of the common variance. This solution comprised the following factors: perception and causes of violence (20 items); effects of violence (13 items); and response to violence (3 items). In the original confirmatory subsample, the final model with six theory-based residual covariances was subjected to WLSMV confirmatory factor analysis, showing an overall acceptable fit (\u03c72(585) = 1297.5, \u03c72\/df = 2.22, CFI = 0.900, TLI = 0.892, RMSEA = 0.063 [90% CI 0.059\u20130.068], SRMR = 0.093). A robustness wave involving 45 additional nurses, conducted between 27 August and 2 September 2026, produced almost identical results when combined with the confirmatory subsample (n = 349). Supplementary analyses supported composite reliability and discriminant validity, and found that measurement invariance was supported across institution type, whereas findings regarding sex invariance were interpreted as preliminary. In the original sample of N = 608, Cronbach\u2019s \u03b1 was 0.943, 0.930 and 0.842 for the three factors, and 0.950 for the total scale. Two-week test\u2013retest reliability was r = 0.976. The scale provides a multidimensional measure of nurses\u2019 evaluative-attributional beliefs, perceived effects and responses to violence from patients and relatives.<\/jats:p>","DOI":"10.3390\/bs16091665","type":"journal-article","created":{"date-parts":[[2026,9,16]],"date-time":"2026-09-16T16:07:29Z","timestamp":1789574849000},"page":"1665","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Development of the Nurses\u2019 Attitudes Toward Violence by Patients and Patients\u2019 Relatives Scale: A Methodological Study"],"prefix":"10.3390","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4548-0311","authenticated-orcid":false,"given":"Deniz","family":"G\u00fcr","sequence":"first","affiliation":[{"name":"Vocational School, Atlas University, 34403 Istanbul, T\u00fcrkiye"},{"name":"Department of Nursing Management, Florence Nightingale Faculty of Nursing, Istanbul University-Cerrahpasa, 34320 Istanbul, T\u00fcrkiye"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5790-5992","authenticated-orcid":false,"given":"\u00dclk\u00fc","family":"Baykal","sequence":"additional","affiliation":[{"name":"Department of Nursing Management, Florence Nightingale Faculty of Nursing, Istanbul University-Cerrahpasa, 34320 Istanbul, T\u00fcrkiye"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2026,9,16]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Alfuqaha, O. A., Albawati, N. M., Alhiary, S. S., Alhalaiqa, F. N., Haha, M. F. F., Musa, S. S., Shunnar, O., and Al Thaher, Y. (2022). Workplace violence among healthcare providers during the COVID-19 health emergency: A cross-sectional study. Behavioral Sciences, 12, (4).","DOI":"10.3390\/bs12040106"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"186","DOI":"10.1016\/j.puhe.2021.02.009","article-title":"Workplace violence in the emergency department: A systematic review and meta-analysis","volume":"196","author":"Aljohani","year":"2021","journal-title":"Public Health"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"4748","DOI":"10.1111\/jocn.17169","article-title":"Protective and risk factors of workplace violence against nurses: A cross-sectional study","volume":"33","author":"Bagnasco","year":"2024","journal-title":"Journal of Clinical Nursing"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"E13","DOI":"10.1097\/HMR.0000000000000286","article-title":"Workplace violence: Examination of the tensions between duty of care, worker safety, and zero tolerance","volume":"45","author":"Beattie","year":"2020","journal-title":"Health Care Management Review"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"61","DOI":"10.1186\/s13054-024-04844-z","article-title":"Violence against healthcare professionals in intensive care units: A systematic review and meta-analysis of frequency, risk factors, interventions, and preventive measures","volume":"28","author":"Berger","year":"2024","journal-title":"Critical Care"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"464","DOI":"10.1080\/10705510701301834","article-title":"Sensitivity of goodness of fit indexes to lack of measurement invariance","volume":"14","author":"Chen","year":"2007","journal-title":"Structural Equation Modeling"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"9496021","DOI":"10.1155\/2023\/9496021","article-title":"Patient violence towards mental health nurses: A concept analysis","volume":"2023","author":"Cho","year":"2023","journal-title":"Perspectives in Psychiatric Care"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1759","DOI":"10.1111\/jonm.13618","article-title":"Why nurses do not report patient aggression: A review and appraisal of the literature","volume":"30","author":"Christensen","year":"2022","journal-title":"Journal of Nursing Management"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1412","DOI":"10.1037\/pas0000626","article-title":"Constructing validity: New developments in creating objective measuring instruments","volume":"31","author":"Clark","year":"2019","journal-title":"Psychological Assessment"},{"key":"ref_10","unstructured":"Valle, R. S., and King, M. (1978). Psychological research as the phenomenologist views it. Existential-phenomenological alternatives for psychology, Oxford University Press."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"381","DOI":"10.1037\/1082-989X.12.4.381","article-title":"The insidious effects of failing to include design-driven correlated residuals in latent-variable covariance structure analysis","volume":"12","author":"Cole","year":"2007","journal-title":"Psychological Methods"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"qxag077","DOI":"10.1093\/haschl\/qxag077","article-title":"Workplace violence against nurses is a patient safety crisis, not \u201cpart of the job\u201d","volume":"4","author":"Connell","year":"2026","journal-title":"Health Affairs Scholar"},{"key":"ref_13","unstructured":"B\u00fct\u00fcn, M., and Demir, S. B. (2016). Nitel ara\u015ft\u0131rma y\u00f6ntemleri: Be\u015f yakla\u015f\u0131ma g\u00f6re nitel ara\u015ft\u0131rma ve ara\u015ft\u0131rma deseni [Qualitative inquiry and research design: Choosing among five approaches], Siyasal Kitabevi. [3rd ed.]. (Original work published 2013)."},{"key":"ref_14","unstructured":"Demir, S. B., and B\u00fct\u00fcn, M. (2021). Nitel ara\u015ft\u0131rma y\u00f6ntemleri: Be\u015f yakla\u015f\u0131ma g\u00f6re nitel ara\u015ft\u0131rma ve ara\u015ft\u0131rma deseni [Qualitative inquiry and research design: Choosing among five approaches], Siyasal Kitabevi. (Original work published 2013)."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"3238","DOI":"10.1111\/jan.14859","article-title":"Development and psychometric properties of the attitude scale towards female workers in healthcare settings","volume":"77","author":"Baykal","year":"2021","journal-title":"Journal of Advanced Nursing"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"194","DOI":"10.1016\/S0897-1897(05)80008-4","article-title":"Instrument review: Getting the most from a panel of experts","volume":"5","author":"Davis","year":"1992","journal-title":"Applied Nursing Research"},{"key":"ref_17","first-page":"449","article-title":"Content validity evidences in test development: An applied perspective","volume":"12","author":"Ruch","year":"2012","journal-title":"International Journal of Clinical and Health Psychology"},{"key":"ref_18","unstructured":"DeVellis, R. F. (2017). Scale development: Theory and applications, SAGE. [4th ed.]."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Dopelt, K., Davidovitch, N., Stupak, A., Ben Ayun, R., Lev Eltsufin, A., and Levy, C. (2022). Workplace violence against hospital workers during the COVID-19 pandemic in Israel: Implications for public health. International Journal of Environmental Research and Public Health, 19, (8).","DOI":"10.3390\/ijerph19084659"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"e12453","DOI":"10.1111\/nin.12453","article-title":"Nursing violent patients: Vulnerability and the limits of the duty to provide care","volume":"29","author":"Dunsford","year":"2022","journal-title":"Nursing Inquiry"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Elsharkawy, N. B., Alruwaili, A. N., Elsayed Ramadan, O. M., Alruwaili, M. M., Alhaiti, A., and Abdelaziz, E. M. (2025). Barriers to reporting workplace violence: A qualitative study of nurses\u2019 perceptions in tertiary care settings. BMC Nursing, 24.","DOI":"10.1186\/s12912-025-03039-3"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Fiorino, F. S., Oliveri, C., Vivarelli, S., and Fenga, C. (2026). The rising tide of workplace violence in the healthcare sector: A global scoping review of burden, determinants, and prevention strategies (2021\u20132025). Frontiers in Public Health, 14.","DOI":"10.3389\/fpubh.2026.1851734"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1177\/002224378101800104","article-title":"Evaluating structural equation models with unobservable variables and measurement error","volume":"18","author":"Fornell","year":"1981","journal-title":"Journal of Marketing Research"},{"key":"ref_24","unstructured":"G\u00fcr, D. (2023). Hem\u015firelerin hasta ve hasta yak\u0131n\u0131 \u015fiddetine y\u00f6nelik tutumu \u00f6l\u00e7e\u011finin geli\u015ftirilmesi [Development of the attitude scale toward violence by patients and their relatives against nurses]. [Doctoral dissertation, Istanbul University-Cerrahpasa]. CoHE Thesis Center, Thesis No. 818620."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"39","DOI":"10.7475\/kjan.2015.27.1.39","article-title":"Development and validation of the Hospital Violence Attitude Scale-18 (HVAS-18) for clinical nurses","volume":"27","author":"Ha","year":"2015","journal-title":"Korean Journal of Adult Nursing"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"115","DOI":"10.1007\/s11747-014-0403-8","article-title":"A new criterion for assessing discriminant validity in variance-based structural equation modeling","volume":"43","author":"Henseler","year":"2015","journal-title":"Journal of the Academy of Marketing Science"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"179","DOI":"10.1007\/BF02289447","article-title":"A rationale and test for the number of factors in factor analysis","volume":"30","author":"Horn","year":"1965","journal-title":"Psychometrika"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"1688","DOI":"10.1111\/jonm.13721","article-title":"Violence against nurses by patients and visitors in the emergency department: A concept analysis","volume":"30","author":"Hou","year":"2022","journal-title":"Journal of Nursing Management"},{"key":"ref_29","unstructured":"International Labour Office, International Council of Nurses, World Health Organization, and Public Services International (2002). Framework guidelines for addressing workplace violence in the health sector, International Labour Office. Available online: https:\/\/www.who.int\/publications\/i\/item\/9221134466."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"51","DOI":"10.1111\/j.1471-6712.1997.tb00430.x","article-title":"The perception of aggression","volume":"11","author":"Jansen","year":"1997","journal-title":"Scandinavian Journal of Caring Sciences"},{"key":"ref_31","unstructured":"Jorgensen, T. D., Pornprasertmanit, S., Schoemann, A. M., and Rosseel, Y. (2026, June 10). semTools: Useful tools for structural equation modeling (R package version 0.5-6), Available online: https:\/\/CRAN.R-project.org\/package=semTools."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"4235","DOI":"10.1111\/jocn.17639","article-title":"Nurses\u2019 workplace violence reporting behaviours and reasons for not formally reporting: A cross-sectional secondary analysis","volume":"34","author":"Lee","year":"2025","journal-title":"Journal of Clinical Nursing"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"342","DOI":"10.15452\/cejnm.2021.12.0009","article-title":"The factors affecting patient aggression scale: Psychometric testing of a new tool","volume":"12","year":"2021","journal-title":"Central European Journal of Nursing and Midwifery"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"936","DOI":"10.3758\/s13428-015-0619-7","article-title":"Confirmatory factor analysis with ordinal data: Comparing robust maximum likelihood and diagonally weighted least squares","volume":"48","author":"Li","year":"2016","journal-title":"Behavior Research Methods"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"927","DOI":"10.1136\/oemed-2019-105849","article-title":"Prevalence of workplace violence against healthcare workers: A systematic review and meta-analysis","volume":"76","author":"Liu","year":"2019","journal-title":"Occupational and Environmental Medicine"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Mahmoudi, F., Garmaroudi, G., Saniee, N., Razavi, N., Mosadeghrad, A. M., and Ashoorkhani, M. (2026). Causes of workplace violence against nurses and strategies for its prevention in developed countries: A scoping review. BMC Nursing, 25.","DOI":"10.1186\/s12912-025-04227-x"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"279","DOI":"10.12968\/bjon.2014.23.5.279","article-title":"Awareness and minimisation of systematic bias in research","volume":"23","author":"Malone","year":"2014","journal-title":"British Journal of Nursing"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"61","DOI":"10.1037\/met0000425","article-title":"Dynamic fit index cutoffs for confirmatory factor analysis models","volume":"28","author":"McNeish","year":"2023","journal-title":"Psychological Methods"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"442","DOI":"10.1111\/jpm.12759","article-title":"Reliability and validity of the Korean 12-item Perception of Aggression Scale","volume":"29","author":"Nam","year":"2022","journal-title":"Journal of Psychiatric and Mental Health Nursing"},{"key":"ref_40","unstructured":"Neuman, W. L. (2014). Social research methods: Qualitative and quantitative approaches, Pearson Education. [7th ed.]."},{"key":"ref_41","first-page":"1","article-title":"Intercoder reliability in qualitative research: Debates and practical guidelines","volume":"19","author":"Joffe","year":"2020","journal-title":"International Journal of Qualitative Methods"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"515","DOI":"10.1097\/NNA.0000000000000927","article-title":"Inpatient nurses\u2019 perception of workplace violence based on specialty","volume":"50","author":"Perkins","year":"2020","journal-title":"Journal of Nursing Administration"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"502","DOI":"10.1016\/j.aucc.2018.10.003","article-title":"Violence and aggression in the intensive care unit: What is the impact of the Australian National Emergency Access Target?","volume":"32","author":"Pol","year":"2019","journal-title":"Australian Critical Care"},{"key":"ref_44","unstructured":"Revelle, W. (2026, June 12). psych: Procedures for psychological, psychometric, and personality research (R package), Available online: https:\/\/CRAN.R-project.org\/package=psych."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"1","DOI":"10.18637\/jss.v048.i02","article-title":"lavaan: An R package for structural equation modeling","volume":"48","author":"Rosseel","year":"2012","journal-title":"Journal of Statistical Software"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"504","DOI":"10.1177\/1054773818823333","article-title":"Risk factors and triggers that may result in patient-initiated violence on inpatient psychiatric units: An integrative review","volume":"29","author":"Yifter","year":"2020","journal-title":"Clinical Nursing Research"},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Seddik, S. A., Abdelhai, R., Aboushady, A. T., Nawwar, A. E., El Essawy, R. A., and Hegazy, A. A. (2023). Violence against healthcare workers during the COVID-19 pandemic: A cross-sectional survey at Cairo University Hospital. Frontiers in Public Health, 11.","DOI":"10.3389\/fpubh.2023.1277056"},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Spelten, E., Thomas, B., O\u2019Meara, P., van Vuuren, J., and McGillion, A. (2020). Violence against emergency department nurses: Can we identify the perpetrators?. PLoS ONE, 15, (4).","DOI":"10.1371\/journal.pone.0230793"},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Spencer, C., Sitarz, J., Fouse, J., and DeSanto, K. (2023). Nurses\u2019 rationale for underreporting of patient- and visitor-perpetrated workplace violence: A systematic review. BMC Nursing, 22.","DOI":"10.1186\/s12912-023-01226-8"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"139","DOI":"10.1111\/jebm.12432","article-title":"An integrative review of waiting time, queuing, and design as contributory factors to emergency department violence","volume":"14","author":"Timmins","year":"2021","journal-title":"Journal of Evidence-Based Medicine"},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"219","DOI":"10.1177\/0095798418771807","article-title":"Exploratory factor analysis: A guide to best practice","volume":"44","author":"Watkins","year":"2018","journal-title":"Journal of Black Psychology"},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Wirth, T., Peters, C., Nienhaus, A., and Schablon, A. (2021). Interventions for workplace violence prevention in emergency departments: A systematic review. International Journal of Environmental Research and Public Health, 18, (16).","DOI":"10.3390\/ijerph18168459"},{"key":"ref_53","unstructured":"World Health Organization (2020). State of the world\u2019s nursing 2020: Investing in education, jobs and leadership, World Health Organization. Available online: https:\/\/www.who.int\/publications\/i\/item\/9789240003279."},{"key":"ref_54","unstructured":"World Health Organization (2026, June 10). Violence and harassment, Available online: https:\/\/www.who.int\/tools\/occupational-hazards-in-health-sector\/violence-harassment."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"NP9168","DOI":"10.1177\/0886260520980386","article-title":"A socio-ecological framework for understanding workplace violence in China\u2019s health sector: A qualitative analysis of health workers\u2019 responses to an open-ended survey question","volume":"37","author":"Wu","year":"2022","journal-title":"Journal of Interpersonal Violence"},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"4500","DOI":"10.1111\/jan.16708","article-title":"Emergency department crowding as a contributing factor related to patient-initiated violence against nurses: A literature review","volume":"81","author":"Xie","year":"2025","journal-title":"Journal of Advanced Nursing"},{"key":"ref_57","doi-asserted-by":"crossref","unstructured":"Yang, H.-L., Tai, J.-C., Wang, C.-H., Shyu, Y.-K., Chou, K.-R., and Pien, L.-C. (2025). Workplace violence, work characteristics, and seniority levels among nurses: A cross-sectional study. BMC Nursing, 24.","DOI":"10.1186\/s12912-025-02887-3"}],"container-title":["Behavioral Sciences"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2076-328X\/16\/9\/1665\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,9,22]],"date-time":"2026-09-22T11:11:55Z","timestamp":1790075515000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2076-328X\/16\/9\/1665"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,9,16]]},"references-count":57,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2026,9]]}},"alternative-id":["bs16091665"],"URL":"https:\/\/doi.org\/10.3390\/bs16091665","relation":{},"ISSN":["2076-328X"],"issn-type":[{"value":"2076-328X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,9,16]]}}}