{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,16]],"date-time":"2026-10-16T08:28:56Z","timestamp":1792139336549,"version":"4.4.0"},"reference-count":72,"publisher":"Public Library of Science (PLoS)","issue":"1","license":[{"start":{"date-parts":[[2023,1,20]],"date-time":"2023-01-20T00:00:00Z","timestamp":1674172800000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001807","name":"FAPESP","doi-asserted-by":"crossref","award":["2017\/12815-0"],"award-info":[{"award-number":["2017\/12815-0"]}],"id":[{"id":"10.13039\/501100001807","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100002322","name":"Coordena\u00e7\u00e3o de Aperfei\u00e7oamento de Pessoal de N\u00edvel Superior","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100002322","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000038","name":"Natural Sciences and Engineering Research Council of Canada","doi-asserted-by":"publisher","award":["RGPIN-2018-03831"],"award-info":[{"award-number":["RGPIN-2018-03831"]}],"id":[{"id":"10.13039\/501100000038","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["www.plosone.org"],"crossmark-restriction":false},"short-container-title":["PLoS ONE"],"abstract":"<jats:p>This systematic review aimed to investigate the measurement properties of pain scoring instruments in farm animals. According to the PRISMA guidelines, a registered report protocol was previously published in this journal. Studies reporting the development and validation of acute and chronic pain scoring instruments based on behavioral and\/or facial expressions of farm animals were searched. Data extraction and assessment were performed individually by two investigators using the Consensus-based Standards for the Selection of Health Measurement Instruments (COSMIN) guidelines. Nine categories were assessed: two for scale development (general design requirements and development, and content validity and comprehensibility) and seven for measurement properties (internal consistency, reliability, measurement error, criterion and construct validity, responsiveness and cross-cultural validity). The overall strength of evidence (high, moderate, low, or very low) of each instrument was scored based on methodological quality, number of studies and studies\u2019 findings. Twenty instruments for three species (bovine, ovine and swine) were included. There was considerable variability concerning their development and measurement properties. Three behavior-based instruments scored high for strength of evidence: UCAPS (Unesp-Botucatu Unidimensional Composite Pain Scale for assessing postoperative pain in cattle), USAPS (Unesp-Botucatu Sheep Acute Composite Pain Scale) and UPAPS (Unesp-Botucatu Pig Composite Acute Pain Scale). Four instruments scored moderate for strength of evidence: MPSS (Multidimensional Pain Scoring System for bovine), SPFES (Sheep Pain Facial Expression Scale), LGS (Lamb Grimace Scale) and PGS-B (Piglet Grimace Scale-B). Most instruments (n = 13) scored low or very low for final overall evidence. Construct validity was the most reported measurement property followed by criterion validity and reliability. Instruments with reported validation are urgently required for pain assessment of buffalos, goats, camelids and avian species.<\/jats:p>","DOI":"10.1371\/journal.pone.0280830","type":"journal-article","created":{"date-parts":[[2023,1,20]],"date-time":"2023-01-20T13:50:04Z","timestamp":1674222604000},"page":"e0280830","update-policy":"https:\/\/doi.org\/10.1371\/journal.pone.corrections_policy","source":"Crossref","is-referenced-by-count":30,"title":["Measurement properties of pain scoring instruments in farm animals: A systematic review using the COSMIN checklist"],"prefix":"10.1371","volume":"18","author":[{"given":"Rubia Mitalli","family":"Tomacheuski","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5722-5687","authenticated-orcid":true,"given":"Beatriz Paglerani","family":"Monteiro","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Marina Cayetano","family":"Evangelista","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Stelio Pacca Loureiro","family":"Luna","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4150-6043","authenticated-orcid":true,"given":"Paulo Vin\u00edcius","family":"Steagall","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"340","published-online":{"date-parts":[[2023,1,20]]},"reference":[{"key":"pone.0280830.ref001","doi-asserted-by":"crossref","first-page":"495","DOI":"10.3389\/fvets.2019.00495","article-title":"Prioritization of farm animal welfare issues using expert consensus","volume":"6","author":"FC Rioja-Lang","year":"2020","journal-title":"Front Vet Sci"},{"key":"pone.0280830.ref002","doi-asserted-by":"crossref","first-page":"400","DOI":"10.1136\/vr.104428","article-title":"Clinician attitudes to pain and use of analgesia in cattle: Where are we 10 years on?","volume":"181","author":"JG Remnant","year":"2017","journal-title":"Vet Rec"},{"key":"pone.0280830.ref003","doi-asserted-by":"crossref","first-page":"410","DOI":"10.1111\/vaa.12025","article-title":"Attitude of Brazilian veterinarians in the recognition and treatment of pain in horses and cattle","volume":"40","author":"SERS Lorena","year":"2013","journal-title":"Vet Anaesth Analg"},{"key":"pone.0280830.ref004","first-page":"1129","article-title":"Factors affecting Canadian veterinarians\u2019 use of analgesics when dehorning beef and dairy calves","volume":"48","author":"CJ Hewson","year":"2007","journal-title":"Can Vet J"},{"key":"pone.0280830.ref005","doi-asserted-by":"crossref","first-page":"261","DOI":"10.1207\/s15327604jaws0804_3","article-title":"Pain detection and amelioration in animals on the farm: issues and options","volume":"8","author":"L Anil","year":"2005","journal-title":"J Appl Anim Welf Sci"},{"key":"pone.0280830.ref006","first-page":"231","article-title":"Identifying pain behaviors in dairy cattle","volume":"29","author":"KB Gleerup","year":"2017","journal-title":"WCDS Adv Dairy Technol"},{"key":"pone.0280830.ref007","doi-asserted-by":"crossref","first-page":"131","DOI":"10.1016\/S1090-0233(02)00186-7","article-title":"Pain alleviation in animals: attitudes and practices of Finnish veterinarians","volume":"165","author":"M Raekallio","year":"2003","journal-title":"Vet J"},{"key":"pone.0280830.ref008","first-page":"361","article-title":"A survey of bovine practitioners attitudes to pain and analgesia in cattle","volume":"8","author":"SA Watts","year":"2000","journal-title":"Cattle Pract"},{"key":"pone.0280830.ref009","doi-asserted-by":"crossref","first-page":"2250","DOI":"10.3168\/jds.S0022-0302(02)74304-X","article-title":"The impact of clinical lameness on the milk yield of dairy cows","volume":"85","author":"LE Green","year":"2002","journal-title":"J Dairy Sci"},{"key":"pone.0280830.ref010","doi-asserted-by":"crossref","first-page":"36","DOI":"10.1016\/j.vas.2016.11.003","article-title":"Long-term weight gain and economic impact in pigs castrated under local anaesthesia","volume":"1","author":"FG Telles","year":"2016","journal-title":"Vet Anim Sci"},{"key":"pone.0280830.ref011","doi-asserted-by":"crossref","first-page":"121","DOI":"10.1093\/bja\/aen087","article-title":"Analgesia from a veterinary perspective","volume":"101","author":"P. Flecknell","year":"2008","journal-title":"Br J Anaesth"},{"key":"pone.0280830.ref012","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41598-019-55693-8","article-title":"Facial expressions of pain in cats: the development and validation of a Feline Grimace Scale","volume":"9","author":"MC Evangelista","year":"2019","journal-title":"Sci Rep"},{"key":"pone.0280830.ref013","doi-asserted-by":"crossref","first-page":"19","DOI":"10.1016\/j.applanim.2016.01.007","article-title":"Development of a facial expression scale using footrot and mastitis as models of pain in sheep","volume":"176","author":"KM McLennan","year":"2016","journal-title":"Appl Anim Behav Sci"},{"key":"pone.0280830.ref014","doi-asserted-by":"crossref","first-page":"1","DOI":"10.3389\/fvets.2016.00100","article-title":"The assessment of facial expressions in piglets undergoing tail docking and castration: toward the development of the Piglet Grimace Scale","volume":"3","author":"P Di Giminiani","year":"2016","journal-title":"Front Vet Sci"},{"key":"pone.0280830.ref015","doi-asserted-by":"crossref","first-page":"215","DOI":"10.3389\/fvets.2018.00215","article-title":"Algometer precision for quantifying mechanical nociceptive threshold when applied to the udder of lactating dairy cows","volume":"5","author":"C Krug","year":"2018","journal-title":"Front Vet Sci"},{"key":"pone.0280830.ref016","doi-asserted-by":"crossref","first-page":"3010","DOI":"10.3168\/jds.2007-0968","article-title":"Analgesics improve the gait of lame dairy cattle","volume":"91","author":"FC Flower","year":"2008","journal-title":"J Dairy Sci"},{"key":"pone.0280830.ref017","doi-asserted-by":"crossref","first-page":"605","DOI":"10.1017\/S0962728600026257","article-title":"Subjective and objective assessment of pain and discomfort due to lameness in dairy cattle","volume":"12","author":"KA O\u2019Callaghan","year":"2003","journal-title":"Anim Welf"},{"key":"pone.0280830.ref018","doi-asserted-by":"crossref","first-page":"2007","DOI":"10.3168\/jds.2009-2803","article-title":"Automated methods for detecting lameness and measuring analgesia in dairy cattle","volume":"93","author":"N Chapinal","year":"2010","journal-title":"J Dairy Sci"},{"key":"pone.0280830.ref019","doi-asserted-by":"crossref","first-page":"283","DOI":"10.1038\/nrn2606","article-title":"Animal models of pain: Progress and challenges","author":"JS Mogil","year":"2009","journal-title":"Nature Reviews Neuroscience"},{"key":"pone.0280830.ref020","article-title":"Systemic inflammatory and stress markers in cattle and sheep submitted to different reproductive procedures","volume":"48","author":"VGG Costa","year":"2018","journal-title":"Cienc Rural"},{"key":"pone.0280830.ref021","doi-asserted-by":"crossref","first-page":"998","DOI":"10.1017\/S1751731112002406","article-title":"Identifying and monitoring pain in farm animals: a review","volume":"7","author":"A Prunier","year":"2013","journal-title":"Anim"},{"key":"pone.0280830.ref022","doi-asserted-by":"crossref","first-page":"e0233552","DOI":"10.1371\/journal.pone.0233552","article-title":"Validation of the UNESP-Botucatu pig composite acute pain scale (UPAPS)","volume":"15","author":"SPL Luna","year":"2020","journal-title":"PLoS One"},{"key":"pone.0280830.ref023","doi-asserted-by":"crossref","first-page":"200","DOI":"10.1186\/s12917-014-0200-0","article-title":"Validation of the UNESP-Botucatu unidimensional composite pain scale for assessing postoperative pain in cattle","volume":"10","author":"FA Oliveira","year":"2014","journal-title":"BMC Vet Res"},{"key":"pone.0280830.ref024","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1371\/journal.pone.0175839","article-title":"The Sheep Grimace Scale as an indicator of post-operative distress and pain in laboratory sheep","volume":"12","author":"C H\u00e4ger","year":"2017","journal-title":"PLoS One"},{"key":"pone.0280830.ref025","doi-asserted-by":"crossref","first-page":"227","DOI":"10.1016\/j.tvjl.2007.02.002","article-title":"Pain mechanisms and their implication for the management of pain in farm and companion animals","volume":"174","author":"I Vi\u00f1uela-Fern\u00e1ndez","year":"2007","journal-title":"Vet J"},{"key":"pone.0280830.ref026","doi-asserted-by":"crossref","first-page":"e0239622","DOI":"10.1371\/journal.pone.0239622","article-title":"Validation of the Unesp-Botucatu composite scale to assess acute postoperative abdominal pain in sheep (USAPS)","volume":"15","author":"NEOF Silva","year":"2020","journal-title":"PLoS One"},{"key":"pone.0280830.ref027","doi-asserted-by":"crossref","first-page":"266","DOI":"10.2527\/1997.751266x","article-title":"Assessment of acute pain in farm animals using behavioral and physiological measurements","volume":"75","author":"V Molony","year":"1997","journal-title":"J Anim Sci"},{"key":"pone.0280830.ref028","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1371\/journal.pone.0134024","article-title":"Ewes direct most maternal attention towards lambs that show the greatest pain-related behavioural responses","volume":"10","author":"A Futro","year":"2015","journal-title":"PLoS One"},{"key":"pone.0280830.ref029","volume-title":"Handbook of Veterinary Pain Management","author":"JS Gaynor","year":"2014","edition":"3"},{"key":"pone.0280830.ref030","doi-asserted-by":"crossref","first-page":"976","DOI":"10.2460\/ajvr.1993.54.06.976","article-title":"Comparison of a visual analogue scale and a numerical rating scale for assessment of lameness, using sheep as a model","volume":"54","author":"EM Welsh","year":"1993","journal-title":"Am J Vet Res"},{"key":"pone.0280830.ref031","doi-asserted-by":"crossref","first-page":"353","DOI":"10.1016\/0304-3959(89)90049-3","article-title":"The effect of chronic clinical pain on thermal and mechanical thresholds in sheep","volume":"39","author":"SJ Ley","year":"1989","journal-title":"Pain"},{"key":"pone.0280830.ref032","doi-asserted-by":"crossref","first-page":"217","DOI":"10.1016\/0304-3959(94)90097-3","article-title":"A comparison of pain measurement characteristics of mechanical visual analogue and simple numerical rating scales","volume":"56","author":"DD Price","year":"1994","journal-title":"Pain"},{"key":"pone.0280830.ref033","doi-asserted-by":"crossref","first-page":"61","DOI":"10.2460\/javma.1998.212.01.61","article-title":"Comparison of three methods used for assessment of pain in dogs","volume":"212","author":"LL Holton","year":"1998","journal-title":"J Am Vet Med Assoc"},{"key":"pone.0280830.ref034","doi-asserted-by":"crossref","first-page":"49","DOI":"10.1016\/j.beproc.2016.09.010","article-title":"Coding and quantification of a facial expression for pain in lambs","volume":"132","author":"MJ Guesgen","year":"2016","journal-title":"Behav Processes"},{"key":"pone.0280830.ref035","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1016\/j.applanim.2015.08.023","article-title":"Pain evaluation in dairy cattle","volume":"171","author":"KB Gleerup","year":"2015","journal-title":"Appl Anim Behav Sci"},{"key":"pone.0280830.ref036","doi-asserted-by":"crossref","DOI":"10.1093\/med\/9780199685219.001.0001","volume-title":"Health Measurement Scales: a practical guide to their development and use","author":"DL Streiner","year":"2015","edition":"5"},{"key":"pone.0280830.ref037","first-page":"49","article-title":"Validation of the Italian version of the UNESP-Botucatu multidimensional composite pain scale for the assessment of postoperative pain in cats","volume":"54","author":"G Della Rocca","year":"2018","journal-title":"Vet Ital"},{"key":"pone.0280830.ref038","doi-asserted-by":"crossref","first-page":"1147","DOI":"10.1007\/s11136-018-1798-3","article-title":"COSMIN guideline for systematic reviews of patient-reported outcome measures","volume":"27","author":"CAC Prinsen","year":"2018","journal-title":"Qual Life Res"},{"key":"pone.0280830.ref039","doi-asserted-by":"crossref","first-page":"539","DOI":"10.1007\/s11136-010-9606-8","article-title":"The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: An international Delphi study","volume":"19","author":"LB Mokkink","year":"2010","journal-title":"Qual Life Res"},{"key":"pone.0280830.ref040","doi-asserted-by":"crossref","first-page":"1171","DOI":"10.1007\/s11136-017-1765-4","article-title":"COSMIN Risk of Bias checklist for systematic reviews of Patient-Reported Outcome Measures","volume":"27","author":"LB Mokkink","year":"2018","journal-title":"Qual Life Res"},{"key":"pone.0280830.ref041","first-page":"1","article-title":"COSMIN Risk of Bias tool to assess the quality of studies on reliability or measurement error of outcome measurement instruments: a Delphi study","author":"LB Mokkink","year":"2020","journal-title":"BMC Med Res Methodol"},{"key":"pone.0280830.ref042","doi-asserted-by":"crossref","first-page":"e0251435","DOI":"10.1371\/journal.pone.0251435","article-title":"Measurement properties of pain scoring instruments in farm animals: A systematic review protocol using the COSMIN checklist","volume":"16","author":"RM Tomacheuski","year":"2021","journal-title":"PLoS One"},{"key":"pone.0280830.ref043","unstructured":"OECD, FAO. OECD-FAO Agricultural Outlook 2020\u20132029. OECD; 2020."},{"key":"pone.0280830.ref044","doi-asserted-by":"crossref","first-page":"651","DOI":"10.1007\/s11136-011-9960-1","article-title":"Rating the methodological quality in systematic reviews of studies on measurement properties: A scoring system for the COSMIN checklist","author":"CB Terwee","year":"2012","journal-title":"Qual Life Res"},{"key":"pone.0280830.ref045","article-title":"Measurement properties of grimace scales for pain assessment in non-human mammals: a systematic review","author":"MC Evangelista","year":"2021","journal-title":"Pain"},{"key":"pone.0280830.ref046","first-page":"1","article-title":"COSMIN methodology for systematic reviews of Patient\u2014Reported Outcome Measures (PROMs)","author":"LB Mokkink","year":"2018","journal-title":"User Manual"},{"key":"pone.0280830.ref047","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.applanim.2019.06.001","article-title":"Conceptual and methodological issues relating to pain assessment in mammals: The development and utilisation of pain facial expression scales","author":"KM McLennan","year":"2019","journal-title":"Appl Anim Behav Sci"},{"key":"pone.0280830.ref048","doi-asserted-by":"crossref","first-page":"231","DOI":"10.1177\/2192568218806847","article-title":"Reliability and validity of the AOSpine thoracolumbar injury classification system: a systematic review","author":"A Abedi","year":"2019","journal-title":"Global Spine J"},{"key":"pone.0280830.ref049","doi-asserted-by":"crossref","first-page":"40","DOI":"10.1186\/s13028-017-0306-z","article-title":"Experimentally induced subclinical mastitis: are lipopolysaccharide and lipoteichoic acid eliciting similar pain responses?","volume":"59","author":"A Giovannini","year":"2017","journal-title":"Acta Vet Scand"},{"key":"pone.0280830.ref050","first-page":"436","article-title":"Pain identification after orchiectomy in young bulls: development of the visual analogue scale compared with physiological parameters, behavioral patterns and facial expression","volume":"38","author":"HG Bertagnon","year":"2018","journal-title":"Pesqui Vet Bras"},{"key":"pone.0280830.ref051","doi-asserted-by":"crossref","first-page":"2118","DOI":"10.3168\/jds.2013-7142","article-title":"Assessing experimental visceral pain in dairy cattle: A pilot, prospective, blinded, randomized, and controlled study focusing on spinal pain proteomics","volume":"97","author":"P Rialland","year":"2014","journal-title":"J Dairy Sci"},{"key":"pone.0280830.ref052","doi-asserted-by":"crossref","first-page":"706","DOI":"10.1080\/08941939.2018.1457191","article-title":"Development of a pain scoring system for use in sheep surgically implanted with ventricular assist devices","volume":"32","author":"J Izer","year":"2019","journal-title":"J Invest Surg"},{"key":"pone.0280830.ref053","doi-asserted-by":"crossref","first-page":"2034","DOI":"10.1017\/S1751731119000314","article-title":"Benefits of a multimodal analgesia compared to local anesthesia alone to alleviate pain following castration in sheep: a multiparametric approach","volume":"13","author":"D Durand","year":"2019","journal-title":"Anim"},{"key":"pone.0280830.ref054","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1016\/j.rvsc.2019.08.004","article-title":"Application of a score for evaluation of pain, distress and discomfort in pigs with lameness and prolapses: correlation with saliva biomarkers and severity of the disease","volume":"126","author":"M Contreras-Aguilar","year":"2019","journal-title":"Res Vet Sci"},{"key":"pone.0280830.ref055","unstructured":"Nodari SR, Guerra O, Sassi M, Nassuato C, Gastaldo A, Casa G della, et al. Validation of a behavioural pain scale in piglets undergoing castration. Atti della Soceit\u00e0 Italiana di Patologia ed Allevamento dei Suini, XXXVII Meeting Annuale, Piacenza, Italia. 2011; 117\u2013125."},{"key":"pone.0280830.ref056","doi-asserted-by":"crossref","first-page":"105258","DOI":"10.1016\/j.applanim.2021.105258","article-title":"Pain assessment based on facial expression of bulls during castration","volume":"236","author":"PH Yamada","year":"2021","journal-title":"Appl Anim Behav Sci"},{"key":"pone.0280830.ref057","doi-asserted-by":"crossref","first-page":"51","DOI":"10.3389\/fvets.2017.00051","article-title":"Development of a Piglet Grimace Scale to evaluate piglet pain using facial expressions following castration and tail docking: A Pilot Study","volume":"4","author":"AV Viscardi","year":"2017","journal-title":"Front Vet Sci"},{"key":"pone.0280830.ref058","article-title":"Development of a facial expression scale using farrowing as a model of pain in sows","volume":"10","author":"E Navarro","year":"2020","journal-title":"Anim"},{"key":"pone.0280830.ref059","doi-asserted-by":"crossref","first-page":"1253","DOI":"10.1016\/j.vaa.2016.11.008","article-title":"Validation of the Italian version of the UNESP-Botucatu unidimensional composite pain scale for the assessment of postoperative pain in cattle","volume":"44","author":"G Della Rocca","year":"2017","journal-title":"Vet Anaesth Analg"},{"key":"pone.0280830.ref060","article-title":"Is the Piglet Grimace Scale (PGS) a useful welfare indicator to assess pain after cryptorchidectomy in growing pigs?","volume":"10","author":"C Vullo","year":"2020","journal-title":"Anim"},{"key":"pone.0280830.ref061","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s12917-018-1643-5","article-title":"Efficacy of buprenorphine for management of surgical castration pain in piglets","volume":"14","author":"AV Viscardi","year":"2018","journal-title":"BMC Vet Res"},{"key":"pone.0280830.ref062","doi-asserted-by":"crossref","first-page":"1","DOI":"10.3389\/fvets.2018.00299","article-title":"Use of Meloxicam or Ketoprofen for piglet pain control following surgical castration","volume":"5","author":"AV Viscardi","year":"2018","journal-title":"Front Vet Sci"},{"key":"pone.0280830.ref063","doi-asserted-by":"crossref","first-page":"143","DOI":"10.1186\/1746-6148-9-143","article-title":"Validation of the English version of the UNESP-Botucatu multidimensional composite pain scale for assessing postoperative pain in cats","volume":"9","author":"JT Brondani","year":"2013","journal-title":"BMC Vet Res"},{"key":"pone.0280830.ref064","first-page":"1","article-title":"Measuring Health: A guide to rating scales and questionnaires","author":"I. McDowell","year":"2009","journal-title":"Meas Heal A Guid to Rat Scales Quest"},{"key":"pone.0280830.ref065","doi-asserted-by":"crossref","first-page":"99","DOI":"10.1207\/S15327752JPA8001_18","article-title":"Starting at the beginning: an introduction to coefficient alpha and internal consistency","volume":"80","author":"DL Streiner","year":"2003","journal-title":"J Pers Assess"},{"key":"pone.0280830.ref066","doi-asserted-by":"crossref","first-page":"420","DOI":"10.1037\/0033-2909.86.2.420","article-title":"Intraclass correlations: uses in assessing rater reliability","volume":"86","author":"PE Shrout","year":"1979","journal-title":"Psychol Bull"},{"key":"pone.0280830.ref067","doi-asserted-by":"crossref","first-page":"517","DOI":"10.1080\/10106049.2012.725775","article-title":"Use of Kendall\u2019s coefficient of concordance to assess agreement among observers of very high resolution imagery","volume":"28","author":"A Gearhart","year":"2013","journal-title":"Geocarto Int"},{"key":"pone.0280830.ref068","first-page":"121","article-title":"What\u2019s under the ROC? An introduction to receiver operating characteristics curves","volume":"52","author":"DL Streiner","year":"2007","journal-title":"Res Methods Psychiatry"},{"key":"pone.0280830.ref069","doi-asserted-by":"crossref","first-page":"228","DOI":"10.1111\/j.1751-0813.2002.tb10820.x","article-title":"A comparison of catecholamine and cortisol responses of young lambs and calves to painful husbandry procedures","volume":"80","author":"DJ Mellor","year":"2002","journal-title":"Aust Vet J"},{"key":"pone.0280830.ref070","doi-asserted-by":"crossref","first-page":"75","DOI":"10.1007\/s40122-013-0015-x","article-title":"The Physiologic Effects of Pain on the Endocrine System","volume":"2","author":"F. Tennant","year":"2013","journal-title":"Pain Ther"},{"key":"pone.0280830.ref071","doi-asserted-by":"crossref","first-page":"174","DOI":"10.2460\/ajvr.72.2.174","article-title":"Refinement and initial validation of a multidimensional composite scale for use in assessing acute postoperative pain in cats","volume":"72","author":"JT Brondani","year":"2011","journal-title":"Am J Vet Res"},{"key":"pone.0280830.ref072","doi-asserted-by":"crossref","first-page":"604","DOI":"10.1016\/j.neubiorev.2014.09.001","article-title":"Empathy: gender effects in brain and behavior","volume":"46","author":"L Christov-Moore","year":"2014","journal-title":"Neurosci Biobehav Rev"}],"container-title":["PLOS ONE"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pone.0280830","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,10,12]],"date-time":"2024-10-12T13:52:26Z","timestamp":1728741146000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pone.0280830"}},"subtitle":[],"editor":[{"given":"Ali","family":"Montazeri","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"editor"}]}],"short-title":[],"issued":{"date-parts":[[2023,1,20]]},"references-count":72,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,1,20]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pone.0280830","relation":{},"ISSN":["1932-6203"],"issn-type":[{"value":"1932-6203","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,1,20]]}}}