{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,9]],"date-time":"2026-06-09T07:29:25Z","timestamp":1780990165522,"version":"3.54.1"},"reference-count":56,"publisher":"Springer Science and Business Media LLC","issue":"S5","license":[{"start":{"date-parts":[[2020,8,1]],"date-time":"2020-08-01T00:00:00Z","timestamp":1596240000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,8,20]],"date-time":"2020-08-20T00:00:00Z","timestamp":1597881600000},"content-version":"vor","delay-in-days":19,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Med Inform Decis Mak"],"published-print":{"date-parts":[[2020,8]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec><jats:title>Background<\/jats:title><jats:p>Despite the vagueness and uncertainty that is intrinsic in any medical act, interpretation and decision (including acts of data reporting and representation of relevant medical conditions), still little research has focused on how to explicitly take this uncertainty into account. In this paper, we focus on the representation of a general and wide-spread medical terminology, which is grounded on a traditional and well-established convention, to represent severity of health conditions (for instance, pain, visible signs), ranging from<jats:italic>Absent<\/jats:italic>to<jats:italic>Extreme<\/jats:italic>. Specifically, we will study how both potential patients and doctors perceive the different levels of the terminology in both quantitative and qualitative terms, and if the embedded user knowledge could improve the representation of ordinal values in the construction of machine learning models.<\/jats:p><\/jats:sec><jats:sec><jats:title>Methods<\/jats:title><jats:p>To this aim, we conducted a questionnaire-based research study involving a relatively large sample of 1,152 potential patients and 31 clinicians to represent numerically the perceived meaning of standard and widely-applied labels to describe health conditions. Using these collected values, we then present and discuss different possible fuzzy-set based representations that address the vagueness of medical interpretation by taking into account the perceptions of domain experts. We also apply the findings of this user study to evaluate the impact of different encodings on the predictive performance of common machine learning models in regard to a real-world medical prognostic task.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>We found significant differences in the perception of pain levels between the two user groups. We also show that the proposed encodings can improve the performances of specific classes of models, and discuss when this is the case.<\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusions<\/jats:title><jats:p>In perspective, our hope is that the proposed techniques for ordinal scale representation and ordinal encoding may be useful to the research community, and also that our methodology will be applied to other widely used ordinal scales for improving validity of datasets and bettering the results of machine learning tasks.<\/jats:p><\/jats:sec>","DOI":"10.1186\/s12911-020-01152-8","type":"journal-article","created":{"date-parts":[[2020,8,20]],"date-time":"2020-08-20T06:02:53Z","timestamp":1597903373000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":15,"title":["Ordinal labels in machine learning: a user-centered approach to improve data validity in medical settings"],"prefix":"10.1186","volume":"20","author":[{"given":"Andrea","family":"Seveso","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Andrea","family":"Campagner","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Davide","family":"Ciucci","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Federico","family":"Cabitza","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2020,8,20]]},"reference":[{"issue":"7639","key":"1152_CR1","doi-asserted-by":"crossref","first-page":"115","DOI":"10.1038\/nature21056","volume":"542","author":"A Esteva","year":"2017","unstructured":"Esteva A, Kuprel B, Novoa RA, Ko J, Swetter SM, Blau HM, Thrun S. Dermatologist-level classification of skin cancer with deep neural networks. Nature. 2017; 542(7639):115.","journal-title":"Nature"},{"issue":"22","key":"1152_CR2","doi-asserted-by":"crossref","first-page":"2402","DOI":"10.1001\/jama.2016.17216","volume":"316","author":"V Gulshan","year":"2016","unstructured":"Gulshan V, Peng L, Coram M, Stumpe MC, Wu D, Narayanaswamy A, Venugopalan S, Widner K, Madams T, Cuadros J, Kim R, Raman R, Cuadros J, Nelson PC, Mega JL, Webster DR. Development and validation of a deep learning algorithm for detection of diabetic retinopathy in retinal fundus photographs. J Am Med Assoc. 2016; 316(22):2402\u201310.","journal-title":"J Am Med Assoc"},{"key":"1152_CR3","volume-title":"International Cross-Domain Conference for Machine Learning and Knowledge Extraction","author":"F Cabitza","year":"2019","unstructured":"Cabitza F, Campagner A, Ciucci D. New frontiers in explainable AI: Understanding the GI to interpret the GO LNCS, volume 11713. In: International Cross-Domain Conference for Machine Learning and Knowledge Extraction. Cham: Springer: 2019. p. 27\u201347."},{"key":"1152_CR4","first-page":"425","volume":"409","author":"RC Fox","year":"2000","unstructured":"Fox RC. Medical uncertainty revisited. Handb Soc Stud Health Med. 2000; 409:425.","journal-title":"Handb Soc Stud Health Med"},{"issue":"2","key":"1152_CR5","doi-asserted-by":"crossref","first-page":"331","DOI":"10.1016\/S0165-0114(99)00148-7","volume":"120","author":"MF Abbod","year":"2001","unstructured":"Abbod MF, von Keyserlingk DG, Linkens DA, Mahfouf M. Survey of utilisation of fuzzy technology in medicine and healthcare. Fuzzy Sets Syst. 2001; 120(2):331\u201349.","journal-title":"Fuzzy Sets Syst"},{"key":"1152_CR6","doi-asserted-by":"crossref","first-page":"145","DOI":"10.1016\/j.cmpb.2018.04.013","volume":"161","author":"H Ahmadi","year":"2018","unstructured":"Ahmadi H, Gholamzadeh M, Shahmoradi L, Nilashi M, Rashvand P. Diseases diagnosis using fuzzy logic methods: A systematic and meta-analysis review. Comput Methods Prog Biomed. 2018; 161:145\u201372.","journal-title":"Comput Methods Prog Biomed"},{"key":"1152_CR7","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-7908-1859-8","volume-title":"Fuzzy Systems in Medicine","author":"P Szczepaniak","year":"2000","unstructured":"Szczepaniak P, Lisboa P, Kacprzyk J, (eds). Fuzzy Systems in Medicine. Heidelberg: Springer; 2000."},{"key":"1152_CR8","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-7908-1804-8","volume-title":"Fuzzy Logic in Medicine","author":"S Barro","year":"2002","unstructured":"Barro S, Mar\u00edn R. Fuzzy Logic in Medicine. Heidelberg: Springer; 2002."},{"issue":"1-3","key":"1152_CR9","doi-asserted-by":"crossref","first-page":"153","DOI":"10.1016\/S0933-3657(00)00080-4","volume":"21","author":"L Godo","year":"2001","unstructured":"Godo L, de M\u00e1ntaras RL, Puyol-Gruart J, Sierra C. Renoir, pneumon-ia and terap-ia: three medical applications based on fuzzy logic. Artif Intell Med. 2001; 21(1-3):153\u201362.","journal-title":"Artif Intell Med"},{"key":"1152_CR10","volume-title":"Medical Applications with Fuzzy Sets","year":"1986","unstructured":"Sanchez E. In: Jones A, Kaufmann A, Zimmermann H-J, (eds).Medical Applications with Fuzzy Sets. Dordrecht: Springer; 1986, pp. 331\u201347."},{"issue":"1","key":"1152_CR11","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.artmed.2010.01.003","volume":"49","author":"T Vetterlein","year":"2010","unstructured":"Vetterlein T, Mandl H, Adlassnig K-P. Fuzzy Arden syntax: A fuzzy programming language for medicine. Artif Intell Med. 2010; 49(1):1\u201310.","journal-title":"Artif Intell Med"},{"issue":"3","key":"1152_CR12","first-page":"1025","volume":"20","author":"S El-Sappagh","year":"2017","unstructured":"El-Sappagh S, Elmogy M. A fuzzy ontology modeling for case base knowledge in diabetes mellitus domain. Eng Sci Technol Int J. 2017; 20(3):1025\u201340.","journal-title":"Eng Sci Technol Int J"},{"key":"1152_CR13","doi-asserted-by":"crossref","first-page":"237","DOI":"10.1007\/978-1-4614-6666-6_15","volume":"301","author":"C-S Lee","year":"2013","unstructured":"Lee C-S, Wang M-H, Hsu C-Y, Chen Z-W. Type-2 fuzzy set and fuzzy ontology for diet application. Stud Fuzziness Soft Comput. 2013; 301:237\u201356.","journal-title":"Stud Fuzziness Soft Comput"},{"key":"1152_CR14","doi-asserted-by":"crossref","first-page":"207","DOI":"10.1016\/j.fss.2015.11.002","volume":"298","author":"T Vetterlein","year":"2016","unstructured":"Vetterlein T, Zamansky A. Reasoning with graded information: The case of diagnostic rating scales in healthcare. Fuzzy Sets Syst. 2016; 298:207\u201321.","journal-title":"Fuzzy Sets Syst"},{"key":"1152_CR15","volume-title":"17th International Conference on Information Processing and Management of Uncertainty in Knowledge-Based Systems","author":"P Zywica","year":"2018","unstructured":"Zywica P. Modelling medical uncertainties with use of fuzzy sets and their extensions vol. 855. In: 17th International Conference on Information Processing and Management of Uncertainty in Knowledge-Based Systems. Cham: Springer: 2018."},{"key":"1152_CR16","doi-asserted-by":"crossref","first-page":"103188","DOI":"10.1016\/j.jbi.2019.103188","volume":"94","author":"R Saripalle","year":"2019","unstructured":"Saripalle R, Runyan C, Russell M. Using HL7 FHIR to achieve interoperability in patient health record. J Biomed Inform. 2019; 94:103188.","journal-title":"J Biomed Inform"},{"key":"1152_CR17","unstructured":"Valueset-condition-severity - FHIR V4.0.1. 2019. http:\/\/hl7.org\/fhir\/ValueSet\/condition-severity. Accessed 01 Apr 2020."},{"issue":"1","key":"1152_CR18","doi-asserted-by":"crossref","first-page":"10178","DOI":"10.2196\/10178","volume":"21","author":"G Hernandez","year":"2019","unstructured":"Hernandez G, Garin O, Dima AL, Pont A, Pastor MM, Alonso J, Van Ganse E, Laforest L, de Bruin M, Mayoral K, Serra-Sutton V, Ferrer M. EuroQol (EQ-5D-5L) Validity in Assessing the Quality of Life in Adults With Asthma: Cross-Sectional Study. J Med Internet Res. 2019; 21(1):10178.","journal-title":"J Med Internet Res"},{"key":"1152_CR19","doi-asserted-by":"crossref","first-page":"167","DOI":"10.1136\/bmj.f167","volume":"346","author":"N Black","year":"2013","unstructured":"Black N. Patient reported outcome measures could help transform healthcare. Br Med J. 2013; 346:167.","journal-title":"Br Med J"},{"issue":"6","key":"1152_CR20","doi-asserted-by":"crossref","first-page":"1375","DOI":"10.1007\/s11999-016-4813-4","volume":"474","author":"JF Baumhauer","year":"2016","unstructured":"Baumhauer JF, Bozic KJ. Value-based healthcare: patient-reported outcomes in clinical decision making. Clin Orthop Relat Res. 2016; 474(6):1375\u20138.","journal-title":"Clin Orthop Relat Res"},{"issue":"24","key":"1152_CR21","doi-asserted-by":"crossref","first-page":"2405","DOI":"10.1001\/jama.2019.5284","volume":"321","author":"DW Challener","year":"2019","unstructured":"Challener DW, Prokop LJ, Abu-Saleh O. The proliferation of reports on clinical scoring systems: Issues about uptake and clinical utility. J Am Med Assoc. 2019; 321(24):2405\u2013406.","journal-title":"J Am Med Assoc"},{"issue":"6519","key":"1152_CR22","doi-asserted-by":"crossref","first-page":"537","DOI":"10.1136\/bmj.292.6519.537","volume":"292","author":"M Forrest","year":"1986","unstructured":"Forrest M, Andersen B. Ordinal scale and statistics in medical research. Br Med J Clin Res Ed. 1986; 292(6519):537\u20138.","journal-title":"Br Med J Clin Res Ed"},{"issue":"4","key":"1152_CR23","doi-asserted-by":"crossref","first-page":"437","DOI":"10.1111\/j.1471-6712.2004.00305.x","volume":"18","author":"U Jakobsson","year":"2004","unstructured":"Jakobsson U. Statistical presentation and analysis of ordinal data in nursing research. Scand J Caring Sci. 2004; 18(4):437\u201340.","journal-title":"Scand J Caring Sci"},{"issue":"1","key":"1152_CR24","doi-asserted-by":"crossref","first-page":"12","DOI":"10.1186\/1478-7954-1-12","volume":"1","author":"JA Salomon","year":"2003","unstructured":"Salomon JA. Reconsidering the use of rankings in the valuation of health states: a model for estimating cardinal values from ordinal data. Popul Health Metrics. 2003; 1(1):12.","journal-title":"Popul Health Metrics"},{"issue":"3","key":"1152_CR25","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1016\/j.jpainsymman.2017.10.024","volume":"55","author":"TM Atkinson","year":"2018","unstructured":"Atkinson TM, Hay JL, Dueck AC, Mitchell SA, Mendoza TR, Rogak LJ, Minasian LM, Basch E. What do \u2018none,\u2019 \u2018mild,\u2019 \u2018moderate,\u2019\u2018severe,\u2019 and \u2018very severe\u2019 mean to patients with cancer? Content validity of PRO-CTCAE response scales. J Pain Symptom Manag. 2018; 55(3):3\u20136.","journal-title":"J Pain Symptom Manag"},{"issue":"3","key":"1152_CR26","doi-asserted-by":"crossref","first-page":"199","DOI":"10.1016\/0020-0255(75)90036-5","volume":"8","author":"LA Zadeh","year":"1975","unstructured":"Zadeh LA. The concept of a linguistic variable and its application to approximate reasoning I. Inf Sci. 1975; 8(3):199\u2013249.","journal-title":"Inf Sci"},{"issue":"5","key":"1152_CR27","doi-asserted-by":"crossref","first-page":"1609","DOI":"10.1016\/j.eswa.2012.09.015","volume":"40","author":"Q Li","year":"2013","unstructured":"Li Q. A novel likert scale based on fuzzy sets theory. Expert Syst Appl. 2013; 40(5):1609\u201318.","journal-title":"Expert Syst Appl"},{"issue":"3","key":"1152_CR28","doi-asserted-by":"crossref","first-page":"337","DOI":"10.1016\/j.kjss.2017.01.002","volume":"38","author":"P Vonglao","year":"2017","unstructured":"Vonglao P. Application of fuzzy logic to improve the likert scale to measure latent variables. Kasetsart J Soc Sci. 2017; 38(3):337\u201344.","journal-title":"Kasetsart J Soc Sci"},{"key":"1152_CR29","unstructured":"Coates A, Ng AY. The importance of encoding versus training with sparse coding and vector quantization. In: Proceedings of the 28th International Conference on Machine Learning (ICML-11): 2011. p. 921\u20138. https:\/\/icml.cc\/Conferences\/2011\/papers\/485_bibfile.bib."},{"issue":"5","key":"1152_CR30","first-page":"706","volume":"10","author":"N Crichton","year":"2001","unstructured":"Crichton N. Visual analogue scale (VAS). J Clin Nurs. 2001; 10(5):706\u20136.","journal-title":"J Clin Nurs"},{"key":"1152_CR31","volume-title":"International Conference on Scalable Uncertainty Management","author":"F Cabitza","year":"2018","unstructured":"Cabitza F, Ciucci D. Fuzzification of ordinal classes. The case of the HL7 severity grading LNCS, volume 11142. In: International Conference on Scalable Uncertainty Management. Cham: Springer: 2018. p. 64\u201377."},{"issue":"2","key":"1152_CR32","doi-asserted-by":"crossref","first-page":"301","DOI":"10.1016\/0022-247X(83)90253-6","volume":"92","author":"JG Dijkman","year":"1983","unstructured":"Dijkman JG, van Haeringen H, de Lange SJ. Fuzzy numbers. J Math Anal Appl. 1983; 92(2):301\u201341.","journal-title":"J Math Anal Appl"},{"issue":"2","key":"1152_CR33","doi-asserted-by":"crossref","first-page":"159","DOI":"10.1016\/S0165-0114(97)00337-0","volume":"108","author":"W Van Leekwijck","year":"1999","unstructured":"Van Leekwijck W, Kerre EE. Defuzzification: criteria and classification. Fuzzy Sets Syst. 1999; 108(2):159\u201378.","journal-title":"Fuzzy Sets Syst"},{"key":"1152_CR34","doi-asserted-by":"crossref","DOI":"10.1002\/9781118014967","volume-title":"Handbook of Monte Carlo Methods","author":"D Kroese","year":"2011","unstructured":"Kroese D, Taimre T, Botev Z. Handbook of Monte Carlo Methods. Hoboken: Wiley; 2011."},{"key":"1152_CR35","doi-asserted-by":"crossref","first-page":"77","DOI":"10.1016\/j.ins.2011.11.042","volume":"189","author":"S Greenfield","year":"2012","unstructured":"Greenfield S, Chiclana F, John R, Coupland S. The sampling method of defuzzification for type-2 fuzzy sets: Experimental evaluation. Inf Sci. 2012; 189:77\u201392.","journal-title":"Inf Sci"},{"issue":"1","key":"1152_CR36","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1023\/A:1010933404324","volume":"45","author":"L Breiman","year":"2001","unstructured":"Breiman L. Random forests. Mach Learn. 2001; 45(1):5\u201332.","journal-title":"Mach Learn"},{"issue":"3","key":"1152_CR37","doi-asserted-by":"crossref","first-page":"199","DOI":"10.1023\/B:STCO.0000035301.49549.88","volume":"14","author":"AJ Smola","year":"2004","unstructured":"Smola AJ, Sch\u00f6lkopf B. A tutorial on support vector regression. Stat Comput. 2004; 14(3):199\u2013222.","journal-title":"Stat Comput"},{"issue":"1","key":"1152_CR38","first-page":"3133","volume":"15","author":"M Fern\u00e1ndez-Delgado","year":"2014","unstructured":"Fern\u00e1ndez-Delgado M, Cernadas E, Barro S, Amorim D. Do we need hundreds of classifiers to solve real world classification problems?J Mach Learn Res. 2014; 15(1):3133\u201381.","journal-title":"J Mach Learn Res"},{"issue":"3","key":"1152_CR39","doi-asserted-by":"crossref","first-page":"175","DOI":"10.1080\/00031305.1992.10475879","volume":"46","author":"NS Altman","year":"1992","unstructured":"Altman NS. An introduction to kernel and nearest-neighbor nonparametric regression. Am Stat. 1992; 46(3):175\u201385.","journal-title":"Am Stat"},{"issue":"1","key":"1152_CR40","doi-asserted-by":"crossref","first-page":"267","DOI":"10.1111\/j.2517-6161.1996.tb02080.x","volume":"58","author":"R Tibshirani","year":"1996","unstructured":"Tibshirani R. Regression shrinkage and selection via the LASSO. J R Stat Soc Ser B Methodol. 1996; 58(1):267\u201388.","journal-title":"J R Stat Soc Ser B Methodol"},{"issue":"253","key":"1152_CR41","doi-asserted-by":"crossref","first-page":"68","DOI":"10.1080\/01621459.1951.10500769","volume":"46","author":"FJ Massey Jr","year":"1951","unstructured":"Massey Jr FJ. The Kolmogorov-Smirnov test for goodness of fit. J Am Stat Assoc. 1951; 46(253):68\u201378.","journal-title":"J Am Stat Assoc"},{"key":"1152_CR42","doi-asserted-by":"crossref","unstructured":"Landoni E, Ambrogi F, Mariani L, Miceli R. Parametric and nonparametric two-sample tests for feature screening in class comparison: a simulation study. Epidemiol Biostat Public Health. 2016; 13(2).","DOI":"10.2427\/11808"},{"issue":"1","key":"1152_CR43","doi-asserted-by":"crossref","first-page":"50","DOI":"10.1214\/aoms\/1177730491","volume":"18","author":"HB Mann","year":"1947","unstructured":"Mann HB, Whitney DR. On a test of whether one of two random variables is stochastically larger than the other. Ann Math Stat. 1947; 18(1):50\u201360.","journal-title":"Ann Math Stat"},{"key":"1152_CR44","first-page":"1","volume":"4","author":"MP Fay","year":"2010","unstructured":"Fay MP, Proschan MA. Wilcoxon-Mann-Whitney or t-test? on assumptions for hypothesis tests and multiple interpretations of decision rules. Stat Surv. 2010; 4:1.","journal-title":"Stat Surv"},{"issue":"5704","key":"1152_CR45","doi-asserted-by":"crossref","first-page":"286","DOI":"10.1136\/bmj.2.5704.286","volume":"2","author":"CM Boyle","year":"1970","unstructured":"Boyle CM. Difference between patients\u2019 and doctors\u2019 interpretation of some common medical terms. Br Med J. 1970; 2(5704):286\u20139.","journal-title":"Br Med J"},{"issue":"3","key":"1152_CR46","doi-asserted-by":"crossref","first-page":"255","DOI":"10.1111\/j.1399-6576.1989.tb02901.x","volume":"33","author":"M Forrest","year":"1989","unstructured":"Forrest M. Assessment of pain: a comparison between patients and doctors. Acta Anaesthesiol Scand. 1989; 33(3):255\u20136.","journal-title":"Acta Anaesthesiol Scand"},{"issue":"3","key":"1152_CR47","doi-asserted-by":"crossref","first-page":"475","DOI":"10.1177\/1460458218824705","volume":"25","author":"F Cabitza","year":"2019","unstructured":"Cabitza F, Locoro A, Laderighi C, Rasoini R, Compagnone D, Berjano P. The elephant in the record: on the multiplicity of data recording work. Health Inform J. 2019; 25(3):475\u201390.","journal-title":"Health Inform J"},{"key":"1152_CR48","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-319-90503-7","volume-title":"Organizing for the Digital World","author":"F Cabitza","year":"2019","unstructured":"Cabitza F, Ciucci D, Rasoini R. A giant with feet of clay: on the validity of the data that feed machine learning in medicine In: Cabitza F, Magni M, Batini C, editors. Organizing for the Digital World. Cham: Springer: 2019. p. 121\u201336."},{"key":"1152_CR49","volume-title":"Additive Models, Trees, and Related Methods","author":"T Hastie","year":"2009","unstructured":"Hastie T, Tibshirani R, Friedman J. Additive Models, Trees, and Related Methods. New York, NY: Springer; 2009, pp. 295\u2013336."},{"key":"1152_CR50","doi-asserted-by":"crossref","unstructured":"Yuan M, Lin Y. J R Stat Soc Ser B Stat Methodol. 2006; 68(1):49\u201367.","DOI":"10.1111\/j.1467-9868.2005.00532.x"},{"key":"1152_CR51","volume-title":"2009 IEEE\/SP 15th Workshop on Statistical Signal Processing","author":"AT Puig","year":"2009","unstructured":"Puig AT, Wiesel A, Hero AO. A multidimensional shrinkage-thresholding operator. In: 2009 IEEE\/SP 15th Workshop on Statistical Signal Processing. Cardiff: IEEE: 2009. p. 113\u2013116."},{"key":"1152_CR52","volume-title":"Machine Learning: a Probabilistic Perspective","author":"KP Murphy","year":"2012","unstructured":"Murphy KP. Machine Learning: a Probabilistic Perspective. Cambridge, Massachusetts: MIT press; 2012."},{"issue":"4","key":"1152_CR53","first-page":"7","volume":"175","author":"K Potdar","year":"2017","unstructured":"Potdar K, Pardawala TS, Pai CD. A comparative study of categorical variable encoding techniques for neural network classifiers. Int J Comput Appl. 2017; 175(4):7\u20139.","journal-title":"Int J Comput Appl"},{"issue":"8","key":"1152_CR54","doi-asserted-by":"crossref","first-page":"805","DOI":"10.1016\/j.joca.2012.04.001","volume":"20","author":"J Ranstam","year":"2012","unstructured":"Ranstam J. Why the p-value culture is bad and confidence intervals a better alternative. Osteoarthr Cartil. 2012; 20(8):805\u20138.","journal-title":"Osteoarthr Cartil"},{"issue":"3","key":"1152_CR55","doi-asserted-by":"crossref","first-page":"41","DOI":"10.5312\/wjo.v9.i3.41","volume":"9","author":"M Hung","year":"2018","unstructured":"Hung M, Bounsanga J, Voss MW, Saltzman CL. Establishing minimum clinically important difference values for the patient-reported outcomes measurement information system physical function, hip disability and osteoarthritis outcome score for joint reconstruction, and knee injury and osteoarthritis outcome score for joint reconstruction in orthopaedics. World J Orthop. 2018; 9(3):41.","journal-title":"World J Orthop"},{"issue":"1","key":"1152_CR56","doi-asserted-by":"crossref","first-page":"117","DOI":"10.1080\/07350015.1999.10524801","volume":"17","author":"HV Ophem","year":"1999","unstructured":"Ophem HV, Stam P, Praag BV. Multichoice logit: modeling incomplete preference rankings of classical concerts. J Bus Econ Stat. 1999; 17(1):117\u201328.","journal-title":"J Bus Econ Stat"}],"container-title":["BMC Medical Informatics and Decision Making"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12911-020-01152-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12911-020-01152-8\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12911-020-01152-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,8,12]],"date-time":"2024-08-12T04:51:48Z","timestamp":1723438308000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcmedinformdecismak.biomedcentral.com\/articles\/10.1186\/s12911-020-01152-8"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,8]]},"references-count":56,"journal-issue":{"issue":"S5","published-print":{"date-parts":[[2020,8]]}},"alternative-id":["1152"],"URL":"https:\/\/doi.org\/10.1186\/s12911-020-01152-8","relation":{},"ISSN":["1472-6947"],"issn-type":[{"value":"1472-6947","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,8]]},"assertion":[{"value":"29 May 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"8 June 2020","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"20 August 2020","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The dataset used in the machine learning part of the study is anonymous and it was built within a research compliant with all relevant national regulations, institutional policies and in accordance with the tenets of the Helsinki Declaration (as revised in 2013), which was approved by the IRCCS Orthopedic Institute Galeazzi Institutional Review Board or equivalent committee. For the ordinal data collections, which do not contain personal nor medical data, approval by review boards or equivalent committees was not necessary at the time we conducted this study.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"We obtained the written consent to publish their clinical data from the patients in this study.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare that they have no competing interests.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"142"}}