{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,30]],"date-time":"2026-09-30T09:05:13Z","timestamp":1790759113775,"version":"4.1.0"},"reference-count":37,"publisher":"Wiley","issue":"6","license":[{"start":{"date-parts":[[2022,4,6]],"date-time":"2022-04-06T00:00:00Z","timestamp":1649203200000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/onlinelibrary.wiley.com\/termsAndConditions#vor"}],"funder":[{"DOI":"10.13039\/501100006586","name":"Centre Hospitalier Universitaire de Nice","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100006586","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["European Journal of Pain"],"published-print":{"date-parts":[[2022,7]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec><jats:title>Background<\/jats:title><jats:p>Pain intensity evaluation by self\u2010report is difficult and biased in non\u2010communicating people, which may contribute to inappropriate pain management. The use of artificial intelligence (AI) to evaluate pain intensity based on automated facial expression analysis has not been evaluated in clinical conditions.<\/jats:p><\/jats:sec><jats:sec><jats:title>Methods<\/jats:title><jats:p>We trained and externally validated a deep\u2010learning system (ResNet\u201018 convolutional neural network) to identify and classify 2810 facial expressions of 1189 patients, captured before and after surgery, according to their self\u2010reported pain intensity using numeric rating scale (NRS, 0\u201310). AI performances were evaluated by accuracy (concordance between AI prediction and patient\u2010reported pain intensity), sensitivity and specificity to diagnose pain \u22654\/10 and \u22657\/10. We then confronted AI performances with those of 33 nurses to evaluate pain intensity from facial expression in the same situation.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>In the external testing set (120 face images), the deep learning system was able to predict exactly the pain intensity among the 11 possible scores (0\u201310) in 53% of the cases with a mean error of 2.4 points. Its sensitivities to detect pain \u22654\/10 and \u22657\/10 were 89.7% and 77.5%, respectively. Nurses estimated the right NRS pain intensity with a mean accuracy of 14.9% and identified pain \u22654\/10 and \u22657\/10 with sensitivities of 44.9% and 17.0%.<\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusions<\/jats:title><jats:p>Subject to further improvement of AI performances through further training, these results suggest that AI using facial expression analysis could be used to assist physicians to evaluate pain and detect severe pain, especially in people not able to report appropriately their pain by themselves.<\/jats:p><\/jats:sec><jats:sec><jats:title>Significance<\/jats:title><jats:p>These original findings represent a major step in the development of a fully automated, rapid, standardized and objective method based on facial expression analysis to measure pain and detect severe pain.<\/jats:p><\/jats:sec>","DOI":"10.1002\/ejp.1948","type":"journal-article","created":{"date-parts":[[2022,3,30]],"date-time":"2022-03-30T03:34:35Z","timestamp":1648611275000},"page":"1282-1291","update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":78,"title":["Artificial intelligence to evaluate postoperative pain based on facial expression recognition"],"prefix":"10.1002","volume":"26","author":[{"given":"Denys","family":"Fontaine","sequence":"first","affiliation":[{"name":"Department of Neurosurgery Centre Hospitalier Universitaire de Nice  Nice France"},{"name":"FHU INOVPAIN Centre Hospitalier Universitaire de Nice  Nice France"},{"name":"Universit\u00e9 Cote d\u2019Azur UR2CA (Unit\u00e9 de Recherche Clinique C\u00f4te d\u2019Azur)  Nice France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Valentin","family":"Vielzeuf","sequence":"additional","affiliation":[{"name":"Orange Labs  Lannion France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Philippe","family":"Genestier","sequence":"additional","affiliation":[{"name":"Orange Labs  Lannion France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Pascal","family":"Limeux","sequence":"additional","affiliation":[{"name":"Orange Labs  Lannion France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Serena","family":"Santucci\u2010Sivilotto","sequence":"additional","affiliation":[{"name":"FHU INOVPAIN Centre Hospitalier Universitaire de Nice  Nice France"},{"name":"Universit\u00e9 Cote d\u2019Azur UR2CA (Unit\u00e9 de Recherche Clinique C\u00f4te d\u2019Azur)  Nice France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Emmanuel","family":"Mory","sequence":"additional","affiliation":[{"name":"Orange Labs  Lannion France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nelly","family":"Darmon","sequence":"additional","affiliation":[{"name":"Universit\u00e9 Cote d\u2019Azur UR2CA (Unit\u00e9 de Recherche Clinique C\u00f4te d\u2019Azur)  Nice France"},{"name":"Department of Psychiatry Centre Hospitalier Universitaire de Nice  Nice France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Michel","family":"Lanteri\u2010Minet","sequence":"additional","affiliation":[{"name":"FHU INOVPAIN Centre Hospitalier Universitaire de Nice  Nice France"},{"name":"Universit\u00e9 Cote d\u2019Azur UR2CA (Unit\u00e9 de Recherche Clinique C\u00f4te d\u2019Azur)  Nice France"},{"name":"Pain Clinic Centre Hospitalier Universitaire de Nice  Nice France"},{"name":"INSERM\/UdA U1107 Neuro\u2010Dol Auvergne University  Clermont\u2010Ferrand France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"May","family":"Mokhtar","sequence":"additional","affiliation":[{"name":"Laboratoire d'Anthropologie et de Psychologie Cognitives et Sociales (LAPCOS) Universit\u00e9 Cote d\u2019Azur  Nice France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Melanie","family":"Laine","sequence":"additional","affiliation":[{"name":"Laboratoire d'Anthropologie et de Psychologie Cognitives et Sociales (LAPCOS) Universit\u00e9 Cote d\u2019Azur  Nice France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Damien","family":"Vistoli","sequence":"additional","affiliation":[{"name":"Laboratoire d'Anthropologie et de Psychologie Cognitives et Sociales (LAPCOS) Universit\u00e9 Cote d\u2019Azur  Nice France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"name":"for the DEFI study group","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"311","published-online":{"date-parts":[[2022,4,6]]},"reference":[{"key":"e_1_2_9_2_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.imavis.2009.05.007"},{"key":"e_1_2_9_3_1","first-page":"1","article-title":"Openface: an open source facial behavior analysis toolkit","volume":"2016","author":"Baltru\u0161aitis T.","year":"2016","journal-title":"IEEE Winter Conference on Applications of Computer Vision (WACV)"},{"key":"e_1_2_9_4_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.artmed.2020.101954"},{"key":"e_1_2_9_5_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.artmed.2004.12.003"},{"key":"e_1_2_9_6_1","doi-asserted-by":"publisher","DOI":"10.1037\/0022\u20103514.48.4.1089"},{"key":"e_1_2_9_7_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0147\u20109563(99)70056\u20107"},{"key":"e_1_2_9_8_1","doi-asserted-by":"publisher","DOI":"10.2217\/pmt\u20102017\u20100049"},{"key":"e_1_2_9_9_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.pain.2011.06.028"},{"key":"e_1_2_9_10_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF01115465"},{"key":"e_1_2_9_11_1","doi-asserted-by":"publisher","DOI":"10.1038\/nature21056"},{"key":"e_1_2_9_12_1","doi-asserted-by":"publisher","DOI":"10.1016\/S1474\u20104422(14)70103\u20106"},{"key":"e_1_2_9_13_1","doi-asserted-by":"publisher","DOI":"10.3390\/s20164373"},{"key":"e_1_2_9_14_1","doi-asserted-by":"crossref","unstructured":"He K. Zhang X. Ren S. &Sun J.(2016).Deep residual learning for image recognition(pp.770\u2013778). Proceedings of the IEEE conference on computer vision and pattern recognition.","DOI":"10.1109\/CVPR.2016.90"},{"key":"e_1_2_9_15_1","doi-asserted-by":"publisher","DOI":"10.1111\/apa.12861"},{"key":"e_1_2_9_16_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41568\u2010018\u20100016\u20105"},{"key":"e_1_2_9_17_1","doi-asserted-by":"publisher","DOI":"10.14219\/jada.archive.2007.0293"},{"key":"e_1_2_9_18_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00371\u2010021\u201002056\u2010y"},{"key":"e_1_2_9_19_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.pain.2006.04.003"},{"key":"e_1_2_9_20_1","doi-asserted-by":"publisher","DOI":"10.1155\/2012\/803474"},{"key":"e_1_2_9_21_1","doi-asserted-by":"publisher","DOI":"10.3390\/s18020401"},{"key":"e_1_2_9_22_1","doi-asserted-by":"publisher","DOI":"10.1097\/j.pain.0000000000001424"},{"key":"e_1_2_9_23_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jpain.2004.06.002"},{"key":"e_1_2_9_24_1","first-page":"320","volume-title":"Wall and Melzack textbook of pain","author":"McGrath P.","year":"2013"},{"key":"e_1_2_9_25_1","first-page":"301","volume-title":"Wall and Melzack textbook of pain","author":"Melzack R.","year":"2013"},{"key":"e_1_2_9_26_1","doi-asserted-by":"publisher","DOI":"10.1056\/NEJMoa1917130"},{"key":"e_1_2_9_27_1","doi-asserted-by":"publisher","DOI":"10.3390\/s21093273"},{"key":"e_1_2_9_28_1","doi-asserted-by":"publisher","DOI":"10.1016\/0304\u20103959(92)90213\u2010U"},{"key":"e_1_2_9_29_1","doi-asserted-by":"publisher","DOI":"10.2217\/pmt.11.22"},{"key":"e_1_2_9_30_1","doi-asserted-by":"publisher","DOI":"10.1016\/0304\u20103959(89)90038\u20109"},{"key":"e_1_2_9_31_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.pain.2008.04.010"},{"key":"e_1_2_9_32_1","doi-asserted-by":"publisher","DOI":"10.1155\/2001\/108098"},{"key":"e_1_2_9_33_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ejpain.2010.06.012"},{"key":"e_1_2_9_34_1","doi-asserted-by":"publisher","DOI":"10.1542\/peds.2015\u20100029"},{"key":"e_1_2_9_35_1","unstructured":"Vielzeuf V. Lechervy A. Pateux S. &Jurie F.(2020).Towards a General Model of Knowledge for Facial Analysis by Multi\u2010Source Transfer Learning. The IEEE Winter Conference on Applications of Computer Vision;241\u2013251."},{"key":"e_1_2_9_36_1","doi-asserted-by":"publisher","DOI":"10.3389\/fmed.2020.566278"},{"key":"e_1_2_9_37_1","first-page":"1","article-title":"Automatic recognition methods supporting pain assessment: A survey","volume":"13","author":"Werner P.","year":"2019","journal-title":"IEEE Transactions on Affective Computing"},{"key":"e_1_2_9_38_1","doi-asserted-by":"publisher","DOI":"10.1186\/1471\u20102318\u20106\u20103"}],"container-title":["European Journal of Pain"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/ejp.1948","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/full-xml\/10.1002\/ejp.1948","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/ejp.1948","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,8,23]],"date-time":"2023-08-23T05:53:10Z","timestamp":1692769990000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1002\/ejp.1948"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,4,6]]},"references-count":37,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2022,7]]}},"alternative-id":["10.1002\/ejp.1948"],"URL":"https:\/\/doi.org\/10.1002\/ejp.1948","archive":["Portico"],"relation":{},"ISSN":["1090-3801","1532-2149"],"issn-type":[{"value":"1090-3801","type":"print"},{"value":"1532-2149","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,4,6]]},"assertion":[{"value":"2022-12-20","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-03-28","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-04-06","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}