{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,24]],"date-time":"2026-09-24T01:09:07Z","timestamp":1790212147095,"version":"4.1.0"},"reference-count":56,"publisher":"SPIE-Intl Soc Optical Eng","issue":"S1","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J. Med. Imag."],"published-print":{"date-parts":[[2023,4,20]]},"abstract":"<jats:p>PurposeSaliency models that predict observers\u2019 visual attention to facial differences could enable psychosocial interventions to help patients and their families anticipate staring behaviors. The purpose of this study was to assess the ability of existing saliency models to predict observers\u2019 visual attention to acquired facial differences arising from head and neck cancer and its treatment.ApproachSaliency maps predicted by graph-based visual saliency (GBVS), an artificial neural network (ANN), and a face-specific model were compared to observer fixation maps generated from eye-tracking of lay observers presented with clinical facial photographs of patients with a visible or functional impairment manifesting in the head and neck region. We used a linear mixed-effects model to investigate observer and stimulus factors associated with the saliency models\u2019 accuracy.ResultsThe GBVS model predicted many irrelevant regions (e.g., shirt collars) as being salient. The ANN model underestimated observers\u2019 attention to facial differences relative to the central region of the face. Compared with GBVS and ANN, the face-specific saliency model was more accurate on this task; however, the face-specific model underestimated the saliency of deviations from the typical structure of human faces. The linear mixed-effects model revealed that the location of the facial difference (midface versus periphery) was significantly associated with saliency model performance. Model performance was also significantly impacted by interobserver variability.ConclusionsExisting saliency models are not adequate for predicting observers\u2019 visual attention to facial differences. Extensions of face-specific saliency models are needed to accurately predict the saliency of acquired facial differences arising from head and neck cancer and its treatment.<\/jats:p>","DOI":"10.1117\/1.jmi.10.s1.s11908","type":"journal-article","created":{"date-parts":[[2023,4,20]],"date-time":"2023-04-20T15:06:01Z","timestamp":1682003161000},"page":"1-20","source":"Crossref","is-referenced-by-count":0,"title":["Assessing saliency models of observers\u2019 visual attention on acquired facial differences"],"prefix":"10.1117","volume":"10","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9147-4006","authenticated-orcid":false,"given":"Haoqi","family":"Wang","sequence":"first","affiliation":[{"name":"The Univ. of Texas at Austin"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Krista","family":"Nicklaus","sequence":"additional","affiliation":[{"name":"The Univ. of Texas at Austin"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Eloise","family":"Jewett","sequence":"additional","affiliation":[{"name":"The Univ. of Texas at Austin"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4225-3121","authenticated-orcid":false,"given":"Eeshaan","family":"Rehani","sequence":"additional","affiliation":[{"name":"The Univ. of Texas at Austin"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tzuan A.","family":"Chen","sequence":"additional","affiliation":[{"name":"HEALTH Research Institute, Univ. of Houston"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jeff","family":"Engelmann","sequence":"additional","affiliation":[{"name":"Rogers Behavioral Health"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mary Catherine","family":"Bordes","sequence":"additional","affiliation":[{"name":"The Univ. of Texas M.D. Anderson Cancer Ctr."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Deepti","family":"Chopra","sequence":"additional","affiliation":[{"name":"The Univ. of Texas M.D. Anderson Cancer Ctr."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Gregory P.","family":"Reece","sequence":"additional","affiliation":[{"name":"The Univ. of Texas M.D. Anderson Cancer Ctr."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Z-Hye","family":"Lee","sequence":"additional","affiliation":[{"name":"The Univ. of Texas M.D. Anderson Cancer Ctr."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mia K.","family":"Markey","sequence":"additional","affiliation":[{"name":"The Univ. of Texas at Austin"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"189","reference":[{"key":"r1","author":"Garland-Thomson","year":"2009"},{"key":"r2","doi-asserted-by":"publisher","DOI":"10.1016\/S1740-1445(03)00005-6"},{"key":"r3","doi-asserted-by":"publisher","DOI":"10.1016\/j.bodyim.2005.03.004"},{"key":"r4","doi-asserted-by":"publisher","DOI":"10.1016\/j.bodyim.2021.05.008"},{"key":"r5","doi-asserted-by":"publisher","DOI":"10.7717\/peerj.870"},{"key":"r6","doi-asserted-by":"publisher","DOI":"10.1016\/j.bodyim.2007.04.005"},{"key":"r7","doi-asserted-by":"publisher","DOI":"10.1002\/em.21878"},{"key":"r8","doi-asserted-by":"publisher","DOI":"10.1136\/bmjopen-2020-046634"},{"key":"r9","doi-asserted-by":"publisher","DOI":"10.2196\/26355"},{"key":"r10","doi-asserted-by":"publisher","DOI":"10.1080\/13548506.2011.647701"},{"key":"r11","doi-asserted-by":"publisher","DOI":"10.1002\/cncr.28469"},{"key":"r12","doi-asserted-by":"publisher","DOI":"10.1007\/s00520-020-05725-1"},{"key":"r13","doi-asserted-by":"publisher","DOI":"10.1177\/082585971403000102"},{"key":"r14","doi-asserted-by":"publisher","DOI":"10.1016\/j.oraloncology.2013.04.005"},{"key":"r15","year":"2013"},{"key":"r16","doi-asserted-by":"publisher","DOI":"10.1093\/jbcr\/irz117"},{"key":"r17","first-page":"141","article-title":"Bottom-up saliency models for still images: a practical review","author":"Riche","year":"2016"},{"key":"r18","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2019.2935715"},{"key":"r19","doi-asserted-by":"publisher","DOI":"10.1093\/asj\/sjz328"},{"key":"r20","doi-asserted-by":"publisher","DOI":"10.1016\/j.bodyim.2021.10.010"},{"key":"r21","doi-asserted-by":"publisher","DOI":"10.1007\/s00266-022-02854-2"},{"key":"r22","doi-asserted-by":"publisher","DOI":"10.1002\/lary.28890"},{"key":"r23","doi-asserted-by":"publisher","DOI":"10.1177\/1055665620926014"},{"key":"r24","doi-asserted-by":"publisher","DOI":"10.1002\/lary.28305"},{"key":"r25","article-title":"Saliency maps of images of facial disfigurements from head and neck cancer","author":"Cook","year":"2019"},{"key":"r26","article-title":"Evaluation of saliency models for clinical photographs of disfigured faces","author":"Wang","year":"2022"},{"key":"r27","doi-asserted-by":"publisher","DOI":"10.1097\/00006534-199808000-00045"},{"key":"r28","doi-asserted-by":"publisher","DOI":"10.16910\/jemr.7.1.1"},{"key":"r29","article-title":"Graph-based visual saliency","author":"Harel","year":"2006"},{"key":"r30","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.38"},{"key":"r31","article-title":"Very deep convolutional networks for large-scale image recognition","author":"Simonyan","year":"2015"},{"key":"r32","doi-asserted-by":"publisher","DOI":"10.1167\/14.1.28"},{"key":"r33","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2017.2689776"},{"key":"r34","doi-asserted-by":"publisher","DOI":"10.1109\/34.730558"},{"key":"r35","doi-asserted-by":"publisher","DOI":"10.1134\/S1054661820030141"},{"key":"r36","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-01270-0_47"},{"key":"r37","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2018.2815601"},{"key":"r38","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-46454-1_49"},{"key":"r39","doi-asserted-by":"publisher","DOI":"10.1016\/j.visres.2005.03.019"},{"key":"r40","article-title":"R: a language and environment for statistical computing","year":"2022"},{"key":"r41","doi-asserted-by":"publisher","DOI":"10.18637\/jss.v067.i01"},{"key":"r42","doi-asserted-by":"publisher","DOI":"10.1002\/pon.4776"},{"key":"r43","doi-asserted-by":"publisher","DOI":"10.1188\/12.CJON.153-159"},{"key":"r44","doi-asserted-by":"publisher","DOI":"10.1177\/0194599819837621"},{"key":"r45","doi-asserted-by":"publisher","DOI":"10.7759\/cureus.1418"},{"key":"r46","article-title":"Head and Neck Cancers","year":"2023"},{"key":"r47","doi-asserted-by":"publisher","DOI":"10.1001\/jamaoto.2021.3425"},{"key":"r48","doi-asserted-by":"publisher","DOI":"10.1002\/hed.21022"},{"key":"r49","doi-asserted-by":"publisher","DOI":"10.1353\/hpu.2022.0036"},{"key":"r50","doi-asserted-by":"publisher","DOI":"10.1016\/j.thorsurg.2021.09.004"},{"key":"r51","doi-asserted-by":"publisher","DOI":"10.1016\/j.ecl.2021.11.017"},{"key":"r52","doi-asserted-by":"publisher","DOI":"10.1016\/j.amjoto.2020.102624"},{"key":"r53","author":"Bibbins-Domingo","year":"2022"},{"key":"r54","doi-asserted-by":"publisher","DOI":"10.1016\/j.cognition.2013.08.012"},{"key":"r55","doi-asserted-by":"publisher","DOI":"10.3758\/PBR.15.6.1089"},{"key":"r56","doi-asserted-by":"publisher","DOI":"10.1080\/13506285.2017.1301614"}],"container-title":["Journal of Medical Imaging"],"original-title":[],"link":[{"URL":"https:\/\/www.spiedigitallibrary.org\/journals\/journal-of-medical-imaging\/volume-10\/issue-S1\/S11908\/Assessing-saliency-models-of-observers-visual-attention-on-acquired-facial\/10.1117\/1.JMI.10.S1.S11908.full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,9,24]],"date-time":"2026-09-24T00:45:59Z","timestamp":1790210759000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.spiedigitallibrary.org\/journals\/journal-of-medical-imaging\/volume-10\/issue-S1\/S11908\/Assessing-saliency-models-of-observers-visual-attention-on-acquired-facial\/10.1117\/1.JMI.10.S1.S11908.full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,4,20]]},"references-count":56,"journal-issue":{"issue":"S1","published-online":{"date-parts":[[2023,2,1]]}},"URL":"https:\/\/doi.org\/10.1117\/1.jmi.10.s1.s11908","relation":{},"ISSN":["2329-4302","2329-4310"],"issn-type":[{"value":"2329-4302","type":"print"},{"value":"2329-4310","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,4,20]]}}}