{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T02:54:04Z","timestamp":1760151244175,"version":"build-2065373602"},"reference-count":22,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2022,3,6]],"date-time":"2022-03-06T00:00:00Z","timestamp":1646524800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Informatics"],"abstract":"<jats:p>Deception, also known as faking, is a critical issue when collecting data using questionnaires. As shown by previous studies, people have the tendency to fake their answers whenever they gain an advantage from doing so, e.g., when taking a test for a job application. Current methods identify the general attitude of faking but fail to identify faking patterns and the exact responses affected. Moreover, these strategies often require extensive data collection of honest responses and faking patterns related to the specific questionnaire use case, e.g., the position that people are applying to. In this work, we propose a self-attention-based autoencoder (SABA) model that can spot faked responses in a questionnaire solely relying on a set of honest answers that are not necessarily related to its final use case. We collect data relative to a popular personality test (the 10-item Big Five test) in three different use cases, i.e., to obtain: (i) child custody in court, (ii) a position as a salesperson, and (iii) a role in a humanitarian organization. The proposed model outperforms by a sizeable margin in terms of F1 score three competitive baselines, i.e., an autoencoder based only on feedforward layers, a distribution model, and a k-nearest-neighbor-based model.<\/jats:p>","DOI":"10.3390\/informatics9010023","type":"journal-article","created":{"date-parts":[[2022,3,6]],"date-time":"2022-03-06T20:38:16Z","timestamp":1646599096000},"page":"23","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Identifying Faked Responses in Questionnaires with Self-Attention-Based Autoencoders"],"prefix":"10.3390","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1701-7805","authenticated-orcid":false,"given":"Alberto","family":"Purpura","sequence":"first","affiliation":[{"name":"Department of Information Engineering, University of Padova, Via Gradenigo 6\/B, 35122 Padova, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6026-0133","authenticated-orcid":false,"given":"Giuseppe","family":"Sartori","sequence":"additional","affiliation":[{"name":"Department of General Psychology, University of Padova, Via Venezia 8, 35122 Padova, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2156-9530","authenticated-orcid":false,"given":"Dora","family":"Giorgianni","sequence":"additional","affiliation":[{"name":"Department of General Psychology, University of Padova, Via Venezia 8, 35122 Padova, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8769-7693","authenticated-orcid":false,"given":"Graziella","family":"Orr\u00fa","sequence":"additional","affiliation":[{"name":"Department of Surgical, Medical, Molecular and Critical Area Pathology, University of Pisa, Via Paradisa 2, 56126 Pisa, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5739-9639","authenticated-orcid":false,"given":"Gian Antonio","family":"Susto","sequence":"additional","affiliation":[{"name":"Department of Information Engineering, University of Padova, Via Gradenigo 6\/B, 35122 Padova, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2022,3,6]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Sartori, G., Zangrossi, A., Orr\u00f9, G., and Monaro, M. (2017). Detection of malingering in psychic damage ascertainment. P5 Medicine and Justice, Springer.","DOI":"10.1007\/978-3-319-67092-8_21"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Mazza, C., Orr\u00f9, G., Burla, F., Monaro, M., Ferracuti, S., Colasanti, M., and Roma, P. (2019). Indicators to distinguish symptom accentuators from symptom producers in individuals with a diagnosed adjustment disorder: A pilot study on inconsistency subtypes using SIMS and MMPI-2-RF. PLoS ONE, 14.","DOI":"10.1371\/journal.pone.0227113"},{"key":"ref_3","unstructured":"Goodfellow, I., Bengio, Y., and Courville, A. (2016). Deep Learning, MIT Press."},{"key":"ref_4","unstructured":"Devlin, J., Chang, M., Lee, K., and Toutanova, K. (2018). Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"203","DOI":"10.1016\/j.jrp.2006.02.001","article-title":"Measuring personality in one minute or less: A 10-item short version of the Big Five Inventory in English and German","volume":"41","author":"Rammstedt","year":"2007","journal-title":"J. Res. Personal."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"2","DOI":"10.1109\/TAFFC.2018.2854179","article-title":"Decoding the Perception of Sincerity in Dialogues","volume":"12","author":"Girlea","year":"2021","journal-title":"IEEE Trans. Affect. Comput."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"394","DOI":"10.1109\/T-AFFC.2011.35","article-title":"Red-Pill Robots Only, Please","volume":"3","author":"Bringsjord","year":"2012","journal-title":"IEEE Trans. Affect. Comput."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Nazari, Z., Lucas, G., and Gratch, J. (2017). Fixed-pie Lie in Action. International Conference on Intelligent Virtual Agents, Springer.","DOI":"10.1007\/978-3-319-67401-8_38"},{"key":"ref_9","unstructured":"Ott, M., Cardie, C., and Hancock, J. (2013, January 10\u201312). Negative deceptive opinion spam. Proceedings of the HLT-NAACL \u201913, Atlanta, GA, USA."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Toma, C.L., and Hancock, J. (2010, January 6\u201310). Reading between the lines: Linguistic cues to deception in online dating profiles. Proceedings of the CSCW \u201910, Savannah, GA, USA.","DOI":"10.1145\/1718918.1718921"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"421","DOI":"10.1002\/j.1556-6676.1992.tb01627.x","article-title":"Millon clinical multiaxial inventory: I & II","volume":"70","author":"Millon","year":"1992","journal-title":"J. Couns. Dev."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"674","DOI":"10.1016\/j.yebeh.2011.01.034","article-title":"MMPI-II personality profiles of patients with psychogenic nonepileptic seizures","volume":"20","author":"Bodde","year":"2011","journal-title":"Epilepsy Behav."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"46","DOI":"10.1007\/BF02686767","article-title":"Faking personality questionnaires: Fabricating different profiles for different purposes","volume":"9","author":"Furnham","year":"1990","journal-title":"Curr. Psychol."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"389","DOI":"10.3389\/fpsyt.2019.00389","article-title":"Introducing machine learning to detect personality faking-good in a male sample: A new model based on Minnesota multiphasic personality inventory-2 restructured form scales and reaction times","volume":"10","author":"Mazza","year":"2019","journal-title":"Front. Psychiatry"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"2970","DOI":"10.3389\/fpsyg.2019.02970","article-title":"Machine learning in psychometrics and psychological research","volume":"10","author":"Monaro","year":"2020","journal-title":"Front. Psychol."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Cardaioli, M., Cecconello, S., Monaro, M., Sartori, G., Conti, M., and Orr\u00f9, G. (2021). Malingering Scraper: A Novel Framework to Reconstruct Honest Profiles from Malingerer Psychopathological Tests. International Conference on Neural Information Processing, Springer.","DOI":"10.1007\/978-3-030-92310-5_50"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"283","DOI":"10.3389\/fpsyg.2018.00283","article-title":"False identity detection using complex sentences","volume":"9","author":"Monaro","year":"2018","journal-title":"Front. Psychol."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"249","DOI":"10.3389\/fpsyt.2018.00249","article-title":"The detection of malingering: A new tool to identify made-up depression","volume":"9","author":"Monaro","year":"2018","journal-title":"Front. Psychiatry"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"107063","DOI":"10.1016\/j.chb.2021.107063","article-title":"Detecting deception through facial expressions in a dataset of videotaped interviews: A comparison between human judges and machine learning models","volume":"127","author":"Monaro","year":"2022","journal-title":"Comput. Hum. Behav."},{"key":"ref_20","unstructured":"Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A., Kaiser, L., and Polosukhin, I. (2017). Attention is all you need. arXiv."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Luong, M., Pham, H., and Manning, C. (2015). Effective approaches to attention-based neural machine translation. arXiv.","DOI":"10.18653\/v1\/D15-1166"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"135","DOI":"10.1016\/j.paid.2014.11.053","article-title":"An Italian version of the 10-item Big Five Inventory: An application to hedonic and utilitarian shopping values","volume":"76","author":"Guido","year":"2015","journal-title":"Personal. Individ. Differ."}],"container-title":["Informatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2227-9709\/9\/1\/23\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T22:32:53Z","timestamp":1760135573000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2227-9709\/9\/1\/23"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,3,6]]},"references-count":22,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2022,3]]}},"alternative-id":["informatics9010023"],"URL":"https:\/\/doi.org\/10.3390\/informatics9010023","relation":{},"ISSN":["2227-9709"],"issn-type":[{"type":"electronic","value":"2227-9709"}],"subject":[],"published":{"date-parts":[[2022,3,6]]}}}