{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,25]],"date-time":"2026-03-25T17:48:27Z","timestamp":1774460907747,"version":"3.50.1"},"reference-count":40,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2020,1,7]],"date-time":"2020-01-07T00:00:00Z","timestamp":1578355200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,1,7]],"date-time":"2020-01-07T00:00:00Z","timestamp":1578355200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Big Data"],"published-print":{"date-parts":[[2020,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Explosive performance and memory space growth in computing machines, along with recent specialization of deep learning models have radically boosted the role of images in semantic pattern recognition. In the same way that a textual post on social media reveals individual characteristics of its author, facial images may manifest some personality traits. This work is the first milestone in our attempt to infer personality traits from facial images. With this ultimate goal in mind, here we explore a new level of image understanding, inferring criminal tendency from facial images via deep learning. In particular, two deep learning models, including a standard feedforward neural network (SNN) and a convolutional neural network (CNN) are applied to discriminate criminal and non-criminal facial images. Confusion matrix and training and test accuracies are reported for both models, using tenfold cross-validation on a set of 10,000 facial images. The CNN was more consistent than the SNN in learning to reach its best test accuracy, which was 8% higher than the SNN\u2019s test accuracy. Next, to explore the classifier\u2019s hypothetical bias due to gender, we controlled for gender by applying only male facial images. No meaningful discrepancies in classification accuracies or learning consistencies were observed, suggesting little to no gender bias in the classifier. Finally, dissecting and visualizing convolutional layers in CNN showed that the shape of the face, eyebrows, top of the eye, pupils, nostrils, and lips are taken advantage of by CNN in order to classify the two sets of images.<\/jats:p>","DOI":"10.1186\/s40537-019-0282-4","type":"journal-article","created":{"date-parts":[[2020,2,3]],"date-time":"2020-02-03T14:07:50Z","timestamp":1580738870000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":17,"title":["RETRACTED ARTICLE: Criminal tendency detection from facial images and the gender bias effect"],"prefix":"10.1186","volume":"7","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0212-0228","authenticated-orcid":false,"given":"Mahdi","family":"Hashemi","sequence":"first","affiliation":[]},{"given":"Margeret","family":"Hall","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2020,1,7]]},"reference":[{"issue":"3","key":"282_CR1","doi-asserted-by":"publisher","first-page":"1497","DOI":"10.1111\/j.1751-9004.2008.00109.x","volume":"2","author":"LA Zebrowitz","year":"2008","unstructured":"Zebrowitz LA, Montepare JM. Social psychological face perception: why appearance matters. Soc Personal Psychol Compass. 2008;2(3):1497\u2013517.","journal-title":"Soc Personal Psychol Compass"},{"key":"282_CR2","doi-asserted-by":"publisher","DOI":"10.1215\/9780822387800","volume-title":"Criminal man","author":"C Lombroso","year":"2006","unstructured":"Lombroso C. Criminal man. 5th ed. Durham: Duke Univ. Press; 2006.","edition":"5"},{"key":"282_CR3","volume-title":"Poker face: the art of analyzing poker tells","author":"J Hargrave","year":"2010","unstructured":"Hargrave J. Poker face: the art of analyzing poker tells. Dubuque: Kendall Hunt Pub Co; 2010."},{"issue":"2","key":"282_CR4","doi-asserted-by":"publisher","first-page":"246","DOI":"10.1037\/pspa0000098","volume":"114","author":"Y Wang","year":"2018","unstructured":"Wang Y, Kosinski M. Deep neural networks are more accurate than humans at detecting sexual orientation from facial images. J Personal Soc Psychol. 2018;114(2):246\u201357.","journal-title":"J Personal Soc Psychol"},{"issue":"10","key":"282_CR5","doi-asserted-by":"publisher","first-page":"2401","DOI":"10.1109\/TPAMI.2013.51","volume":"35","author":"X Geng","year":"2013","unstructured":"Geng X, Yin C, Zhou ZH. Facial age estimation by learning from label distributions. IEEE Trans Pattern Anal Mach Intell. 2013;35(10):2401\u201312.","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"issue":"1","key":"282_CR6","doi-asserted-by":"publisher","first-page":"15","DOI":"10.1140\/epjds\/s13688-017-0110-z","volume":"6","author":"AG Reece","year":"2017","unstructured":"Reece AG, Danforth CM. Instagram photos reveal predictive markers of depression. EPJ Data Sci. 2017;6(1):15.","journal-title":"EPJ Data Sci"},{"key":"282_CR7","volume-title":"The facial action coding system (FACS): a technique for the measurement of facial action","author":"P Ekman","year":"1978","unstructured":"Ekman P, Friesen W. The facial action coding system (FACS): a technique for the measurement of facial action. Palo Alto: Consulting Psychologists; 1978."},{"key":"282_CR8","unstructured":"Tsapatsoulis N, Karpouzis K, Stamou G, Piat F, Kollias S. A fuzzy system for emotion classification based on the MPEG-4 facial definition parameter set. In: 10th European signal processing conference; 2000. p. 1\u20134."},{"issue":"8","key":"282_CR9","doi-asserted-by":"publisher","first-page":"1369","DOI":"10.1016\/S0031-3203(99)00113-2","volume":"33","author":"N Oliver","year":"2000","unstructured":"Oliver N, Pentland A, B\u00e9rard F. LAFTER: a real-time face and lips tracker with facial expression recognition. Pattern Recogn. 2000;33(8):1369\u201382.","journal-title":"Pattern Recogn"},{"issue":"5","key":"282_CR10","doi-asserted-by":"publisher","first-page":"699","DOI":"10.1109\/TPAMI.2005.93","volume":"27","author":"Y Zhang","year":"2005","unstructured":"Zhang Y, Ji Q. Active and dynamic information fusion for facial expression understanding from image sequences. IEEE Trans Pattern Anal Mach Intell. 2005;27(5):699\u2013714.","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"key":"282_CR11","unstructured":"Wu X, Zhang X. Automated inference on criminality using face images.\u00a02016. arXiv preprint. arXiv:1611.04135."},{"key":"282_CR12","doi-asserted-by":"publisher","first-page":"132","DOI":"10.1016\/j.ijinfomgt.2018.10.010","volume":"45","author":"A Taneja","year":"2019","unstructured":"Taneja A, Arora A. Modeling user preferences using neural networks and tensor factorization model. Int J Inf Manag. 2019;45:132\u201348.","journal-title":"Int J Inf Manag"},{"key":"282_CR13","unstructured":"Krizhevsky A, Sutskever I, Hinton GE. Imagenet classification with deep convolutional neural networks. In: Advances in neural information processing systems; 2012. p. 1097\u2013105."},{"key":"282_CR14","doi-asserted-by":"crossref","unstructured":"Baranwal S, Khandelwal S, Arora A. Deep learning convolutional neural network for apple leaves disease detection. In: International conference on sustainable computing in science, technology & management; 2019; Jaipur, India. p. 260\u20137.","DOI":"10.2139\/ssrn.3351641"},{"key":"282_CR15","doi-asserted-by":"crossref","unstructured":"Ouyang W, Wang X, Zeng X, Qiu S, Luo P, Tian Y, Li H, Yang S, Wang Z, Loy CC, et al. Deepid-net: deformable deep convolutional neural networks for object detection. In: IEEE conference on computer vision and pattern recognition; 2015. p. 2403\u201312.","DOI":"10.1109\/CVPR.2015.7298854"},{"key":"282_CR16","unstructured":"Sun Y, Liang D, Wang X, Tang X. Deepid3: face recognition with very deep neural networks. 2015. arXiv preprint. arXiv:1502.00873."},{"key":"282_CR17","doi-asserted-by":"crossref","unstructured":"Cristani M, Vinciarelli A, Segalin C, Perina A. Unveiling the multimedia unconscious: Implicit cognitive processes and multimedia content analysis. In: The 21st ACM international conference on multimedia; 2013. p. 213\u201322.","DOI":"10.1145\/2502081.2502280"},{"issue":"2","key":"282_CR18","doi-asserted-by":"publisher","first-page":"268","DOI":"10.1109\/TAFFC.2016.2516994","volume":"8","author":"C Segalin","year":"2017","unstructured":"Segalin C, Perina A, Cristani M, Vinciarelli A. The pictures we like are our image: continuous mapping of favorite pictures into self-assessed and attributed personality traits. IEEE Trans Affect Comput. 2017;8(2):268\u201385.","journal-title":"IEEE Trans Affect Comput"},{"issue":"1","key":"282_CR19","doi-asserted-by":"publisher","first-page":"34","DOI":"10.1016\/j.cviu.2016.10.013","volume":"156","author":"C Segalin","year":"2017","unstructured":"Segalin C, Cheng DS, Cristani M. Social profiling through image understanding: personality inference using convolutional neural networks. Comput Vis Image Underst. 2017;156(1):34\u201350.","journal-title":"Comput Vis Image Underst"},{"key":"282_CR20","unstructured":"NIST Special Database 18. 2010. https:\/\/www.nist.gov\/srd\/nist-special-database-18. Accessed 12 Apr 2019."},{"key":"282_CR21","unstructured":"Viola P, Jones M. Rapid object detection using a boosted cascade of simple features. In: IEEE computer society conference on computer vision and pattern recognition; 2001. p. 1\u20139."},{"key":"282_CR22","unstructured":"Face Recognition Database. http:\/\/cbcl.mit.edu\/software-datasets\/heisele\/facerecognition-database.html. Accessed 02 June 2018."},{"key":"282_CR23","unstructured":"FEI Face Database. http:\/\/fei.edu.br\/~cet\/facedatabase.html. Accessed 02 June 2018."},{"key":"282_CR24","unstructured":"Georgia Tech face database. http:\/\/www.anefian.com\/research\/face_reco.htm. Accessed 02 June 2018."},{"key":"282_CR25","unstructured":"Face Place. http:\/\/wiki.cnbc.cmu.edu\/Face_Place. Accessed 02 June 2018."},{"key":"282_CR26","unstructured":"Face Detection Data Set and Benchmark Home. http:\/\/vis-www.cs.umass.edu\/fddb\/. Accessed 02 June 2018."},{"key":"282_CR27","unstructured":"Hinton GE, Srivastava N, Krizhevsky A, Sutskever I, Salakhutdinov RR. Improving neural networks by preventing co-adaptation of feature detectors. 2012. arXiv preprint. arXiv:1207.0580."},{"key":"282_CR28","unstructured":"Nair V, Hinton GE. Rectified linear units improve restricted boltzmann machines. In: The 27th international conference on machine learning; 2010. p. 807\u201314."},{"key":"282_CR29","unstructured":"Kingma DP, Ba J. Adam: a method for stochastic optimization. 2014. arXiv preprint. arXiv:1412.6980."},{"key":"282_CR30","unstructured":"Simonyan K, Zisserman A. Very deep convolutional networks for large-scale image recognition. 2014. arXiv preprint. arXiv:1409.1556."},{"issue":"9","key":"282_CR31","doi-asserted-by":"publisher","first-page":"2564","DOI":"10.1109\/TKDE.2015.2415497","volume":"27","author":"M Wang","year":"2015","unstructured":"Wang M, Liu X, Wu X. Visual classification by l1-hypergraph modeling. IEEE Trans Knowl Data Eng. 2015;27(9):2564\u201374.","journal-title":"IEEE Trans Knowl Data Eng"},{"issue":"7","key":"282_CR32","doi-asserted-by":"publisher","first-page":"3262","DOI":"10.1109\/TIP.2012.2190083","volume":"21","author":"J Yu","year":"2012","unstructured":"Yu J, Tao D, Wang M. Adaptive hypergraph learning and its application in image classification. IEEE Trans Image Process. 2012;21(7):3262\u201372.","journal-title":"IEEE Trans Image Process"},{"key":"282_CR33","doi-asserted-by":"crossref","unstructured":"Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, Erhan D, Vanhoucke V, Rabinovich A. Going deeper with convolutions. In: IEEE conference on computer vision and pattern recognition; 2015. p. 1\u20139.","DOI":"10.1109\/CVPR.2015.7298594"},{"key":"282_CR34","doi-asserted-by":"crossref","unstructured":"Zeiler MD, Fergus R. Visualizing and understanding convolutional networks. In: European conference on computer vision; 2014. p. 818\u201333.","DOI":"10.1007\/978-3-319-10590-1_53"},{"issue":"1","key":"282_CR35","doi-asserted-by":"publisher","first-page":"95","DOI":"10.1016\/j.imavis.2019.06.001","volume":"89","author":"M Hashemi","year":"2019","unstructured":"Hashemi M, Hall M. Detecting and classifying online dark visual propaganda. Image Vis Comput. 2019;89(1):95\u2013105.","journal-title":"Image Vis Comput"},{"issue":"1","key":"282_CR36","doi-asserted-by":"publisher","first-page":"98","DOI":"10.1186\/s40537-019-0263-7","volume":"6","author":"M Hashemi","year":"2019","unstructured":"Hashemi M. Enlarging smaller images before inputting into convolutional neural network: zero-padding vs. interpolation. J Big Data. 2019;6(1):98.","journal-title":"J Big Data"},{"key":"282_CR37","doi-asserted-by":"crossref","unstructured":"Farfade SS, Saberian MJ, Li LJ. Multi-view face detection using deep convolutional neural networks. In: 5th International conference on multimedia retrieval; 2015. p. 643\u201350.","DOI":"10.1145\/2671188.2749408"},{"key":"282_CR38","doi-asserted-by":"publisher","DOI":"10.1007\/s11042-019-08373-8","author":"M Hashemi","year":"2020","unstructured":"Hashemi M. Web page classification: a survey of perspectives, gaps, and future directions. Multimedia Tools Appl. 2020. https:\/\/doi.org\/10.1007\/s11042-019-08373-8.","journal-title":"Multimedia Tools Appl"},{"key":"282_CR39","unstructured":"Zeiler MD, Fergus R. Stochastic pooling for regularization of deep convolutional neural networks. 2013. arXiv preprint. arXiv:1301.3557."},{"key":"282_CR40","unstructured":"TensorFlow. TensorFlow Tutorials. 2019. https:\/\/www.tensorflow.org\/tutorials. Accessed 01 Jan 2019."}],"updated-by":[{"DOI":"10.1186\/s40537-020-00323-8","type":"retraction","label":"Retraction","source":"retraction-watch","updated":{"date-parts":[[2020,6,30]],"date-time":"2020-06-30T00:00:00Z","timestamp":1593475200000},"record-id":"23707"},{"DOI":"10.1186\/s40537-020-00323-8","type":"retraction","label":"Retraction","source":"publisher","updated":{"date-parts":[[2020,6,30]],"date-time":"2020-06-30T00:00:00Z","timestamp":1593475200000}}],"container-title":["Journal of Big Data"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s40537-019-0282-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1186\/s40537-019-0282-4\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s40537-019-0282-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,1,6]],"date-time":"2021-01-06T00:07:04Z","timestamp":1609891624000},"score":1,"resource":{"primary":{"URL":"https:\/\/journalofbigdata.springeropen.com\/articles\/10.1186\/s40537-019-0282-4"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,1,7]]},"references-count":40,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2020,12]]}},"alternative-id":["282"],"URL":"https:\/\/doi.org\/10.1186\/s40537-019-0282-4","relation":{"retraction":[{"id-type":"doi","id":"10.1186\/s40537-020-00323-8","asserted-by":"object"}]},"ISSN":["2196-1115"],"issn-type":[{"value":"2196-1115","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,1,7]]},"assertion":[{"value":"31 August 2019","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"30 December 2019","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"7 January 2020","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"30 June 2020","order":4,"name":"change_date","label":"Change Date","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"Correction","order":5,"name":"change_type","label":"Change Type","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"An amendment to this paper has been published and can be accessed via the original article.","order":6,"name":"change_details","label":"Change Details","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare that they have no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"2"}}