{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,30]],"date-time":"2026-07-30T21:10:39Z","timestamp":1785445839279,"version":"3.56.0"},"reference-count":16,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2021,2,17]],"date-time":"2021-02-17T00:00:00Z","timestamp":1613520000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100000780","name":"European Commission","doi-asserted-by":"publisher","award":["H2020-871042"],"award-info":[{"award-number":["H2020-871042"]}],"id":[{"id":"10.13039\/501100000780","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000780","name":"European Commission","doi-asserted-by":"publisher","award":["H2020-101006879"],"award-info":[{"award-number":["H2020-101006879"]}],"id":[{"id":"10.13039\/501100000780","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100002943","name":"Departament d'Innovaci\u00f3, Universitats i Empresa, Generalitat de Catalunya","doi-asserted-by":"publisher","award":["2017 SGR 705"],"award-info":[{"award-number":["2017 SGR 705"]}],"id":[{"id":"10.13039\/501100002943","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004837","name":"Ministerio de Ciencia e Innovaci\u00f3n","doi-asserted-by":"publisher","award":["RTI2018-095094-B-C21"],"award-info":[{"award-number":["RTI2018-095094-B-C21"]}],"id":[{"id":"10.13039\/501100004837","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004837","name":"Ministerio de Ciencia e Innovaci\u00f3n","doi-asserted-by":"publisher","award":["TIN2016-80250-R"],"award-info":[{"award-number":["TIN2016-80250-R"]}],"id":[{"id":"10.13039\/501100004837","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100005416","name":"Norwegian Research Council","doi-asserted-by":"publisher","award":["308904"],"award-info":[{"award-number":["308904"]}],"id":[{"id":"10.13039\/501100005416","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Applied Sciences"],"abstract":"<jats:p>To comply with the EU General Data Protection Regulation (GDPR), companies managing personal data have been forced to review their privacy policies. However, privacy policies will not solve any problems as long as users do not read or are not able to understand them. In order to assist users in both issues, we present a system that automatically assesses privacy policies. Our proposal quantifies the degree of policy compliance with respect to the data protection goals stated by the GPDR and presents clear and intuitive privacy scores to the user. In this way, users will become immediately aware of the risks associated with the services and their severity; this will empower them to take informed decisions when accepting (or not) the terms of a service. We leverage manual annotations and machine learning to train a model that automatically tags privacy policies according to their compliance (or not) with the data protection goals of the GDPR. In contrast with related works, we define clear annotation criteria consistent with the GDPR, and this enables us not only to provide aggregated scores, but also fine-grained ratings that help to understand the reasons of the assessment. The latter is aligned with the concept of explainable artificial intelligence. We have applied our method to the policies of 10 well-known internet services. Our scores are sound and consistent with the results reported in related works.<\/jats:p>","DOI":"10.3390\/app11041762","type":"journal-article","created":{"date-parts":[[2021,2,17]],"date-time":"2021-02-17T21:35:42Z","timestamp":1613597742000},"page":"1762","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":26,"title":["Automatic Assessment of Privacy Policies under the GDPR"],"prefix":"10.3390","volume":"11","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7275-7887","authenticated-orcid":false,"given":"David","family":"S\u00e1nchez","sequence":"first","affiliation":[{"name":"Center for Cybersecurity Research of Catalonia (Cybercat), Department of Computer Engineering and Mathematics, Universitat Rovira i Virgili, UNESCO Chair in Data Privacy, Av. Pa\u00efsos Catalans, 26, E-43007 Tarragona, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2342-5100","authenticated-orcid":false,"given":"Alexandre","family":"Viejo","sequence":"additional","affiliation":[{"name":"Center for Cybersecurity Research of Catalonia (Cybercat), Department of Computer Engineering and Mathematics, Universitat Rovira i Virgili, UNESCO Chair in Data Privacy, Av. Pa\u00efsos Catalans, 26, E-43007 Tarragona, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Montserrat","family":"Batet","sequence":"additional","affiliation":[{"name":"Center for Cybersecurity Research of Catalonia (Cybercat), Department of Computer Engineering and Mathematics, Universitat Rovira i Virgili, UNESCO Chair in Data Privacy, Av. Pa\u00efsos Catalans, 26, E-43007 Tarragona, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2021,2,17]]},"reference":[{"key":"ref_1","unstructured":"(2020, December 23). FaceApp\u2018s Terms of Use. Available online: https:\/\/www.faceapp.com\/terms-20170803.html."},{"key":"ref_2","unstructured":"Koetsier, J. (2021, February 16). Viral app FaceApp Now Owns Access to More than 150 Million People\u2019s Faces and Names, in Forbes, ed. 17 July. Available online: https:\/\/www.forbes.com\/sites\/johnkoetsier\/2019\/07\/17\/viral-app-faceapp-now-owns-access-to-more-than-150-million-peoples-faces-and-names\/."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"128","DOI":"10.1080\/1369118X.2018.1486870","article-title":"The biggest lie on the Internet: Ignoring the privacy policies and terms of service policies of social networking services","volume":"23","author":"Obar","year":"2018","journal-title":"Inf. Commun. Soc."},{"key":"ref_4","unstructured":"Litman-Navarro, K. (2021, February 16). We Read 150 Privacy Policies. They Were an Incomprehensible Disaster, in New York Times, ed. 12 June. Available online: https:\/\/www.nytimes.com\/interactive\/2019\/06\/12\/opinion\/facebook-google-privacy-policies.html."},{"key":"ref_5","unstructured":"Zimmeck, S., and Bellovin, S.M. (2014, January 20\u201322). Privee: An Architecture for Automatically Analyzing Web Privacy Policies. Proceedings of the 23rd USENIX Security Symposium, San Diego, CA, USA."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Wilson, S. (2016, January 7\u201312). The Creation and Analysis of a Website Privacy Policy Corpus. Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics, Berlin, Germany.","DOI":"10.18653\/v1\/P16-1126"},{"key":"ref_7","unstructured":"Harkous, H., Fawaz, K., Lebret, R., Schaub, F., Shin, K.G., and Aberer, K. (2018, January 15\u201317). Polisis: Automated Analysis and Presentation of Privacy Policies Using Deep Learning. Proceedings of the 27th USENIX Security Symposium, Balimore, MD, USA."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1145\/3127519","article-title":"PrivacyCheck: Automatic Summarization of Privacy Policies Using Data Mining","volume":"18","author":"Zaeem","year":"2018","journal-title":"ACM Trans. Internet Technol."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Tesfay, W.B., Hofmann, P., Nakamura, T., Kiyomoto, S., and Serna, J. (2018, January 21). PrivacyGuide: Towards and Implementation of the EU GDPR on Internet Privacy Policy Evaluation. Proceedings of the Fourth ACM International Workshop on Security and Privacy Analytics, Tempe, AZ, USA.","DOI":"10.1145\/3180445.3180447"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"M\u00fcller, N.M., Kowatsch, D., Debus, P., Mirdita, D., and B\u00f6ttinger, K. (2019, January 10\u201313). On GDPR Compliance of Companies\u2019 Privacy Policies. Proceedings of the 22nd International Conference on Text, Speech, Dialogue, Liubliana, Eslovenia.","DOI":"10.1007\/978-3-030-27947-9_13"},{"key":"ref_11","unstructured":"(2021, February 16). Conference of the Independent Data Protection Supervisory Authorities of the Federation and the L\u00e4nder, The Standard Data Protection Model Version 2.0b. Available online: https:\/\/www.datenschutzzentrum.de\/uploads\/sdm\/SDM-Methodology_V2.0b.pdf."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"300","DOI":"10.1016\/j.matdes.2018.11.060","article-title":"Using deep neural network with small dataset to predict material defects","volume":"162","author":"Feng","year":"2019","journal-title":"Mater. Des."},{"key":"ref_13","unstructured":"Hsu, C.-W., Chang, C.-C., and Lin, C.-J. (2021, February 16). A Practical Guide to Support Vector Classification, National Taiwan University. Available online: https:\/\/www.csie.ntu.edu.tw\/~cjlin\/papers\/guide\/guide.pdf."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Lebanoff, L., and Liu, F. (November, January 31). Automatic Detection of Vague Words and Sentences in Privacy Policies. Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, Brussels, Belgium.","DOI":"10.18653\/v1\/D18-1387"},{"key":"ref_15","unstructured":"Newton, C. (2021, February 16). The Verge Tech Survey 2020, in The Verge, ed. 2 March. Available online: https:\/\/www.theverge.com\/2020\/3\/2\/21144680\/verge-tech-survey-2020-trust-privacy-security-facebook-amazon-google-apple."},{"key":"ref_16","unstructured":"Devlin, J., Chang, M.-W., Lee, K., and Toutanova, K. (2021, February 16). BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. Available online: https:\/\/arxiv.org\/abs\/1810.04805v2."}],"container-title":["Applied Sciences"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2076-3417\/11\/4\/1762\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T05:25:07Z","timestamp":1760160307000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2076-3417\/11\/4\/1762"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,2,17]]},"references-count":16,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2021,2]]}},"alternative-id":["app11041762"],"URL":"https:\/\/doi.org\/10.3390\/app11041762","relation":{},"ISSN":["2076-3417"],"issn-type":[{"value":"2076-3417","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,2,17]]}}}