{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T02:32:55Z","timestamp":1760236375777,"version":"build-2065373602"},"reference-count":45,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2021,11,22]],"date-time":"2021-11-22T00:00:00Z","timestamp":1637539200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Digital"],"abstract":"<jats:p>Privacy policies play an important part in informing users about their privacy concerns by operating as memorandums of understanding (MOUs) between them and online services providers. Research suggests that these policies are infrequently read because they are often lengthy, written in jargon, and incomplete, making them difficult for most users to understand. Users are more likely to read short excerpts of privacy policies if they pertain directly to their concern. In this paper, a novel approach and a proof-of-concept tool are proposed that reduces the amount of privacy policy text a user has to read. It does so using a domain ontology and natural language processing (NLP) to identify key areas of the policies that users should read to address their concerns and take appropriate action. Using the ontology to locate key parts of privacy policies, average reading times were substantially reduced from 29\u201332 min to 45 s.<\/jats:p>","DOI":"10.3390\/digital1040015","type":"journal-article","created":{"date-parts":[[2021,11,23]],"date-time":"2021-11-23T02:55:17Z","timestamp":1637636117000},"page":"198-215","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["Improving Readability of Online Privacy Policies through DOOP: A Domain Ontology for Online Privacy"],"prefix":"10.3390","volume":"1","author":[{"given":"Dhiren A.","family":"Audich","sequence":"first","affiliation":[{"name":"School of Computer Science, University of Guelph, 50 Stone Road, Guelph, ON N1G 2W1, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3728-0275","authenticated-orcid":false,"given":"Rozita","family":"Dara","sequence":"additional","affiliation":[{"name":"School of Computer Science, University of Guelph, 50 Stone Road, Guelph, ON N1G 2W1, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Blair","family":"Nonnecke","sequence":"additional","affiliation":[{"name":"School of Computer Science, University of Guelph, 50 Stone Road, Guelph, ON N1G 2W1, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,11,22]]},"reference":[{"key":"ref_1","unstructured":"Madden, M., and Rainie, L. (2021, November 09). Americans\u2019 Attitudes about Privacy, Security and Surveillance. Available online: http:\/\/www.pewinternet.org\/2015\/05\/20\/americans-attitudes-about-privacy-security-and-surveillance\/."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Jensen, C., and Potts, C. (2004, January 24\u201329). Privacy Policies as Decision-Making Tools: An Evaluation of Online Privacy Notices. Proceedings of the 2004 Conference on Human Factors in Computing Systems (CHI 2004), Vienna, Austria.","DOI":"10.1145\/985692.985752"},{"key":"ref_3","unstructured":"(2021, November 09). Ten Steps to Develop a Multilayered Privacy Notice. Available online: https:\/\/www.huntonprivacyblog.com\/wp-content\/uploads\/sites\/18\/2012\/07\/Centre-10-Steps-to-Multilayered-Privacy-Notice.pdf."},{"key":"ref_4","unstructured":"Munur, M., Branam, S., and Mrkobrad, M. (2021, November 09). Best PRACTICES in Drafting Plain-Language and Layered Privacy Policies. Available online: https:\/\/iapp.org\/news\/a\/2012-09-13-best-practices-in-drafting-plain-language-and-layered-privacy\/."},{"key":"ref_5","unstructured":"Westin, A.F. (1967). Privacy and Freedom, Atheneum."},{"key":"ref_6","unstructured":"(2021, November 09). Privacy Online: Fair Information Practices in the Electronic Marketplace, Available online: https:\/\/www.ftc.gov\/reports\/privacy-online-fair-information-practices-electronic-marketplace-federal-trade-commission."},{"key":"ref_7","unstructured":"(2021, November 09). Regulation (EU) 2016\/679 of the European Parliament and of the Council of 27 April 2016 on the Protection of Natural Persons with Regard to the Processing of Personal Data and on the Free Movement of Such Data, and Repealing Directive 95\/46\/EC (General Data Protection Regulation). Available online: http:\/\/eur-lex.europa.eu\/legal-content\/EN\/TXT\/PDF\/?uri=CELEX:32016R0679&from=EN."},{"key":"ref_8","unstructured":"(2021, November 09). Personal Information Protection and Electronic Documents Act. Available online: http:\/\/laws-lois.justice.gc.ca\/eng\/acts\/P-8.6\/index.html."},{"key":"ref_9","unstructured":"(2021, November 09). Digital Privacy Act. Available online: http:\/\/laws-lois.justice.gc.ca\/eng\/annualstatutes\/2015_32\/page-1.html."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"128","DOI":"10.1080\/1369118X.2018.1486870","article-title":"The biggest lie on the internet: Ignoring the privacy policies and terms of service policies of social networking services","volume":"23","author":"Obar","year":"2020","journal-title":"Inf. Commun. Soc."},{"key":"ref_11","unstructured":"Mcdonald, A.M., Reeder, R.W., Kelley, P.G., and Cranor, L.F. (2009, January 5\u20137). A comparative study of online privacy policies and formats. Proceedings of the 9th International Symposium on Privacy Enhancing Technologies (PETS \u201909), Seattle, WA, USA."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1002\/dir.20009","article-title":"Strategies for reducing online privacy risks: Why consumers read (or don\u2019t read) online privacy notices","volume":"18","author":"Milne","year":"2004","journal-title":"J. Interact. Mark."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Wilson, S., Schaub, F., Dara, A.A., Liu, F., Cherivirala, S., Leon, P.G., Andersen, M.S., Zimmeck, S., Sathyendra, K.M., and Russell, N.C. (2016, January 7\u201312). The creation and analysis of a website privacy policy corpus. Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Berlin, Germany.","DOI":"10.18653\/v1\/P16-1126"},{"key":"ref_14","unstructured":"Cranor, L.F., Langheinrich, M., and Marchiori, M. (2002). A P3P preference exchange language 1.0 (APPEL1. 0). W3C Work. Draft, 15, Available online: https:\/\/ci.nii.ac.jp\/naid\/10027364004\/."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"50","DOI":"10.1109\/MSECP.2003.1253568","article-title":"P3P: Making privacy policies more useful","volume":"1","author":"Cranor","year":"2003","journal-title":"IEEE Secur. Priv."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"310","DOI":"10.1007\/s10664-012-9204-1","article-title":"Understanding privacy policies","volume":"18","author":"Pek","year":"2013","journal-title":"Empir. Softw. Eng."},{"key":"ref_17","unstructured":"(2021, November 09). Terms of Service; Didn\u2019t Read (ToS;DR). Available online: https:\/\/www.theverge.com\/2012\/8\/14\/3241572\/tos-dr-terms-of-service."},{"key":"ref_18","unstructured":"Zimmeck, S., and Bellovin, S.M. (2014, January 20\u201322). Privee: An architecture for automatically analyzing web privacy policies. Proceedings of the 23rd USENIX Security Symposium (USENIX Security 14), San Diego, CA, USA."},{"key":"ref_19","unstructured":"Sadeh, N., Acquisti, R., Breaux, T.D., Cranor, L.F., Mcdonalda, A.M., Reidenbergb, J.R., Smith, N.A., Liu, F., Russellb, N.C., and Schaub, F. (2013). The Usable Privacy Policy Project: Combining Crowdsourcing, Machine Learning and Natural Language Processing to Semi-Automatically Answer Those Privacy Questions Users Care About, Carnegie Mellon University."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Ramanath, R., Schaub, F., Wilson, S., Liu, F., Sadeh, N., and Smith, N.A. (2014, January 2\u20134). Identifying relevant text fragments to help crowdsource privacy policy annotations. Proceedings of the Second AAAI Conference on Human Computation and Crowdsourcing, Pittsburgh, PA, USA.","DOI":"10.1609\/hcomp.v2i1.13179"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Wilson, S., Schaub, F., Ramanath, R., Sadeh, N., Liu, F., Smith, N.A., and Liu, F. (2016, January 11\u201315). Crowdsourcing Annotations for Websites\u2019 Privacy Policies: Can It Really Work?. Proceedings of the 25th International Conference on World Wide Web. International World Wide Web Conferences Steering Committee, Montreal, QC, Canada.","DOI":"10.1145\/2872427.2883035"},{"key":"ref_22","unstructured":"Harkous, H., Fawaz, K., Lebret, R., Schaub, F., Shin, K.G., and Aberer, K. (2018, January 15\u201317). Polisis: Automated analysis and presentation of privacy policies using deep learning. Proceedings of the 27th {USENIX} Security Symposium ({USENIX} Security 18, Baltimore, MD, USA."},{"key":"ref_23","unstructured":"Harkous, H., Fawaz, K., Shin, K.G., and Aberer, K. (2016, January 22\u201324). Pribots: Conversational privacy with chatbots. Proceedings of the Twelfth Symposium on Usable Privacy and Security ({SOUPS}) 2016, Denver, CO, USA."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1145\/3127519","article-title":"Privacycheck: Automatic summarization of privacy policies using data mining","volume":"18","author":"Zaeem","year":"2018","journal-title":"ACM Trans. Internet Technol. (TOIT)"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"88","DOI":"10.2478\/popets-2021-0019","article-title":"Automated Extraction and Presentation of Data Practices in Privacy Policies","volume":"2021","author":"Bui","year":"2021","journal-title":"Proc. Priv. Enhancing Technol."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Srinath, M., Sundareswara, S.N., Giles, C.L., and Wilson, S. (2021). PrivaSeer: A Privacy Policy Search Engine. International Conference on Web Engineering, Springer.","DOI":"10.1007\/978-3-030-74296-6_22"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"58","DOI":"10.1145\/1041410.1041420","article-title":"Ontologies and semantics for seamless connectivity","volume":"33","author":"Uschold","year":"2004","journal-title":"ACM Sigmod Rec."},{"key":"ref_28","unstructured":"Bermejo, J. (2007). A Simplified Guide to Create an Ontology, Madrid University."},{"key":"ref_29","unstructured":"Malheiros, Y., and Freitas, F. (2021, November 09). A Method to Develop Description Logic Ontologies Iteratively Based on Competency Questions: An Implementation. ONTOBRAS 2013, 142\u2013153. Available online: http:\/\/citeseerx.ist.psu.edu\/viewdoc\/download?doi=10.1.1.403.2087&rep=rep1&type=pdf#page=142."},{"key":"ref_30","unstructured":"Noy, N.F., and McGuinness, D.L. (2001). Ontology Development 101: A Guide to Creating Your First Ontology, Stanford University. Technical Report KSL-01-05 and SMI-2001-0880, Stanford Knowledge Systems Laboratory and Stanford Medical Informatics."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Su\u00e1rez-Figueroa, M.C., G\u00f3mez-P\u00e9rez, A., Motta, E., and Gangemi, A. (2012). The NeOn Methodology for Ontology Engineering. Ontology Engineering in a Networked World, Springer.","DOI":"10.1007\/978-3-642-24794-1"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1145\/2757001.2757003","article-title":"The prot\u00e9g\u00e9 project: A look back and a look forward","volume":"1","author":"Musen","year":"2015","journal-title":"AI Matters"},{"key":"ref_33","unstructured":"Brank, J., Grobelnik, M., and Mladeni\u0107, D. (2005, January 22\u201326). A survey of ontology evaluation techniques. Proceedings of the Conference on Data Mining and Data Warehouses, Houston, TX, USA."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"163","DOI":"10.1016\/j.jbi.2010.07.006","article-title":"Natural Language Processing methods and systems for biomedical ontology learning","volume":"44","author":"Liu","year":"2011","journal-title":"J. Biomed. Inform."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Velardi, P., Fabriani, P., and Missikoff, M. (2001, January 17\u201319). Using text processing techniques to automatically enrich a domain ontology. Proceedings of the International Conference on Formal Ontology in Information Systems-Volume 2001, Ogunquit, ME, USA.","DOI":"10.1145\/505168.505194"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Naik, M.P. (2015, January 5\u20137). A Survey on Semantic Document Clustering. Proceedings of the Electrical, Computer and Communication Technologies (ICECCT), Coimbatore, India.","DOI":"10.1109\/ICECCT.2015.7226036"},{"key":"ref_37","unstructured":"Gr\u00fcninger, M., and Fox, M.S. (1995, January 19\u201320). Methodology for the Design and Evaluation of Ontologies; (In Proceedings of the Workshop on Basic Ontological Issues in Knowledge Sharing, IJCAI-95, Montreal. Proceedings of the Workshop on Basic Ontological Issues in Knowledge Sharing (IJCAI-95), Montreal, QC, USA. Available online: http:\/\/citeseerx.ist.psu.edu\/viewdoc\/citations?doi=10.1.1.44.8723."},{"key":"ref_38","first-page":"53","article-title":"The State of the Art in Ontology Design","volume":"18","author":"Hafner","year":"1997","journal-title":"AI Mag."},{"key":"ref_39","unstructured":"(2021, November 09). Stanford Center for Biomedical Informatics Research, Stanford University School of Medicine. Available online: https:\/\/protege.stanford.edu\/products.php."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Audich, D.A., Dara, R., and Nonnecke, B. (2016, January 19\u201321). Extracting keyword and keyphrase from online privacy policies. Proceedings of the 2016 Eleventh International Conference on Digital Information Management (ICDIM), Porto, Portugal.","DOI":"10.1109\/ICDIM.2016.7829792"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Guntamukkala, N., Dara, R., and Grewal, G. (2015, January 9\u201311). A Machine-Learning Based Approach for Measuring the Completeness of Online Privacy Policies. Proceedings of the 2015 IEEE 14th International Conference on Machine Learning and Applications (ICMLA), Miami, FL, USA.","DOI":"10.1109\/ICMLA.2015.143"},{"key":"ref_42","unstructured":"(2021, November 09). OECD Guidelines on the Protection of Privacy and Transborder Flows of Personal Data. Available online: https:\/\/www.oecd.org\/internet\/ieconomy\/oecdguidelinesontheprotectionofprivacyandtransborderflowsofpersonaldata.htm#part2."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"292","DOI":"10.1007\/11814771_26","article-title":"FaCT++ description logic reasoner: System description","volume":"4130","author":"Tsarkov","year":"2006","journal-title":"Autom. Reason."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"245","DOI":"10.1007\/s10817-014-9305-1","article-title":"HermiT: An OWL 2 Reasoner","volume":"53","author":"Glimm","year":"2014","journal-title":"J. Autom. Reason."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"51","DOI":"10.1016\/j.websem.2007.03.004","article-title":"Pellet: A practical OWL-DL reasoner","volume":"5","author":"Sirin","year":"2007","journal-title":"Web Semant. Sci. Serv. Agents World Wide Web"}],"container-title":["Digital"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2673-6470\/1\/4\/15\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T07:33:45Z","timestamp":1760168025000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2673-6470\/1\/4\/15"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,11,22]]},"references-count":45,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2021,12]]}},"alternative-id":["digital1040015"],"URL":"https:\/\/doi.org\/10.3390\/digital1040015","relation":{},"ISSN":["2673-6470"],"issn-type":[{"type":"electronic","value":"2673-6470"}],"subject":[],"published":{"date-parts":[[2021,11,22]]}}}