{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,11]],"date-time":"2026-03-11T05:42:20Z","timestamp":1773207740056,"version":"3.50.1"},"reference-count":58,"publisher":"MDPI AG","issue":"23","license":[{"start":{"date-parts":[[2021,11,23]],"date-time":"2021-11-23T00:00:00Z","timestamp":1637625600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Applied Sciences"],"abstract":"<jats:p>Since there are growing concerns regarding online privacy, firms may have the risk of being involved in various privacy infringement cases resulting in legal causations. If firms are aware of consequences from possible cases of invasion of online privacy, they can more actively prevent future online privacy infringements. Thus, this study attempts to predict the probability of judgment types caused by various invasions within US judicial cases that are related to online privacy invasions. Since legal judgment results are significantly influenced by societal factors and technological development, this study tries to identify a model that can accurately predict legal judgment with explainability. To archive the study objective, it compares the prediction performance by applying five types of classification algorithms (LDA, NNET, CART, SVM, and random forest) of machine learning. We also examined the relationship between privacy infringement factors and adjudications by applying network text analysis. The results indicate that firms could have a high possibility of both civil and criminal law responsibilities if they distributed malware or spyware, intentionally or non-intentionally, to collect unauthorized data. It addresses the needs of reflecting both quantitative and qualitative approach for establishing automatic legal systems for improving its accuracy based on the socio-technical perspective.<\/jats:p>","DOI":"10.3390\/app112311080","type":"journal-article","created":{"date-parts":[[2021,11,24]],"date-time":"2021-11-24T02:46:08Z","timestamp":1637721968000},"page":"11080","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":14,"title":["AI Model for Predicting Legal Judgments to Improve Accuracy and Explainability of Online Privacy Invasion Cases"],"prefix":"10.3390","volume":"11","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1268-2056","authenticated-orcid":false,"given":"Minjung","family":"Park","sequence":"first","affiliation":[{"name":"Ewha School of Business, Ewha Womans University, 52 Ewhayeodae-gil, Seodaemun-gu, Seoul 03760, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sangmi","family":"Chai","sequence":"additional","affiliation":[{"name":"Ewha School of Business, Ewha Womans University, 52 Ewhayeodae-gil, Seodaemun-gu, Seoul 03760, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,11,23]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"143","DOI":"10.14257\/jse.2016.04.05","article-title":"A Study of Personal Information Handler Based on Social Network Analysis","volume":"13","author":"Kim","year":"2016","journal-title":"J. Secur. Eng."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Kelbert, F., Shirazi, F., Simo, H., W\u00fcchner, T., Buchmann, J., Pretschner, A., and Waidner, M. (2012). State of online privacy: A technical perspective. Internet Privacy, Springer.","DOI":"10.1007\/978-3-642-31943-3_4"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1177\/0539018403042001798","article-title":"Knowledge graphs and network text analysis","volume":"42","author":"Popping","year":"2003","journal-title":"Soc. Sci. Inf."},{"key":"ref_4","first-page":"309","article-title":"Computer models for legal prediction","volume":"46","author":"Ashley","year":"2006","journal-title":"Jurimetrics"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"125","DOI":"10.1007\/s10506-009-9077-9","article-title":"Automatically classifying case texts and predicting outcomes","volume":"17","author":"Ashley","year":"2009","journal-title":"Artif. Intell. Law"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Bruninghaus, S., and Ashley, K.D. (2003, January 24\u201328). Predicting Outcomes of Case Based Legal Arguments. Proceedings of the 9th International Conference on Artificial Intelligence and Law, Scotland, UK.","DOI":"10.1145\/1047788.1047838"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"213","DOI":"10.1007\/s10506-020-09273-1","article-title":"Scalable and explainable legal prediction","volume":"29","author":"Branting","year":"2021","journal-title":"Artif. Intell. Law"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"2249","DOI":"10.1016\/j.csda.2007.08.015","article-title":"Empirical characterization of random forest variable importance measures","volume":"52","author":"Archer","year":"2008","journal-title":"Comput. Stat. Data Anal."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"379","DOI":"10.1007\/s10506-005-4160-3","article-title":"Using NLP techniques to identify legal ontology components: Concepts and relations","volume":"12","author":"Lame","year":"2004","journal-title":"Artif. Intell. Law"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"220","DOI":"10.1016\/j.ins.2021.01.004","article-title":"A Blockchain-based approach for matching desired and real privacy settings of social network users","volume":"557","author":"Lax","year":"2021","journal-title":"Inf. Sci."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1615","DOI":"10.1016\/j.phpro.2012.02.238","article-title":"Intrusion detection technology research based on apriori algorithm","volume":"24","author":"Hanguang","year":"2012","journal-title":"Phys. Procedia"},{"key":"ref_12","unstructured":"Hofmann, T., Lucchi, A., Lacoste-Julien, S., and McWilliams, B. (2015). Variance reduced stochastic gradient descent with neighbors. arXiv."},{"key":"ref_13","first-page":"993","article-title":"Latent dirichlet allocation","volume":"3","author":"Blei","year":"2003","journal-title":"J. Mach. Learn. Res."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"71","DOI":"10.1016\/j.knosys.2016.03.004","article-title":"Hierarchical anonymization algorithms against background knowledge attack in data releasing","volume":"101","author":"Amiri","year":"2016","journal-title":"Knowl.-Based Syst."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1418","DOI":"10.1109\/TIFS.2017.2663337","article-title":"Individual differential privacy: A utility-preserving formulation of differential privacy guarantees","volume":"12","year":"2017","journal-title":"IEEE Trans. Inf. Forensics Secur."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Kotsogiannis, I., Machanavajjhala, A., Hay, M., and Miklau, G. (2017, January 14\u201319). Pythia: Data Dependent Differentially Private Algorithm Selection. Proceedings of the 2017 ACM International Conference on Management of Data, Chicago, IL, USA.","DOI":"10.1145\/3035918.3035945"},{"key":"ref_17","unstructured":"Lundmark, M., and Dahlman, C.-J. (2021, November 16). Differential privacy and machine learning: Calculating sensitivity with generated data sets. Comput. Sci., Available online: https:\/\/kth.diva-portal.org\/smash\/get\/diva2:1112478\/FULLTEXT01.pdf."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"211","DOI":"10.1561\/0400000042","article-title":"The algorithmic foundations of differential privacy","volume":"9","author":"Dwork","year":"2014","journal-title":"Found. Trends Theor. Comput. Sci."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Aggarwal, C.C., and Philip, S.Y. (2008). A general survey of privacy-preserving data mining models and algorithms. Privacy-Preserving Data Mining, Springer.","DOI":"10.1007\/978-0-387-70992-5"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Dong, B., Liu, R., and Wang, W.H. (2014, January 3\u20137). Prada: Privacy-Preserving Data-Deduplication-as-a-Service. Proceedings of the 23rd ACM International Conference on Conference on Information and Knowledge Management, Shanghai, China.","DOI":"10.1145\/2661829.2661863"},{"key":"ref_21","unstructured":"Yi, X., Rao, F.-Y., Bertino, E., and Bouguettaya, A. (April, January 17). Privacy-Preserving Association Rule Mining in Cloud Computing. Proceedings of the 10th ACM Symposium on Information, Computer and Communications Security, Singapore."},{"key":"ref_22","first-page":"797","article-title":"Open access in a closed universe: Lexis, Westlaw, law schools, and the legal information market","volume":"10","author":"Arewa","year":"2006","journal-title":"Lewis Clark Law Rev."},{"key":"ref_23","first-page":"257","article-title":"E-Commerce Law and the Prospects for Uniform E-Commerce Rules on the Privacy and Security of Electronic Communications","volume":"33","author":"Takasugi","year":"2016","journal-title":"Ariz. J. Int. Comp. Law"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Valdes, A., and Skinner, K. (2000). Adaptive, Model-Based Monitoring for Cyber Attack Detection. International Workshop on Recent Advances in Intrusion Detection, Springer.","DOI":"10.1007\/3-540-39945-3_6"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s12911-018-0724-5","article-title":"The state of research on cyberattacks against hospitals and available best practice recommendations: A scoping review","volume":"19","author":"Argaw","year":"2019","journal-title":"BMC Med Inform. Decis. Mak."},{"key":"ref_26","first-page":"49","article-title":"A content analysis of journal articles using the language network analysis methods","volume":"31","author":"Lee","year":"2014","journal-title":"J. Korean Soc. Inf. Manag."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/1756-0500-4-299","article-title":"Data mining methods in the prediction of Dementia: A real-data comparison of the accuracy, sensitivity and specificity of linear discriminant analysis, logistic regression, neural networks, support vector machines, classification trees and random forests","volume":"4","author":"Maroco","year":"2011","journal-title":"BMC Res. Notes"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"67","DOI":"10.1093\/esr\/jcp006","article-title":"Logistic regression: Why we cannot do what we think we can do, and what we can do about it","volume":"26","author":"Mood","year":"2010","journal-title":"Eur. Sociol. Rev."},{"key":"ref_29","first-page":"2520","article-title":"Dynamical behavior of computer virus on Internet","volume":"217","author":"Han","year":"2010","journal-title":"Appl. Math. Comput."},{"key":"ref_30","unstructured":"Alpaydin, E. (2020). Introduction to Machine Learning, MIT Press."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Haupt, S.E., Cowie, J., Linden, S., McCandless, T., Kosovic, B., and Alessandrini, S. (November, January 29). Machine learning for applied weather prediction. Proceedings of the 2018 IEEE 14th International Conference on e-Science (e-Science), IEEE, Amsterdam, The Netherlands.","DOI":"10.1109\/eScience.2018.00047"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"671","DOI":"10.1007\/s10844-013-0279-y","article-title":"A naive Bayes probability estimation model based on self-adaptive differential evolution","volume":"42","author":"Wu","year":"2014","journal-title":"J. Intell. Inf. Syst."},{"key":"ref_33","first-page":"1089","article-title":"No unbiased estimator of the variance of k-fold cross-validation","volume":"5","author":"Bengio","year":"2004","journal-title":"J. Mach. Learn. Res."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"7941","DOI":"10.1007\/s00500-018-3424-2","article-title":"An efficient hybrid multilayer perceptron neural network with grasshopper optimization","volume":"23","author":"Heidari","year":"2019","journal-title":"Soft Comput."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Anderson, J. (1995). An Introduction to Neural Networks, MIT Press.","DOI":"10.7551\/mitpress\/3905.001.0001"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"217","DOI":"10.1080\/01431160412331269698","article-title":"Random forest classifier for remote sensing classification","volume":"26","author":"Pal","year":"2005","journal-title":"Int. J. Remote Sens."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"293","DOI":"10.1023\/A:1018628609742","article-title":"Least squares support vector machine classifiers","volume":"9","author":"Suykens","year":"1999","journal-title":"Neural Process. Lett."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Padmanabhan, B., Zheng, Z., and Kimbrough, S.O. (2006). An empirical analysis of the value of complete information for eCRM models. Mis Q., 247\u2013267.","DOI":"10.2307\/25148730"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Padmanabhan, B., Zheng, Z., and Kimbrough, S.O. (2001, January 26\u201329). Personalization from incomplete data: What you don\u2019t know can hurt. Proceedings of the Seventh ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Francisco, CA, USA.","DOI":"10.1145\/502512.502535"},{"key":"ref_40","first-page":"1137","article-title":"Rule-based classification systems using classification and regression tree (CART) analysis","volume":"67","author":"Lawrence","year":"2001","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"65","DOI":"10.1016\/j.eswa.2005.01.006","article-title":"A comparative predictive analysis of neural networks (NNs), nonlinear regression and classification and regression tree (CART) models","volume":"29","author":"Razi","year":"2005","journal-title":"Expert Syst. Appl."},{"key":"ref_42","unstructured":"Tsoi, A.C., and Pearson, R. (1991). Comparison of Three Classification Techniques: CART, C4. 5 and Multi-Layer Perceptrons. Advances in Neural Information Processing Systems, Kaufmann."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"717","DOI":"10.1016\/S0360-8352(98)00099-0","article-title":"A rule induction approach for determining the number of kanbans in a just-in-time production system","volume":"34","author":"Markham","year":"1998","journal-title":"Comput. Ind. Eng."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"273","DOI":"10.1007\/BF00994018","article-title":"Support-vector networks","volume":"20","author":"Cortes","year":"1995","journal-title":"Mach. Learn."},{"key":"ref_45","unstructured":"Pal, S.K., and Wang, P.P. (1996). Genetic Algorithms for Pattern Recognition, CRC Press."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Wang, C., and Jin, X. (2020, January 23\u201326). Study on Prediction of Legal Judgments Based on the CNN-BiGRU Model. Proceedings of the 2020 6th International Conference on Computing and Artificial Intelligence, Tianjin, China.","DOI":"10.1145\/3404555.3404573"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1023\/A:1010933404324","article-title":"Random forests","volume":"45","author":"Breiman","year":"2001","journal-title":"Mach. Learn."},{"key":"ref_48","first-page":"18","article-title":"Classification and regression by randomForest","volume":"2","author":"Liaw","year":"2002","journal-title":"R News"},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"D\u00edaz-Uriarte, R., and De Andres, S.A. (2006). Gene selection and classification of microarray data using random forest. BMC Bioinform., 7.","DOI":"10.1186\/1471-2105-7-3"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"1509","DOI":"10.1093\/bioinformatics\/bti171","article-title":"Optimal number of features as a function of sample size for various classification rules","volume":"21","author":"Hua","year":"2005","journal-title":"Bioinformatics"},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"696","DOI":"10.1111\/poms.12819","article-title":"The forest or the trees? Tackling Simpson\u2019s paradox with classification trees","volume":"27","author":"Shmueli","year":"2018","journal-title":"Prod. Oper. Manag."},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Caball\u00e9-Cervig\u00f3n, N., Castillo-Sequera, J.L., G\u00f3mez-Pulido, J.A., G\u00f3mez-Pulido, J.M., and Polo-Luque, M.L. (2020). Machine learning applied to diagnosis of human diseases: A systematic review. Appl. Sci., 10.","DOI":"10.3390\/app10155135"},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Wasserman, S., and Faust, K. (1994). Social Network Analysis: Methods and Applications, Cambridge University Press.","DOI":"10.1017\/CBO9780511815478"},{"key":"ref_54","unstructured":"Sowa, J.F. (1984). Conceptual Structures: Information Processing in Mind and Machine, Addison-Wesley Longman Publishing Co. Inc."},{"key":"ref_55","unstructured":"Wellman, B., and Berkowitz, S.D. (1988). Social Structures: A Network Approach, CUP Archive."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"1131","DOI":"10.1016\/j.tourman.2008.02.010","article-title":"Network effects on cooperation in destination website development","volume":"29","author":"Bhat","year":"2008","journal-title":"Tour. Manag."},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"1024","DOI":"10.1093\/aje\/kwi308","article-title":"Infection in social networks: Using network analysis to identify high-risk individuals","volume":"162","author":"Christley","year":"2005","journal-title":"Am. J. Epidemiol."},{"key":"ref_58","unstructured":"Gunning, D. (2016). Broad Agency Announcement Explainable Artificial Intelligence (XAI), Defense Advanced Research Projects Agency. Technical Report."}],"container-title":["Applied Sciences"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2076-3417\/11\/23\/11080\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T07:34:28Z","timestamp":1760168068000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2076-3417\/11\/23\/11080"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,11,23]]},"references-count":58,"journal-issue":{"issue":"23","published-online":{"date-parts":[[2021,12]]}},"alternative-id":["app112311080"],"URL":"https:\/\/doi.org\/10.3390\/app112311080","relation":{},"ISSN":["2076-3417"],"issn-type":[{"value":"2076-3417","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,11,23]]}}}