{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,1]],"date-time":"2026-05-01T17:41:03Z","timestamp":1777657263648,"version":"3.51.4"},"reference-count":123,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2017,7,3]],"date-time":"2017-07-03T00:00:00Z","timestamp":1499040000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["MAKE"],"abstract":"<jats:p>The grand goal of Machine Learning is to develop software which can learn from previous experience\u2014similar to how we humans do. Ultimately, to reach a level of usable intelligence, we need (1) to learn from prior data, (2) to extract knowledge, (3) to generalize\u2014i.e., guessing where probability function mass\/density concentrates, (4) to fight the curse of dimensionality, and (5) to disentangle underlying explanatory factors of the data\u2014i.e., to make sense of the data in the context of an application domain. To address these challenges and to ensure successful machine learning applications in various domains an integrated machine learning approach is important. This requires a concerted international effort without boundaries, supporting collaborative, cross-domain, interdisciplinary and transdisciplinary work of experts from seven sections, ranging from data pre-processing to data visualization, i.e., to map results found in arbitrarily high dimensional spaces into the lower dimensions to make it accessible, usable and useful to the end user. An integrated machine learning approach needs also to consider issues of privacy, data protection, safety, security, user acceptance and social implications. This paper is the inaugural introduction to the new journal of MAchine Learning &amp; Knowledge Extraction (MAKE). The goal is to provide an incomplete, personally biased, but consistent introduction into the concepts of MAKE and a brief overview of some selected topics to stimulate future research in the international research community.<\/jats:p>","DOI":"10.3390\/make1010001","type":"journal-article","created":{"date-parts":[[2017,7,3]],"date-time":"2017-07-03T10:27:31Z","timestamp":1499077651000},"page":"1-20","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":52,"title":["Introduction to MAchine Learning &amp; Knowledge Extraction (MAKE)"],"prefix":"10.3390","volume":"1","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6786-5194","authenticated-orcid":false,"given":"Andreas","family":"Holzinger","sequence":"first","affiliation":[{"name":"Holzinger Group, HCI-KDD, Institute for Medical Informatics &amp; Statistics, Medical University Graz, Auenbruggerplatz 2\/V, 8036 Graz, Austria"}]}],"member":"1968","published-online":{"date-parts":[[2017,7,3]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"36","DOI":"10.1145\/3052935","article-title":"Making money using math","volume":"60","author":"Meijer","year":"2017","journal-title":"Commun. ACM"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Pearl, J. (1988). Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference, Morgan Kaufmann.","DOI":"10.1016\/B978-0-08-051489-5.50008-4"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"85","DOI":"10.1016\/j.neunet.2014.09.003","article-title":"Deep learning in neural networks: An overview","volume":"61","author":"Schmidhuber","year":"2015","journal-title":"Neural Netw."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"436","DOI":"10.1038\/nature14539","article-title":"Deep learning","volume":"521","author":"LeCun","year":"2015","journal-title":"Nature"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"264","DOI":"10.1137\/1116025","article-title":"On the Uniform Convergence of Relative Frequencies of Events to Their Probabilities","volume":"16","author":"Vapnik","year":"1971","journal-title":"Theory Probab. Appl."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Bousquet, O., von Luxburg, U., and Raetsch, G. (2004). Introduction to Statistical Learning Theory. Advanced Lectures on Machine Learning, Springer.","DOI":"10.1007\/b100712"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Hastie, T., Tibshirani, R., and Friedman, J. (2009). The Elements of Statistical Learning: Data Mining, Inference, and Prediction, Springer. [2nd ed.].","DOI":"10.1007\/978-0-387-84858-7"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"370","DOI":"10.1098\/rstl.1763.0053","article-title":"An Essay towards solving a Problem in the Doctrine of Chances (communicated by Richard Price)","volume":"53","author":"Bayes","year":"1763","journal-title":"Philos. Trans."},{"key":"ref_9","first-page":"227","article-title":"M\u00e9moire sur les probabilit\u00e9s","volume":"1778","author":"Laplace","year":"1781","journal-title":"M\u00e9moires de l\u2019Acad\u00e9mie Royale des sciences de Paris"},{"key":"ref_10","first-page":"3","article-title":"Interpolation und extrapolation von stationaeren zufaelligen Folgen","volume":"5","author":"Kolmogorov","year":"1941","journal-title":"Izv. Akad. Nauk SSSR Ser. Mat."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Rasmussen, C.E., and Williams, C.K. (2006). Gaussian Processes for Machine Learning, MIT Press.","DOI":"10.7551\/mitpress\/3206.001.0001"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"712","DOI":"10.1016\/j.tins.2004.10.007","article-title":"The Bayesian brain: The role of uncertainty in neural coding and computation","volume":"27","author":"Knill","year":"2004","journal-title":"Trends Neurosci."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"287","DOI":"10.1016\/j.tics.2006.05.007","article-title":"Probabilistic models of cognition: Conceptual foundations","volume":"10","author":"Chater","year":"2006","journal-title":"Trends Cogn. Sci."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Doya, K., Ishii, S., Pouget, A., and Rao, R. (2007). Bayesian Brain: Probabilistic Approaches to Neural Coding, MIT Press.","DOI":"10.7551\/mitpress\/9780262042383.001.0001"},{"key":"ref_15","unstructured":"Wood, F., van de Meent, J.-W., and Mansinghka, V. (2014, January 22\u201325). A new approach to probabilistic programming inference. Proceedings of the 17th International Conference on Artificial Intelligence and Statistics (AISTATS) 2014, Reykjavik, Iceland."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"e55","DOI":"10.7717\/peerj-cs.55","article-title":"Probabilistic programming in Python using PyMC3","volume":"2","author":"Salvatier","year":"2016","journal-title":"PeerJ Comput. Sci."},{"key":"ref_17","unstructured":"Gordon, A.D., Henzinger, T.A., Nori, A.V., and Rajamani, S.K. (June, January 31). Probabilistic programming. Proceedings of the on Future of Software Engineering, Hyderabad, India."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"210","DOI":"10.1147\/rd.33.0210","article-title":"Some studies in machine learning using the game of checkers","volume":"3","author":"Samuel","year":"1959","journal-title":"IBM J. Res. Dev."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1279","DOI":"10.1126\/science.1192788","article-title":"How to grow a mind: Statistics, structure, and abstraction","volume":"331","author":"Tenenbaum","year":"2011","journal-title":"Science"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1297","DOI":"10.1126\/science.1170411","article-title":"Beyond the Data Deluge","volume":"323","author":"Bell","year":"2009","journal-title":"Science"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"255","DOI":"10.1126\/science.aaa8415","article-title":"Machine learning: Trends, perspectives, and prospects","volume":"349","author":"Jordan","year":"2015","journal-title":"Science"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1527","DOI":"10.1162\/neco.2006.18.7.1527","article-title":"A fast learning algorithm for deep belief nets","volume":"18","author":"Hinton","year":"2006","journal-title":"Neural Comput."},{"key":"ref_23","unstructured":"Henke, N., Bughin, J., Chui, M., Manyika, J., Saleh, T., Wiseman, B., and Sethupathy, G. (2016). The Age of Analytics: Competing in a Data-Driven World, Mckinsey Company."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Holzinger, A., Dehmer, M., and Jurisica, I. (2014). Knowledge Discovery and interactive Data Mining in Bioinformatics\u2014State-of-the-Art, future challenges and research directions. BMC Bioinform., 15.","DOI":"10.1186\/1471-2105-15-S6-I1"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Michaelis, S., Piatkowski, N., and Stolpe, M. (2016). Knowledge Discovery from Complex High Dimensional Data. Solving Large Scale Learning Tasks. Challenges and Algorithms, Lecture Notes in Artificial Intelligence, LNAI 9580, Springer.","DOI":"10.1007\/978-3-319-41706-6"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Simovici, D.A., and Djeraba, C. (2014). Mathematical Tools for Data Mining, Springer.","DOI":"10.1007\/978-1-4471-6407-4"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Jaynes, E.T. (2003). Probability Theory: The Logic of Science, Cambridge University Press.","DOI":"10.1017\/CBO9780511790423"},{"key":"ref_28","first-page":"1","article-title":"Bayesian non-parametrics and the probabilistic approach to modelling","volume":"371","author":"Ghahramani","year":"2013","journal-title":"Philos. Trans. R. Soc. A Math. Phys. Eng. Sci."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"452","DOI":"10.1038\/nature14541","article-title":"Probabilistic machine learning and artificial intelligence","volume":"521","author":"Ghahramani","year":"2015","journal-title":"Nature"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"1798","DOI":"10.1109\/TPAMI.2013.50","article-title":"Representation learning: A review and new perspectives","volume":"35","author":"Bengio","year":"2013","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_31","first-page":"2611","article-title":"pyGPs: A Python library for Gaussian process regression and classification","volume":"16","author":"Neumann","year":"2015","journal-title":"J. Mach. Learn. Res."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"409","DOI":"10.1023\/A:1009868929893","article-title":"The Role of Occam\u2019s Razor in Knowledge Discovery","volume":"3","author":"Domingos","year":"1999","journal-title":"Data Min. Knowl. Discov."},{"key":"ref_33","unstructured":"Wilson, A.G., Dann, C., Lucas, C.G., and Xing, E.P. (arXiv, 2015). The Human Kernel, arXiv."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"148","DOI":"10.1109\/JPROC.2015.2494218","article-title":"Taking the human out of the loop: A review of Bayesian optimization","volume":"104","author":"Shahriari","year":"2016","journal-title":"Proc. IEEE"},{"key":"ref_35","first-page":"1531","article-title":"Large scale multiple kernel learning","volume":"7","author":"Sonnenburg","year":"2006","journal-title":"J. Mach. Learn. Res."},{"key":"ref_36","unstructured":"Holzinger, A. (2012). Biomedical Informatics: Computational Sciences Meets Life Sciences, BoD."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"1171","DOI":"10.1214\/009053607000000677","article-title":"Kernel methods in machine learning","volume":"36","author":"Hofmann","year":"2008","journal-title":"Ann. Stat."},{"key":"ref_38","first-page":"553","article-title":"Modeling human function learning with Gaussian processes","volume":"Volume 21","author":"Koller","year":"2009","journal-title":"Advances in Neural Information Processing Systems (NIPS 2008)"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1007\/s40708-016-0042-6","article-title":"Interactive Machine Learning for Health Informatics: When do we need the human-in-the-loop?","volume":"3","author":"Holzinger","year":"2016","journal-title":"Brain Inform."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Holzinger, A., Plass, M., Holzinger, K., Crisan, G.C., Pintea, C.M., and Palade, V. (2016). Towards interactive Machine Learning (iML): Applying Ant Colony Algorithms to solve the Traveling Salesman Problem with the Human-in-the-Loop approach. Springer Lecture Notes in Computer Science LNCS 9817, Springer.","DOI":"10.1007\/978-3-319-45507-5_6"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"423","DOI":"10.1089\/cmb.1998.5.423","article-title":"On the complexity of protein folding","volume":"5","author":"Crescenzi","year":"1998","journal-title":"J. Comput. Biol."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"527","DOI":"10.3758\/BF03213088","article-title":"Human performance on the traveling salesman problem","volume":"58","author":"Macgregor","year":"1996","journal-title":"Percept. Psychophys."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"70","DOI":"10.1016\/j.ijar.2007.03.013","article-title":"Clustering and visualization approaches for human cell cycle gene expression data analysis","volume":"47","author":"Napolitano","year":"2008","journal-title":"Int. J. Approx. Reason."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"589","DOI":"10.1093\/bioinformatics\/btk026","article-title":"A multi-step approach to time series analysis and gene expression clustering","volume":"22","author":"Amato","year":"2006","journal-title":"Bioinformatics"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"111","DOI":"10.1006\/cviu.1999.0768","article-title":"ASSERT: A Physician-in-the-Loop Content-Based Retrieval System for HRCT Image Databases","volume":"75","author":"Shyu","year":"1999","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"36","DOI":"10.1109\/MC.2013.31","article-title":"The future of human-in-the-loop cyber-physical systems","volume":"46","author":"Schirner","year":"2013","journal-title":"Computer"},{"key":"ref_47","unstructured":"Pereira, F., Burges, C.J., Bottou, L., and Weinberger, K.Q. (2012). Imagenet classification with deep convolutional neural networks. Advances in Neural Information Processing Systems (NIPS 2012), NIPS."},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Mikolov, T., Deoras, A., Povey, D., Burget, L., and Cernocky, J. (2011, January 11\u201315). Strategies for training large scale neural network language models. Proceedings of the IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU 2011), Waikoloa, HI, USA.","DOI":"10.1109\/ASRU.2011.6163930"},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"168","DOI":"10.1038\/nature12346","article-title":"Connectomic reconstruction of the inner plexiform layer in the mouse retina","volume":"500","author":"Helmstaedter","year":"2013","journal-title":"Nature"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"i121","DOI":"10.1093\/bioinformatics\/btu277","article-title":"Deep learning of the tissue-regulated splicing code","volume":"30","author":"Leung","year":"2014","journal-title":"Bioinformatics"},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Bar, Y., Diamant, I., Wolf, L., and Greenspan, H. (2015, January 21\u201326). Deep learning with non-medical training used for chest pathology identification. Proceedings of the Medical Imaging 2015: Computer-Aided Diagnosis, Orlando, FL, USA.","DOI":"10.1117\/12.2083124"},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"1299","DOI":"10.1109\/TMI.2016.2535302","article-title":"Convolutional Neural Networks for Medical Image Analysis: Full Training or Fine Tuning?","volume":"35","author":"Tajbakhsh","year":"2016","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Holzinger, A. (2016). Deep learning trends for focal brain pathology segmentation in MRI. Machine Learning for Health Informatics, Springer.","DOI":"10.1007\/978-3-319-50478-0"},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"431","DOI":"10.1038\/nphys4035","article-title":"Machine learning phases of matter","volume":"13","author":"Carrasquilla","year":"2017","journal-title":"Nat. Phys."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"529","DOI":"10.1038\/nature14236","article-title":"Human-level control through deep reinforcement learning","volume":"518","author":"Mnih","year":"2015","journal-title":"Nature"},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"484","DOI":"10.1038\/nature16961","article-title":"Mastering the game of Go with deep neural networks and tree search","volume":"529","author":"Silver","year":"2016","journal-title":"Nature"},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"451","DOI":"10.1146\/annurev-psych-120709-145346","article-title":"Heuristic Decision Making","volume":"62","author":"Gigerenzer","year":"2011","journal-title":"Annu. Rev. Psychol."},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"77","DOI":"10.31887\/DCNS.2012.14.1\/jmarewski","article-title":"Heuristic decision making in medicine","volume":"14","author":"Marewski","year":"2012","journal-title":"Dialogues Clin. Neurosci."},{"key":"ref_59","doi-asserted-by":"crossref","unstructured":"Pearl, J. (2009). Causality: Models, Reasoning, and Inference, Cambridge University Press. [2nd ed.].","DOI":"10.1017\/CBO9780511803161"},{"key":"ref_60","doi-asserted-by":"crossref","first-page":"3395","DOI":"10.1109\/TKDE.2016.2606428","article-title":"Bayesian deep learning: A framework and some existing methods","volume":"28","author":"Wang","year":"2016","journal-title":"IEEE Trans Knowl. Data Eng."},{"key":"ref_61","unstructured":"Gal, Y., and Ghahramani, Z. (2016, January 19\u201324). Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learning. Proceedings of the 33rd International Conference on Machine Learning (ICML), New York, NY, USA."},{"key":"ref_62","first-page":"106","article-title":"Catastrophic interference in connectionist networks: The sequential learning problem","volume":"Volume 24","author":"Bower","year":"1989","journal-title":"The Psychology of Learning and Motivation"},{"key":"ref_63","unstructured":"Goodfellow, I.J., Mirza, M., Xiao, D., Courville, A., and Bengio, Y. (arXiv, 2015). An empirical investigation of catastrophic forgeting in gradient-based neural networks, arXiv."},{"key":"ref_64","doi-asserted-by":"crossref","unstructured":"Lee, J., Kim, H., Lee, J., and Yoon, S. (arXiv, 2016). Intrinsic Geometric Information Transfer Learning on Multiple Graph-Structured Datasets, arXiv.","DOI":"10.1609\/aaai.v31i1.10904"},{"key":"ref_65","unstructured":"Henaff, M., Bruna, J., and LeCun, Y. (arXiv, 2015). Deep convolutional networks on graph-structured data, arXiv."},{"key":"ref_66","doi-asserted-by":"crossref","first-page":"156","DOI":"10.1007\/978-3-540-73255-6_14","article-title":"Ontology\u2014Supported Machine Learning and Decision Support in Biomedicine","volume":"Volume 4544","author":"Tannen","year":"2007","journal-title":"Data Integration in the Life Sciences"},{"key":"ref_67","doi-asserted-by":"crossref","unstructured":"Holzinger, A., and Jurisica, I. (2014). Knowledge Discovery and Data Mining in Biomedical Informatics: The future is in Integrative, Interactive Machine Learning Solutions. Lecture Notes in Computer Science LNCS 8401, Springer.","DOI":"10.1007\/978-3-662-43968-5_1"},{"key":"ref_68","unstructured":"Balcan, N., Blum, A., and Mansour, Y. (2013, January 16\u201321). Exploiting Ontology Structures and Unlabeled Data for Learning. Proceedings of the 30th International Conference on Machine Learning, Atlanta, GA, USA."},{"key":"ref_69","unstructured":"Carlson, A., Betteridge, J., Kisiel, B., Settles, B., Hruschka, E.R., and Mitchell, T.M. (2010, January 11\u201315). Toward an Architecture for Never-Ending Language Learning (NELL). Proceedings of the Twenty-Fourth AAAI Conference on Artificial Intelligence (AAAI-10), Atlanta, GA, USA."},{"key":"ref_70","first-page":"1157","article-title":"An introduction to variable and feature selection","volume":"3","author":"Guyon","year":"2003","journal-title":"J. Mach. Learn. Res."},{"key":"ref_71","unstructured":"Manning, C.D., and Schuetze, H. (1999). Foundations of Statistical Natural Language Processing, MIT Press."},{"key":"ref_72","doi-asserted-by":"crossref","first-page":"578","DOI":"10.1111\/j.1467-9280.2009.02335.x","article-title":"Using speakers\u2019 referential intentions to model early cross-situational word learning","volume":"20","author":"Frank","year":"2009","journal-title":"Psychol. Sci."},{"key":"ref_73","doi-asserted-by":"crossref","first-page":"818","DOI":"10.1016\/j.tics.2016.08.005","article-title":"Pragmatic language interpretation as probabilistic inference","volume":"20","author":"Goodman","year":"2016","journal-title":"Trends Cogn. Sci."},{"key":"ref_74","unstructured":"Rong, X. (arXiv, 2014). Word2vec parameter learning explained, arXiv."},{"key":"ref_75","unstructured":"Goldberg, Y., and Levy, O. (arXiv, 2014). word2vec Explained: deriving Mikolov et al.\u2019s negative-sampling word-embedding method, arXiv."},{"key":"ref_76","doi-asserted-by":"crossref","unstructured":"Wallach, H.M. (2006, January 25\u201329). Topic modeling: Beyond bag-of-words. Proceedings of the 23rd International Conference on Machine Learning (ICML), Pittsburgh, PA, USA.","DOI":"10.1145\/1143844.1143967"},{"key":"ref_77","unstructured":"Bottou, L., and Littman, M. (2009, January 14\u201318). Feature hashing for large scale multitask learning. Proceedings of the 26th Annual International Conference on Machine Learning (ICML 2009), Montreal, QC, Canada."},{"key":"ref_78","first-page":"147","article-title":"Automatic capacity tuning of very large VC-dimension classifiers","volume":"Volume 7","author":"Cowan","year":"1993","journal-title":"Proceedings of the 7th Advances in Neural Information Processing Systems Conference (NIPS 1993)"},{"key":"ref_79","first-page":"985","article-title":"Kronecker graphs: An approach to modeling networks","volume":"11","author":"Leskovec","year":"2010","journal-title":"J. Mach. Learn. Res."},{"key":"ref_80","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/2898361","article-title":"SNAP: A general-purpose network analysis and graph-mining library","volume":"8","author":"Leskovec","year":"2016","journal-title":"ACM Trans. Intell. Syst. Technol."},{"key":"ref_81","unstructured":"Wood, F., Meent, J.W., and Mansinghka, V. (2014, January 22\u201325). A new approach to probabilistic programming inference. Proceedings of the 17th International Conference on Artificial Intelligence and Statistics (AISTATS) 2014, Reykjavik, Iceland."},{"key":"ref_82","doi-asserted-by":"crossref","unstructured":"Malle, B., Kieseberg, P., Weippl, E., and Holzinger, A. (2016). The right to be forgotten: Towards Machine Learning on perturbed knowledge bases. Springer Lecture Notes in Computer Science LNCS 9817, Springer.","DOI":"10.1007\/978-3-319-45507-5_17"},{"key":"ref_83","first-page":"1305","article-title":"Robust process discovery with artificial negative events","volume":"10","author":"Goedertier","year":"2009","journal-title":"J. Mach. Learn. Res."},{"key":"ref_84","doi-asserted-by":"crossref","unstructured":"Doucet, A., De Freitas, N., and Gordon, N. (2001). An introduction to sequential Monte Carlo methods. Sequential Monte Carlo Methods in Practice, Springer.","DOI":"10.1007\/978-1-4757-3437-9"},{"key":"ref_85","unstructured":"Konecn\u00fd, J., McMahan, H.B., Ramage, D., and Richt\u00e1rik, P. (arXiv, 2016). Federated Optimization: Distributed Machine Learning for On-Device Intelligence, arXiv."},{"key":"ref_86","unstructured":"Bonawitz, K., Ivanov, V., Kreuter, B., Marcedone, A., McMahan, H.B., Patel, S., Ramage, D., Segal, A., and Seth, K. (arXiv, 2016). Practical Secure Aggregation for Federated Learning on User-Held Data, arXiv."},{"key":"ref_87","unstructured":"McMahan, B., Moore, E., Ramage, D., Hampson, S., and y Arcas, B.A. (2017, January 20\u201322). Communication-efficient learning of deep networks from decentralized data. Proceedings of the 20th International Conference on Artificial Intelligence and Statistics, Fort Lauderdale, FL, USA."},{"key":"ref_88","doi-asserted-by":"crossref","unstructured":"Leskovec, J., Singh, A., and Kleinberg, J. (2006). Patterns of influence in a recommendation network. Pacific-Asia Conference on Knowledge Discovery and Data Mining, Springer.","DOI":"10.1007\/11731139_44"},{"key":"ref_89","doi-asserted-by":"crossref","first-page":"1134","DOI":"10.1145\/1968.1972","article-title":"A theory of the learnable","volume":"27","author":"Valiant","year":"1984","journal-title":"Commun. ACM"},{"key":"ref_90","doi-asserted-by":"crossref","first-page":"149","DOI":"10.1613\/jair.731","article-title":"A model of inductive bias learning","volume":"12","author":"Baxter","year":"2000","journal-title":"J. Artif. Intell. Res."},{"key":"ref_91","doi-asserted-by":"crossref","unstructured":"Evgeniou, T., and Pontil, M. (2004, January 22\u201325). Regularized multi-task learning. Proceedings of the Tenth ACM SIGKDD International Conference On Knowledge Discovery and Data Mining, Seattle, WA, USA.","DOI":"10.1145\/1014052.1014067"},{"key":"ref_92","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1109\/5254.708428","article-title":"Support vector machines.","volume":"13","author":"Hearst","year":"1998","journal-title":"IEEE Intell. Syst. Appl."},{"key":"ref_93","first-page":"207","article-title":"Distance metric learning for large margin nearest neighbor classification","volume":"10","author":"Weinberger","year":"2009","journal-title":"J. Mach. Learn. Res."},{"key":"ref_94","unstructured":"Lafferty, J., Williams, C., Shawe-Taylor, J., Zemel, R., and Culotta, A. (2010). Large margin multi-task metric learning. Advances in Neural Information Processing Systems 23 (NIPS 2010), NIPS."},{"key":"ref_95","doi-asserted-by":"crossref","unstructured":"Kirkpatrick, J., Pascanu, R., Rabinowitz, N., Veness, J., Desjardins, G., Rusu, A.A., Milan, K., Quan, J., Ramalho, T., Grabska-Barwinska, A., Hassabis, D., Clopath, C., Kumaran, D., and Hadsell, R. (arXiv, 2016). Overcoming catastrophic forgetting in neural networks, arXiv.","DOI":"10.1073\/pnas.1611835114"},{"key":"ref_96","doi-asserted-by":"crossref","first-page":"1345","DOI":"10.1109\/TKDE.2009.191","article-title":"A Survey on Transfer Learning","volume":"22","author":"Pan","year":"2010","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"ref_97","first-page":"1633","article-title":"Transfer learning for reinforcement learning domains: A survey","volume":"10","author":"Taylor","year":"2009","journal-title":"J. Mach. Learn. Res."},{"key":"ref_98","first-page":"79","article-title":"Multiagent systems","volume":"19","author":"Sycara","year":"1998","journal-title":"AI Mag."},{"key":"ref_99","unstructured":"Lynch, N.A. (1996). Distributed Algorithms, Morgan Kaufmann."},{"key":"ref_100","doi-asserted-by":"crossref","first-page":"118","DOI":"10.1080\/01621459.1974.10480137","article-title":"Reaching a consensus","volume":"69","author":"DeGroot","year":"1974","journal-title":"J. Am. Stat. Assoc."},{"key":"ref_101","doi-asserted-by":"crossref","first-page":"688","DOI":"10.1109\/21.156582","article-title":"Consensus theoretic classification methods","volume":"22","author":"Benediktsson","year":"1992","journal-title":"IEEE Trans. Syst. Man Cybern."},{"key":"ref_102","doi-asserted-by":"crossref","first-page":"71","DOI":"10.1177\/0272989X9701700108","article-title":"Assessing rater performance without a gold standard using consensus theory","volume":"17","author":"Weller","year":"1997","journal-title":"Med. Decis. Mak."},{"key":"ref_103","doi-asserted-by":"crossref","first-page":"215","DOI":"10.1109\/JPROC.2006.887293","article-title":"Consensus and cooperation in networked multi-agent systems","volume":"95","author":"Fax","year":"2007","journal-title":"Proc. IEEE"},{"key":"ref_104","doi-asserted-by":"crossref","unstructured":"Roche, B., Guegan, J.F., and Bousquet, F. (2008). Multi-agent systems in epidemiology: A first step for computational biology in the study of vector-borne disease transmission. BMC Bioinform., 9.","DOI":"10.1186\/1471-2105-9-435"},{"key":"ref_105","first-page":"1789","article-title":"Collaborative multiagent reinforcement learning by payoff propagation","volume":"7","author":"Kok","year":"2006","journal-title":"J. Mach. Learn. Res."},{"key":"ref_106","unstructured":"Holzinger, A. (2016). Reasoning Under Uncertainty: Towards Collaborative Interactive Machine Learning. Machine Learning for Health Informatics: State-of-the-Art and Future Challenges, Springer."},{"key":"ref_107","unstructured":"Holzinger, A. (2011). Successful Management of Research and Development, BoD."},{"key":"ref_108","doi-asserted-by":"crossref","unstructured":"Holzinger, A. (2016). Machine Learning for Health Informatics. Machine Learning for Health Informatics: State-of-the-Art and Future Challenges, Lecture Notes in Artificial Intelligence LNAI 9605, Springer.","DOI":"10.1007\/978-3-319-50478-0"},{"key":"ref_109","doi-asserted-by":"crossref","first-page":"97","DOI":"10.1109\/MSP.2010.938752","article-title":"Adaptive Learning in a World of Projections","volume":"28","author":"Theodoridis","year":"2011","journal-title":"IEEE Signal Process. Mag."},{"key":"ref_110","doi-asserted-by":"crossref","first-page":"82","DOI":"10.1109\/MSP.2012.2205597","article-title":"Deep Neural Networks for Acoustic Modeling in Speech Recognition","volume":"29","author":"Hinton","year":"2012","journal-title":"IEEE Signal Process. Mag."},{"key":"ref_111","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1109\/MSP.2015.2481559","article-title":"Bayesian Machine Learning","volume":"33","author":"Wu","year":"2016","journal-title":"IEEE Signal Process. Mag."},{"key":"ref_112","unstructured":"Russell, S., Dietterich, T., Horvitz, E., Selman, B., Rossi, F., Hassabis, D., Legg, S., Suleyman, M., George, D., and Phoenix, S. (2017, June 25). Letter to the Editor: Research Priorities for Robust and Beneficial Artificial Intelligence: An Open Letter. Available online: https:\/\/www.bibsonomy.org\/bibtex\/2185f9c84cb3aef91e7bb82eeb4728ce0\/dblp."},{"key":"ref_113","first-page":"15","article-title":"Machine ethics: Creating an ethical intelligent agent","volume":"28","author":"Anderson","year":"2007","journal-title":"AI Mag."},{"key":"ref_114","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s10458-008-9047-8","article-title":"Introduction to the special issue on normative multiagent systems","volume":"17","author":"Boella","year":"2008","journal-title":"Auton. Agents Multi-Agent Syst."},{"key":"ref_115","doi-asserted-by":"crossref","first-page":"278","DOI":"10.1007\/s12559-015-9362-8","article-title":"Autonomous Agents and Ethical Decision-Making","volume":"8","author":"Cervantes","year":"2016","journal-title":"Cogn. Comput."},{"key":"ref_116","doi-asserted-by":"crossref","first-page":"24","DOI":"10.1038\/523024a","article-title":"The Robot\u2019s dilemma","volume":"523","author":"Deng","year":"2015","journal-title":"Nature"},{"key":"ref_117","doi-asserted-by":"crossref","first-page":"975","DOI":"10.1002\/spe.537","article-title":"Explaining code for publication","volume":"33","author":"Thimbleby","year":"2003","journal-title":"Softw. Pract. Exp."},{"key":"ref_118","first-page":"2443","article-title":"The need for open source software in machine learning","volume":"8","author":"Sonnenburg","year":"2007","journal-title":"J. Mach. Learn. Res."},{"key":"ref_119","doi-asserted-by":"crossref","unstructured":"Michalski, R.S., Carbonell, J.G., and Mitchell, T.M. (1983). Machine Learning: An Artificial Intelligence Approach, Springer.","DOI":"10.1007\/978-3-662-12405-5"},{"key":"ref_120","unstructured":"Holzinger, A. (2012, January 25\u201327). On Knowledge Discovery and Interactive Intelligent Visualization of Biomedical Data\u2014Challenges in Human\u2013Computer Interaction & Biomedical Informatics. Proceedings of the DATA 2012, International Conference on Data Technologies and Applications, Rome, Italy."},{"key":"ref_121","unstructured":"Cuzzocrea, A., Kittl, C., Simos, D.E., Weippl, E., and Xu, L. (2013). Human\u2014Computer Interaction and Knowledge Discovery (HCI-KDD): What is the benefit of bringing those two fields to work together?. Multidisciplinary Research and Practice for Information Systems, Springer Lecture Notes in Computer Science LNCS 8127, Springer."},{"key":"ref_122","first-page":"6","article-title":"Trends in Interactive Knowledge Discovery for Personalized Medicine: Cognitive Science meets Machine Learning","volume":"15","author":"Holzinger","year":"2014","journal-title":"IEEE Intell. Inform. Bull."},{"key":"ref_123","unstructured":"Kandel, E.R., Schwartz, J.H., Jessell, T.M., Siegelbaum, S.A., and Hudspeth, A. (2012). Principles of Neural Science, McGraw-Hill. [5th ed.]."}],"container-title":["Machine Learning and Knowledge Extraction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2504-4990\/1\/1\/1\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T18:41:18Z","timestamp":1760208078000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2504-4990\/1\/1\/1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,7,3]]},"references-count":123,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2019,3]]}},"alternative-id":["make1010001"],"URL":"https:\/\/doi.org\/10.3390\/make1010001","relation":{},"ISSN":["2504-4990"],"issn-type":[{"value":"2504-4990","type":"electronic"}],"subject":[],"published":{"date-parts":[[2017,7,3]]}}}