{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,10]],"date-time":"2026-04-10T16:08:22Z","timestamp":1775837302598,"version":"3.50.1"},"reference-count":29,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2016,6,7]],"date-time":"2016-06-07T00:00:00Z","timestamp":1465257600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J. Imaging"],"abstract":"<jats:p>Many medical image analysis tasks require complex learning strategies to reach a quality of image-based decision support that is sufficient in clinical practice. The analysis of medical texture in tomographic images, for example of lung tissue, is no exception. Via a learning framework, very good classification accuracy can be obtained, but several parameters need to be optimized. This article describes a practical framework for efficient distributed parameter optimization. The proposed solutions are applicable for many research groups with heterogeneous computing infrastructures and for various machine learning algorithms. These infrastructures can easily be connected via distributed computation frameworks. We use the Hadoop framework to run and distribute both grid and random search strategies for hyperparameter optimization and cross-validations on a cluster of 21 nodes composed of desktop computers and servers. We show that significant speedups of up to 364\u00d7 compared to a serial execution can be achieved using our in-house Hadoop cluster by distributing the computation and automatically pruning the search space while still identifying the best-performing parameter combinations. To the best of our knowledge, this is the first article presenting practical results in detail for complex data analysis tasks on such a heterogeneous infrastructure together with a linked simulation framework that allows for computing resource planning. The results are directly applicable in many scenarios and allow implementing an efficient and effective strategy for medical (image) data analysis and related learning approaches.<\/jats:p>","DOI":"10.3390\/jimaging2020019","type":"journal-article","created":{"date-parts":[[2016,6,7]],"date-time":"2016-06-07T02:51:31Z","timestamp":1465267891000},"page":"19","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":17,"title":["Optimized Distributed Hyperparameter Search and Simulation for Lung Texture Classification in CT Using Hadoop"],"prefix":"10.3390","volume":"2","author":[{"given":"Roger","family":"Schaer","sequence":"first","affiliation":[{"name":"Information Systems Institute, University of Applied Sciences Western Switzerland (HES-SO), Techno-P\u00f4le 3, 3960 Sierre, Switzerland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6800-9878","authenticated-orcid":false,"given":"Henning","family":"M\u00fcller","sequence":"additional","affiliation":[{"name":"Information Systems Institute, University of Applied Sciences Western Switzerland (HES-SO), Techno-P\u00f4le 3, 3960 Sierre, Switzerland"},{"name":"University Hospitals and University of Geneva, Rue Gabrielle-Perret-Gentil 4, 1205 Geneva, Switzerland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Adrien","family":"Depeursinge","sequence":"additional","affiliation":[{"name":"Information Systems Institute, University of Applied Sciences Western Switzerland (HES-SO), Techno-P\u00f4le 3, 3960 Sierre, Switzerland"},{"name":"Ecole Polytechnique F\u00e9d\u00e9rale de Lausanne (EPFL), 1015 Lausanne, Switzerland"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2016,6,7]]},"reference":[{"key":"ref_1","unstructured":"Kim, J. (1997). Iterated Grid Search Algorithm on Unimodal Criteria. [Ph.D. Thesis, Virginia Polytechnic Institute and State University]."},{"key":"ref_2","first-page":"281","article-title":"Random Search for Hyper-parameter Optimization","volume":"13","author":"Bergstra","year":"2012","journal-title":"J. Mach. Learn. Res."},{"key":"ref_3","unstructured":"Markonis, D., Schaer, R., Eggel, I., M\u00fcller, H., and Depeursinge, A. (2015). Using MapReduce for Large\u2013scale Medical Image Analysis, Available online: http:\/\/xxx.lanl.gov\/abs\/arXiv:1510.06937."},{"key":"ref_4","unstructured":"Owen, S., Anil, R., Dunning, T., and Friedman, E. (2011). Mahout in Action, Manning Publications Co."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1186\/s13755-015-0011-0","article-title":"MLBCD: A machine learning tool for big clinical data","volume":"3","author":"Luo","year":"2015","journal-title":"Health Inf. Sci. Syst."},{"key":"ref_6","unstructured":"Hutter, F., Hoos, H.H., and Leyton-Brown, K. (2011). Learning and Intelligent Optimization, Springer-Verlag."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"107","DOI":"10.1016\/j.neucom.2004.11.022","article-title":"Evolutionary tuning of multiple SVM parameters","volume":"64","author":"Friedrichs","year":"2005","journal-title":"Neurocomputing"},{"key":"ref_8","unstructured":"Thornton, C., Hutter, F., Hoos, H.H., and Leyton-Brown, K. Auto-WEKA: Combined Selection and Hyperparameter Optimization of Classification Algorithms. Proceedings of the 19th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining."},{"key":"ref_9","unstructured":"Pereira, F., Burges, C.J.C., Bottou, L., and Weinberger, K.Q. (2012). Advances in Neural Information Processing Systems 25, Curran Associates, Inc."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"131","DOI":"10.1023\/A:1012450327387","article-title":"Choosing Multiple Parameters for Support Vector Machines","volume":"46","author":"Chapelle","year":"2002","journal-title":"Mach. Learn."},{"key":"ref_11","unstructured":"Shawe-Taylor, J., Zemel, R.S., Bartlett, P.L., Pereira, F., and Weinberger, K.Q. (2011). Advances in Neural Information Processing Systems 24, Curran Associates, Inc."},{"key":"ref_12","first-page":"2051","article-title":"A Surrogate Modeling and Adaptive Sampling Toolbox for Computer Based Design","volume":"11","author":"Gorissen","year":"2010","journal-title":"J. Mach. Learn. Res."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"014008","DOI":"10.1088\/1749-4699\/8\/1\/014008","article-title":"Hyperopt: A Python library for model selection and hyperparameter optimization","volume":"8","author":"Bergstra","year":"2015","journal-title":"Comput. Sci. Discov."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Sparks, E.R., Talwalkar, A., Haas, D., Franklin, M.J., Jordan, M.I., and Kraska, T. (2015, January 27\u201329). Automating Model Search for Large Scale Machine Learning. Proceedings of the Sixth ACM Symposium on Cloud Computing, Kohala Coast, HI, USA.","DOI":"10.1145\/2806777.2806945"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"5667","DOI":"10.1109\/TSP.2010.2062509","article-title":"Distributed Learning in Multi-Armed Bandit With Multiple Players","volume":"58","author":"Liu","year":"2010","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"227","DOI":"10.1016\/j.compmedimag.2011.07.003","article-title":"Building a Reference Multimedia Database for Interstitial Lung Diseases","volume":"36","author":"Depeursinge","year":"2012","journal-title":"Comput. Med. Imaging Gr."},{"key":"ref_17","unstructured":"Depeursinge, A., Foncubierta-Rodr\u00edguez, A., Van De Ville, D., and M\u00fcller, H. (2012). Medical Image Computing and Computer\u2013Assisted Intervention MICCAI 2012, Springer."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"898","DOI":"10.1109\/TIP.2013.2295755","article-title":"Rotation\u2013covariant texture learning using steerable Riesz wavelets","volume":"23","author":"Depeursinge","year":"2014","journal-title":"IEEE Trans. Image Process."},{"key":"ref_19","unstructured":"Dean, J., and Ghemawat, S. (2004, January 6\u20138). MapReduce: simplified data processing on large clusters. Proceedings of the 6th conference on Symposium on Opearting Systems Design & Implementation, San Francisco, CA, USA."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Shvachko, K., Kuang, H., Radia, S., and Chansler, R. (2010, January 3\u20137). The Hadoop Distributed File System. Proceedings of the 2010 IEEE 26th Symposium on Mass Storage Systems and Technologies (MSST), Hyatt Regency, NV, USA.","DOI":"10.1109\/MSST.2010.5496972"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Vavilapalli, V.K., Murthy, A.C., Douglas, C., Agarwal, S., Konar, M., Evans, R., Graves, T., Lowe, J., Shah, H., and Seth, S. (2013, January 1\u20133). Apache Hadoop YARN: Yet Another Resource Negotiator. Proceedings of the 4th Annual Symposium on Cloud Computing, Santa Clara, CA, USA.","DOI":"10.1145\/2523616.2523633"},{"key":"ref_22","unstructured":"Hunt, P., Konar, M., Junqueira, F.P., and Reed, B. (2010, January 23\u201325). ZooKeeper: Wait-free Coordination for Internet-scale Systems. Proceedings of the 2010 USENIX Conference on USENIX Annual Technical Conference, Boston, MA, USA."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"10","DOI":"10.1145\/1656274.1656278","article-title":"The WEKA Data Mining Software: An Update","volume":"11","author":"Hall","year":"2009","journal-title":"SIGKDD Explor. Newsl."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"2883","DOI":"10.1016\/S0031-3203(03)00219-X","article-title":"Texture classification using the support vector machines","volume":"36","author":"Li","year":"2003","journal-title":"Pattern Recognit."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1007\/s10278-008-9158-4","article-title":"Comparative Performance Analysis of State\u2013of\u2013the\u2013Art Classification Algorithms Applied to Lung Tissue Categorization","volume":"23","author":"Depeursinge","year":"2010","journal-title":"J. Digit. Imaging"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Vapnik, V.N. (1995). The Nature of Statistical Learning Theory, Springer.","DOI":"10.1007\/978-1-4757-2440-0"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1023\/A:1010933404324","article-title":"Random Forests","volume":"45","author":"Breiman","year":"2001","journal-title":"Mach. Learn."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1007\/BF00116251","article-title":"Induction of decision trees","volume":"1","author":"Quinlan","year":"1986","journal-title":"Mach. Learn."},{"key":"ref_29","unstructured":"Pereira, F., Burges, C.J.C., Bottou, L., and Weinberger, K.Q. (2012). Advances in Neural Information Processing Systems 25, Curran Associates, Inc."}],"container-title":["Journal of Imaging"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2313-433X\/2\/2\/19\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T19:25:06Z","timestamp":1760210706000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2313-433X\/2\/2\/19"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,6,7]]},"references-count":29,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2016,6]]}},"alternative-id":["jimaging2020019"],"URL":"https:\/\/doi.org\/10.3390\/jimaging2020019","relation":{},"ISSN":["2313-433X"],"issn-type":[{"value":"2313-433X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2016,6,7]]}}}