{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T02:57:21Z","timestamp":1760237841868,"version":"build-2065373602"},"reference-count":59,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2020,6,26]],"date-time":"2020-06-26T00:00:00Z","timestamp":1593129600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Data"],"abstract":"<jats:p>Multi-instance (MI) learning is a branch of machine learning, where each object (bag) consists of multiple feature vectors (instances)\u2014for example, an image consisting of multiple patches and their corresponding feature vectors. In MI classification, each bag in the training set has a class label, but the instances are unlabeled. The instances are most commonly regarded as a set of points in a multi-dimensional space. Alternatively, instances are viewed as realizations of random vectors with corresponding probability distribution, where the bag is the distribution, not the realizations. By introducing the probability distribution space to bag-level classification problems, dissimilarities between probability distributions (divergences) can be applied. The bag-to-bag Kullback\u2013Leibler information is asymptotically the best classifier, but the typical sparseness of MI training sets is an obstacle. We introduce bag-to-class divergence to MI learning, emphasizing the hierarchical nature of the random vectors that makes bags from the same class different. We propose two properties for bag-to-class divergences, and an additional property for sparse training sets, and propose a dissimilarity measure that fulfils them. Its performance is demonstrated on synthetic and real data. The probability distribution space is valid for MI learning, both for the theoretical analysis and applications.<\/jats:p>","DOI":"10.3390\/data5020056","type":"journal-article","created":{"date-parts":[[2020,6,26]],"date-time":"2020-06-26T05:19:36Z","timestamp":1593148776000},"page":"56","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["A Probabilistic Bag-to-Class Approach to Multiple-Instance Learning"],"prefix":"10.3390","volume":"5","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0619-7276","authenticated-orcid":false,"given":"Kajsa","family":"M\u00f8llersen","sequence":"first","affiliation":[{"name":"Department of Community Medicine, Faculty of Health Science, UiT The Arctic University of Norway, N-9037 Troms\u00f8, Norway"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1150-2498","authenticated-orcid":false,"given":"Jon Yngve","family":"Hardeberg","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Faculty of Information Technology and Electrical Engineering, NTNU\u2014Norwegian University of Science and Technology, N-2815 Gj\u00f8vik, Norway"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Fred","family":"Godtliebsen","sequence":"additional","affiliation":[{"name":"Department of Mathematics and Statistics, Faculty of Science and Technology, UiT The Arctic University of Norway, N-9037 Troms\u00f8, Norway"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2020,6,26]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"280","DOI":"10.1016\/j.media.2019.03.009","article-title":"Not-so-supervised: A survey of semi-supervised, multi-instance, and transfer learning in medical image analysis","volume":"54","author":"Cheplygina","year":"2019","journal-title":"Med. Image Anal."},{"key":"ref_2","unstructured":"Gelasca, E.D., Byun, J., Obara, B., and Manjunath, B.S. (2008, January 12\u201315). Evaluation and Benchmark for Biological Image Segmentation. Proceedings of the IEEE International Conference on Image Processing, San Diego, CA, USA."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Kandemir, M., Zhang, C., and Hamprecht, F.A. (2014, January 14\u201318). Empowering Multiple Instance Histopathology Cancer Diagnosis by Cell Graphs. Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention\u2014MICCAI 2014, Boston, MA, USA.","DOI":"10.1007\/978-3-319-10470-6_29"},{"key":"ref_4","first-page":"1","article-title":"Multiple-Instance Learning from Distributions","volume":"17","author":"Doran","year":"2016","journal-title":"J. Mach. Learn. Res."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"47","DOI":"10.1007\/s10489-007-0111-x","article-title":"Multi-instance clustering with applications to multi-instance prediction","volume":"31","author":"Zhang","year":"2009","journal-title":"Appl. Intell."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"2291","DOI":"10.1016\/j.artint.2011.10.002","article-title":"Multi-instance multi-label learning","volume":"176","author":"Zhou","year":"2012","journal-title":"Artif. Intell."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"446","DOI":"10.1016\/j.patcog.2017.05.001","article-title":"Deep patch learning for weakly supervised object classification and discovery","volume":"71","author":"Tang","year":"2017","journal-title":"Pattern Recognit."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1016\/j.patcog.2017.08.026","article-title":"Revisiting multiple instance neural networks","volume":"74","author":"Wang","year":"2018","journal-title":"Pattern Recognit."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1016\/S0004-3702(96)00034-3","article-title":"Solving the multiple instance problem with axis-parallel rectangles","volume":"89","author":"Dietterich","year":"1997","journal-title":"Artif. Intell."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"826","DOI":"10.1016\/j.neucom.2015.07.024","article-title":"Multiple-instance learning based decision neural networks for image retrieval and classification","volume":"171","author":"Xu","year":"2016","journal-title":"Neurocomputing"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"407","DOI":"10.1016\/j.patcog.2016.08.026","article-title":"Diversified dictionaries for multi-instance learning","volume":"64","author":"Qiao","year":"2017","journal-title":"Pattern Recognit."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Weidmann, N., Frank, E., and Pfahringer, B. (2003, January 22\u201326). A Two-Level Learning Method for Generalized Multi-instance Problems. Proceedings of the European Conference on Machine Learning, Cavtat-Dubrovnik, Croatia.","DOI":"10.1007\/978-3-540-39857-8_42"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1017\/S026988890999035X","article-title":"A review of multi-instance learning assumptions","volume":"25","author":"Foulds","year":"2010","journal-title":"Knowl. Eng. Rev."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"264","DOI":"10.1016\/j.patcog.2014.07.022","article-title":"Multiple Instance Learning with Bag Dissimilarities","volume":"48","author":"Cheplygina","year":"2015","journal-title":"Pattern Recognit."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1016\/j.artint.2013.06.003","article-title":"Multiple Instance Classification: Review, Taxonomy and Comparative Study","volume":"201","author":"Amores","year":"2013","journal-title":"Artif. Intell."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"329","DOI":"10.1016\/j.patcog.2017.10.009","article-title":"Multiple Instance Learning: A survey of Problem Characteristics and Applications","volume":"77","author":"Carbonneau","year":"2018","journal-title":"Pattern Recognit."},{"key":"ref_17","first-page":"570","article-title":"A framework for multiple-instance learning","volume":"Volume 10","author":"Maron","year":"1998","journal-title":"Advances in Neural Information Processing Systems, Denver, CO, USA, 30 November\u20135 December 1998"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Dai, H., Srikant, R., and Zhang, C. (2004). Logistic Regression and Boosting for Labeled Bags of Instances, Springer. Lecture Notes in Computer Science.","DOI":"10.1007\/b97861"},{"key":"ref_19","first-page":"222","article-title":"Bag Dissimilarities for Multiple Instance Learning","volume":"Volume 7005","author":"Pelillo","year":"2011","journal-title":"Similarity-Based Pattern Recognition"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Zhou, Z.H., Sun, Y.Y., and Li, Y.F. (2009, January 14\u201318). Multi-instance Learning by Treating Instances As non-I.I.D. Samples. Proceedings of the 26th Annual International Conference on Machine Learning\u2014ICML \u201909, Montreal, QC, Canada.","DOI":"10.1145\/1553374.1553534"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1379","DOI":"10.1109\/TNNLS.2015.2424254","article-title":"Dissimilarity-Based Ensembles for Multiple Instance Learning","volume":"27","author":"Cheplygina","year":"2016","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Boiman, O., Shechtman, E., and Irani, M. (2008, January 23\u201328). In defense of Nearest-Neighbor based image classification. Proceedings of the 2008 IEEE Conference on Computer Vision and Pattern Recognition, Anchorage, AK, USA.","DOI":"10.1109\/CVPR.2008.4587598"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1260005","DOI":"10.1142\/S0218001412600051","article-title":"Bridging structure and feature representations in graph matching","volume":"26","author":"Lee","year":"2012","journal-title":"Int. J. Patten Recognit. Artif. Intell."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"21","DOI":"10.1142\/S1469026805001453","article-title":"On generalized multiple-instance learning","volume":"5","author":"Scott","year":"2005","journal-title":"Int. J. Comput. Intell. Appl."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"75","DOI":"10.1016\/j.ecoinf.2016.04.001","article-title":"Enhancing the dissimilarity-based classification of birdsong recordings","volume":"33","year":"2016","journal-title":"Ecol. Inform."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Hancock, E.R., Wilson, R.C., Windeatt, T., Ulusoy, I., and Escolano, F. (2010). Dissimilarity-Based Multiple Instance Learning. Structural, Syntactic, and Statistical Pattern Recognition, Springer.","DOI":"10.1007\/978-3-642-14980-1"},{"key":"ref_27","unstructured":"Sch\u00f6lkopf, B. (December, January 27). The Kernel Trick for Distances. Proceedings of the 13th International Conference on Neural Information Processing Systems, Denver, CO, USA."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"975","DOI":"10.1109\/TNNLS.2016.2519102","article-title":"Scalable Algorithms for Multi-Instance Learning","volume":"28","author":"Wei","year":"2017","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1214\/aoms\/1177729694","article-title":"On Information and Sufficiency","volume":"22","author":"Kullback","year":"1951","journal-title":"Ann. Math. Stat."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"3","DOI":"10.2307\/3315900","article-title":"A fast distance-based approach for determining the number of components in mixtures","volume":"31","author":"Sahu","year":"2003","journal-title":"Can. J. Stat."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"103","DOI":"10.1016\/j.eswa.2018.09.049","article-title":"Multiple instance learning for histopathological breast cancer image classification","volume":"117","author":"Sudharshan","year":"2019","journal-title":"Expert Syst. Appl."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Zhang, G., Yin, J., Li, Z., Su, X., Li, G., and Zhang, H. (2013). Automated skin biopsy histopathological image annotation using multi-instance representation and learning. BMC Med. Genom., 6.","DOI":"10.1186\/1755-8794-6-S3-S10"},{"key":"ref_33","first-page":"645","article-title":"Multiple instance cancer detection by boosting regularised trees","volume":"Volume 9349","author":"Li","year":"2015","journal-title":"Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)"},{"key":"ref_34","unstructured":"Tomczak, J.M., Ilse, M., and Welling, M. (2017). Deep Learning with Permutation-invariant Operator for Multi-instance Histopathology Classification. arXiv."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"316","DOI":"10.1109\/TMI.2017.2758580","article-title":"Multi-Instance Multi-Label Learning for Multi-Class Classification of Whole Slide Breast Histopathology Images","volume":"37","author":"Mercan","year":"2018","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"591","DOI":"10.1016\/j.media.2014.01.010","article-title":"Weakly supervised histopathology cancer image segmentation and classification","volume":"18","author":"Xu","year":"2014","journal-title":"Med. Image Anal."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"McCann, M.T., Bhagavatula, R., Fickus, M.C., Ozolek, J.A., and Kova\u0109evi\u0107, J. (October, January 30). Automated colitis detection from endoscopic biopsies as a tissue screening tool in diagnostic pathology. Proceedings of the 2012 19th IEEE International Conference on Image Processing, Orlando, FL, USA.","DOI":"10.1109\/ICIP.2012.6467483"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Dundar, M.M., Badve, S., Raykar, V.C., Jain, R.K., Sertel, O., and Gurcan, M.N. (2010, January 23\u201326). A multiple instance learning approach toward optimal classification of pathology slides. Proceedings of the International Conference on Pattern Recognition, Istanbul, Turkey.","DOI":"10.1109\/ICPR.2010.669"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"3458","DOI":"10.1016\/j.patcog.2010.05.010","article-title":"Nearest neighbour group-based classification","volume":"43","author":"Samsudin","year":"2010","journal-title":"Pattern Recognit."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"i52","DOI":"10.1093\/bioinformatics\/btw252","article-title":"Classifying and segmenting microscopy imageswith deep multiple instance learning","volume":"32","author":"Kraus","year":"2016","journal-title":"Bioinformatics"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Hou, L., Samaras, D., Kurc, T.M., Gao, Y., Davis, J.E., and Saltz, J.H. (2015). Efficient Multiple Instance Convolutional Neural Networks for GigapixelResolution Image Classification. arXiv.","DOI":"10.1109\/CVPR.2016.266"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"2376","DOI":"10.1109\/TMI.2017.2724070","article-title":"Constrained Deep Weak Supervision for Histopathology Image Segmentation","volume":"36","author":"Jia","year":"2017","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"751","DOI":"10.1109\/TKDE.2011.221","article-title":"Clustering Uncertain Data Based on Probability Distribution Similarity","volume":"25","author":"Jiang","year":"2013","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Kriegel, H.P., and Pfeifle, M. (2005, January 21\u201324). Density-based Clustering of Uncertain Data. Proceedings of the Eleventh ACM SIGKDD International Conference on Knowledge Discovery in Data Mining KDD \u201905, Chicago, IL, USA.","DOI":"10.1145\/1081870.1081955"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"131","DOI":"10.1111\/j.2517-6161.1966.tb00626.x","article-title":"A General Class of Coefficients of Divergence of One Distribution from Another","volume":"28","author":"Ali","year":"1966","journal-title":"J. R. Stat. Soc. Ser. B (Methodol.)"},{"key":"ref_46","first-page":"299","article-title":"Information-type measures of difference of probability distributions and indirect observations","volume":"2","year":"1967","journal-title":"Studia Scientiarum Mathematicarum Hungarica"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"800","DOI":"10.1090\/S0002-9939-1953-0056868-5","article-title":"On orthogonal probability measures","volume":"4","author":"Berger","year":"1953","journal-title":"Proc. Am. Math. Soc."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"419","DOI":"10.1111\/j.1751-5823.2002.tb00178.x","article-title":"On Choosing and Bounding Probability Metrics","volume":"70","author":"Gibbs","year":"2002","journal-title":"Int. Stat. Rev."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"1674","DOI":"10.4236\/am.2016.715143","article-title":"On Data-Independent Properties for Density-Based Dissimilarity Measures in Hybrid Clustering","volume":"07","author":"Dhar","year":"2016","journal-title":"Appl. Math."},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"M\u00f8llersen, K., Hardeberg, J.Y., and Godtliebsen, F. (2015, January 25\u201326). Divergence-based colour features for melanoma detection. Proceedings of the 2015 Colour and Visual Computing Symposium (CVCS), Gj\u00f8vik, Norway.","DOI":"10.1109\/CVCS.2015.7274885"},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"2034","DOI":"10.1016\/j.jmva.2006.03.007","article-title":"Interpreting Kullback-Leibler Divergence with the Neyman-Pearson Lemma","volume":"97","author":"Eguchi","year":"2006","journal-title":"J. Multivar. Anal."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"773","DOI":"10.1080\/01621459.1995.10476572","article-title":"Bayes Factors","volume":"90","author":"Kass","year":"1995","journal-title":"J. Am. Stat. Assoc."},{"key":"ref_53","first-page":"581","article-title":"Generalized non-symmetric divergence measures and inequaities","volume":"9","author":"Taneja","year":"2006","journal-title":"J. Interdiscip. Math."},{"key":"ref_54","doi-asserted-by":"crossref","unstructured":"McLachlan, G., and Peel, D. (2000). Finite Mixture Models, John Wiley & Sons, Inc.","DOI":"10.1002\/0471721182"},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"683","DOI":"10.1111\/j.2517-6161.1991.tb01857.x","article-title":"A Reliable Data-Based Bandwidth Selection Method for Kernel Density Estimation","volume":"53","author":"Sheather","year":"1991","journal-title":"J. R. Stat. Soc. Ser. B (Methodol.)"},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1007\/s10994-016-5560-1","article-title":"An empirical study on image bag generators for multi-instance learning","volume":"105","author":"Wei","year":"2016","journal-title":"Mach. Learn."},{"key":"ref_57","first-page":"561","article-title":"Support vector machines for multiple-instance learning","volume":"15","author":"Andrews","year":"2003","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_58","doi-asserted-by":"crossref","unstructured":"Venkatesan, R., Chandakkar, P., and Li, B. (2015, January 7\u201313). Simpler Non-Parametric Methods Provide as Good or Better Results to Multiple-Instance Learning. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.","DOI":"10.1109\/ICCV.2015.299"},{"key":"ref_59","doi-asserted-by":"crossref","unstructured":"Sun, M., Han, T.X., Liu, M.-C., and Khodayari-Rostamabad, A. (2016, January 4\u20138). Multiple Instance Learning Convolutional Neural Networks for object recognition. Proceedings of the 2016 23rd International Conference on Pattern Recognition (ICPR), Cancun, Mexico.","DOI":"10.1109\/ICPR.2016.7900139"}],"container-title":["Data"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2306-5729\/5\/2\/56\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T09:43:05Z","timestamp":1760175785000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2306-5729\/5\/2\/56"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,6,26]]},"references-count":59,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2020,6]]}},"alternative-id":["data5020056"],"URL":"https:\/\/doi.org\/10.3390\/data5020056","relation":{},"ISSN":["2306-5729"],"issn-type":[{"type":"electronic","value":"2306-5729"}],"subject":[],"published":{"date-parts":[[2020,6,26]]}}}