{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,21]],"date-time":"2025-12-21T07:11:38Z","timestamp":1766301098342,"version":"3.41.0"},"reference-count":83,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2020,6,22]],"date-time":"2020-06-22T00:00:00Z","timestamp":1592784000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100005416","name":"Norges Forskningsr\u00e5d","doi-asserted-by":"crossref","award":["263248"],"award-info":[{"award-number":["263248"]}],"id":[{"id":"10.13039\/501100005416","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Comput. Healthcare"],"published-print":{"date-parts":[[2020,7,31]]},"abstract":"<jats:p>Precise and efficient automated identification of gastrointestinal (GI) tract diseases can help doctors treat more patients and improve the rate of disease detection and identification. Currently, automatic analysis of diseases in the GI tract is a hot topic in both computer science and medical-related journals. Nevertheless, the evaluation of such an automatic analysis is often incomplete or simply wrong. Algorithms are often only tested on small and biased datasets, and cross-dataset evaluations are rarely performed. A clear understanding of evaluation metrics and machine learning models with cross datasets is crucial to bring research in the field to a new quality level. Toward this goal, we present comprehensive evaluations of five distinct machine learning models using global features and deep neural networks that can classify 16 different key types of GI tract conditions, including pathological findings, anatomical landmarks, polyp removal conditions, and normal findings from images captured by common GI tract examination instruments. In our evaluation, we introduce performance hexagons using six performance metrics, such as recall, precision, specificity, accuracy, F1-score, and the Matthews correlation coefficient to demonstrate how to determine the real capabilities of models rather than evaluating them shallowly. Furthermore, we perform cross-dataset evaluations using different datasets for training and testing. With these cross-dataset evaluations, we demonstrate the challenge of actually building a generalizable model that could be used across different hospitals. Our experiments clearly show that more sophisticated performance metrics and evaluation methods need to be applied to get reliable models rather than depending on evaluations of the splits of the same dataset\u2014that is, the performance metrics should always be interpreted together rather than relying on a single metric.<\/jats:p>","DOI":"10.1145\/3386295","type":"journal-article","created":{"date-parts":[[2020,6,22]],"date-time":"2020-06-22T18:18:12Z","timestamp":1592849892000},"page":"1-29","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":51,"title":["An Extensive Study on Cross-Dataset Bias and Evaluation Metrics Interpretation for Machine Learning Applied to Gastrointestinal Tract Abnormality Classification"],"prefix":"10.1145","volume":"1","author":[{"given":"Vajira","family":"Thambawita","sequence":"first","affiliation":[{"name":"SimulaMet and Oslo Metropolitan University, Oslo, Norway"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8078-6730","authenticated-orcid":false,"given":"Debesh","family":"Jha","sequence":"additional","affiliation":[{"name":"SimulaMet and UiT\u2014The Arctic University of Norway, Troms\u00f8, Norway"}]},{"given":"Hugo Lewi","family":"Hammer","sequence":"additional","affiliation":[{"name":"Oslo Metropolitan University and SimulaMet, Oslo, Norway"}]},{"given":"H\u00e5vard D.","family":"Johansen","sequence":"additional","affiliation":[{"name":"UiT\u2014The Arctic University of Norway, Troms\u00f8, Norway"}]},{"given":"Dag","family":"Johansen","sequence":"additional","affiliation":[{"name":"UiT\u2014The Arctic University of Norway, Troms\u00f8, Norway"}]},{"given":"P\u00e5l","family":"Halvorsen","sequence":"additional","affiliation":[{"name":"SimulaMet and Oslo Metropolitan University, Oslo, Norway"}]},{"given":"Michael A.","family":"Riegler","sequence":"additional","affiliation":[{"name":"SimulaMet, Oslo, Norway"}]}],"member":"320","published-online":{"date-parts":[[2020,6,22]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"Proceedings of MediaEval","author":"Agrawal Taruna","year":"2017","unstructured":"Taruna Agrawal , Rahul Gupta , Saurabh Sahu , and Carol Y . Espy-Wilson. 2017. SCL-UMD at the Medico Task-MediaEval 2017: Transfer learning based classification of medical images . In Proceedings of MediaEval 2017 . Taruna Agrawal, Rahul Gupta, Saurabh Sahu, and Carol Y. Espy-Wilson. 2017. SCL-UMD at the Medico Task-MediaEval 2017: Transfer learning based classification of medical images. In Proceedings of MediaEval 2017."},{"key":"e_1_2_1_2_1","volume-title":"Proceedings of IEEE BMEI2008","volume":"2","author":"Alexandre Lu\u00eds A.","year":"2008","unstructured":"Lu\u00eds A. Alexandre , Nuno Nobre , and Jo\u00e3o Casteleiro . 2008 . Color and position versus texture features for endoscopic polyp detection . In Proceedings of IEEE BMEI2008 , Vol. 2 . 38--42. Lu\u00eds A. Alexandre, Nuno Nobre, and Jo\u00e3o Casteleiro. 2008. Color and position versus texture features for endoscopic polyp detection. In Proceedings of IEEE BMEI2008, Vol. 2. 38--42."},{"key":"e_1_2_1_3_1","volume-title":"Bildverarbeitung f\u00fcr die Medizin","author":"Ameling Stefan","year":"2009","unstructured":"Stefan Ameling , Stephan Wirth , Dietrich Paulus , Gerard Lacey , and Fernando Vilarino . 2009. Texture-based polyp detection in colonoscopy . In Bildverarbeitung f\u00fcr die Medizin 2009 . 346--350. Stefan Ameling, Stephan Wirth, Dietrich Paulus, Gerard Lacey, and Fernando Vilarino. 2009. Texture-based polyp detection in colonoscopy. In Bildverarbeitung f\u00fcr die Medizin 2009. 346--350."},{"key":"e_1_2_1_4_1","volume-title":"Proceedings of CARE and CLIP","author":"Angermann Quentin","year":"2017","unstructured":"Quentin Angermann , Jorge Bernal , Cristina S\u00e1nchez-Montes , Maroua Hammami , Gloria Fern\u00e1ndez-Esparrach , Xavier Dray , Olivier Romain , F. Javier S\u00e1nchez , and Aymeric Histace . 2017 . Towards real-time polyp detection in colonoscopy videos: Adapting still frame-based methodologies for video sequences analysis . In Proceedings of CARE and CLIP 2017. 29--41. Quentin Angermann, Jorge Bernal, Cristina S\u00e1nchez-Montes, Maroua Hammami, Gloria Fern\u00e1ndez-Esparrach, Xavier Dray, Olivier Romain, F. Javier S\u00e1nchez, and Aymeric Histace. 2017. Towards real-time polyp detection in colonoscopy videos: Adapting still frame-based methodologies for video sequences analysis. In Proceedings of CARE and CLIP 2017. 29--41."},{"key":"e_1_2_1_5_1","volume-title":"Proceedings of CARS","author":"Bernal Jorge","year":"2018","unstructured":"Jorge Bernal , Aymeric Histace , Marc Masana , Quentin Angermann , Cristina S\u00e1nchez-Montes , Cristina Rodriguez , Maroua Hammami , 2018 . Polyp detection benchmark in colonoscopy videos using GTCreator: A novel fully configurable tool for easy and fast annotation of image databases . In Proceedings of CARS 2018. Jorge Bernal, Aymeric Histace, Marc Masana, Quentin Angermann, Cristina S\u00e1nchez-Montes, Cristina Rodriguez, Maroua Hammami, et al. 2018. Polyp detection benchmark in colonoscopy videos using GTCreator: A novel fully configurable tool for easy and fast annotation of image databases. In Proceedings of CARS 2018."},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.compmedimag.2015.02.007"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2012.03.002"},{"key":"e_1_2_1_8_1","volume-title":"Proceedings of IEEE EMBC","author":"Bernal Jorge","year":"2013","unstructured":"Jorge Bernal , Javier S\u00e1nchez , and Fernando Vilarino . 2013 . Impact of image preprocessing methods on polyp localization in colonoscopy frames . In Proceedings of IEEE EMBC 2013. 7350--7354. Jorge Bernal, Javier S\u00e1nchez, and Fernando Vilarino. 2013. Impact of image preprocessing methods on polyp localization in colonoscopy frames. In Proceedings of IEEE EMBC 2013. 7350--7354."},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMI.2017.2664042"},{"key":"e_1_2_1_10_1","volume-title":"Proceedings of MediaEval","author":"Borgli Rune Johan","year":"2018","unstructured":"Rune Johan Borgli , P\u00e5l Halvorsen , Michael Riegler , and H\u00e5kon Kvale Stensland . 2018 . Automatic hyperparameter optimization in Keras for the MediaEval 2018 Medico Multimedia Task . In Proceedings of MediaEval 2018. Rune Johan Borgli, P\u00e5l Halvorsen, Michael Riegler, and H\u00e5kon Kvale Stensland. 2018. Automatic hyperparameter optimization in Keras for the MediaEval 2018 Medico Multimedia Task. In Proceedings of MediaEval 2018."},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-7908-2604-3_16"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.3322\/caac.21492"},{"key":"e_1_2_1_13_1","first-page":"357","article-title":"Automatic detection of colorectal polyps in static images","volume":"23","author":"Cheng Da-Chuan","year":"2011","unstructured":"Da-Chuan Cheng , Wen-Chien Ting , Yung-Fu Chen , and Xiaoyi Jiang . 2011 . Automatic detection of colorectal polyps in static images . Biomedical Engineering: Applications, Basis and Communications 23 , 05 (2011), 357 -- 367 . Da-Chuan Cheng, Wen-Chien Ting, Yung-Fu Chen, and Xiaoyi Jiang. 2011. Automatic detection of colorectal polyps in static images. Biomedical Engineering: Applications, Basis and Communications 23, 05 (2011), 357--367.","journal-title":"Biomedical Engineering: Applications, Basis and Communications"},{"key":"e_1_2_1_14_1","unstructured":"Torch Contributors. 2018. Torchvision Models. Retrieved May 7 2020 from https:\/\/pytorch.org\/docs\/stable\/torchvision\/models.html.  Torch Contributors. 2018. Torchvision Models. Retrieved May 7 2020 from https:\/\/pytorch.org\/docs\/stable\/torchvision\/models.html."},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10479-005-5724-z"},{"key":"e_1_2_1_16_1","doi-asserted-by":"crossref","first-page":"5057","DOI":"10.3748\/wjg.v24.i45.5057","article-title":"Methodology to develop machine learning algorithms to improve performance in gastrointestinal endoscopy","volume":"24","author":"de Lange Thomas","year":"2018","unstructured":"Thomas de Lange , P\u00e5l Halvorsen , and Michael Riegler . 2018 . Methodology to develop machine learning algorithms to improve performance in gastrointestinal endoscopy . World Journal of Gastroenterology 24 , 45 (2018), 5057 . Thomas de Lange, P\u00e5l Halvorsen, and Michael Riegler. 2018. Methodology to develop machine learning algorithms to improve performance in gastrointestinal endoscopy. World Journal of Gastroenterology 24, 45 (2018), 5057.","journal-title":"World Journal of Gastroenterology"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"e_1_2_1_18_1","volume-title":"Proceedings of MediaEval","author":"Dias Danielle","year":"2018","unstructured":"Danielle Dias and Ulisses Dias . 2018 . Transfer learning with CNN architectures for classifying gastrointestinal diseases and anatomical landmarks . In Proceedings of MediaEval 2018. Danielle Dias and Ulisses Dias. 2018. Transfer learning with CNN architectures for classifying gastrointestinal diseases and anatomical landmarks. In Proceedings of MediaEval 2018."},{"key":"e_1_2_1_19_1","volume-title":"Proceedings of KDD-Cup \u201909","author":"Doetsch Patrick","year":"2009","unstructured":"Patrick Doetsch , Christian Buck , Pavlo Golik , Niklas Hoppe , Michael Kramp , Johannes Laudenberg , Christian Oberd\u00f6rfer , Pascal Steingrube , Jens Forster , and Arne Mauser . 2009 . Logistic model trees with AUC split criterion for the KDD Cup 2009 Small Challenge . In Proceedings of KDD-Cup \u201909 . 77--88. Patrick Doetsch, Christian Buck, Pavlo Golik, Niklas Hoppe, Michael Kramp, Johannes Laudenberg, Christian Oberd\u00f6rfer, Pascal Steingrube, Jens Forster, and Arne Mauser. 2009. Logistic model trees with AUC split criterion for the KDD Cup 2009 Small Challenge. In Proceedings of KDD-Cup \u201909. 77--88."},{"key":"e_1_2_1_20_1","volume-title":"Proceedings of IEEE CVPR","author":"Doll\u00e1r Piotr","year":"2009","unstructured":"Piotr Doll\u00e1r , Christian Wojek , Bernt Schiele , and Pietro Perona . 2009 . Pedestrian detection: A benchmark . In Proceedings of IEEE CVPR 2009. Piotr Doll\u00e1r, Christian Wojek, Bernt Schiele, and Pietro Perona. 2009. Pedestrian detection: A benchmark. In Proceedings of IEEE CVPR 2009."},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1214\/aos\/1016218223"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/1656274.1656278"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.90"},{"key":"e_1_2_1_24_1","volume-title":"Proceedings of MediaEval","author":"Hicks Steven A.","year":"2018","unstructured":"Steven A. Hicks , Pia H. Smedsrud , P\u00e5l Halvorsen , and Michael Riegler . 2018 . Deep learning based disease detection using domain specific transfer learning . In Proceedings of MediaEval 2018. Steven A. Hicks, Pia H. Smedsrud, P\u00e5l Halvorsen, and Michael Riegler. 2018. Deep learning based disease detection using domain specific transfer learning. In Proceedings of MediaEval 2018."},{"key":"e_1_2_1_25_1","volume-title":"Proceedings of MediaEval","author":"Hoang Trung-Hieu","year":"2018","unstructured":"Trung-Hieu Hoang , Hai-Dang Nguyen , and Thanh-An Nguyen . 2018 . An application of residual network and faster - RCNN for Medico: Multimedia Task at MediaEval 2018 . In Proceedings of MediaEval 2018. Trung-Hieu Hoang, Hai-Dang Nguyen, and Thanh-An Nguyen. 2018. An application of residual network and faster - RCNN for Medico: Multimedia Task at MediaEval 2018. In Proceedings of MediaEval 2018."},{"key":"e_1_2_1_26_1","volume-title":"Proceedings of IEEE CVPR","author":"Huang Gao","year":"2017","unstructured":"Gao Huang , Zhuang Liu , Laurens Van Der Maaten , and Kilian Q. Weinberger . 2017. Densely connected convolutional networks . In Proceedings of IEEE CVPR 2017 . 2261--2269. Gao Huang, Zhuang Liu, Laurens Van Der Maaten, and Kilian Q. Weinberger. 2017. Densely connected convolutional networks. In Proceedings of IEEE CVPR 2017. 2261--2269."},{"key":"e_1_2_1_27_1","volume-title":"Proceedings of IEEE ICIP","volume":"2","author":"Hwang Sae","year":"2007","unstructured":"Sae Hwang , JungHwan Oh , Wallapak Tavanapong , Johnny Wong , and Piet C . De Groen. 2007. Polyp detection in colonoscopy video using elliptical shape feature . In Proceedings of IEEE ICIP 2007 , Vol. 2 . 465--468. Sae Hwang, JungHwan Oh, Wallapak Tavanapong, Johnny Wong, and Piet C. De Groen. 2007. Polyp detection in colonoscopy video using elliptical shape feature. In Proceedings of IEEE ICIP 2007, Vol. 2. 465--468."},{"key":"e_1_2_1_28_1","volume-title":"Proceedings of IEEE CBMS","author":"Iakovidis Dimitrios K.","year":"2005","unstructured":"Dimitrios K. Iakovidis , Dimitrios E. Maroulis , Stavros A. Karkanis , and A. Brokos . 2005. A comparative study of texture features for the discrimination of gastric polyps in endoscopic video . In Proceedings of IEEE CBMS 2005 . 575--580. Dimitrios K. Iakovidis, Dimitrios E. Maroulis, Stavros A. Karkanis, and A. Brokos. 2005. A comparative study of texture features for the discrimination of gastric polyps in endoscopic video. In Proceedings of IEEE CBMS 2005. 575--580."},{"key":"e_1_2_1_29_1","volume-title":"Proceedings of MVA","volume":"13","author":"Iwahori Yuji","year":"2013","unstructured":"Yuji Iwahori , Takayuki Shinohara , Akira Hattori , Robert J. Woodham , Shinji Fukui , Manas Kamal Bhuyan , and Kunio Kasugai . 2013 . Automatic polyp detection in endoscope images using a Hessian filter . In Proceedings of MVA 2013, Vol. 13 . 21--24. Yuji Iwahori, Takayuki Shinohara, Akira Hattori, Robert J. Woodham, Shinji Fukui, Manas Kamal Bhuyan, and Kunio Kasugai. 2013. Automatic polyp detection in endoscope images using a Hessian filter. In Proceedings of MVA 2013, Vol. 13. 21--24."},{"key":"e_1_2_1_30_1","volume-title":"Proceedings of MMM","author":"Jha Debesh","year":"2020","unstructured":"Debesh Jha , Pia Smedsrud , Michael Riegler , P\u00e5l Halvorsen , Thomas de Lange , Dag Johansen , and H\u00e5vard Johansen . 2020 . Kvasir-SEG: A segmented polyp dataset . In Proceedings of MMM 2020. 1--12. Debesh Jha, Pia Smedsrud, Michael Riegler, P\u00e5l Halvorsen, Thomas de Lange, Dag Johansen, and H\u00e5vard Johansen. 2020. Kvasir-SEG: A segmented polyp dataset. In Proceedings of MMM 2020. 1--12."},{"key":"e_1_2_1_31_1","volume-title":"Proceedings of IEEE EMBC","author":"Jia Xiao","year":"2017","unstructured":"Xiao Jia and Max Q . -H. Meng. 2017. Gastrointestinal bleeding detection in wireless capsule endoscopy images using handcrafted and CNN features . In Proceedings of IEEE EMBC 2017 . 3154--3157. Xiao Jia and Max Q.-H. Meng. 2017. Gastrointestinal bleeding detection in wireless capsule endoscopy images using handcrafted and CNN features. In Proceedings of IEEE EMBC 2017. 3154--3157."},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/TITB.2003.813794"},{"key":"e_1_2_1_33_1","volume-title":"Proceedings of MediaEval","author":"Khan Zeshan","year":"2018","unstructured":"Zeshan Khan and Muhammad Atif Tahir . 2018 . Majority voting of heterogeneous classifiers for finding abnormalities in the gastro-intestinal tract . In Proceedings of MediaEval 2018. Zeshan Khan and Muhammad Atif Tahir. 2018. Majority voting of heterogeneous classifiers for finding abnormalities in the gastro-intestinal tract. In Proceedings of MediaEval 2018."},{"key":"e_1_2_1_34_1","volume-title":"Proceedings of ECCV","author":"Khosla Aditya","year":"2012","unstructured":"Aditya Khosla , Tinghui Zhou , Tomasz Malisiewicz , Alexei Efros , and Antonio Torralba . 2012 . Undoing the damage of dataset bias . In Proceedings of ECCV 2012. Aditya Khosla, Tinghui Zhou, Tomasz Malisiewicz, Alexei Efros, and Antonio Torralba. 2012. Undoing the damage of dataset bias. In Proceedings of ECCV 2012."},{"key":"e_1_2_1_35_1","volume-title":"Kingma and Jimmy Ba","author":"Diederik","year":"2014","unstructured":"Diederik P. Kingma and Jimmy Ba . 2014 . Adam : A method for stochastic optimization. arXiv:1412.6980. Diederik P. Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv:1412.6980."},{"key":"e_1_2_1_36_1","volume-title":"Proceedings of MediaEval","author":"Kirker\u00f8d Mathias","year":"2018","unstructured":"Mathias Kirker\u00f8d , Vajira Thambawita , Michael Riegler , and P\u00e5l Halvorsen . 2018 . Using preprocessing as a tool in medical image detection . In Proceedings of MediaEval 2018. Mathias Kirker\u00f8d, Vajira Thambawita, Michael Riegler, and P\u00e5l Halvorsen. 2018. Using preprocessing as a tool in medical image detection. In Proceedings of MediaEval 2018."},{"key":"e_1_2_1_37_1","volume-title":"Proceedings of MediaEval","author":"Ko Tobey H.","year":"2018","unstructured":"Tobey H. Ko , Zhonglei Gu , and Yang Liu . 2018 . Weighted discriminant embedding: Discriminant subspace learning for imbalanced medical data classification . In Proceedings of MediaEval 2018. Tobey H. Ko, Zhonglei Gu, and Yang Liu. 2018. Weighted discriminant embedding: Discriminant subspace learning for imbalanced medical data classification. In Proceedings of MediaEval 2018."},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10994-005-0466-3"},{"key":"e_1_2_1_39_1","doi-asserted-by":"crossref","first-page":"470","DOI":"10.1055\/s-0031-1291666","article-title":"Factors influencing the miss rate of polyps in a back-to-back colonoscopy study","volume":"44","author":"Leufkens A. M.","year":"2012","unstructured":"A. M. Leufkens , M. G. H. van Oijen , F. P. Vleggaar , and P. D. Siersema . 2012 . Factors influencing the miss rate of polyps in a back-to-back colonoscopy study . Endoscopy 44 , 05 (2012), 470 -- 475 . A. M. Leufkens, M. G. H. van Oijen, F. P. Vleggaar, and P. D. Siersema. 2012. Factors influencing the miss rate of polyps in a back-to-back colonoscopy study. Endoscopy 44, 05 (2012), 470--475.","journal-title":"Endoscopy"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1109\/TITB.2012.2185807"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0016-5107(05)00133-1"},{"key":"e_1_2_1_42_1","volume-title":"Proceedings of ACM MMSys","author":"Lux Mathias","year":"2016","unstructured":"Mathias Lux , Michael Riegler , P\u00e5l Halvorsen , Konstantin Pogorelov , and Nektarios Anagnostopoulos . 2016 . LIRE: Open source visual information retrieval . In Proceedings of ACM MMSys 2016. 30. Mathias Lux, Michael Riegler, P\u00e5l Halvorsen, Konstantin Pogorelov, and Nektarios Anagnostopoulos. 2016. LIRE: Open source visual information retrieval. In Proceedings of ACM MMSys 2016. 30."},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMI.2014.2314959"},{"key":"e_1_2_1_44_1","doi-asserted-by":"crossref","first-page":"713","DOI":"10.1038\/s41551-018-0308-9","article-title":"Detecting colorectal polyps via machine learning","volume":"2","author":"Mori Yuichi","year":"2018","unstructured":"Yuichi Mori and Shin-Ei Kudo . 2018 . Detecting colorectal polyps via machine learning . Nature Biomedical Engineering 2 , 10 (2018), 713 . Yuichi Mori and Shin-Ei Kudo. 2018. Detecting colorectal polyps via machine learning. Nature Biomedical Engineering 2, 10 (2018), 713.","journal-title":"Nature Biomedical Engineering"},{"key":"e_1_2_1_45_1","volume-title":"Proceedings of MediaEval","author":"Ali Naqvi Syed Sadiq","year":"2017","unstructured":"Syed Sadiq Ali Naqvi , Shees Nadeem , Muhammad Zaid , and Muhammad Atif Tahir . 2017 . Ensemble of texture features for finding abnormalities in the gastro-intestinal tract . In Proceedings of MediaEval 2017. Syed Sadiq Ali Naqvi, Shees Nadeem, Muhammad Zaid, and Muhammad Atif Tahir. 2017. Ensemble of texture features for finding abnormalities in the gastro-intestinal tract. In Proceedings of MediaEval 2017."},{"key":"e_1_2_1_46_1","volume-title":"Proceedings of MediaEval","author":"Ostroukhova Olga","year":"2018","unstructured":"Olga Ostroukhova , Konstantin Pogorelov , Michael Riegler , Duc-Tien Dang-Nguyen , and P\u00e5l Halvorsen . 2018 . Transfer learning with prioritized classification and training dataset equalization for medical objects detection . In Proceedings of MediaEval 2018. Olga Ostroukhova, Konstantin Pogorelov, Michael Riegler, Duc-Tien Dang-Nguyen, and P\u00e5l Halvorsen. 2018. Transfer learning with prioritized classification and training dataset equalization for medical objects detection. In Proceedings of MediaEval 2018."},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1109\/TBME.2012.2188397"},{"key":"e_1_2_1_48_1","volume-title":"Proceedings of MediaEval","author":"Petscharnig Stefan","year":"2017","unstructured":"Stefan Petscharnig , Klaus Sch\u00f6ffmann , and Mathias Lux . 2017 . An inception-like CNN architecture for GI disease and anatomical landmark classification . In Proceedings of MediaEval 2017. Stefan Petscharnig, Klaus Sch\u00f6ffmann, and Mathias Lux. 2017. An inception-like CNN architecture for GI disease and anatomical landmark classification. In Proceedings of MediaEval 2017."},{"key":"e_1_2_1_49_1","volume-title":"Proceedings of IEEE CBMS","author":"Pogorelov Konstantin","year":"2018","unstructured":"Konstantin Pogorelov , Olga Ostroukhova , Mattis Jeppsson , H\u00e5vard Espeland , Carsten Griwodz , Thomas de Lange , Dag Johansen , Michael Riegler , and P\u00e5l Halvorsen . 2018 . Deep learning and hand-crafted feature based approaches for polyp detection in medical videos . In Proceedings of IEEE CBMS 2018. 381--386. Konstantin Pogorelov, Olga Ostroukhova, Mattis Jeppsson, H\u00e5vard Espeland, Carsten Griwodz, Thomas de Lange, Dag Johansen, Michael Riegler, and P\u00e5l Halvorsen. 2018. Deep learning and hand-crafted feature based approaches for polyp detection in medical videos. In Proceedings of IEEE CBMS 2018. 381--386."},{"key":"e_1_2_1_50_1","volume-title":"Proceedings of ACM MMSys","author":"Pogorelov Konstantin","year":"2017","unstructured":"Konstantin Pogorelov , Kristin Ranheim Randel , Thomas de Lange , Sigrun Losada Eskeland , Carsten Griwodz , Dag Johansen , Concetto Spampinato , 2017 . Nerthus: A bowel preparation quality video dataset . In Proceedings of ACM MMSys 2017. 170--174. Konstantin Pogorelov, Kristin Ranheim Randel, Thomas de Lange, Sigrun Losada Eskeland, Carsten Griwodz, Dag Johansen, Concetto Spampinato, et al. 2017. Nerthus: A bowel preparation quality video dataset. In Proceedings of ACM MMSys 2017. 170--174."},{"key":"e_1_2_1_51_1","volume-title":"Proceedings of ACM MMSys","author":"Pogorelov Konstantin","year":"2017","unstructured":"Konstantin Pogorelov , Kristin Ranheim Randel , Carsten Griwodz , Sigrun Losada Eskeland , Thomas de Lange , Dag Johansen , Concetto Spampinato , 2017 . Kvasir: A multi-class image dataset for computer aided gastrointestinal disease detection . In Proceedings of ACM MMSys 2017. 164--169. Konstantin Pogorelov, Kristin Ranheim Randel, Carsten Griwodz, Sigrun Losada Eskeland, Thomas de Lange, Dag Johansen, Concetto Spampinato, et al. 2017. Kvasir: A multi-class image dataset for computer aided gastrointestinal disease detection. In Proceedings of ACM MMSys 2017. 164--169."},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11042-017-4989-y"},{"key":"e_1_2_1_53_1","volume-title":"Proceedings of MediaEval","author":"Pogorelov Konstantin","year":"2018","unstructured":"Konstantin Pogorelov , Michael Riegler , P\u00e5l Halvorsen , Thomas De Lange , Kristin Ranheim Randel , Duc-Tien Dang-Nguyen , Mathias Lux , and Olga Ostroukhova . 2018 . Medico multimedia task at MediaEval 2018 . In Proceedings of MediaEval 2018. Konstantin Pogorelov, Michael Riegler, P\u00e5l Halvorsen, Thomas De Lange, Kristin Ranheim Randel, Duc-Tien Dang-Nguyen, Mathias Lux, and Olga Ostroukhova. 2018. Medico multimedia task at MediaEval 2018. In Proceedings of MediaEval 2018."},{"key":"e_1_2_1_54_1","volume-title":"Proceedings of MediaEval","author":"Pogorelov Konstantin","year":"2017","unstructured":"Konstantin Pogorelov , Michael Riegler , P\u00e5l Halvorsen , Carsten Griwodz , Thomas de Lange , Kristin Randel , Sigrun Eskeland , Dang Nguyen , Duc Tien , and Olga Ostroukhova . 2017 . A comparison of deep learning with global features for gastrointestinal disease detection . In Proceedings of MediaEval 2017. Konstantin Pogorelov, Michael Riegler, P\u00e5l Halvorsen, Carsten Griwodz, Thomas de Lange, Kristin Randel, Sigrun Eskeland, Dang Nguyen, Duc Tien, and Olga Ostroukhova. 2017. A comparison of deep learning with global features for gastrointestinal disease detection. In Proceedings of MediaEval 2017."},{"key":"e_1_2_1_55_1","volume-title":"Proceedings of MediaEval","author":"Pogorelov Konstantin","year":"2018","unstructured":"Konstantin Pogorelov , Michael Riegler , P\u00e5l Halvorsen , Thomas De Lange , Kristin Ranheim Randel , Duc-Tien Dang-Nguyen , Mathias Lux , and Olga Ostroukhova . 2018 . Medico multimedia task at MediaEval 2018 . In Proceedings of MediaEval 2018. Konstantin Pogorelov, Michael Riegler, P\u00e5l Halvorsen, Thomas De Lange, Kristin Ranheim Randel, Duc-Tien Dang-Nguyen, Mathias Lux, and Olga Ostroukhova. 2018. Medico multimedia task at MediaEval 2018. In Proceedings of MediaEval 2018."},{"key":"e_1_2_1_56_1","volume-title":"Proceedings of ACM MM","author":"Riegler Michael","year":"2014","unstructured":"Michael Riegler , Martha Larson , Mathias Lux , and Christoph Kofler . 2014 . How \u2018how\u2019 reflects what\u2019s what: Content-based exploitation of how users frame social images . In Proceedings of ACM MM 2014. 397--406. Michael Riegler, Martha Larson, Mathias Lux, and Christoph Kofler. 2014. How \u2018how\u2019 reflects what\u2019s what: Content-based exploitation of how users frame social images. In Proceedings of ACM MM 2014. 397--406."},{"key":"e_1_2_1_57_1","volume-title":"Proceedings of ACM MM","author":"Riegler Michael","year":"2016","unstructured":"Michael Riegler , Mathias Lux , Carsten Griwodz , Concetto Spampinato , Thomas de Lange , Sigrun L. Eskeland , Konstantin Pogorelov , 2016 . Multimedia and medicine: Teammates for better disease detection and survival . In Proceedings of ACM MM 2016. 968--977. Michael Riegler, Mathias Lux, Carsten Griwodz, Concetto Spampinato, Thomas de Lange, Sigrun L. Eskeland, Konstantin Pogorelov, et al. 2016. Multimedia and medicine: Teammates for better disease detection and survival. In Proceedings of ACM MM 2016. 968--977."},{"key":"e_1_2_1_58_1","first-page":"26","article-title":"From annotation to computer-aided diagnosis: Detailed evaluation of a medical multimedia system","volume":"13","author":"Riegler Michael","year":"2017","unstructured":"Michael Riegler , Konstantin Pogorelov , Sigrun Losada Eskeland , Peter Thelin Schmidt , Zeno Albisser , Dag Johansen , Carsten Griwodz , P\u00e5l Halvorsen , and Thomas De Lange . 2017 . From annotation to computer-aided diagnosis: Detailed evaluation of a medical multimedia system . ACM Transactions on Multimedia Computing, Communications, and Applications 13 , 3 (2017), 26 . Michael Riegler, Konstantin Pogorelov, Sigrun Losada Eskeland, Peter Thelin Schmidt, Zeno Albisser, Dag Johansen, Carsten Griwodz, P\u00e5l Halvorsen, and Thomas De Lange. 2017. From annotation to computer-aided diagnosis: Detailed evaluation of a medical multimedia system. ACM Transactions on Multimedia Computing, Communications, and Applications 13, 3 (2017), 26.","journal-title":"ACM Transactions on Multimedia Computing, Communications, and Applications"},{"key":"e_1_2_1_59_1","volume-title":"Proceedings of MediaEval","author":"Riegler Michael","year":"2017","unstructured":"Michael Riegler , Konstantin Pogorelov , P\u00e5l Halvorsen , Kristin Randel , Sigrun Losada Eskeland , Duc-Tien Dang-Nguyen , Mathias Lux , Carsten Griwodz , Concetto Spampinato , and Thomas Lange . 2017 . Multimedia for medicine: The Medico Task at MediaEval 2017 . In Proceedings of MediaEval 2017. Michael Riegler, Konstantin Pogorelov, P\u00e5l Halvorsen, Kristin Randel, Sigrun Losada Eskeland, Duc-Tien Dang-Nguyen, Mathias Lux, Carsten Griwodz, Concetto Spampinato, and Thomas Lange. 2017. Multimedia for medicine: The Medico Task at MediaEval 2017. In Proceedings of MediaEval 2017."},{"key":"e_1_2_1_60_1","unstructured":"Sebastian Ruder. 2016. An overview of gradient descent optimization algorithms. arXiv:1609.04747.  Sebastian Ruder. 2016. An overview of gradient descent optimization algorithms. arXiv:1609.04747."},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-015-0816-y"},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF00993309"},{"key":"e_1_2_1_63_1","volume-title":"Proceedings of IEEE EMBC","author":"Shin Younghak","year":"2017","unstructured":"Younghak Shin and Ilangko Balasingham . 2017 . Comparison of hand-craft feature based SVM and CNN based deep learning framework for automatic polyp classification . In Proceedings of IEEE EMBC 2017. 3277--3280. Younghak Shin and Ilangko Balasingham. 2017. Comparison of hand-craft feature based SVM and CNN based deep learning framework for automatic polyp classification. In Proceedings of IEEE EMBC 2017. 3277--3280."},{"key":"e_1_2_1_64_1","volume-title":"Proceedings of MediaEval","author":"Steiner Michael","year":"2018","unstructured":"Michael Steiner , Mathias Lux , and P\u00e5l Halvorsen . 2018 . The 2018 Medico Multimedia Task submission of Team NOAT using neural network features and search-based classification . In Proceedings of MediaEval 2018. Michael Steiner, Mathias Lux, and P\u00e5l Halvorsen. 2018. The 2018 Medico Multimedia Task submission of Team NOAT using neural network features and search-based classification. In Proceedings of MediaEval 2018."},{"key":"e_1_2_1_65_1","volume-title":"Proceedings of PKDD","author":"Sumner Marc","year":"2005","unstructured":"Marc Sumner , Eibe Frank , and Mark Hall . 2005 . Speeding up logistic model tree induction . In Proceedings of PKDD 2005. 675--683. Marc Sumner, Eibe Frank, and Mark Hall. 2005. Speeding up logistic model tree induction. In Proceedings of PKDD 2005. 675--683."},{"key":"e_1_2_1_66_1","volume-title":"Proceedings of ICML","author":"Sutskever Ilya","year":"2013","unstructured":"Ilya Sutskever , James Martens , George Dahl , and Geoffrey Hinton . 2013 . On the importance of initialization and momentum in deep learning . In Proceedings of ICML 2013. 1139--1147. Ilya Sutskever, James Martens, George Dahl, and Geoffrey Hinton. 2013. On the importance of initialization and momentum in deep learning. In Proceedings of ICML 2013. 1139--1147."},{"key":"e_1_2_1_67_1","volume-title":"Proceedings of IEEE ISBI","author":"Tajbakhsh Nima","year":"2015","unstructured":"Nima Tajbakhsh , Suryakanth R. Gurudu , and Jianming Liang . 2015 . Automatic polyp detection in colonoscopy videos using an ensemble of convolutional neural networks . In Proceedings of IEEE ISBI 2015. 79--83. Nima Tajbakhsh, Suryakanth R. Gurudu, and Jianming Liang. 2015. Automatic polyp detection in colonoscopy videos using an ensemble of convolutional neural networks. In Proceedings of IEEE ISBI 2015. 79--83."},{"key":"e_1_2_1_68_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMI.2015.2487997"},{"key":"e_1_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMI.2016.2535302"},{"key":"e_1_2_1_70_1","volume-title":"Proceedings of MediaEval","author":"Taschwer Mario","year":"2018","unstructured":"Mario Taschwer , Manfred J\u00fcrgen Primus , Klaus Schoeffmann , and Oge Marques . 2018 . Early and late fusion of classifiers for the MediaEval Medico Task . In Proceedings of MediaEval 2018. Mario Taschwer, Manfred J\u00fcrgen Primus, Klaus Schoeffmann, and Oge Marques. 2018. Early and late fusion of classifiers for the MediaEval Medico Task. In Proceedings of MediaEval 2018."},{"key":"e_1_2_1_71_1","volume-title":"Proceedings of MediaEval","author":"Thambawita Vajira","year":"2018","unstructured":"Vajira Thambawita , Debesh Jha , Michael Riegler , P\u00e5l Halvorsen , Hugo Lewi Hammer , H\u00e5vard D. Johansen , and Dag Johansen . 2018 . The Medico-Task 2018: Disease detection in the gastrointestinal tract using global features and deep learning . In Proceedings of MediaEval 2018. Vajira Thambawita, Debesh Jha, Michael Riegler, P\u00e5l Halvorsen, Hugo Lewi Hammer, H\u00e5vard D. Johansen, and Dag Johansen. 2018. The Medico-Task 2018: Disease detection in the gastrointestinal tract using global features and deep learning. In Proceedings of MediaEval 2018."},{"key":"e_1_2_1_72_1","volume-title":"Proceedings of IEEE CVPR","author":"Torralba A.","year":"2011","unstructured":"A. Torralba and A. A. Efros . 2011. Unbiased look at dataset bias . In Proceedings of IEEE CVPR 2011 . 1521--1528. A. Torralba and A. A. Efros. 2011. Unbiased look at dataset bias. In Proceedings of IEEE CVPR 2011. 1521--1528."},{"key":"e_1_2_1_73_1","first-page":"4037190","article-title":"A benchmark for endoluminal scene segmentation of colonoscopy images","volume":"2017","author":"V\u00e1zquez David","year":"2017","unstructured":"David V\u00e1zquez , Jorge Bernal , F. Javier S\u00e1nchez , Gloria Fern\u00e1ndez-Esparrach , Antonio M. L\u00f3pez , Adriana Romero , Michal Drozdzal , and Aaron C. Courville . 2017 . A benchmark for endoluminal scene segmentation of colonoscopy images . Journal of Healthcare Engineering 2017 (2017), 4037190 . David V\u00e1zquez, Jorge Bernal, F. Javier S\u00e1nchez, Gloria Fern\u00e1ndez-Esparrach, Antonio M. L\u00f3pez, Adriana Romero, Michal Drozdzal, and Aaron C. Courville. 2017. A benchmark for endoluminal scene segmentation of colonoscopy images. Journal of Healthcare Engineering 2017 (2017), 4037190.","journal-title":"Journal of Healthcare Engineering"},{"key":"e_1_2_1_74_1","doi-asserted-by":"crossref","unstructured":"L. Von Karsa J. Patnick and N. Segnan. 2012. European guidelines for quality assurance in colorectal cancer screening and diagnosis. First edition\u2014Executive summary. Endoscopy 44 Suppl. 3 (2012) SE1--SE8.  L. Von Karsa J. Patnick and N. Segnan. 2012. European guidelines for quality assurance in colorectal cancer screening and diagnosis. First edition\u2014Executive summary. Endoscopy 44 Suppl. 3 (2012) SE1--SE8.","DOI":"10.1055\/s-0032-1309822"},{"key":"e_1_2_1_75_1","doi-asserted-by":"crossref","first-page":"741","DOI":"10.1038\/s41551-018-0301-3","article-title":"Development and validation of a deep-learning algorithm for the detection of polyps during colonoscopy","volume":"2","author":"Wang Pu","year":"2018","unstructured":"Pu Wang , Xiao Xiao , Jeremy R. Glissen Brown , Tyler M. Berzin , Mengtian Tu , Fei Xiong , Xiao Hu , 2018 . Development and validation of a deep-learning algorithm for the detection of polyps during colonoscopy . Nature Biomedical Engineering 2 , 10 (2018), 741 . Pu Wang, Xiao Xiao, Jeremy R. Glissen Brown, Tyler M. Berzin, Mengtian Tu, Fei Xiong, Xiao Hu, et al. 2018. Development and validation of a deep-learning algorithm for the detection of polyps during colonoscopy. Nature Biomedical Engineering 2, 10 (2018), 741.","journal-title":"Nature Biomedical Engineering"},{"key":"e_1_2_1_76_1","doi-asserted-by":"publisher","DOI":"10.1109\/JBHI.2013.2285230"},{"key":"e_1_2_1_77_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cmpb.2015.04.002"},{"key":"e_1_2_1_78_1","doi-asserted-by":"publisher","DOI":"10.1109\/JBHI.2016.2637004"},{"key":"e_1_2_1_79_1","doi-asserted-by":"crossref","first-page":"1250","DOI":"10.1109\/JBHI.2017.2734329","article-title":"Automatic polyp detection via a novel unified bottom-up and top-down saliency approach","volume":"22","author":"Yuan Yixuan","year":"2018","unstructured":"Yixuan Yuan , Dengwang Li , and Max Q.-H. Meng . 2018 . Automatic polyp detection via a novel unified bottom-up and top-down saliency approach . IEEE Journal of Biomedical and Health Informatics 22 , 4 (2018), 1250 -- 1260 . Yixuan Yuan, Dengwang Li, and Max Q.-H. Meng. 2018. Automatic polyp detection via a novel unified bottom-up and top-down saliency approach. IEEE Journal of Biomedical and Health Informatics 22, 4 (2018), 1250--1260.","journal-title":"IEEE Journal of Biomedical and Health Informatics"},{"key":"e_1_2_1_80_1","volume-title":"ADADELTA: An adaptive learning rate method. arXiv:1212.5701.","author":"Zeiler Matthew D.","year":"2012","unstructured":"Matthew D. Zeiler . 2012 . ADADELTA: An adaptive learning rate method. arXiv:1212.5701. Matthew D. Zeiler. 2012. ADADELTA: An adaptive learning rate method. arXiv:1212.5701."},{"key":"e_1_2_1_81_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0214133"},{"key":"e_1_2_1_82_1","doi-asserted-by":"crossref","first-page":"e0185508","DOI":"10.1371\/journal.pone.0185508","article-title":"Gastric precancerous diseases classification using CNN with a concise model","volume":"12","author":"Zhang Xu","year":"2017","unstructured":"Xu Zhang , Weiling Hu , Fei Chen , Jiquan Liu , Yuanhang Yang , Liangjing Wang , Huilong Duan , and Jianmin Si . 2017 . Gastric precancerous diseases classification using CNN with a concise model . PloS One 12 , 9 (2017), e0185508 . Xu Zhang, Weiling Hu, Fei Chen, Jiquan Liu, Yuanhang Yang, Liangjing Wang, Huilong Duan, and Jianmin Si. 2017. Gastric precancerous diseases classification using CNN with a concise model. PloS One 12, 9 (2017), e0185508.","journal-title":"PloS One"},{"key":"e_1_2_1_83_1","volume-title":"Proceedings of IEEE BMEI2014","author":"Zhou Mingda","year":"2014","unstructured":"Mingda Zhou , Guanqun Bao , Yishuang Geng , Bader Alkandari , and Xiaoxi Li . 2014 . Polyp detection and radius measurement in small intestine using video capsule endoscopy . In Proceedings of IEEE BMEI2014 . 237--241. Mingda Zhou, Guanqun Bao, Yishuang Geng, Bader Alkandari, and Xiaoxi Li. 2014. Polyp detection and radius measurement in small intestine using video capsule endoscopy. In Proceedings of IEEE BMEI2014. 237--241."}],"container-title":["ACM Transactions on Computing for Healthcare"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3386295","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3386295","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T22:38:26Z","timestamp":1750199906000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3386295"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,6,22]]},"references-count":83,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2020,7,31]]}},"alternative-id":["10.1145\/3386295"],"URL":"https:\/\/doi.org\/10.1145\/3386295","relation":{},"ISSN":["2691-1957","2637-8051"],"issn-type":[{"type":"print","value":"2691-1957"},{"type":"electronic","value":"2637-8051"}],"subject":[],"published":{"date-parts":[[2020,6,22]]},"assertion":[{"value":"2019-03-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-02-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-06-22","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}