{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,30]],"date-time":"2026-04-30T14:23:34Z","timestamp":1777559014351,"version":"3.51.4"},"reference-count":42,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2019,2,26]],"date-time":"2019-02-26T00:00:00Z","timestamp":1551139200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>In recent years, large datasets of high-resolution mammalian neural images have become available, which has prompted active research on the analysis of gene expression data. Traditional image processing methods are typically applied for learning functional representations of genes, based on their expressions in these brain images. In this paper, we describe a novel end-to-end deep learning-based method for generating compact representations of in situ hybridization (ISH) images, which are invariant-to-translation. In contrast to traditional image processing methods, our method relies, instead, on deep convolutional denoising autoencoders (CDAE) for processing raw pixel inputs, and generating the desired compact image representations. We provide an in-depth description of our deep learning-based approach, and present extensive experimental results, demonstrating that representations extracted by CDAE can help learn features of functional gene ontology categories for their classification in a highly accurate manner. Our methods improve the previous state-of-the-art classification rate (Liscovitch, et al.) from an average AUC of 0.92 to 0.997, i.e., it achieves 96% reduction in error rate. Furthermore, the representation vectors generated due to our method are more compact in comparison to previous state-of-the-art methods, allowing for a more efficient high-level representation of images. These results are obtained with significantly downsampled images in comparison to the original high-resolution ones, further underscoring the robustness of our proposed method.<\/jats:p>","DOI":"10.3390\/e21030221","type":"journal-article","created":{"date-parts":[[2019,2,26]],"date-time":"2019-02-26T11:00:44Z","timestamp":1551178844000},"page":"221","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["Supervised and Unsupervised End-to-End Deep Learning for Gene Ontology Classification of Neural In Situ Hybridization Images"],"prefix":"10.3390","volume":"21","author":[{"given":"Ido","family":"Cohen","sequence":"first","affiliation":[{"name":"Department of Computer Science, Bar-Ilan University, Ramat-Gan 5290002, Israel"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2904-4982","authenticated-orcid":false,"given":"Eli (Omid)","family":"David","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Bar-Ilan University, Ramat-Gan 5290002, Israel"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Nathan S.","family":"Netanyahu","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Bar-Ilan University, Ramat-Gan 5290002, Israel"},{"name":"Gonda Brain Research Center, Bar-Ilan University, Ramat-Gan 5290002, Israel"},{"name":"Center for Automation Research, UMIACS, University of Maryland at College Park, College Park, MD 20742, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2019,2,26]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"168","DOI":"10.1038\/nature05453","article-title":"Genome-wide atlas of gene expression in the adult mouse brain","volume":"445","author":"Lein","year":"2007","journal-title":"Nature"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"356","DOI":"10.1038\/nn.2281","article-title":"An anatomic gene expression atlas of the adult mouse brain","volume":"12","author":"Ng","year":"2009","journal-title":"Nat. Neurosci."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"539","DOI":"10.1007\/s00335-012-9406-2","article-title":"High-resolution gene expression atlases for adult and developing mouse brain and spinal cord","volume":"23","author":"Henry","year":"2012","journal-title":"Mamm. Genome"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Puniyani, K., and Xing, E.P. (2013). GINI: From ISH images to gene interaction networks. PLoS Comput. Biol., 9.","DOI":"10.1371\/journal.pcbi.1003227"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"The Gene Ontology Consortium (2008). The gene ontology project in 2008. Nucleic Acids Res., 36, D440\u2013D444.","DOI":"10.1093\/nar\/gkm883"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1038\/75556","article-title":"Gene ontology: Tool for the unification of biology","volume":"25","author":"Ashburner","year":"2000","journal-title":"Nat. Genet."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"2084","DOI":"10.1093\/bioinformatics\/bth207","article-title":"Gene annotation from scientific literature using mappings between keyword systems","volume":"20","author":"Perez","year":"2004","journal-title":"Bioinformatics"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"723","DOI":"10.1093\/bib\/bbr002","article-title":"The what, where, how and why of gene ontology\u2014A primer for bioinformaticians","volume":"12","author":"Skunca","year":"2011","journal-title":"Brief. Bioinform."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1647","DOI":"10.1093\/bioinformatics\/btp288","article-title":"A tool for identification of genes expressed in patterns of interest using the Allen Brain Atlas","volume":"25","author":"Davis","year":"2009","journal-title":"Bioinformatics"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"933","DOI":"10.1016\/j.neunet.2011.06.012","article-title":"Multi-scale correlation structure of gene expression in the brain","volume":"24","author":"Hawrylycz","year":"2011","journal-title":"Neural Netw."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"245","DOI":"10.1176\/jnp.2009.21.3.245","article-title":"Evaluating the affective component of the cerebellar cognitive affective syndrome","volume":"21","author":"Wolf","year":"2009","journal-title":"J. Neuropsychol. Clin. Neurosci."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"i36","DOI":"10.1093\/bioinformatics\/btt207","article-title":"FuncISH: Learning a functional representation of neural ISH images","volume":"29","author":"Liscovitch","year":"2013","journal-title":"Bioinformatics"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1023\/B:VISI.0000029664.99615.94","article-title":"Distinctive image features from scale-invariant keypoints","volume":"60","author":"Lowe","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Kordmahalleh, M.M., Homaifar, A., and Dukka, B.K. (2013, January 10\u201313). Hierarchical multi-label gene function prediction using adaptive mutation in crowding niching. Proceedings of the IEEE International Conference on Bioinformatics and Bioengineering, Chania, Greece.","DOI":"10.1109\/BIBE.2013.6701563"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"896","DOI":"10.1101\/gr.440803","article-title":"Predicting gene function from patterns of annotation","volume":"13","author":"King","year":"2013","journal-title":"Genome Res."},{"key":"ref_16","unstructured":"Vembu, S., and Morris, Q. (2014, January 3\u20137). An efficient algorithm to integrate network and attribute data for gene function prediction. Proceedings of the Pacific Symposium on Biocomputing, Big Island, HI, USA."},{"key":"ref_17","unstructured":"Zitnik, M., and Zupan, B. (2014, January 3\u20137). Matrix factorization-based data fusion for gene function prediction in baker\u2019s yeast and slime mold. Proceedings of the Pacific Symposium on Biocomputing, Big Island, HI, USA."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Pinoli, P., Chicco, D., and Masseroli, M. (2015). Computational algorithms to predict gene ontology annotations. BMC Bioinform., 16.","DOI":"10.1186\/1471-2105-16-S6-S4"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Cohen, I., David, E.O., Netanyahu, N.S., Liscovitch, N., and Chechik, G. (2017, January 11\u201314). DeepBrain: Functional representation of neural in situ hybridization images for gene ontology classification using deep convolutional autoencoders. Proceedings of the International Conference on Artificial Neural Networks, Alghero, Italy.","DOI":"10.1007\/978-3-319-68612-7_33"},{"key":"ref_20","unstructured":"Krizhevsky, A., and Hinton, G.E. (2011, January 27\u201329). Using very deep autoencoders for content-based image retrieval. Proceedings of the European Symposium on Artificial Neural Networks, Bruges, Belgium."},{"key":"ref_21","unstructured":"(2019, February 20). Comparative Mammalian Brain Collections. Available online: http:\/\/neurosciencelibrary.org\/index.html."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Brown, M., and Lowe, D.G. (2003, January 13\u201316). Recognising panoramas. Proceedings of the 9th International Conference on Computer Vision, Nice, France.","DOI":"10.1109\/ICCV.2003.1238630"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"541","DOI":"10.1162\/neco.1989.1.4.541","article-title":"Backpropagation 550 applied to handwritten zip code recognition","volume":"1","author":"LeCun","year":"1989","journal-title":"Neural Comput."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"2278","DOI":"10.1109\/5.726791","article-title":"Gradient-based learning applied to document recognition","volume":"86","author":"LeCun","year":"1998","journal-title":"Proc. IEEE"},{"key":"ref_25","unstructured":"Krizhevsky, A., Sutskever, I., and Hinton, G.E. (2012, January 3\u20136). ImageNet classification with deep convolutional neural networks. Proceedings of the Advances in Neural Information Processing Systems, Lake Tahoe, NV, USA."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/978-3-540-45169-3_1","article-title":"Hierarchical neural networks for image interpretation","volume":"2766","author":"Behnke","year":"2003","journal-title":"Lect. Notes Comput. Sci."},{"key":"ref_27","unstructured":"Krizhevsky, A. (2009). Learning Multiple Layers of Features from Tiny Images. [Master\u2019s Thesis, Computer Science Department, University of Toronto]."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"1527","DOI":"10.1162\/neco.2006.18.7.1527","article-title":"A fast learning algorithm for deep belief nets","volume":"18","author":"Hinton","year":"2006","journal-title":"Neural Comput."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Vincent, P., Larochelle, H., Bengio, Y., and Manzagol, P.A. (2008, January 5\u20139). Extracting and composing robust features with denoising autoencoders. Proceedings of the 25th International Conference on Machine Learning, Helsinki, Finland.","DOI":"10.1145\/1390156.1390294"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"533","DOI":"10.1038\/323533a0","article-title":"Learning representations by back-propagating errors","volume":"323","author":"Rumelhart","year":"1986","journal-title":"Nature"},{"key":"ref_31","first-page":"3371","article-title":"Stacked denoising autoencoders: Learning useful representations in a deep network with a local denoising criterion","volume":"11","author":"Vincent","year":"2010","journal-title":"J. Mach. Learn. Res."},{"key":"ref_32","unstructured":"Turchenko, V., and Luczak, A. (arXiv, 2015). Creation of a deep convolutional auto-encoder in Caffe, arXiv."},{"key":"ref_33","unstructured":"Lowe, D., and Helmer, S. (July, January 27). Object class recognition with many local features. Proceedings of the Workshop on Generative Model Based Vision, Washington, DC, USA."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Serre, T., Wolf, L., and Poggio, T. (2005, January 20\u201325). Object recognition with features inspired by visual cortex. Proceedings of the Computer Vision and Pattern Recognition Conference, San Diego, CA, USA.","DOI":"10.21236\/ADA454604"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Masci, J., Meier, U., Ciresan, D., and Schmidhuber, J. (2011, January 14\u201317). Stacked convolutional auto-encoders for hierarchical feature extraction. Proceedings of the International Conference on Artificial Neural Networks, Espoo, Finland.","DOI":"10.1007\/978-3-642-21735-7_7"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Zeiler, M.D., Taylor, G.W., and Fergus, R. (2011, January 6\u201313). Adaptive deconvolutional networks for mid and high level feature learning. Proceedings of the International Conference on Computer Vision, Barcelona, Spain.","DOI":"10.1109\/ICCV.2011.6126474"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Zeiler, M.D., and Fergus, R. (2014, January 6\u201312). Visualizing and understanding convolutional networks. Proceedings of the European Conference on Computer Vision, Zurich, Switzerland.","DOI":"10.1007\/978-3-319-10590-1_53"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Zeng, T., Li, R., Mukkamala, R., Ye, J., and Ji, S. (2015). Deep convolutional neural networks for annotating gene 544 expression patterns in the mouse brain. BMC Bioinform., 16.","DOI":"10.1186\/s12859-015-0553-9"},{"key":"ref_39","unstructured":"Sermanet, P., Eigen, D., Zhang, X., Mathieu, M., Fergus, R., and LeCun, Y. (2014, January 14\u201316). OverFeat: Integrated recognition, localization and detection using convolutional networks. Proceedings of the International Conference on Learning Representations, Banff, AB, Canada."},{"key":"ref_40","unstructured":"Simonyan, K., and Zisserman, A. (arXiv, 2014). Very deep convolutional networks for large-scale image recognition, arXiv."},{"key":"ref_41","unstructured":"Lee, H., Ekanadham, C., and Ng, A. (2007, January 3\u20136). Sparse deep belief net model for visual area V2. Proceedings of the Advances in Neural Information Processing Systems, Vancouver, BC, Canada."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Le, Q.V., Monga, R., Devin, M., Chen, K., Corrado, G.S., Dean, J., and Ng, A. (2013, January 26\u201331). Building high-level features using large scale unsupervised learning. Proceedings of the International Conference on Machine Learning, Vancouver, BC, Canada.","DOI":"10.1109\/ICASSP.2013.6639343"}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/21\/3\/221\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T12:34:47Z","timestamp":1760186087000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/21\/3\/221"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,2,26]]},"references-count":42,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2019,3]]}},"alternative-id":["e21030221"],"URL":"https:\/\/doi.org\/10.3390\/e21030221","relation":{},"ISSN":["1099-4300"],"issn-type":[{"value":"1099-4300","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,2,26]]}}}