{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,24]],"date-time":"2026-03-24T15:57:25Z","timestamp":1774367845478,"version":"3.50.1"},"reference-count":57,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2023,2,27]],"date-time":"2023-02-27T00:00:00Z","timestamp":1677456000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"National Key Research and Development Program of China","award":["2018AAA0102702"],"award-info":[{"award-number":["2018AAA0102702"]}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["62172020"],"award-info":[{"award-number":["62172020"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Multimedia Comput. Commun. Appl."],"published-print":{"date-parts":[[2023,7,31]]},"abstract":"<jats:p>With the progress of Mars exploration, numerous Mars image data are being collected and need to be analyzed. However, due to the severe train-test gap and quality distortion of Martian data, the performance of existing computer vision models is unsatisfactory. In this article, we introduce a semi-supervised framework for machine vision on Mars and try to resolve two specific tasks: classification and segmentation. Contrastive learning is a powerful representation learning technique. However, there is too much information overlap between Martian data samples, leading to a contradiction between contrastive learning and Martian data. Our key idea is to reconcile this contradiction with the help of annotations and further take advantage of unlabeled data to improve performance. For classification, we propose to ignore inner-class pairs on labeled data as well as neglect negative pairs on unlabeled data, forming supervised inter-class contrastive learning and unsupervised similarity learning. For segmentation, we extend supervised inter-class contrastive learning into an element-wise mode and use online pseudo labels for supervision on unlabeled areas. Experimental results show that our learning strategies can improve the classification and segmentation models by a large margin and outperform state-of-the-art approaches.<\/jats:p>","DOI":"10.1145\/3572916","type":"journal-article","created":{"date-parts":[[2022,12,1]],"date-time":"2022-12-01T12:41:10Z","timestamp":1669898470000},"page":"1-23","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":12,"title":["Semi-supervised Learning for Mars Imagery Classification and Segmentation"],"prefix":"10.1145","volume":"19","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3951-3877","authenticated-orcid":false,"given":"Wenjing","family":"Wang","sequence":"first","affiliation":[{"name":"Wangxuan Institute of Computer Technology, Peking University, Beijing, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3229-4096","authenticated-orcid":false,"given":"Lilang","family":"Lin","sequence":"additional","affiliation":[{"name":"Wangxuan Institute of Computer Technology, Peking University, Beijing, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6205-3808","authenticated-orcid":false,"given":"Zejia","family":"Fan","sequence":"additional","affiliation":[{"name":"Wangxuan Institute of Computer Technology, Peking University, Beijing, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0468-9576","authenticated-orcid":false,"given":"Jiaying","family":"Liu","sequence":"additional","affiliation":[{"name":"Wangxuan Institute of Computer Technology, Peking University, Beijing, China"}]}],"member":"320","published-online":{"date-parts":[[2023,2,27]]},"reference":[{"key":"e_1_3_2_2_2","volume-title":"IEEE Aerospace Conference","author":"Abcouwer Neil","year":"2021","unstructured":"Neil Abcouwer, Shreyansh Daftry, Siddarth Venkatraman, Tyler del Sesto, Olivier Toupet, Ravi Lanka, Jialin Song, Yisong Yue, and Masahiro Ono. 2021. Machine learning based path planning for improved rover navigation. In IEEE Aerospace Conference."},{"key":"e_1_3_2_3_2","article-title":"Integrating machine learning for planetary science: Perspectives for the next decade","author":"Azari Abigail R.","year":"2020","unstructured":"Abigail R. Azari, John B. Biersteker, Ryan M. Dewey, Gary Doran, Emily J. Forsberg, Camilla D. K. Harris, Hannah R. Kerner, Katherine A. Skinner, Andy W. Smith, Rashied Amini, Saverio Cambioni, Victoria Da Poian, Tadhg M. Garton, Michael D. Himes, Sarah Millholland, and Suranga Ruhunusiri. 2020. Integrating machine learning for planetary science: Perspectives for the next decade. arXiv (2020).","journal-title":"arXiv"},{"key":"e_1_3_2_4_2","volume-title":"IEEE International Conference on Computer Vision","author":"Beyer Lucas","year":"2019","unstructured":"Lucas Beyer, Xiaohua Zhai, Avital Oliver, and Alexander Kolesnikov. 2019. S4L: Self-supervised semi-supervised learning. In IEEE International Conference on Computer Vision."},{"key":"e_1_3_2_5_2","volume-title":"IEEE Conference on Computer Vision and Pattern Recognition","author":"Bouman Katherine L.","year":"2016","unstructured":"Katherine L. Bouman, Michael D. Johnson, Daniel Zoran, Vincent L. Fish, Sheperd S. Doeleman, and William T. Freeman. 2016. Computational imaging for VLBI image reconstruction. In IEEE Conference on Computer Vision and Pattern Recognition."},{"key":"e_1_3_2_6_2","volume-title":"Conference on Neural Information Processing Systems","author":"Cao Kaidi","year":"2019","unstructured":"Kaidi Cao, Colin Wei, Adrien Gaidon, Nikos Ar\u00e9chiga, and Tengyu Ma. 2019. Learning imbalanced datasets with label-distribution-aware margin loss. In Conference on Neural Information Processing Systems."},{"key":"e_1_3_2_7_2","volume-title":"Conference on Neural Information Processing Systems","author":"Caron Mathilde","year":"2020","unstructured":"Mathilde Caron, Ishan Misra, Julien Mairal, Priya Goyal, Piotr Bojanowski, and Armand Joulin. 2020. Unsupervised learning of visual features by contrasting cluster assignments. In Conference on Neural Information Processing Systems."},{"key":"e_1_3_2_8_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00138-007-0081-3"},{"issue":"5","key":"e_1_3_2_9_2","doi-asserted-by":"crossref","first-page":"379","DOI":"10.1002\/rob.20192","article-title":"Oasis: Onboard autonomous science investigation system for opportunistic rover science","volume":"24","author":"Casta\u00f1o Rebecca","year":"2007","unstructured":"Rebecca Casta\u00f1o, Tara A. Estlin, Robert C. Anderson, Daniel M. Gaines, Andres Castano, Benjamin J. Bornstein, Caroline Chouinard, and Michele Judd. 2007. Oasis: Onboard autonomous science investigation system for opportunistic rover science. Journal of Field Robotics 24, 5 (2007), 379\u2013397.","journal-title":"Journal of Field Robotics"},{"key":"e_1_3_2_10_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-01234-2_49"},{"key":"e_1_3_2_11_2","volume-title":"International Conference on Machine Learning","author":"Chen Ting","year":"2020","unstructured":"Ting Chen, Simon Kornblith, Mohammad Norouzi, and Geoffrey Hinton. 2020. A simple framework for contrastive learning of visual representations. In International Conference on Machine Learning."},{"key":"e_1_3_2_12_2","article-title":"Improved baselines with momentum contrastive learning","author":"Chen Xinlei","year":"2020","unstructured":"Xinlei Chen, Haoqi Fan, Ross B. Girshick, and Kaiming He. 2020. Improved baselines with momentum contrastive learning. arXiv (2020).","journal-title":"arXiv"},{"key":"e_1_3_2_13_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00949"},{"key":"e_1_3_2_14_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2007.901238"},{"key":"e_1_3_2_15_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"e_1_3_2_16_2","article-title":"Improved regularization of convolutional neural networks with cutout","author":"Devries Terrance","year":"2017","unstructured":"Terrance Devries and Graham W. Taylor. 2017. Improved regularization of convolutional neural networks with cutout. arXiv (2017).","journal-title":"arXiv"},{"key":"e_1_3_2_17_2","doi-asserted-by":"publisher","DOI":"10.1109\/tpami.2015.2439281"},{"key":"e_1_3_2_18_2","volume-title":"IEEE Aerospace Conference","author":"Doran Gary","year":"2020","unstructured":"Gary Doran, Steven Lu, Maria Liukis, Lukas Mandrake, Umaa Rebbapragada, Kiri L. Wagstaff, Jimmie Young, Erik Langert, Anneliese Braunegg, Paul Horton, Daniel Jeong, and Asher Trockman. 2020. COSMIC: Content-based onboard summarization to monitor infrequent change. In IEEE Aerospace Conference."},{"key":"e_1_3_2_19_2","article-title":"Data augmentation using GANs","author":"Tanaka Fabio Henrique Kiyoiti dos Santos","year":"2019","unstructured":"Fabio Henrique Kiyoiti dos Santos Tanaka and Claus Aranha. 2019. Data augmentation using GANs. arXiv (2019).","journal-title":"arXiv"},{"key":"e_1_3_2_20_2","first-page":"23","article-title":"Machine-learning-driven new geologic discoveries at mars rover landing sites: Jezero and NE syrtis","author":"Dundar Murat","year":"2019","unstructured":"Murat Dundar, Bethany L. Ehlmann, and Ellen K. Leask. 2019. Machine-learning-driven new geologic discoveries at mars rover landing sites: Jezero and NE syrtis. Earth and Space Science Open Archive (2019), 23.","journal-title":"Earth and Space Science Open Archive"},{"key":"e_1_3_2_21_2","volume-title":"IEEE International Conference on Space Mission Challenges for Information Technology","author":"Estlin Tara","year":"2009","unstructured":"Tara Estlin, Rebecca Castano, Benjamin Bornstein, Daniel Gaines, Robert C. Anderson, Charles de Granville, David Thompson, Michael Burl, Michele Judd, and Steve Chien. 2009. Automated targeting for the MER rovers. In IEEE International Conference on Space Mission Challenges for Information Technology."},{"key":"e_1_3_2_22_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00975"},{"key":"e_1_3_2_23_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.90"},{"key":"e_1_3_2_24_2","doi-asserted-by":"publisher","DOI":"10.1145\/3417333"},{"key":"e_1_3_2_25_2","doi-asserted-by":"publisher","DOI":"10.1109\/83.597272"},{"key":"e_1_3_2_26_2","volume-title":"International Conference on Learning Representations","author":"Kang Bingyi","year":"2020","unstructured":"Bingyi Kang, Saining Xie, Marcus Rohrbach, Zhicheng Yan, Albert Gordo, Jiashi Feng, and Yannis Kalantidis. 2020. Decoupling representation and classifier for long-tailed recognition. In International Conference on Learning Representations."},{"key":"e_1_3_2_27_2","volume-title":"Conference on Neural Information Processing Systems","author":"Khosla Prannay","year":"2020","unstructured":"Prannay Khosla, Piotr Teterwak, Chen Wang, Aaron Sarna, Yonglong Tian, Phillip Isola, Aaron Maschinot, Ce Liu, and Dilip Krishnan. 2020. Supervised contrastive learning. In Conference on Neural Information Processing Systems."},{"key":"e_1_3_2_28_2","volume-title":"International Conference on Learning Representations","author":"Kingma Diederik P.","year":"2015","unstructured":"Diederik P. Kingma and Jimmy Ba. 2015. Adam: A method for stochastic optimization. In International Conference on Learning Representations."},{"key":"e_1_3_2_29_2","volume-title":"Conference on Neural Information Processing Systems","author":"Krizhevsky Alex","year":"2012","unstructured":"Alex Krizhevsky, Ilya Sutskever, and Geoffrey E. Hinton. 2012. ImageNet classification with deep convolutional neural networks. In Conference on Neural Information Processing Systems."},{"key":"e_1_3_2_30_2","volume-title":"International Conference on Machine Learning Workshops","author":"Lee Dong-Hyun","year":"2013","unstructured":"Dong-Hyun Lee. 2013. Pseudo-label: The simple and efficient semi-supervised learning method for deep neural networks. In International Conference on Machine Learning Workshops."},{"key":"e_1_3_2_31_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.324"},{"key":"e_1_3_2_32_2","article-title":"Bootstrapping semantic segmentation with regional contrast","author":"Liu Shikun","year":"2021","unstructured":"Shikun Liu, Shuaifeng Zhi, Edward Johns, and Andrew J. Davison. 2021. Bootstrapping semantic segmentation with regional contrast. arXiv (2021).","journal-title":"arXiv"},{"key":"e_1_3_2_33_2","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2016.2552172"},{"key":"e_1_3_2_34_2","article-title":"Machine learning for mars exploration","author":"Momennasab Ali","year":"2021","unstructured":"Ali Momennasab. 2021. Machine learning for mars exploration. arXiv (2021).","journal-title":"arXiv"},{"key":"e_1_3_2_35_2","volume-title":"IEEE Winter Conference on Applications of Computer Vision","author":"Olsson Viktor","year":"2021","unstructured":"Viktor Olsson, Wilhelm Tranheden, Juliano Pinto, and Lennart Svensson. 2021. ClassMix: Segmentation-based data augmentation for semi-supervised learning. In IEEE Winter Conference on Applications of Computer Vision."},{"key":"e_1_3_2_36_2","volume-title":"IEEE Conference on Computer Vision and Pattern Recognition","author":"Ouali Yassine","year":"2020","unstructured":"Yassine Ouali, C\u00e9line Hudelot, and Myriam Tami. 2020. Semi-supervised semantic segmentation with cross-consistency training. In IEEE Conference on Computer Vision and Pattern Recognition."},{"key":"e_1_3_2_37_2","doi-asserted-by":"publisher","DOI":"10.1109\/MAES.2019.2915456"},{"key":"e_1_3_2_38_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.01044"},{"key":"e_1_3_2_39_2","doi-asserted-by":"publisher","DOI":"10.2514\/6.2016-5539"},{"key":"e_1_3_2_40_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00474"},{"key":"e_1_3_2_41_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7298682"},{"key":"e_1_3_2_42_2","doi-asserted-by":"publisher","DOI":"10.3847\/1538-3881\/aa9e09"},{"key":"e_1_3_2_43_2","volume-title":"International Conference on Learning Representations","author":"Simonyan Karen","year":"2015","unstructured":"Karen Simonyan and Andrew Zisserman. 2015. Very deep convolutional networks for large-scale image recognition. In International Conference on Learning Representations."},{"issue":"56","key":"e_1_3_2_44_2","first-page":"1929","article-title":"Dropout: A simple way to prevent neural networks from overfitting","volume":"15","author":"Srivastava Nitish","year":"2014","unstructured":"Nitish Srivastava, Geoffrey Hinton, Alex Krizhevsky, Ilya Sutskever, and Ruslan Salakhutdinov. 2014. Dropout: A simple way to prevent neural networks from overfitting. Journal of Machine Learning Research 15, 56 (2014), 1929\u20131958.","journal-title":"Journal of Machine Learning Research"},{"key":"e_1_3_2_45_2","volume-title":"IEEE International Conference on Computer Vision","author":"Sun Chen","year":"2017","unstructured":"Chen Sun, Abhinav Shrivastava, Saurabh Singh, and Abhinav Gupta. 2017. Revisiting unreasonable effectiveness of data in deep learning era. In IEEE International Conference on Computer Vision."},{"key":"e_1_3_2_46_2","volume-title":"IEEE Conference on Computer Vision and Pattern Recognition Workshops","author":"Swan R. Michael","year":"2021","unstructured":"R. Michael Swan, Deegan Atha, Henry A. Leopold, Matthew Gildner, Stephanie Oij, Cindy Chiu, and Masahiro Ono. 2021. AI4MARS: A dataset for terrain-aware autonomous driving on mars. In IEEE Conference on Computer Vision and Pattern Recognition Workshops."},{"key":"e_1_3_2_47_2","volume-title":"Conference on Neural Information Processing Systems","author":"Tarvainen Antti","year":"2017","unstructured":"Antti Tarvainen and Harri Valpola. 2017. Mean teachers are better role models: Weight-averaged consistency targets improve semi-supervised deep learning results. In Conference on Neural Information Processing Systems."},{"key":"e_1_3_2_48_2","article-title":"Representation learning with contrastive predictive coding","author":"Oord A\u00e4ron van den","year":"2018","unstructured":"A\u00e4ron van den Oord, Yazhe Li, and Oriol Vinyals. 2018. Representation learning with contrastive predictive coding. arXiv (2018).","journal-title":"arXiv"},{"key":"e_1_3_2_49_2","volume-title":"Conference on Innovative Applications of Artificial Intelligence","author":"Wagstaff Kiri L.","year":"2018","unstructured":"Kiri L. Wagstaff, You Lu, Alice Stanboli, Kevin Grimes, Thamme Gowda, and Jordan Padams. 2018. Deep mars: CNN classification of mars imagery for the PDS imaging atlas. In Conference on Innovative Applications of Artificial Intelligence."},{"issue":"6","key":"e_1_3_2_50_2","doi-asserted-by":"crossref","first-page":"779","DOI":"10.1089\/ast.2017.1738","article-title":"Exoplanet biosignatures: Future directions","volume":"18","author":"Walker Sara I.","year":"2018","unstructured":"Sara I. Walker, William Bains, Leroy Cronin, Shiladitya DasSarma, Sebastian Danielache, Shawn Domagal-Goldman, Betul Kacar, Nancy Y. Kiang, Adrian Lenardic, Christopher T. Reinhard, et\u00a0al. 2018. Exoplanet biosignatures: Future directions. Astrobiology 18, 6 (2018), 779\u2013824.","journal-title":"Astrobiology"},{"key":"e_1_3_2_51_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-46478-7_31"},{"issue":"23","key":"e_1_3_2_52_2","doi-asserted-by":"crossref","first-page":"3981","DOI":"10.3390\/rs12233981","article-title":"DoMars16k: A diverse dataset for weakly supervised geomorphologic analysis on mars","volume":"12","author":"Wilhelm Thorsten","year":"2020","unstructured":"Thorsten Wilhelm, Melina Geis, Jens P\u00fcttschneider, Timo Sievernich, Tobias Weber, Kay Wohlfarth, and Christian W\u00f6hler. 2020. DoMars16k: A diverse dataset for weakly supervised geomorphologic analysis on mars. Remote Sensing 12, 23 (2020), 3981.","journal-title":"Remote Sensing"},{"key":"e_1_3_2_53_2","doi-asserted-by":"publisher","DOI":"10.1145\/3404374"},{"key":"e_1_3_2_54_2","volume-title":"IEEE International Conference on Computer Vision","author":"Yun Sangdoo","year":"2019","unstructured":"Sangdoo Yun, Dongyoon Han, Sanghyuk Chun, Seong Joon Oh, Youngjoon Yoo, and Junsuk Choe. 2019. CutMix: Regularization strategy to train strong classifiers with localizable features. In IEEE International Conference on Computer Vision."},{"key":"e_1_3_2_55_2","volume-title":"International Conference on Learning Representations","author":"Zhang Hongyi","year":"2018","unstructured":"Hongyi Zhang, Moustapha Ciss\u00e9, Yann N. Dauphin, and David Lopez-Paz. 2018. mixup: Beyond empirical risk minimization. In International Conference on Learning Representations."},{"key":"e_1_3_2_56_2","article-title":"Semi-supervised contrastive learning with similarity co-calibration","author":"Zhang Yuhang","year":"2022","unstructured":"Yuhang Zhang, Xiaopeng Zhang, Jie Li, Robert Qiu, Haohang Xu, and Qi Tian. 2022. Semi-supervised contrastive learning with similarity co-calibration. IEEE Transactions on Multimedia (2022). https:\/\/ieeexplore.ieee.org\/document\/9732218.","journal-title":"IEEE Transactions on Multimedia"},{"key":"e_1_3_2_57_2","volume-title":"IEEE Conference on Computer Vision and Pattern Recognition","author":"Zhao Xiangyun","year":"2021","unstructured":"Xiangyun Zhao, Raviteja Vemulapalli, Philip Andrew Mansfield, Boqing Gong, Bradley Green, Lior Shapira, and Ying Wu. 2021. Contrastive learning for label efficient semantic segmentation. In IEEE Conference on Computer Vision and Pattern Recognition."},{"key":"e_1_3_2_58_2","volume-title":"IEEE Conference on Computer Vision and Pattern Recognition","author":"Zhou Boyan","year":"2020","unstructured":"Boyan Zhou, Quan Cui, Xiu-Shen Wei, and Zhao-Min Chen. 2020. BBN: Bilateral-branch network with cumulative learning for long-tailed visual recognition. In IEEE Conference on Computer Vision and Pattern Recognition."}],"container-title":["ACM Transactions on Multimedia Computing, Communications, and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3572916","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3572916","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T17:51:38Z","timestamp":1750182698000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3572916"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,2,27]]},"references-count":57,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2023,7,31]]}},"alternative-id":["10.1145\/3572916"],"URL":"https:\/\/doi.org\/10.1145\/3572916","relation":{},"ISSN":["1551-6857","1551-6865"],"issn-type":[{"value":"1551-6857","type":"print"},{"value":"1551-6865","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,2,27]]},"assertion":[{"value":"2022-08-22","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-11-25","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-02-27","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}