{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,15]],"date-time":"2026-10-15T09:47:46Z","timestamp":1792057666845,"version":"4.4.0"},"reference-count":50,"publisher":"Springer Science and Business Media LLC","issue":"5","license":[{"start":{"date-parts":[[2024,11,13]],"date-time":"2024-11-13T00:00:00Z","timestamp":1731456000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,11,13]],"date-time":"2024-11-13T00:00:00Z","timestamp":1731456000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Int J Comput Vis"],"published-print":{"date-parts":[[2025,5]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>\n                    This paper tackles the limitation of a closed-world object detection model that was trained on one species. The expectation for this model is that it will not generalize well to recognize the instances of new species if they were present in the incoming data stream. We propose a novel object detection framework for this open-world setting that is suitable for applications that monitor wildlife, ocean life, livestock, plant phenotype and crops that typically feature one species in the image. Our method leverages labeled samples from one species in combination with a novelty detection method and Segment Anything Model, a vision foundation model, to (1) identify the presence of new species in unlabeled images, (2) localize their instances, and (3)\n                    <jats:italic>retrain<\/jats:italic>\n                    the initial model with the localized novel class instances. The resulting integrated system\n                    <jats:italic>assimilates<\/jats:italic>\n                    and\n                    <jats:italic>learns<\/jats:italic>\n                    from unlabeled samples of the new classes while not \u201cforgetting\u201d the original species the model was trained on. We demonstrate our findings on two different domains, (1) wildlife detection and (2) plant detection. Our method achieves an AP of 56.2 (for 4 novel species) to 61.6 (for 1 novel species) for wildlife domain, without relying on any ground truth data in the background.\n                  <\/jats:p>","DOI":"10.1007\/s11263-024-02234-0","type":"journal-article","created":{"date-parts":[[2024,11,13]],"date-time":"2024-11-13T18:17:07Z","timestamp":1731521827000},"page":"2247-2258","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Learning to Detect Novel Species with SAM in the Wild"],"prefix":"10.1007","volume":"133","author":[{"ORCID":"https:\/\/orcid.org\/0009-0004-7057-3637","authenticated-orcid":false,"given":"Garvita","family":"Allabadi","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ana","family":"Lucic","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yu-Xiong","family":"Wang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Vikram","family":"Adve","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2024,11,13]]},"reference":[{"key":"2234_CR1","unstructured":"AI2. (2021). Earth ranger. https:\/\/www.earthranger.com\/"},{"issue":"6","key":"2234_CR2","doi-asserted-by":"publisher","first-page":"1039","DOI":"10.1002\/rob.21699","volume":"34","author":"S Bargoti","year":"2017","unstructured":"Bargoti, S., & Underwood, J. P. (2017). Image segmentation for fruit detection and yield estimation in apple orchards. Journal of Field Robotics, 34(6), 1039\u20131060. https:\/\/doi.org\/10.1002\/rob.21699","journal-title":"Journal of Field Robotics"},{"key":"2234_CR3","unstructured":"Berthelot, D., Carlini, N., Goodfellow, I., Papernot, N., Oliver, A., & Raffel, C. A. (2019). MixMatch: A holistic approach to semi-supervised learning. Advances in Neural Information Processing Systems, 32."},{"key":"2234_CR4","unstructured":"Botswana Predator Conservation Trust. (2022a). Hyena id 2022. https:\/\/lila.science\/datasets\/hyena-id-2022\/"},{"key":"2234_CR5","unstructured":"Botswana Predator Conservation Trust. (2022b). Leopard id 2022. https:\/\/lila.science\/datasets\/leopard-id-2022\/."},{"key":"2234_CR6","doi-asserted-by":"publisher","unstructured":"Breunig, M. M., Kriegel, H. P., & Ng, R. T., et\u00a0al. (2000). LOF: Identifying density-based local outliers. In Proceedings of the 2000 ACM SIGMOD international conference on management of data (pp. 93\u2013104). Association for Computing Machinery, New York, NY, USA, SIGMOD \u201900. https:\/\/doi.org\/10.1145\/342009.335388","DOI":"10.1145\/342009.335388"},{"key":"2234_CR7","unstructured":"Brown, T. B., Mann, B., Ryder, N., et\u00a0al. (2020). Language models are few-shot learners. In Proceedings of the 34th international conference on neural information processing systems. Vancouver, BC, Canada."},{"key":"2234_CR8","doi-asserted-by":"crossref","unstructured":"Chen, G., Han, T. X., He, Z., et\u00a0al. (2014). Deep convolutional neural network based species recognition for wild animal monitoring. In 2014 IEEE international conference on image processing (ICIP) (pp. 858\u2013862). DOIurlhttps:\/\/doi.org\/10.1109\/ICIP.2014.7025172","DOI":"10.1109\/ICIP.2014.7025172"},{"key":"2234_CR9","unstructured":"Devlin, J., Chang, M. ., & Lee, K.,et\u00a0al. (2018). Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805"},{"key":"2234_CR10","doi-asserted-by":"crossref","unstructured":"Dhamija, A., Gunther, M., & Ventura, J., et\u00a0al. (2020). The overlooked elephant of object detection: Open set. In Proceedings of the IEEE\/CVF winter conference on applications of computer vision (pp 1021\u20131030).","DOI":"10.1109\/WACV45572.2020.9093355"},{"issue":"2","key":"2234_CR11","doi-asserted-by":"publisher","first-page":"303","DOI":"10.1007\/s11263-009-0275-4","volume":"88","author":"M Everingham","year":"2009","unstructured":"Everingham, M., Gool, L. V., Williams, C. K. I., et al. (2009). The pascal visual object classes (VOC) challenge. International Journal of Computer Vision, 88(2), 303\u2013338. https:\/\/doi.org\/10.1007\/s11263-009-0275-4","journal-title":"International Journal of Computer Vision"},{"key":"2234_CR12","doi-asserted-by":"crossref","unstructured":"Gupta, A., Narayan, S., Joseph, K. J., et\u00a0al. (2022). OW-DETR: Open-world detection transformer. arXiv:2112.01513","DOI":"10.1109\/CVPR52688.2022.00902"},{"key":"2234_CR13","unstructured":"Horn, G. V., Mac\u00a0Aodha, O., Song, Y., et\u00a0al. (2017). The iNaturalist challenge."},{"key":"2234_CR14","doi-asserted-by":"crossref","unstructured":"Iscen, A., Tolias, G., Avrithis, Y., et\u00a0al. (2019). Label propagation for deep semi-supervised learning. In Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition (pp. 5070\u20135079).","DOI":"10.1109\/CVPR.2019.00521"},{"key":"2234_CR15","unstructured":"Jeong, J., Lee, S., Kim, J., et\u00a0al. (2019). Consistency-based semi-supervised learning for object detection. Advances in Neural Information Processing Systems, 32."},{"key":"2234_CR16","doi-asserted-by":"publisher","unstructured":"Jocher, G. (2020). Yolov5 by ultralytics. https:\/\/doi.org\/10.5281\/zenodo.3908559. https:\/\/github.com\/ultralytics\/yolov5.","DOI":"10.5281\/zenodo.3908559"},{"key":"2234_CR17","doi-asserted-by":"crossref","unstructured":"Joseph, K. J., Khan, S., Khan, F. S., et\u00a0al. (2021). Towards open world object detection. arXiv:2103.02603","DOI":"10.1109\/CVPR46437.2021.00577"},{"key":"2234_CR18","doi-asserted-by":"crossref","unstructured":"Kirillov, A., Mintun, E., Ravi, N., et\u00a0al. (2023). Segment anything. arXiv:2304.02643","DOI":"10.1109\/ICCV51070.2023.00371"},{"key":"2234_CR19","doi-asserted-by":"crossref","unstructured":"Le, V. N. T., Ahderom, S., Apopei, B., et\u00a0al. (2020). A novel method for detecting morphologically similar crops and weeds based on the combination of contour masks and filtered local binary pattern operators. Gigascience, 9(3), giaa017.","DOI":"10.1093\/gigascience\/giaa017"},{"key":"2234_CR20","doi-asserted-by":"publisher","unstructured":"Leonid, T. T., Kanna, H., et\u00a0al. (2023). Human wildlife conflict mitigation using yolo algorithm. In 2023 Eighth international conference on science technology engineering and mathematics (ICONSTEM) (pp. 1\u20137). https:\/\/doi.org\/10.1109\/ICONSTEM56934.2023.10142629","DOI":"10.1109\/ICONSTEM56934.2023.10142629"},{"key":"2234_CR21","doi-asserted-by":"crossref","unstructured":"Lin, T., Maire, M., Belongie, S. J., et\u00a0al. (2014). Microsoft COCO: Common objects in context. CoRR arXiv:1405.0312","DOI":"10.1007\/978-3-319-10602-1_48"},{"key":"2234_CR22","doi-asserted-by":"crossref","unstructured":"Liu, Y. C., Ma, C. Y., Dai, X., et\u00a0al. (2022). Open-set semi-supervised object detection. In European conference on computer vision (pp. 143\u2013159). Springer.","DOI":"10.1007\/978-3-031-20056-4_9"},{"issue":"24","key":"2234_CR23","doi-asserted-by":"publisher","first-page":"9669","DOI":"10.3390\/s23249669","volume":"23","author":"S Li","year":"2023","unstructured":"Li, S., Zhang, H., & Xu, F. (2023). Intelligent detection method for wildlife based on deep learning. Sensors (Basel), 23(24), 9669.","journal-title":"Sensors (Basel)"},{"key":"2234_CR24","doi-asserted-by":"crossref","unstructured":"Luo, Y., Zhu, J., Li, M., et\u00a0al. (2018). Smooth neighbors on teacher graphs for semi-supervised learning. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 8896\u20138905).","DOI":"10.1109\/CVPR.2018.00927"},{"key":"2234_CR25","doi-asserted-by":"publisher","unstructured":"Magalh\u00e3es, S. A. (2021). Dataset of tomato inside greenhouses for object detection in Pascal VOC. https:\/\/doi.org\/10.25747\/PC1E-NK92. https:\/\/rdm.inesctec.pt\/dataset\/ii-2021-001","DOI":"10.25747\/PC1E-NK92"},{"key":"2234_CR26","doi-asserted-by":"publisher","unstructured":"Marcel, S., & Rodriguez, Y. (2010). Torchvision the machine-vision package of torch. In Proceedings of the 18th ACM international conference on multimedia. Association for Computing Machinery, New York, NY, USA, MM \u201910 (pp. 1485\u20131488). https:\/\/doi.org\/10.1145\/1873951.1874254.","DOI":"10.1145\/1873951.1874254"},{"key":"2234_CR27","unstructured":"Marine Mammal Laboratory at the NOAA Alaska Fishery Science Center. (2022). Where\u2019s whale-do? https:\/\/lila.science\/datasets\/beluga-id-2022\/"},{"key":"2234_CR28","unstructured":"Miao, H. (2024). Pytorch-wildlife: A collaborative deep learning framework for conservation."},{"issue":"20","key":"2234_CR29","doi-asserted-by":"publisher","first-page":"3168","DOI":"10.3390\/ani13203168","volume":"13","author":"C Mou","year":"2023","unstructured":"Mou, C., Liang, A., Hu, C., et al. (2023). Monitoring endangered and rare wildlife in the field: A foundation deep learning model integrating human knowledge for incremental recognition with few data and low cost. Animals (Basel), 13(20), 3168.","journal-title":"Animals (Basel)"},{"key":"2234_CR30","unstructured":"Oquab, M., Darcet, T., Moutakanni, T., et\u00a0al. (2023). Dinov2: Learning robust visual features without supervision. arXiv:2304.07193. https:\/\/api.semanticscholar.org\/CorpusID:258170077"},{"key":"2234_CR31","unstructured":"Parham, J., Crall, J., & Stewart, C., et\u00a0al. (2017). Animal population censusing at scale with citizen science and photographic identification. In: AAAI spring symposium-technical report. https:\/\/lila.science\/datasets\/great-zebra-giraffe-id"},{"key":"2234_CR32","unstructured":"Paszke, A., Gross, S., Massa, F., et\u00a0al. (2019). Pytorch: An imperative style, high-performance deep learning library. In H. Wallach, H. Larochelle, A. Beygelzimer, et\u00a0al. (Eds.), Advances in neural information processing systems (Vol. 32, pp. 8024\u20138035). Curran Associates Inc."},{"key":"2234_CR33","first-page":"2825","volume":"12","author":"F Pedregosa","year":"2011","unstructured":"Pedregosa, F., Varoquaux, G., Gramfort, A., et al. (2011). Scikit-learn: Machine learning in Python. Journal of Machine Learning Research, 12, 2825\u20132830.","journal-title":"Journal of Machine Learning Research"},{"key":"2234_CR34","unstructured":"Radford, A., Kim, J. W., Hallacy, C., et\u00a0al. (2021). Learning transferable visual models from natural language supervision. arXiv:2103.00020"},{"key":"2234_CR35","unstructured":"Ramesh, A., Dhariwal, P., Nichol, A., et\u00a0al. (2022). Hierarchical text-conditional image generation with clip latents. arXiv:2204.06125"},{"key":"2234_CR36","doi-asserted-by":"crossref","unstructured":"Ren, S., He, K., Girshick, R., et\u00a0al. (2015). Faster R-CNN: Towards real-time object detection with region proposal networks. Advances in Neural Information Processing Systems, 28, 1137\u20131149.","DOI":"10.1109\/TPAMI.2016.2577031"},{"key":"2234_CR37","doi-asserted-by":"publisher","DOI":"10.1016\/j.ecoinf.2022.101919","volume":"75","author":"AM Roy","year":"2023","unstructured":"Roy, A. M., Bhaduri, J., Kumar, T., et al. (2023). WilDect-YOLO: An efficient and robust computer vision-based accurate object localization model for automated endangered wildlife detection. Ecological Informatics, 75, 101919.","journal-title":"Ecological Informatics"},{"key":"2234_CR38","doi-asserted-by":"crossref","unstructured":"Shi, W., Gong, Y., & Ding, C., et\u00a0al. (2018). Transductive semi-supervised deep learning using min-max features. In Proceedings of the European conference on computer vision (ECCV) (pp. 299\u2013315).","DOI":"10.1007\/978-3-030-01228-1_19"},{"key":"2234_CR39","unstructured":"Simonyan, K., & Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556"},{"key":"2234_CR40","unstructured":"Sohn, K., Zhang, Z., & Li, C. L., et\u00a0al. (2020). A simple semi-supervised learning framework for object detection. arXiv:2005.04757"},{"key":"2234_CR41","doi-asserted-by":"publisher","unstructured":"Trivedi, N. K., Maheshwari, H., & Tiwari, R. G., et\u00a0al. (2023b). Hybrid deep neural network for alpaca animal recognition: Achieving high accuracy in detection and classification. In 2023 3rd international conference on technological advancements in computational sciences (ICTACS) (pp. 1145\u20131149). https:\/\/doi.org\/10.1109\/ICTACS59847.2023.10390113","DOI":"10.1109\/ICTACS59847.2023.10390113"},{"key":"2234_CR42","doi-asserted-by":"crossref","unstructured":"Trivedi, N. K., Maheshwari, H., Tiwari, R. G., et\u00a0al. (2023a). Hybrid deep neural network for alpaca animal recognition: Achieving high accuracy in detection and classification. In 2023 3rd international conference on technological advancements in computational sciences (ICTACS). IEEE.","DOI":"10.1109\/ICTACS59847.2023.10390113"},{"issue":"1","key":"2234_CR43","doi-asserted-by":"publisher","first-page":"792","DOI":"10.1038\/s41467-022-27980-y","volume":"13","author":"D Tuia","year":"2022","unstructured":"Tuia, D., Kellenberger, B., Beery, S., et al. (2022). Perspectives in machine learning for wildlife conservation. Nature Communications, 13(1), 792.","journal-title":"Nature Communications"},{"key":"2234_CR44","unstructured":"Wang, X., Huang, T. E., Darrell, T., et\u00a0al. (2020). Frustratingly simple few-shot object detection. arXiv:2003.06957"},{"key":"2234_CR45","doi-asserted-by":"crossref","unstructured":"Wang, Y., Yue, Z., Hua, X. S., et\u00a0al. (2023). Random boxes are open-world object detectors. arXiv:2307.08249","DOI":"10.1109\/ICCV51070.2023.00573"},{"key":"2234_CR46","doi-asserted-by":"publisher","DOI":"10.1016\/j.compag.2021.106404","volume":"189","author":"O Wosner","year":"2021","unstructured":"Wosner, O., Farjon, G., & Bar-Hillel, A. (2021). Object detection in agricultural contexts: A multiple resolution benchmark and comparison to human. Computers and Electronics in Agriculture, 189, 106404.","journal-title":"Computers and Electronics in Agriculture"},{"key":"2234_CR47","unstructured":"Xu, M., Bai, Y., Ghanem, B., Liu, B., Gao, Y., Guo, N., Ye, X., Wan, F., You, H., Fan, D.,et\u00a0al. (2019). Missing labels in object detection. In CVPR workshops (Vol. 3, pp. 5)."},{"key":"2234_CR48","doi-asserted-by":"crossref","unstructured":"Yan, P., Li, G., & Xie, Y., et\u00a0al. (2019). Semi-supervised video salient object detection using pseudo-labels. In Proceedings of the IEEE\/CVF international conference on computer vision (pp. 7284\u20137293).","DOI":"10.1109\/ICCV.2019.00738"},{"key":"2234_CR49","first-page":"18408","volume":"34","author":"B Zhang","year":"2021","unstructured":"Zhang, B., Wang, Y., Hou, W., et al. (2021). FlexMatch: Boosting semi-supervised learning with curriculum pseudo labeling. Advances in Neural Information Processing Systems, 34, 18408\u201318419.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"2234_CR50","doi-asserted-by":"crossref","unstructured":"Zohar, O., Wang, K. C. J., & Yeung, S. (2022). PROB: Probabilistic objectness for open world object detection. In 2023 IEEE\/CVF conference on computer vision and pattern recognition (CVPR) (pp. 11444\u201311453). https:\/\/api.semanticscholar.org\/CorpusID:254246718","DOI":"10.1109\/CVPR52729.2023.01101"}],"container-title":["International Journal of Computer Vision"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11263-024-02234-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11263-024-02234-0\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11263-024-02234-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,4,17]],"date-time":"2025-04-17T02:00:07Z","timestamp":1744855207000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11263-024-02234-0"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,11,13]]},"references-count":50,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2025,5]]}},"alternative-id":["2234"],"URL":"https:\/\/doi.org\/10.1007\/s11263-024-02234-0","relation":{},"ISSN":["0920-5691","1573-1405"],"issn-type":[{"value":"0920-5691","type":"print"},{"value":"1573-1405","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,11,13]]},"assertion":[{"value":"1 September 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"26 August 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"13 November 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}