{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,25]],"date-time":"2026-03-25T07:52:25Z","timestamp":1774425145514,"version":"3.50.1"},"reference-count":60,"publisher":"Public Library of Science (PLoS)","issue":"11","license":[{"start":{"date-parts":[[2021,11,29]],"date-time":"2021-11-29T00:00:00Z","timestamp":1638144000000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100004329","name":"Slovenian Research Agency","doi-asserted-by":"crossref","award":["P5-0410"],"award-info":[{"award-number":["P5-0410"]}],"id":[{"id":"10.13039\/501100004329","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100001871","name":"Funda\u00e7\u00e3o para a Ci\u00eancia e a Tecnologia","doi-asserted-by":"publisher","award":["PTDC\/CCI-INF\/29168\/2017"],"award-info":[{"award-number":["PTDC\/CCI-INF\/29168\/2017"]}],"id":[{"id":"10.13039\/501100001871","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["www.plosone.org"],"crossmark-restriction":false},"short-container-title":["PLoS ONE"],"abstract":"<jats:p>Cell counting is a frequent task in medical research studies. However, it is often performed manually; thus, it is time-consuming and prone to human error. Even so, cell counting automation can be challenging to achieve, especially when dealing with crowded scenes and overlapping cells, assuming different shapes and sizes. In this paper, we introduce a deep learning-based cell detection and quantification methodology to automate the cell counting process in the zebrafish xenograft cancer model, an innovative technique for studying tumor biology and for personalizing medicine. First, we implemented a fine-tuned architecture based on the Faster R-CNN using the Inception ResNet V2 feature extractor. Second, we performed several adjustments to optimize the process, paying attention to constraints such as the presence of overlapped cells, the high number of objects to detect, the heterogeneity of the cells\u2019 size and shape, and the small size of the data set. This method resulted in a median error of approximately 1% of the total number of cell units. These results demonstrate the potential of our novel approach for quantifying cells in poorly labeled images. Compared to traditional Faster R-CNN, our method improved the average precision from 71% to 85% on the studied data set.<\/jats:p>","DOI":"10.1371\/journal.pone.0260609","type":"journal-article","created":{"date-parts":[[2021,11,29]],"date-time":"2021-11-29T18:38:36Z","timestamp":1638211116000},"page":"e0260609","update-policy":"https:\/\/doi.org\/10.1371\/journal.pone.corrections_policy","source":"Crossref","is-referenced-by-count":15,"title":["Object detection for automatic cancer cell counting in zebrafish xenografts"],"prefix":"10.1371","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1888-9018","authenticated-orcid":true,"given":"Carina","family":"Albuquerque","sequence":"first","affiliation":[]},{"given":"Leonardo","family":"Vanneschi","sequence":"additional","affiliation":[]},{"given":"Roberto","family":"Henriques","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8793-1451","authenticated-orcid":true,"given":"Mauro","family":"Castelli","sequence":"additional","affiliation":[]},{"given":"Vanda","family":"P\u00f3voa","sequence":"additional","affiliation":[]},{"given":"Rita","family":"Fior","sequence":"additional","affiliation":[]},{"given":"Nickolas","family":"Papanikolaou","sequence":"additional","affiliation":[]}],"member":"340","published-online":{"date-parts":[[2021,11,29]]},"reference":[{"key":"pone.0260609.ref001","unstructured":"World Health Organization (WHO). Latest Global Cancer Data: Cancer Burden Rises to 19.3 Million New Cases and 10.0 Million Cancer Deaths in 2020 [Internet]. December 2020. Available from: https:\/\/www.iarc.who.int\/wp-content\/uploads\/2020\/12\/pr292_E.pdf. Accessed March 2021."},{"issue":"39","key":"pone.0260609.ref002","doi-asserted-by":"crossref","first-page":"E8234","DOI":"10.1073\/pnas.1618389114","article-title":"Single-cell functional and chemosensitive profiling of combinatorial colorectal therapy in zebrafish xenografts","volume":"114","author":"R Fior","year":"2017","journal-title":"Proc Natl Acad Sci"},{"issue":"7","key":"pone.0260609.ref003","doi-asserted-by":"crossref","first-page":"1769","DOI":"10.3390\/cancers12071769","article-title":"Zebrafish Xenografts Unveil Sensitivity to Olaparib beyond BRCA Status","volume":"12","author":"AB Varanda","year":"2020","journal-title":"Cancers (Basel)"},{"issue":"1","key":"pone.0260609.ref004","first-page":"1","article-title":"Zebrafish xenografts as a fast screening platform for bevacizumab cancer therapy","volume":"3","author":"CR de Almeida","year":"2020","journal-title":"Commun Biol"},{"issue":"2","key":"pone.0260609.ref005","doi-asserted-by":"crossref","first-page":"293","DOI":"10.3390\/cells9020293","article-title":"Zebrafish avatars towards personalized medicine\u2014A comparative review between avatar models","volume":"9","author":"B Costa","year":"2020","journal-title":"Cells"},{"issue":"39","key":"pone.0260609.ref006","doi-asserted-by":"crossref","first-page":"10306","DOI":"10.1073\/pnas.1713769114","article-title":"Fishing for answers in precision cancer medicine","volume":"114","author":"M Fazio","year":"2017","journal-title":"Proc Natl Acad Sci"},{"issue":"5","key":"pone.0260609.ref007","doi-asserted-by":"crossref","first-page":"263","DOI":"10.1038\/s41568-020-0252-3","article-title":"Zebrafish patient avatars in cancer biology and precision cancer therapy","volume":"20","author":"M Fazio","year":"2020","journal-title":"Nat Rev Cancer"},{"key":"pone.0260609.ref008","doi-asserted-by":"crossref","first-page":"101892","DOI":"10.1016\/j.media.2020.101892","article-title":"Deeply-supervised density regression for automatic cell counting in microscopy images","volume":"68","author":"S He","year":"2021","journal-title":"Med Image Anal"},{"key":"pone.0260609.ref009","doi-asserted-by":"crossref","unstructured":"Alahmari SS, Goldgof D, Hall LO, Mouton PR. Automatic cell counting using active deep learning and unbiased stereology. In: 2019 IEEE International Conference on Systems, Man and Cybernetics (SMC). IEEE; 2019. p. 1708\u201313.","DOI":"10.1109\/SMC.2019.8914199"},{"issue":"9","key":"pone.0260609.ref010","doi-asserted-by":"crossref","first-page":"697","DOI":"10.1089\/ten.tec.2012.0486","article-title":"A semiautomatic cell counting tool for quantitative imaging of tissue engineering scaffolds","volume":"19","author":"S De Boodt","year":"2013","journal-title":"Tissue Eng\u2014Part C Methods"},{"issue":"3","key":"pone.0260609.ref011","doi-asserted-by":"crossref","first-page":"283","DOI":"10.1080\/21681163.2016.1149104","article-title":"Microscopy cell counting and detection with fully convolutional regression networks","volume":"6","author":"W Xie","year":"2018","journal-title":"Comput methods Biomech Biomed Eng Imaging Vis"},{"key":"pone.0260609.ref012","doi-asserted-by":"crossref","unstructured":"Hosseini SH, Chen H, Jablonski MM. Automatic detection and counting of retina cell nuclei using deep learning. In: Medical Imaging 2020: Biomedical Applications in Molecular, Structural, and Functional Imaging. International Society for Optics and Photonics; 2020. p. 113172I.","DOI":"10.1117\/12.2567454"},{"key":"pone.0260609.ref013","doi-asserted-by":"crossref","first-page":"101845","DOI":"10.1016\/j.compmedimag.2020.101845","article-title":"A deep learning approach to the screening of malaria infection: Automated and rapid cell counting, object detection and instance segmentation using Mask R-CNN","volume":"88","author":"DR Loh","year":"2021","journal-title":"Comput Med Imaging Graph"},{"key":"pone.0260609.ref014","doi-asserted-by":"crossref","unstructured":"Guo Y, Stein J, Wu G, Krishnamurthy A. Sau-net: A universal deep network for cell counting. In: Proceedings of the 10th ACM International Conference on Bioinformatics, Computational Biology and Health Informatics. 2019. p. 299\u2013306.","DOI":"10.1145\/3307339.3342153"},{"issue":"1","key":"pone.0260609.ref015","doi-asserted-by":"crossref","first-page":"67","DOI":"10.1038\/s41592-018-0261-2","article-title":"U-Net: deep learning for cell counting, detection, and morphometry","volume":"16","author":"T Falk","year":"2019","journal-title":"Nat Methods"},{"issue":"4","key":"pone.0260609.ref016","doi-asserted-by":"crossref","first-page":"982","DOI":"10.1364\/OSAC.388082","article-title":"Automated yeast cells segmentation and counting using a parallel U-Net based two-stage framework","volume":"3","author":"Y Kong","year":"2020","journal-title":"OSA Contin"},{"issue":"9","key":"pone.0260609.ref017","doi-asserted-by":"crossref","first-page":"e1008179","DOI":"10.1371\/journal.pcbi.1008179","article-title":"Detection and segmentation of morphologically complex eukaryotic cells in fluorescence microscopy images via feature pyramid fusion","volume":"16","author":"N Korfhage","year":"2020","journal-title":"PLOS Comput Biol"},{"key":"pone.0260609.ref018","doi-asserted-by":"crossref","unstructured":"Liu Q, Junker A, Murakami K, Hu P. A novel convolutional regression network for cell counting. In: 2019 IEEE 7th International Conference on Bioinformatics and Computational Biology (ICBCB). IEEE; 2019. p. 44\u20139.","DOI":"10.1109\/ICBCB.2019.8854653"},{"key":"pone.0260609.ref019","doi-asserted-by":"crossref","unstructured":"Zheng Y, Chen Z, Zuo Y, Guan X, Wang Z, Mu X. Manifold-regularized regression network: A novel end-to-end method for cell counting and localization. In: ACM International Conference Proceeding Series. 2020.","DOI":"10.1145\/3390557.3394299"},{"issue":"2","key":"pone.0260609.ref020","doi-asserted-by":"crossref","first-page":"323","DOI":"10.1364\/OSAC.413787","article-title":"Improved detection performance in blood cell count by an attention-guided deep learning method","volume":"4","author":"Z Jiang","year":"2021","journal-title":"OSA Contin"},{"key":"pone.0260609.ref021","doi-asserted-by":"crossref","unstructured":"Huang J, Rathod V, Sun C, Zhu M, Korattikara A, Fathi A, et al. Speed\/accuracy trade-offs for modern convolutional object detectors. In: Proceedings of the IEEE conference on computer vision and pattern recognition. 2017. p. 7310\u20131.","DOI":"10.1109\/CVPR.2017.351"},{"key":"pone.0260609.ref022","doi-asserted-by":"crossref","unstructured":"Hung J, Carpenter A. Applying faster R-CNN for object detection on malaria images. In: Proceedings of the IEEE conference on computer vision and pattern recognition workshops. 2017. p. 56\u201361.","DOI":"10.1109\/CVPRW.2017.112"},{"key":"pone.0260609.ref023","doi-asserted-by":"crossref","unstructured":"Uka A, Tare A, Polisi X, Panci I. FASTER R-CNN for cell counting in low contrast microscopic images. In: 2020 International Conference on Computing, Networking, Telecommunications & Engineering Sciences Applications (CoNTESA). IEEE; 2020. p. 64\u20139.","DOI":"10.1109\/CoNTESA50436.2020.9302852"},{"issue":"3","key":"pone.0260609.ref024","doi-asserted-by":"crossref","first-page":"749","DOI":"10.3390\/jcm9030749","article-title":"Artificial intelligence-based mitosis detection in breast cancer histopathology images using faster R-CNN and deep CNNs","volume":"9","author":"T Mahmood","year":"2020","journal-title":"J Clin Med"},{"key":"pone.0260609.ref025","doi-asserted-by":"crossref","unstructured":"Dong B, Shao L, Da Costa M, Bandmann O, Frangi AF. Deep learning for automatic cell detection in wide-field microscopy zebrafish images. In: Proceedings\u2014International Symposium on Biomedical Imaging. 2015. p. 772-6.","DOI":"10.1109\/ISBI.2015.7163986"},{"key":"pone.0260609.ref026","doi-asserted-by":"crossref","unstructured":"Liu W, Anguelov D, Erhan D, Szegedy C, Reed S, Fu CY, et al. Ssd: Single shot multibox detector. In: European conference on computer vision. Springer; 2016. p. 21\u201337.","DOI":"10.1007\/978-3-319-46448-0_2"},{"key":"pone.0260609.ref027","doi-asserted-by":"crossref","unstructured":"Redmon J, Divvala S, Girshick R, Farhadi A. You only look once: Unified, real-time object detection In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition. 2016. p. 779-88.","DOI":"10.1109\/CVPR.2016.91"},{"key":"pone.0260609.ref028","doi-asserted-by":"crossref","unstructured":"Redmon J, Farhadi A. YOLO9000: better, faster, stronger In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition. 2017. p. 7263-71.","DOI":"10.1109\/CVPR.2017.690"},{"key":"pone.0260609.ref029","unstructured":"Redmon J, Farhadi A. Yolov3: An incremental improvement arXiv:1804.02767 [Preprint]. 2018 [cited 2018 Apr 8]. Available from: https:\/\/arxiv.org\/abs\/1804.02767"},{"key":"pone.0260609.ref030","unstructured":"Bochkovskiy A, Wang C, Liao HM. Yolov4: Optimal speed and accuracy of object detection arXiv:2004.10934 [Preprint]. 2020 [cited 2020 Apr 23]. Available from: https:\/\/arxiv.org\/abs\/2004.10934"},{"key":"pone.0260609.ref031","unstructured":"Jocher G, Stoken A, Borovec J, NanoCode012, Chaurasia A, TaoXie et al. ultralytics\/yolov5. Github repository. Available from: https:\/\/github.com\/ultralytics\/yolov5"},{"key":"pone.0260609.ref032","doi-asserted-by":"crossref","unstructured":"Wang C, Liao HM, Wu Y, Chen P, Chen P, Hsieh J, Yeh I CSPNet: A new backbone that can enhance learning capability of CNN In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition. 2020. p. 390-1.","DOI":"10.1109\/CVPRW50498.2020.00203"},{"key":"pone.0260609.ref033","doi-asserted-by":"crossref","unstructured":"Liu S, Qi L, Qin H, Shi J, Jia J Path aggregation network for instance segmentation In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition. 2018. p. 8759-68.","DOI":"10.1109\/CVPR.2018.00913"},{"issue":"6","key":"pone.0260609.ref034","doi-asserted-by":"crossref","first-page":"1137","DOI":"10.1109\/TPAMI.2016.2577031","article-title":"Faster R-CNN: towards real-time object detection with region proposal networks","volume":"39","author":"S Ren","year":"2016","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"key":"pone.0260609.ref035","doi-asserted-by":"crossref","unstructured":"Girshick R. Fast r-cnn. In: Proceedings of the IEEE international conference on computer vision. 2015. p. 1440\u20138.","DOI":"10.1109\/ICCV.2015.169"},{"key":"pone.0260609.ref036","doi-asserted-by":"crossref","unstructured":"Girshick R, Donahue J, Darrell T, Malik J. Rich feature hierarchies for accurate object detection and semantic segmentation. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition. 2014. p. 580-7.","DOI":"10.1109\/CVPR.2014.81"},{"key":"pone.0260609.ref037","first-page":"379","article-title":"R-fcn: Object detection via region-based fully convolutional networks","author":"J Dai","year":"2016","journal-title":"Adv Neural Inf Process Syst"},{"key":"pone.0260609.ref038","doi-asserted-by":"crossref","unstructured":"He K, Zhang X, Ren S, Sun J. Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition. 2016. p. 770\u20138.","DOI":"10.1109\/CVPR.2016.90"},{"key":"pone.0260609.ref039","unstructured":"Sewak M, Karim MR, Pujari P. Practical convolutional neural networks: implement advanced deep learning models using Python. Packt Publishing Ltd; 2018."},{"key":"pone.0260609.ref040","doi-asserted-by":"crossref","unstructured":"Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, et al. Going deeper with convolutions. In: Proceedings of the IEEE conference on computer vision and pattern recognition. 2015. p. 1\u20139.","DOI":"10.1109\/CVPR.2015.7298594"},{"key":"pone.0260609.ref041","unstructured":"Shanmugamani R. Deep Learning for Computer Vision: Expert techniques to train advanced neural networks using TensorFlow and Keras. Packt Publishing Ltd; 2018."},{"key":"pone.0260609.ref042","doi-asserted-by":"crossref","unstructured":"Szegedy C, Ioffe S, Vanhoucke V, Alemi AA. Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning. In: 31st AAAI Conference on Artificial Intelligence, AAAI 2017. 2017. p. 4278-84.","DOI":"10.1609\/aaai.v31i1.11231"},{"key":"pone.0260609.ref043","doi-asserted-by":"crossref","unstructured":"Zoph B, Vasudevan V, Shlens J, Le QV. Learning transferable architectures for scalable image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition. 2018. p. 8697\u2013710.","DOI":"10.1109\/CVPR.2018.00907"},{"key":"pone.0260609.ref044","article-title":"Small object detection with multiscale features","author":"GX Hu","year":"2018","journal-title":"Int J Digit Multimed Broadcast"},{"key":"pone.0260609.ref045","doi-asserted-by":"crossref","unstructured":"Guan T, Zhu H. Atrous faster R-CNN for small scale object detection. In: 2017 2nd International Conference on Multimedia and Image Processing (ICMIP). IEEE; 2017. p. 16\u201321.","DOI":"10.1109\/ICMIP.2017.37"},{"key":"pone.0260609.ref046","doi-asserted-by":"crossref","unstructured":"Eggert C, Brehm S, Winschel A, Zecha D, Lienhart R. A closer look: Small object detection in faster R-CNN. In: Proceedings\u2014IEEE International Conference on Multimedia and Expo. 2017. p. 421-6.","DOI":"10.1109\/ICME.2017.8019550"},{"key":"pone.0260609.ref047","doi-asserted-by":"crossref","first-page":"106838","DOI":"10.1109\/ACCESS.2019.2932731","article-title":"An improved faster R-CNN for small object detection","volume":"7","author":"C Cao","year":"2019","journal-title":"IEEE Access"},{"key":"pone.0260609.ref048","unstructured":"Fu CY, Liu W, Ranga A, Tyagi A, Berg AC. Dssd: Deconvolutional single shot detector. arXiv:1701.06659v1 [Preprint]. 2017 [cited 2017 Jan 23]. Available from: https:\/\/arxiv.org\/abs\/1701.06659v1."},{"key":"pone.0260609.ref049","doi-asserted-by":"crossref","unstructured":"Cao G, Xie X, Yang W, Liao Q, Shi G, Wu J. Feature-fused SSD: Fast detection for small objects. In: Ninth International Conference on Graphic and Image Processing (ICGIP 2017). International Society for Optics and Photonics; 2018. p. 106151E.","DOI":"10.1117\/12.2304811"},{"key":"pone.0260609.ref050","unstructured":"Cui L, Ma R, Lv P, Jiang X, Gao Z, Zhou B, et al. MDSSD: multi-scale deconvolutional single shot detector for small objects. arXiv:1805.07009v3 [Preprint]. 2020 [cited 25 Feb 2020]. Available from: https:\/\/arxiv.org\/abs\/1805.07009v3"},{"key":"pone.0260609.ref051","doi-asserted-by":"crossref","first-page":"103910","DOI":"10.1016\/j.imavis.2020.103910","article-title":"Recent advances in small object detection based on deep learning: A review","volume":"97","author":"K Tong","year":"2020","journal-title":"Image and Vision Computing"},{"key":"pone.0260609.ref052","unstructured":"Zhang K, Xiong F, Sun P, Hu L, Li B, Yu G. Double anchor R-CNN for human detection in a crowd. arXiv:1909.09998v1 [Preprint]. 2019 [cited 22 Sep 2019]. Available from: https:\/\/arxiv.org\/abs\/1909.09998"},{"issue":"1","key":"pone.0260609.ref053","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s40537-019-0197-0","article-title":"A survey on image data augmentation for deep learning","volume":"6","author":"C Shorten","year":"2019","journal-title":"J Big Data"},{"issue":"5","key":"pone.0260609.ref054","doi-asserted-by":"crossref","first-page":"1089","DOI":"10.3390\/s19051089","article-title":"Anchor generation optimization and region of interest assignment for vehicle detection","volume":"19","author":"Y Wang","year":"2019","journal-title":"Sensors (Switzerland)"},{"issue":"7","key":"pone.0260609.ref055","doi-asserted-by":"crossref","first-page":"676","DOI":"10.1038\/nmeth.2019","article-title":"Fiji: an open-source platform for biological-image analysis","volume":"9","author":"J Schindelin","year":"2012","journal-title":"Nat Methods"},{"key":"pone.0260609.ref056","volume-title":"Digital image processing","author":"RC Gonzales","year":"2018","edition":"4"},{"key":"pone.0260609.ref057","doi-asserted-by":"crossref","first-page":"602","DOI":"10.2307\/2528918","article-title":"Principles of Statistics","volume":"25","author":"D Mcpherson","year":"1969","journal-title":"Biometrics"},{"key":"pone.0260609.ref058","doi-asserted-by":"crossref","unstructured":"Lin TY, Goyal P, Girshick R, He K, Doll\u00e1r P. Focal loss for dense object detection. In: Proceedings of the IEEE international conference on computer vision. 2017. p. 2980\u20138.","DOI":"10.1109\/ICCV.2017.324"},{"key":"pone.0260609.ref059","doi-asserted-by":"crossref","unstructured":"Lin TY, Maire M, Belongie S, Hays J, Perona P, Ramanan D, et al. Microsoft coco: Common objects in context. In: European conference on computer vision. Springer; 2014. p. 740\u201355.","DOI":"10.1007\/978-3-319-10602-1_48"},{"key":"pone.0260609.ref060","unstructured":"Solawetz J, Nelson J. How to Train YOLOv5 On a Custom Dataset [Internet]. Roboflow; 2020 Jun 10. Available from: https:\/\/blog.roboflow.com\/how-to-train-yolov5-on-a-custom-dataset\/"}],"container-title":["PLOS ONE"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pone.0260609","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,1,16]],"date-time":"2023-01-16T17:35:47Z","timestamp":1673890547000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pone.0260609"}},"subtitle":[],"editor":[{"given":"Yan Chai","family":"Hum","sequence":"first","affiliation":[]}],"short-title":[],"issued":{"date-parts":[[2021,11,29]]},"references-count":60,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2021,11,29]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pone.0260609","relation":{},"ISSN":["1932-6203"],"issn-type":[{"value":"1932-6203","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,11,29]]}}}