{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,5,21]],"date-time":"2025-05-21T04:31:37Z","timestamp":1747801897526,"version":"3.41.0"},"reference-count":21,"publisher":"Springer Science and Business Media LLC","issue":"3","license":[{"start":{"date-parts":[[2024,10,23]],"date-time":"2024-10-23T00:00:00Z","timestamp":1729641600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,10,23]],"date-time":"2024-10-23T00:00:00Z","timestamp":1729641600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100008414","name":"University of Canterbury","doi-asserted-by":"crossref","id":[{"id":"10.13039\/100008414","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Digit Imaging. Inform. med."],"abstract":"<jats:title>Abstract<\/jats:title>\n          <jats:p>RNAscope staining of breast cancer tissue allows pathologists to deduce genetic characteristics of the cancer by inspection at the microscopic level, which can lead to better diagnosis and treatment. Chromogenic RNAscope staining is easy to fit into existing pathology workflows, but manually analyzing the resulting tissue samples is time consuming. There is also a lack of peer-reviewed, performant solutions for automated analysis of chromogenic RNAscope staining. This paper covers the development and optimization of a novel deep learning method focused on accurate segmentation of RNAscope dots (which signify gene expression) from breast cancer tissue. The deep learning network is convolutional and uses ConvNeXt as its backbone. The upscaling portions of the network use custom, heavily regularized blocks to prevent overfitting and early convergence on suboptimal solutions. The resulting network is modest in size for a segmentation network and able to function well with little training data. This deep learning network was also able to outperform manual expert annotation at finding the positions of RNAscope dots, having a final <jats:inline-formula>\n              <jats:alternatives>\n                <jats:tex-math>$$\\varvec{F}_\\textbf{1}$$<\/jats:tex-math>\n                <mml:math xmlns:mml=\"http:\/\/www.w3.org\/1998\/Math\/MathML\">\n                  <mml:msub>\n                    <mml:mrow>\n                      <mml:mi>F<\/mml:mi>\n                    <\/mml:mrow>\n                    <mml:mn>1<\/mml:mn>\n                  <\/mml:msub>\n                <\/mml:math>\n              <\/jats:alternatives>\n            <\/jats:inline-formula>-score of 0.745. In comparison, the expert inter-rater <jats:inline-formula>\n              <jats:alternatives>\n                <jats:tex-math>$$\\varvec{F}_\\textbf{1}$$<\/jats:tex-math>\n                <mml:math xmlns:mml=\"http:\/\/www.w3.org\/1998\/Math\/MathML\">\n                  <mml:msub>\n                    <mml:mrow>\n                      <mml:mi>F<\/mml:mi>\n                    <\/mml:mrow>\n                    <mml:mn>1<\/mml:mn>\n                  <\/mml:msub>\n                <\/mml:math>\n              <\/jats:alternatives>\n            <\/jats:inline-formula>-score was 0.596.<\/jats:p>","DOI":"10.1007\/s10278-024-01301-9","type":"journal-article","created":{"date-parts":[[2024,10,23]],"date-time":"2024-10-23T16:02:44Z","timestamp":1729699364000},"page":"1704-1721","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Deep Learning Segmentation of Chromogenic Dye RNAscope From Breast Cancer Tissue"],"prefix":"10.1007","volume":"38","author":[{"ORCID":"https:\/\/orcid.org\/0009-0009-3329-407X","authenticated-orcid":false,"given":"Andrew","family":"Davidson","sequence":"first","affiliation":[]},{"given":"Arthur","family":"Morley-Bunker","sequence":"additional","affiliation":[]},{"given":"George","family":"Wiggins","sequence":"additional","affiliation":[]},{"given":"Logan","family":"Walker","sequence":"additional","affiliation":[]},{"given":"Gavin","family":"Harris","sequence":"additional","affiliation":[]},{"given":"Ramakrishnan","family":"Mukundan","sequence":"additional","affiliation":[]},{"given":"kConFab","family":"Investigators","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2024,10,23]]},"reference":[{"key":"1301_CR1","unstructured":"Breast cancer. World Health Organization (2021). https:\/\/www.who.int\/news-room\/fact-sheets\/detail\/breast-cancer"},{"issue":"3","key":"1301_CR2","doi-asserted-by":"publisher","first-page":"288","DOI":"10.1001\/jama.2018.19323","volume":"321","author":"AG Waks","year":"2019","unstructured":"Waks, A.G., Winer, E.P.: Breast Cancer Treatment: A Review. JAMA. 321(3), 288\u2013300 (2019) https:\/\/doi.org\/10.1001\/jama.2018.19323","journal-title":"JAMA."},{"key":"1301_CR3","doi-asserted-by":"publisher","first-page":"15","DOI":"10.1016\/j.breast.2022.08.010","volume":"66","author":"M Arnold","year":"2022","unstructured":"Arnold, M., Morgan, E., Rumgay, H., Mafra, A., Singh, D., Laversanne, M., Vignat, J., Gralow, J.R., Cardoso, F., Siesling, S., Soerjomataram, I.: Current and future burden of breast cancer: Global statistics for 2020 and 2040. The Breast. 66, 15\u201323 (2022) https:\/\/doi.org\/10.1016\/j.breast.2022.08.010","journal-title":"The Breast."},{"key":"1301_CR4","doi-asserted-by":"publisher","unstructured":"Rozario, S.Y., Sarkar, M., Farlie, M.K., Lazarus, M.D.: Responding to the healthcare workforce shortage: A scoping review exploring anatomical pathologists\u2019 professional identities over time. Anatomical Sciences Education. n\/a(n\/a) (2023). https:\/\/doi.org\/10.1002\/ase.2260. https:\/\/anatomypubs.onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/ase.2260","DOI":"10.1002\/ase.2260"},{"key":"1301_CR5","doi-asserted-by":"publisher","unstructured":"Graschew, G., Roelofs, T.A., Rakowsky, S., Schlag, P.M.: E-health and telemedicine. International Journal of Computer Assisted Radiology and Surgery. 1(1), 119\u2013135 (2006). https:\/\/doi.org\/10.1007\/s11548-006-0012-1","DOI":"10.1007\/s11548-006-0012-1"},{"key":"1301_CR6","doi-asserted-by":"publisher","unstructured":"Ghaznavi, F., Evans, A., Madabhushi, A., Feldman, M.: Digital imaging in pathology: Whole-slide imaging and beyond. Annual Review of Pathology: Mechanisms of Disease. 8(1), 331\u2013359 (2013). https:\/\/doi.org\/10.1146\/annurev-pathol-011811-120902. https:\/\/doi.org\/10.1146\/annurev-pathol-011811-120902. PMID: 23157334","DOI":"10.1146\/annurev-pathol-011811-120902"},{"key":"1301_CR7","doi-asserted-by":"publisher","unstructured":"Wang, F., Flanagan, J., Su, N., Wang, L.-C., Bui, S., Nielson, A., Wu, X., Vo, H.-T., Ma, X.-J., Luo, Y.: Rnascope: a novel in situ rna analysis platform for formalin-fixed, paraffin-embedded tissues. The Journal of molecular diagnostics : JMD. 14(1), 22\u201329 (2012). https:\/\/doi.org\/10.1016\/j.jmoldx.2011.08.002 . 22166544[pmid]","DOI":"10.1016\/j.jmoldx.2011.08.002"},{"key":"1301_CR8","doi-asserted-by":"crossref","unstructured":"Liu, Z., Mao, H., Wu, C., Feichtenhofer, C., Darrell, T., Xie, S.: A convnet for the 2020s. CoRR. abs\/2201.03545 (2022). arXiv:2201.03545","DOI":"10.1109\/CVPR52688.2022.01167"},{"key":"1301_CR9","doi-asserted-by":"crossref","unstructured":"Zhou, Z., Siddiquee, M.M.R., Tajbakhsh, N., Liang, J.: Unet++: A nested u-net architecture for medical image segmentation. CoRR. abs\/1807.10165 (2018) arXiv:1807.10165","DOI":"10.1007\/978-3-030-00889-5_1"},{"key":"1301_CR10","doi-asserted-by":"publisher","unstructured":"Morley-Bunker, A.E., Wiggins, G.A.R., Currie, M.J., Morrin, H.R., Whitehead, M.R., Eglinton, T., Pearson, J., Walker, L.C.: Rnascope compatibility with image analysis platforms for the quantification of tissue-based colorectal cancer biomarkers in archival formalin-fixed paraffin-embedded tissue. Acta Histochemica. 123(6), 151765 (2021). https:\/\/doi.org\/10.1016\/j.acthis.2021.151765","DOI":"10.1016\/j.acthis.2021.151765"},{"key":"1301_CR11","doi-asserted-by":"publisher","unstructured":"Arganda-Carreras, I., Kaynig, V., Rueden, C., Eliceiri, K.W., Schindelin, J., Cardona, A., Sebastian\u00a0Seung, H.: Trainable Weka Segmentation: a machine learning tool for microscopy pixel classification. Bioinformatics. 33(15), 2424\u20132426 (2017). https:\/\/doi.org\/10.1093\/bioinformatics\/btx180. https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/33\/15\/2424\/50756582\/bioinformatics_33_15_2424.pdf","DOI":"10.1093\/bioinformatics\/btx180"},{"key":"1301_CR12","doi-asserted-by":"publisher","unstructured":"Jamalzadeh, S., H\u00e4kkinen, A., Andersson, N., Huhtinen, K., Laury, A., Hietanen, S., Hynninen, J., Oikkonen, J., Carpen, O., Virtanen, A., Hautaniemi, S.: Quantish: Rna in situ hybridization image analysis framework for quantifying cell type-specific target rna expression and variability. Laboratory Investigation. 102, 1\u20139 (2022). https:\/\/doi.org\/10.1038\/s41374-022-00743-5","DOI":"10.1038\/s41374-022-00743-5"},{"key":"1301_CR13","doi-asserted-by":"crossref","unstructured":"Davidson, A., Morley-Bunker, A., Wiggins, G., Walker, L., Harris, G., Mukundan, R., Investigators: Grey level texture features for segmentation of chromogenic dye rnascope from breast cancer tissue. ArXiv. abs\/2401.15886 (2024) [cs.CV]","DOI":"10.1007\/s10278-024-01301-9"},{"key":"1301_CR14","unstructured":"Abadi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., Corrado, G.S., Davis, A., Dean, J., Devin, M., Ghemawat, S., Goodfellow, I., Harp, A., Irving, G., Isard, M., Jia, Y., Jozefowicz, R., Kaiser, L., Kudlur, M., Levenberg, J., Man\u00e9, D., Monga, R., Moore, S., Murray, D., Olah, C., Schuster, M., Shlens, J., Steiner, B., Sutskever, I., Talwar, K., Tucker, P., Vanhoucke, V., Vasudevan, V., Vi\u00e9gas, F., Vinyals, O., Warden, P., Wattenberg, M., Wicke, M., Yu, Y., Zheng, X.: TensorFlow: Large-Scale Machine Learning on Heterogeneous Systems. Software available from tensorflow.org (2015). https:\/\/www.tensorflow.org\/"},{"key":"1301_CR15","unstructured":"Chollet, F., et al.: Keras (2015). https:\/\/keras.io"},{"key":"1301_CR16","unstructured":"Ba, J., Kiros, J.R., Hinton, G.E.: Layer normalization. ArXiv. abs\/1607.06450 (2016)"},{"key":"1301_CR17","unstructured":"Zeiler, M.D.: Adadelta: An adaptive learning rate method. ArXiv. abs\/1212.5701 (2012)"},{"key":"1301_CR18","doi-asserted-by":"publisher","unstructured":"Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., Fei-Fei, L.: Imagenet: A large-scale hierarchical image database. In: 2009 IEEE Conference on Computer Vision and Pattern Recognition, pp. 248\u2013255 (2009). https:\/\/doi.org\/10.1109\/CVPR.2009.5206848","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"1301_CR19","unstructured":"Paul, S.: convnext \u2014 kaggle.com. https:\/\/www.kaggle.com\/models\/spsayakpaul\/convnext. [Accessed 04-03-2024] (2022)"},{"key":"1301_CR20","doi-asserted-by":"publisher","unstructured":"Huang, Y., Tang, Z., Chen, D., Su, K., Chen, C.: Batching soft iou for training semantic segmentation networks. IEEE Signal Processing Letters. 27, 66\u201370 (2020). https:\/\/doi.org\/10.1109\/LSP.2019.2956367","DOI":"10.1109\/LSP.2019.2956367"},{"key":"1301_CR21","doi-asserted-by":"publisher","unstructured":"Thorne, H., Mitchell, G., Fox, o.b.o.t.k.c. Stephen: kConFab: A Familial Breast Cancer Consortium Facilitating Research and Translational Oncology. JNCI Monographs. 2011(43), 79\u201381 (2011). https:\/\/doi.org\/10.1093\/jncimonographs\/lgr042. https:\/\/academic.oup.com\/jncimono\/article-pdf\/2011\/43\/79\/2785591\/lgr042.pdf","DOI":"10.1093\/jncimonographs\/lgr042"}],"container-title":["Journal of Imaging Informatics in Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10278-024-01301-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10278-024-01301-9\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10278-024-01301-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,5,20]],"date-time":"2025-05-20T17:27:38Z","timestamp":1747762058000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10278-024-01301-9"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,10,23]]},"references-count":21,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2025,6]]}},"alternative-id":["1301"],"URL":"https:\/\/doi.org\/10.1007\/s10278-024-01301-9","relation":{},"ISSN":["2948-2933"],"issn-type":[{"type":"electronic","value":"2948-2933"}],"subject":[],"published":{"date-parts":[[2024,10,23]]},"assertion":[{"value":"25 April 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"9 October 2024","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"10 October 2024","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"23 October 2024","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"This study involving human participants was reviewed and approved by the University of Otago Human Ethics Committee (Health) - H14\/088. This study was performed in line with the principles of the Declaration of Helsinki.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics Approval"}},{"value":"Informed consent was obtained from all study participants for this study.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent to Participate"}},{"value":"The authors declare no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of Interest"}}]}}