{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,17]],"date-time":"2026-08-17T09:28:46Z","timestamp":1786958926085,"version":"build-2736575974"},"reference-count":122,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2026,8,17]],"date-time":"2026-08-17T00:00:00Z","timestamp":1786924800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2026,8,17]],"date-time":"2026-08-17T00:00:00Z","timestamp":1786924800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Nat Commun"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Cells are plastic, highly heterogeneous and change over time. High-content timelapse imaging promises to reveal dynamic cell behaviors, enabling more accurate identification of cell state and cell fate prediction for biological hypothesis generation and perturbation screens. To empower live-cell imaging based screening, we report the development of (1) a Shape, Appearance, Motion (SAM) \u201cphenome\u201d; a universal set of 2185 image-derived features that act as a image-\u201ctranscriptome\u201d to comprehensively quantify an object\u2019s instantaneous phenotype; (2) the SAM-Phenotype-Observation-Tool (SPOT), for image-\u201csequencing\u201d analysis of phenomes. We validate the effectiveness of unbiased SAM-SPOT workflow on publicly available computer vision and 2D single cell imaging datasets. Importantly, we demonstrate that SAM-phenome outperforms features generated by deep learning AI models trained on &gt;1 million fixed single cell and &gt;5000 single cell video frames, respectively. SAM-phenome and SPOT deliver high-throughput, object-treatment-agnostic, comprehensive screening readouts of dynamics, promising to advance novel molecular target discovery and new medicine development.<\/jats:p>","DOI":"10.1038\/s41467-026-75505-8","type":"journal-article","created":{"date-parts":[[2026,8,17]],"date-time":"2026-08-17T09:03:45Z","timestamp":1786957425000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Development of a universal imaging \u201cphenome\u201d using shape, appearance and motion (SAM) features and the SAM\u00a0Phenotype Observation Tool (SPOT)"],"prefix":"10.1038","volume":"17","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4463-1165","authenticated-orcid":false,"given":"Felix Y.","family":"Zhou","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0006-1580-0117","authenticated-orcid":false,"given":"Adam","family":"Norton-Steele","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lewis","family":"Marsh","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1771-5910","authenticated-orcid":false,"given":"Helen M.","family":"Byrne","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Heather A.","family":"Harrington","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6587-1152","authenticated-orcid":false,"given":"Xin","family":"Lu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2026,8,17]]},"reference":[{"key":"75505_CR1","doi-asserted-by":"publisher","first-page":"1084","DOI":"10.1038\/s41586-024-07069-w","volume":"626","author":"C Qiu","year":"2024","unstructured":"Qiu, C. et al. A single-cell time-lapse of mouse prenatal development from gastrula to birth. Nature 626, 1084\u20131093 (2024).","journal-title":"Nature"},{"key":"75505_CR2","doi-asserted-by":"publisher","first-page":"377","DOI":"10.1038\/nmeth.1315","volume":"6","author":"F Tang","year":"2009","unstructured":"Tang, F. et al. mRNA-Seq whole-transcriptome analysis of a single cell. Nat. Methods 6, 377\u2013382 (2009).","journal-title":"Nat. Methods"},{"key":"75505_CR3","doi-asserted-by":"publisher","first-page":"1663","DOI":"10.1016\/j.cell.2015.11.013","volume":"163","author":"F Paul","year":"2015","unstructured":"Paul, F. et al. Transcriptional heterogeneity and lineage commitment in myeloid progenitors. Cell 163, 1663\u20131677 (2015).","journal-title":"Cell"},{"key":"75505_CR4","doi-asserted-by":"publisher","first-page":"293","DOI":"10.1038\/s41587-023-01767-y","volume":"42","author":"Y Hao","year":"2024","unstructured":"Hao, Y. et al. Dictionary learning for integrative, multimodal and scalable single-cell analysis. Nat. Biotechnol. 42, 293\u2013304 (2024).","journal-title":"Nat. Biotechnol."},{"key":"75505_CR5","doi-asserted-by":"publisher","first-page":"604","DOI":"10.1038\/s41587-023-01733-8","volume":"41","author":"I Virshup","year":"2023","unstructured":"Virshup, I. et al. The scverse project provides a computational ecosystem for single-cell omics data analysis. Nat. Biotechnol. 41, 604\u2013606 (2023).","journal-title":"Nat. Biotechnol."},{"key":"75505_CR6","doi-asserted-by":"publisher","first-page":"723","DOI":"10.1038\/s41592-021-01171-x","volume":"18","author":"PV Kharchenko","year":"2021","unstructured":"Kharchenko, P. V. The triumphs and limitations of computational methods for scRNA-seq. Nat. Methods 18, 723\u2013732 (2021).","journal-title":"Nat. Methods"},{"key":"75505_CR7","doi-asserted-by":"publisher","first-page":"333","DOI":"10.1038\/s41586-023-06054-z","volume":"618","author":"F Mart\u00ednez-Jim\u00e9nez","year":"2023","unstructured":"Mart\u00ednez-Jim\u00e9nez, F. et al. Pan-cancer whole-genome comparison of primary and metastatic solid tumours. Nature 618, 333\u2013341 (2023).","journal-title":"Nature"},{"key":"75505_CR8","doi-asserted-by":"publisher","first-page":"eadd5327","DOI":"10.1126\/science.add5327","volume":"380","author":"C Burdziak","year":"2023","unstructured":"Burdziak, C. et al. Epigenetic plasticity cooperates with cell-cell interactions to direct pancreatic tumorigenesis. Science 380, eadd5327 (2023).","journal-title":"Science"},{"key":"75505_CR9","doi-asserted-by":"publisher","first-page":"1096","DOI":"10.1038\/s42003-023-05468-9","volume":"6","author":"H Balasubramanian","year":"2023","unstructured":"Balasubramanian, H., Hobson, C. M., Chew, T.-L. & Aaron, J. S. Imagining the future of optical microscopy: everything, everywhere, all at once. Commun. Biol. 6, 1096 (2023).","journal-title":"Commun. Biol."},{"key":"75505_CR10","doi-asserted-by":"publisher","first-page":"66","DOI":"10.1038\/s41586-019-1146-y","volume":"569","author":"D Serra","year":"2019","unstructured":"Serra, D. et al. Self-organization and symmetry breaking in intestinal organoid development. Nature 569, 66\u201372 (2019).","journal-title":"Nature"},{"key":"75505_CR11","doi-asserted-by":"publisher","unstructured":"Javer, A., Ripoll-Sanchez, L. & Brown, A. E. X. Powerful and interpretable behavioural features for quantitative phenotyping of Caenorhabditis elegans. Philos. Trans. R Soc. Lond. B Biol. Sci. https:\/\/doi.org\/10.1098\/rstb.2017.0375 (2018).","DOI":"10.1098\/rstb.2017.0375"},{"key":"75505_CR12","doi-asserted-by":"publisher","first-page":"1612","DOI":"10.1038\/s42003-024-07329-5","volume":"7","author":"C Deben","year":"2024","unstructured":"Deben, C. et al. Development and validation of the Normalized Organoid Growth Rate (NOGR) metric in brightfield imaging-based assays. Commun. Biol. 7, 1612 (2024).","journal-title":"Commun. Biol."},{"key":"75505_CR13","doi-asserted-by":"publisher","first-page":"299","DOI":"10.1007\/s13402-022-00750-0","volume":"46","author":"C Deben","year":"2023","unstructured":"Deben, C. et al. OrBITS: label-free and time-lapse monitoring of patient derived organoids for advanced drug screening. Cell. Oncol. 46, 299\u2013314 (2023).","journal-title":"Cell. Oncol."},{"key":"75505_CR14","doi-asserted-by":"crossref","unstructured":"Seal, S. et al. Cell Painting: a decade of discovery and innovation in cellular imaging. Nat. Methods 22, 254\u2013268 (2025).","DOI":"10.1038\/s41592-024-02528-8"},{"key":"75505_CR15","doi-asserted-by":"publisher","first-page":"87","DOI":"10.1016\/S0014-5793(03)00521-0","volume":"546","author":"T Zimmermann","year":"2003","unstructured":"Zimmermann, T., Rietdorf, J. & Pepperkok, R. Spectral imaging and its applications in live cell microscopy. FEBS Lett. 546, 87\u201392 (2003).","journal-title":"FEBS Lett."},{"key":"75505_CR16","doi-asserted-by":"publisher","first-page":"e5621","DOI":"10.1016\/j.cell.2023.11.010","volume":"186","author":"Y Qian","year":"2023","unstructured":"Qian, Y., Celiker, O. T., Wang, Z., Guner-Ataman, B. & Boyden, E. S. Temporally multiplexed imaging of dynamic signaling networks in living cells. Cell 186, e5621 (2023).","journal-title":"Cell"},{"key":"75505_CR17","doi-asserted-by":"publisher","first-page":"749","DOI":"10.1038\/nrm3212","volume":"12","author":"CM Welch","year":"2011","unstructured":"Welch, C. M., Elliott, H., Danuser, G. & Hahn, K. M. Imaging the coordination of multiple signalling activities in living cells. Nat. Rev. Mol. cell Biol. 12, 749\u2013756 (2011).","journal-title":"Nat. Rev. Mol. cell Biol."},{"key":"75505_CR18","doi-asserted-by":"publisher","first-page":"1137","DOI":"10.1038\/nbt.3713","volume":"34","author":"S Skylaki","year":"2016","unstructured":"Skylaki, S., Hilsenbeck, O. & Schroeder, T. Challenges in long-term imaging and quantification of single-cell dynamics. Nat. Biotechnol. 34, 1137\u20131144 (2016).","journal-title":"Nat. Biotechnol."},{"key":"75505_CR19","doi-asserted-by":"publisher","first-page":"93","DOI":"10.1146\/annurev-physiol-022516-034055","volume":"79","author":"EA Specht","year":"2017","unstructured":"Specht, E. A., Braselmann, E. & Palmer, A. E. A critical and comparative review of fluorescent tools for live-cell imaging. Annu. Rev. Physiol. 79, 93\u2013117 (2017).","journal-title":"Annu. Rev. Physiol."},{"key":"75505_CR20","doi-asserted-by":"publisher","first-page":"557","DOI":"10.1038\/nmeth.3891","volume":"13","author":"PJ Cranfill","year":"2016","unstructured":"Cranfill, P. J. et al. Quantitative assessment of fluorescent proteins. Nat. Methods 13, 557\u2013562 (2016).","journal-title":"Nat. Methods"},{"key":"75505_CR21","doi-asserted-by":"publisher","first-page":"502","DOI":"10.1038\/s42003-023-04857-4","volume":"6","author":"S Daetwyler","year":"2023","unstructured":"Daetwyler, S. & Fiolka, R. P. Light-sheets and smart microscopy, an exciting future is dawning. Commun. Biol. 6, 502 (2023).","journal-title":"Commun. Biol."},{"key":"75505_CR22","doi-asserted-by":"publisher","first-page":"575","DOI":"10.1038\/s41576-020-0275-3","volume":"21","author":"RA Gibbs","year":"2020","unstructured":"Gibbs, R. A. The human genome project changed everything. Nat. Rev. Genet. 21, 575\u2013576 (2020).","journal-title":"Nat. Rev. Genet."},{"key":"75505_CR23","doi-asserted-by":"publisher","first-page":"860","DOI":"10.1038\/35057062","volume":"409","author":"ES Lander","year":"2001","unstructured":"Lander, E. S. Initial sequencing and analysis of the human genome. International Human Genome Sequencing Consortium. Nature 409, 860\u2013921 (2001).","journal-title":"Nature"},{"key":"75505_CR24","doi-asserted-by":"publisher","first-page":"1304","DOI":"10.1126\/science.1058040","volume":"291","author":"JC Venter","year":"2001","unstructured":"Venter, J. C. et al. The sequence of the human genome. Science 291, 1304\u20131351 (2001).","journal-title":"Science"},{"key":"75505_CR25","doi-asserted-by":"publisher","first-page":"610","DOI":"10.1016\/j.molcel.2015.04.005","volume":"58","author":"AA Kolodziejczyk","year":"2015","unstructured":"Kolodziejczyk, A. A., Kim, J. K., Svensson, V., Marioni, J. C. & Teichmann, S. A. The technology and biology of single-cell RNA sequencing. Mol. Cell 58, 610\u2013620 (2015).","journal-title":"Mol. Cell"},{"key":"75505_CR26","doi-asserted-by":"publisher","first-page":"395","DOI":"10.1038\/s41576-022-00449-w","volume":"23","author":"R Elmentaite","year":"2022","unstructured":"Elmentaite, R., Dom\u00ednguez Conde, C., Yang, L. & Teichmann, S. A. Single-cell atlases: shared and tissue-specific cell types across human organs. Nat. Rev. Genet. 23, 395\u2013410 (2022).","journal-title":"Nat. Rev. Genet."},{"key":"75505_CR27","doi-asserted-by":"publisher","first-page":"236","DOI":"10.1016\/j.cell.2020.03.053","volume":"181","author":"O Rozenblatt-Rosen","year":"2020","unstructured":"Rozenblatt-Rosen, O. et al. The human tumor atlas network: charting tumor transitions across space and time at single-cell resolution. Cell 181, 236\u2013249 (2020).","journal-title":"Cell"},{"key":"75505_CR28","doi-asserted-by":"publisher","first-page":"e27041","DOI":"10.7554\/eLife.27041","volume":"6","author":"A Regev","year":"2017","unstructured":"Regev, A. et al. The human cell atlas. Elife 6, e27041 (2017).","journal-title":"Elife"},{"key":"75505_CR29","doi-asserted-by":"publisher","first-page":"e1008002","DOI":"10.1371\/journal.pcbi.1008002","volume":"16","author":"CN Martineau","year":"2020","unstructured":"Martineau, C. N., Brown, A. E. X. & Laurent, P. Multidimensional phenotyping predicts lifespan and quantifies health in Caenorhabditis elegans. PLOS Comput. Biol. 16, e1008002 (2020).","journal-title":"PLOS Comput. Biol."},{"key":"75505_CR30","doi-asserted-by":"publisher","first-page":"54","DOI":"10.1016\/j.stem.2018.11.019","volume":"24","author":"F de Sousa E Melo","year":"2019","unstructured":"de Sousa E Melo, F. & de Sauvage, F. J. Cellular Plasticity in Intestinal Homeostasis and Disease. Cell Stem Cell 24, 54\u201364 (2019).","journal-title":"Cell Stem Cell"},{"key":"75505_CR31","doi-asserted-by":"publisher","first-page":"837","DOI":"10.1158\/2159-8290.CD-19-0015","volume":"9","author":"S Yuan","year":"2019","unstructured":"Yuan, S., Norgard, R. J. & Stanger, B. Z. Cellular plasticity in cancer. Cancer Discov. 9, 837\u2013851 (2019).","journal-title":"Cancer Discov."},{"key":"75505_CR32","doi-asserted-by":"publisher","unstructured":"Kinsler, G., Geiler-Samerotte, K. & Petrov, D. A. Fitness variation across subtle environmental perturbations reveals local modularity and global pleiotropy of adaptation. Elife https:\/\/doi.org\/10.7554\/eLife.61271 (2020).","DOI":"10.7554\/eLife.61271"},{"key":"75505_CR33","doi-asserted-by":"publisher","first-page":"20170110","DOI":"10.1098\/rstb.2017.0110","volume":"373","author":"T Isogai","year":"2018","unstructured":"Isogai, T. & Danuser, G. Discovery of functional interactions among actin regulators by analysis of image fluctuations in an unperturbed motile cell system. Philos. Trans. R. Soc. B: Biol. Sci. 373, 20170110 (2018).","journal-title":"Philos. Trans. R. Soc. B: Biol. Sci."},{"key":"75505_CR34","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/gb-2006-7-10-r100","volume":"7","author":"AE Carpenter","year":"2006","unstructured":"Carpenter, A. E. et al. CellProfiler: image analysis software for identifying and quantifying cell phenotypes. Genome Biol. 7, 1\u201311 (2006).","journal-title":"Genome Biol."},{"key":"75505_CR35","doi-asserted-by":"publisher","first-page":"e0217346","DOI":"10.1371\/journal.pone.0217346","volume":"14","author":"E Alizadeh","year":"2019","unstructured":"Alizadeh, E., Xu, W., Castle, J., Foss, J. & Prasad, A. TISMorph: a tool to quantify texture, irregularity and spreading of single cells. PLoS ONE 14, e0217346 (2019).","journal-title":"PLoS ONE"},{"key":"75505_CR36","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s12915-021-00958-w","volume":"19","author":"L Hof","year":"2021","unstructured":"Hof, L. et al. Long-term live imaging and multiscale analysis identify heterogeneity and core principles of epithelial organoid morphogenesis. BMC Biol. 19, 1\u201322 (2021).","journal-title":"BMC Biol."},{"key":"75505_CR37","doi-asserted-by":"crossref","unstructured":"Wahle, P. et al. Multimodal spatiotemporal phenotyping of human retinal organoid development. Nat. Biotechnol. 41, 1765\u20131775 (2023).","DOI":"10.1038\/s41587-023-01747-2"},{"key":"75505_CR38","doi-asserted-by":"publisher","first-page":"1495","DOI":"10.1038\/s12276-021-00641-8","volume":"53","author":"I Lukonin","year":"2021","unstructured":"Lukonin, I., Zinner, M. & Liberali, P. Organoids in image-based phenotypic chemical screens. Exp. Mol. Med. 53, 1495\u20131502 (2021).","journal-title":"Exp. Mol. Med."},{"key":"75505_CR39","first-page":"e246","volume":"10","author":"AG Goglia","year":"2020","unstructured":"Goglia, A. G. et al. A live-cell screen for altered ERK dynamics reveals principles of proliferative control. Cell Syst. 10, e246 (2020).","journal-title":"Cell Syst."},{"key":"75505_CR40","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-022-32958-x","volume":"13","author":"EC Freckmann","year":"2022","unstructured":"Freckmann, E. C. et al. Traject3d allows label-free identification of distinct co-occurring phenotypes within 3D culture by live imaging. Nat. Commun. 13, 5317 (2022).","journal-title":"Nat. Commun."},{"key":"75505_CR41","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-020-69354-8","volume":"10","author":"MJ Cox","year":"2020","unstructured":"Cox, M. J. et al. Tales of 1,008 small molecules: phenomic profiling through live-cell imaging in a panel of reporter cell lines. Sci. Rep. 10, 13262 (2020).","journal-title":"Sci. Rep."},{"key":"75505_CR42","doi-asserted-by":"publisher","first-page":"731","DOI":"10.1038\/s41568-023-00610-5","volume":"23","author":"M Alieva","year":"2023","unstructured":"Alieva, M., Wezenaar, A. K., Wehrens, E. J. & Rios, A. C. Bridging live-cell imaging and next-generation cancer treatment. Nat. Rev. Cancer 23, 731\u2013745 (2023).","journal-title":"Nat. Rev. Cancer"},{"key":"75505_CR43","first-page":"e1218","volume":"29","author":"EG Vazquez","year":"2022","unstructured":"Vazquez, E. G. et al. Dynamic and adaptive cancer stem cell population admixture in colorectal neoplasia. Cell Stem Cell 29, e1218 (2022).","journal-title":"Cell Stem Cell"},{"key":"75505_CR44","doi-asserted-by":"publisher","first-page":"105","DOI":"10.1038\/nm.3984","volume":"22","author":"N Andor","year":"2016","unstructured":"Andor, N. et al. Pan-cancer analysis of the extent and consequences of intratumor heterogeneity. Nat. Med. 22, 105\u2013113 (2016).","journal-title":"Nat. Med."},{"key":"75505_CR45","doi-asserted-by":"publisher","first-page":"e319","DOI":"10.1016\/j.cell.2022.12.028","volume":"186","author":"J-R Lin","year":"2023","unstructured":"Lin, J.-R. et al. Multiplexed 3D atlas of state transitions and immune interaction in colorectal cancer. Cell 186, e319 (2023).","journal-title":"Cell"},{"key":"75505_CR46","first-page":"e736","volume":"12","author":"A Zaritsky","year":"2021","unstructured":"Zaritsky, A. et al. Interpretable deep learning uncovers cellular properties in label-free live cell images that are predictive of highly metastatic melanoma. Cell Syst. 12, e736 (2021).","journal-title":"Cell Syst."},{"key":"75505_CR47","doi-asserted-by":"publisher","first-page":"636","DOI":"10.1038\/s42256-022-00503-6","volume":"4","author":"CJ Soelistyo","year":"2022","unstructured":"Soelistyo, C. J., Vallardi, G., Charras, G. & Lowe, A. R. Learning biophysical determinants of cell fate with deep neural networks. Nat. Mach. Intell. 4, 636\u2013644 (2022).","journal-title":"Nat. Mach. Intell."},{"key":"75505_CR48","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-024-45362-4","volume":"15","author":"J Burgess","year":"2024","unstructured":"Burgess, J. et al. Orientation-invariant autoencoders learn robust representations for shape profiling of cells and organelles. Nat. Commun. 15, 1022 (2024).","journal-title":"Nat. Commun."},{"key":"75505_CR49","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-025-88825-4","volume":"15","author":"V Kim","year":"2025","unstructured":"Kim, V. et al. Self-supervision advances morphological profiling by unlocking powerful image representations. Sci. Rep. 15, 4876 (2025).","journal-title":"Sci. Rep."},{"key":"75505_CR50","doi-asserted-by":"crossref","unstructured":"Ramezani, M. et al. A genome-wide atlas of human cell morphology. Nat. Methods 22, 621\u2013633 (2025).","DOI":"10.1038\/s41592-024-02537-7"},{"key":"75505_CR51","doi-asserted-by":"publisher","first-page":"1114","DOI":"10.1038\/s41592-024-02241-6","volume":"21","author":"SN Chandrasekaran","year":"2024","unstructured":"Chandrasekaran, S. N. et al. Three million images and morphological profiles of cells treated with matched chemical and genetic perturbations. Nat. Methods 21, 1114\u20131121 (2024).","journal-title":"Nat. Methods"},{"key":"75505_CR52","doi-asserted-by":"crossref","unstructured":"Deng, J. et al. ImageNet: A Large-Scale Hierarchical Image Database. In 2009 IEEE Conference on Computer Vision and Pattern Recognition 248\u2013255 (IEEE, 2009).","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"75505_CR53","doi-asserted-by":"crossref","unstructured":"Lin, T.-Y. et al. Microsoft COCO: Common Objects in Context. In Computer Vision\u2013ECCV 2014: 13th European Conference, Zurich, Switzerland, September 6\u201312, 2014, Proceedings, Part V 13. 740\u2013755 (Springer, 2014).","DOI":"10.1007\/978-3-319-10602-1_48"},{"key":"75505_CR54","doi-asserted-by":"publisher","first-page":"273","DOI":"10.1038\/s42256-023-00625-5","volume":"5","author":"T R\u00e4dsch","year":"2023","unstructured":"R\u00e4dsch, T. et al. Labelling instructions matter in biomedical image analysis. Nat. Mach. Intell. 5, 273\u2013283 (2023).","journal-title":"Nat. Mach. Intell."},{"key":"75505_CR55","doi-asserted-by":"crossref","unstructured":"Betzig, E. A Cell Observatory to reveal the subcellular foundations of life. Nat. Methods 22, 646\u2013649 (2025).","DOI":"10.1038\/s41592-024-02379-3"},{"key":"75505_CR56","unstructured":"Kirillov, A. et al. Segment Anything. In Proc. IEEE\/CVF Int. Conf. Comput. Vis. (ICCV), 4015\u20134026 (2023)."},{"key":"75505_CR57","unstructured":"Xu, M. et al. A survey of resource-efficient LLM and multimodal foundation models. Preprint at https:\/\/arxiv.org\/abs\/2401.08092 (2024)."},{"key":"75505_CR58","unstructured":"Ravi, N. et al. Sam 2: Segment anything in images and videos. Preprint at https:\/\/arxiv.org\/abs\/2408.00714 (2024)."},{"key":"75505_CR59","doi-asserted-by":"crossref","unstructured":"Archit, A. et al. Segment anything for microscopy. Nat. Methods 22, 579\u2013591 (2025).","DOI":"10.1038\/s41592-024-02580-4"},{"key":"75505_CR60","unstructured":"Azad, B. et al. Foundational models in medical imaging: a comprehensive survey and future vision. Preprint at https:\/\/arxiv.org\/abs\/2310.18689 (2023)."},{"key":"75505_CR61","doi-asserted-by":"publisher","unstructured":"Zhou, F. Y. et al. Identifying phenotype-genotype-function coupling in 3D organoid imaging using Shape, Appearance and Motion Phenotype Observation Tool (SPOT). https:\/\/doi.org\/10.1038\/s41467-026-75506-7 (2026).","DOI":"10.1038\/s41467-026-75506-7"},{"key":"75505_CR62","doi-asserted-by":"crossref","unstructured":"Farneb\u00e4ck, G. Two-frame motion estimation based on polynomial expansion. In Scandinavian Conference on Image Analysis 363\u2013370 (Springer, 2003).","DOI":"10.1007\/3-540-45103-X_50"},{"key":"75505_CR63","unstructured":"Zaheer, M. et al. Deep sets. Advances in Neural Information Processing Systems 30 (2017)."},{"key":"75505_CR64","unstructured":"Zhang, D. & Lu, G. A Comparative Study of Fourier Descriptors for Shape Representation and Retrieval. In Proc. 5th Asian Conference on Computer Vision 35 (Citeseer)."},{"key":"75505_CR65","doi-asserted-by":"publisher","first-page":"170","DOI":"10.1109\/TSMC.1977.4309681","volume":"7","author":"E Persoon","year":"1977","unstructured":"Persoon, E. & Fu, K.-S. Shape discrimination using Fourier descriptors. IEEE Trans. Syst., Man, Cybern. 7, 170\u2013179 (1977).","journal-title":"IEEE Trans. Syst., Man, Cybern."},{"key":"75505_CR66","doi-asserted-by":"publisher","first-page":"179","DOI":"10.1109\/TIT.1962.1057692","volume":"8","author":"M-K Hu","year":"1962","unstructured":"Hu, M.-K. Visual pattern recognition by moment invariants. IRE Trans. Inf. Theory 8, 179\u2013187 (1962).","journal-title":"IRE Trans. Inf. Theory"},{"key":"75505_CR67","doi-asserted-by":"publisher","first-page":"489","DOI":"10.1109\/34.55109","volume":"12","author":"A Khotanzad","year":"1990","unstructured":"Khotanzad, A. & Hong, Y. H. Invariant image recognition by Zernike moments. IEEE Trans. Pattern Anal. Mach. Intell. 12, 489\u2013497 (1990).","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"75505_CR68","doi-asserted-by":"publisher","first-page":"diab033","DOI":"10.1093\/insilicoplants\/diab033","volume":"4","author":"EJ Am\u00e9zquita","year":"2022","unstructured":"Am\u00e9zquita, E. J. et al. Measuring hidden phenotype: quantifying the shape of barley seeds using the Euler Characteristic Transform. in silico Plants 4, diab033 (2022).","journal-title":"in silico Plants"},{"key":"75505_CR69","first-page":"tnae002","volume":"8","author":"L Marsh","year":"2024","unstructured":"Marsh, L. et al. Detecting temporal shape changes with the Euler characteristic transform. Trans. Math. Appl. 8, tnae002 (2024).","journal-title":"Trans. Math. Appl."},{"key":"75505_CR70","doi-asserted-by":"crossref","unstructured":"Belongie, S., Mori, G. & Malik, J. Matching with shape contexts. Statistics and Analysis of Shapes, 81\u2013105 (2006).","DOI":"10.1007\/0-8176-4481-4_4"},{"key":"75505_CR71","doi-asserted-by":"publisher","first-page":"e0212110","DOI":"10.1371\/journal.pone.0212110","volume":"14","author":"T Lofstedt","year":"2019","unstructured":"Lofstedt, T., Brynolfsson, P., Asklund, T., Nyholm, T. & Garpebring, A. Gray-level invariant Haralick texture features. PLoS ONE 14, e0212110 (2019).","journal-title":"PLoS ONE"},{"key":"75505_CR72","first-page":"2","volume":"2","author":"G Lowe","year":"2004","unstructured":"Lowe, G. Sift-the scale invariant feature transform. Int. J. 2, 2 (2004).","journal-title":"Int. J."},{"key":"75505_CR73","doi-asserted-by":"crossref","unstructured":"Lowe, D. G. Object Recognition from Local Scale-Invariant Features. In Proc. IEEE Int. Conf. Comput. Vis. (ICCV) 2, 1150\u20131157 (1999).","DOI":"10.1109\/ICCV.1999.790410"},{"key":"75505_CR74","unstructured":"LeCun, Y. The MNIST database of handwritten digits. http:\/\/ann.lecun.com\/exdb\/mnist\/ (1998)."},{"key":"75505_CR75","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s12859-021-04344-9","volume":"22","author":"DR Stirling","year":"2021","unstructured":"Stirling, D. R. et al. CellProfiler 4: improvements in speed, utility and usability. BMC Bioinforma. 22, 1\u201311 (2021).","journal-title":"BMC Bioinforma."},{"key":"75505_CR76","doi-asserted-by":"publisher","first-page":"1185","DOI":"10.1109\/34.879802","volume":"22","author":"LJ Latecki","year":"2000","unstructured":"Latecki, L. J. & Lakamper, R. Shape similarity measure based on correspondence of visual parts. IEEE Trans. Pattern Anal. Mach. Intell. 22, 1185\u20131190 (2000).","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"75505_CR77","doi-asserted-by":"publisher","first-page":"129","DOI":"10.1109\/TIT.1982.1056489","volume":"28","author":"SP Lloyd","year":"1982","unstructured":"Lloyd, S. P. Least-squares quantization in PCM. IEEE Trans. Inf. Theory 28, 129\u2013137 (1982).","journal-title":"IEEE Trans. Inf. Theory"},{"key":"75505_CR78","doi-asserted-by":"crossref","unstructured":"Abdelmounaime, S. & Dong-Chen, H. New Brodatz-based image databases for grayscale color and multiband texture analysis. Int. Sch. Res. Notices 2013, 876386 (2013).","DOI":"10.1155\/2013\/876386"},{"key":"75505_CR79","doi-asserted-by":"publisher","unstructured":"Hersey, I. Textures: A Photographic Album for Artists and Designers (book review). Leonardo 1, 91\u201392 https:\/\/doi.org\/10.2307\/1571915 (1968).","DOI":"10.2307\/1571915"},{"key":"75505_CR80","doi-asserted-by":"crossref","unstructured":"Xu, C., Hsieh, S.-H., Xiong, C. & Corso, J. J. Can Humans Fly? Action Understanding with Multiple Classes of Actors. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2264\u20132273 (2015).","DOI":"10.1109\/CVPR.2015.7298839"},{"key":"75505_CR81","doi-asserted-by":"crossref","unstructured":"McInnes, L., Healy, J., Saul, N. & Gro\u00dfberger, L. UMAP: Uniform Manifold Approximation and Projection. J. Open Source Softw. 3, 861 (2018).","DOI":"10.21105\/joss.00861"},{"key":"75505_CR82","doi-asserted-by":"publisher","first-page":"1609","DOI":"10.1093\/bioinformatics\/btu080","volume":"30","author":"M Ma\u0161ka","year":"2014","unstructured":"Ma\u0161ka, M. et al. A benchmark for comparison of cell tracking algorithms. Bioinformatics 30, 1609\u20131617 (2014).","journal-title":"Bioinformatics"},{"key":"75505_CR83","doi-asserted-by":"publisher","DOI":"10.1186\/s13059-019-1663-x","volume":"20","author":"FA Wolf","year":"2019","unstructured":"Wolf, F. A. et al. PAGA: graph abstraction reconciles clustering with trajectory inference through a topology preserving map of single cells. Genome Biol. 20, 59 (2019).","journal-title":"Genome Biol."},{"key":"75505_CR84","doi-asserted-by":"publisher","first-page":"306","DOI":"10.1038\/nature10762","volume":"481","author":"M Greaves","year":"2012","unstructured":"Greaves, M. & Maley, C. C. Clonal evolution in cancer. Nature 481, 306\u2013313 (2012).","journal-title":"Nature"},{"key":"75505_CR85","doi-asserted-by":"publisher","first-page":"547","DOI":"10.1038\/s41587-019-0071-9","volume":"37","author":"W Saelens","year":"2019","unstructured":"Saelens, W., Cannoodt, R., Todorov, H. & Saeys, Y. A comparison of single-cell trajectory inference methods. Nat. Biotechnol. 37, 547\u2013554 (2019).","journal-title":"Nat. Biotechnol."},{"key":"75505_CR86","doi-asserted-by":"publisher","first-page":"1038","DOI":"10.1038\/s41592-021-01249-6","volume":"18","author":"C Edlund","year":"2021","unstructured":"Edlund, C. et al. LIVECell\u2014a large-scale dataset for label-free live cell segmentation. Nat. Methods 18, 1038\u20131045 (2021).","journal-title":"Nat. Methods"},{"key":"75505_CR87","doi-asserted-by":"publisher","first-page":"750","DOI":"10.1109\/TBDATA.2017.2717439","volume":"7","author":"M Chen","year":"2017","unstructured":"Chen, M., Shi, X., Zhang, Y., Wu, D. & Guizani, M. Deep feature learning for medical image analysis with convolutional autoencoder neural network. IEEE Trans. Big Data 7, 750\u2013758 (2017).","journal-title":"IEEE Trans. Big Data"},{"key":"75505_CR88","unstructured":"Zhang, Y. In ICONIP17-DCEC. http:\/\/users.cecs.anu.edu.au\/Tom.Gedeon\/conf\/ABCs2018\/paper\/ABCs2018_paper_58. pdf (2017)."},{"key":"75505_CR89","doi-asserted-by":"publisher","first-page":"255","DOI":"10.1038\/s42003-022-03218-x","volume":"5","author":"L Ternes","year":"2022","unstructured":"Ternes, L. et al. A multi-encoder variational autoencoder controls multiple transformational features in single-cell image analysis. Commun. Biol. 5, 255 (2022).","journal-title":"Commun. Biol."},{"key":"75505_CR90","unstructured":"Sim\u00e9oni, O. et al. DINOv3. Preprint at https:\/\/arxiv.org\/abs\/2508.10104 (2025)."},{"key":"75505_CR91","doi-asserted-by":"publisher","first-page":"711","DOI":"10.1038\/nmeth.2046","volume":"9","author":"Q Zhong","year":"2012","unstructured":"Zhong, Q., Busetto, A. G., Fededa, J. P., Buhmann, J. M. & Gerlich, D. W. Unsupervised modeling of cell morphology dynamics for time-lapse microscopy. Nat. Methods 9, 711\u2013713 (2012).","journal-title":"Nat. Methods"},{"key":"75505_CR92","unstructured":"Rehman, I., Farooq, M. & Simpson, B. Genetics, Mitosis. In StatPearls (Internet) (StatPearls Publishing, 2018)."},{"key":"75505_CR93","doi-asserted-by":"crossref","unstructured":"Donahue, J. et al. Long-Term Recurrent Convolutional Networks for Visual Recognition and Description. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition 2625\u20132634 (2015).","DOI":"10.1109\/CVPR.2015.7298878"},{"key":"75505_CR94","unstructured":"Pu, Y. et al. Variational autoencoder for deep learning of images, labels and captions. In Advances in Neural Information Processing Systems 29, 2352\u20132360 (2016)."},{"key":"75505_CR95","unstructured":"Srivastava, N., Mansimov, E. & Salakhudinov, R. Unsupervised learning of video representations using LSTMs. In International Conference on Machine Learning 843\u2013852 (PMLR, 2015)."},{"key":"75505_CR96","doi-asserted-by":"publisher","first-page":"110176","DOI":"10.1016\/j.asoc.2023.110176","volume":"138","author":"P Li","year":"2023","unstructured":"Li, P., Pei, Y. & Li, J. A comprehensive survey on design and application of autoencoder in deep learning. Appl. Soft Comput. 138, 110176 (2023).","journal-title":"Appl. Soft Comput."},{"key":"75505_CR97","doi-asserted-by":"publisher","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","volume":"9","author":"S Hochreiter","year":"1997","unstructured":"Hochreiter, S. & Schmidhuber, J. Long short-term memory. Neural Comput. 9, 1735\u20131780 (1997).","journal-title":"Neural Comput."},{"key":"75505_CR98","doi-asserted-by":"publisher","first-page":"171","DOI":"10.1038\/s41592-021-01358-2","volume":"19","author":"G Palla","year":"2022","unstructured":"Palla, G. et al. Squidpy: a scalable framework for spatial omics analysis. Nat. Methods 19, 171\u2013178 (2022).","journal-title":"Nat. Methods"},{"key":"75505_CR99","doi-asserted-by":"publisher","first-page":"1141","DOI":"10.1038\/nmeth.4473","volume":"14","author":"V Ulman","year":"2017","unstructured":"Ulman, V. et al. An objective comparison of cell-tracking algorithms. Nat. Methods 14, 1141\u20131152 (2017).","journal-title":"Nat. Methods"},{"key":"75505_CR100","unstructured":"Van der Maaten, L. & Hinton, G. Visualizing data using t-SNE. J. Mach. Learn. Res. 9, 2579\u20132605 (2008)."},{"key":"75505_CR101","first-page":"1","volume":"22","author":"Y Wang","year":"2021","unstructured":"Wang, Y., Huang, H., Rudin, C. & Shaposhnik, Y. Understanding how dimension reduction tools work: an empirical approach to deciphering t-SNE, UMAP, TriMAP, and PaCMAP for data visualization. J. Mach. Learn. Res. 22, 1\u201373 (2021).","journal-title":"J. Mach. Learn. Res."},{"key":"75505_CR102","unstructured":"Krizhevsky, A., Sutskever, I. & Hinton, G. E. Imagenet classification with deep convolutional neural networks. In Advances in Neural Information Processing Systems 25 (2012)."},{"key":"75505_CR103","unstructured":"Redmon, J. & Farhadi, A. YOLOv3: an incremental improvement. Preprint at https:\/\/ui.adsabs.harvard.edu\/abs\/2018arXiv180402767R (2018)."},{"key":"75505_CR104","doi-asserted-by":"publisher","first-page":"1137","DOI":"10.1109\/TPAMI.2016.2577031","volume":"39","author":"S Ren","year":"2016","unstructured":"Ren, S., He, K., Girshick, R. & Sun, J. Faster R-CNN: towards real-time object detection with region proposal networks. IEEE Trans. Pattern Anal. Mach. Intell. 39, 1137\u20131149 (2016).","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"75505_CR105","doi-asserted-by":"publisher","unstructured":"Hadi, M. U. et al. Large Language Models: A Comprehensive Survey of its Applications, Challenges, Limitations, and Future Prospects. Preprint at https:\/\/doi.org\/10.36227\/techrxiv.23589741.v3 (2023)","DOI":"10.36227\/techrxiv.23589741.v3"},{"key":"75505_CR106","doi-asserted-by":"crossref","unstructured":"Ronneberger, O., Fischer, P. & Brox, T. U-Net: convolutional networks for biomedical image segmentation. In Medical Image Computing and Computer-assisted Intervention\u2013MICCAI 2015: 18th International Conference, Munich, Germany, October 5\u20139, 2015, Proceedings, Part III 18 234\u2013241 (Springer, 2015).","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"75505_CR107","unstructured":"Oktay, O. et al. Attention U-Net: learning where to look for the pancreas. Preprint at https:\/\/arxiv.org\/abs\/1804.03999 (2018)."},{"key":"75505_CR108","doi-asserted-by":"publisher","DOI":"10.1038\/s41524-024-01250-5","volume":"10","author":"M Valleti","year":"2024","unstructured":"Valleti, M., Ziatdinov, M., Liu, Y. & Kalinin, S. V. Physics and chemistry from parsimonious representations: image analysis via invariant variational autoencoders. NPJ Comput. Mater. 10, 183 (2024).","journal-title":"NPJ Comput. Mater."},{"key":"75505_CR109","unstructured":"Higgins, I. et al. \u03b2-VAE: Learning Basic Visual Concepts with a Constrained Variational Framework. In Proc. Int. Conf. Learn. Represent (ICLR, 2017)."},{"key":"75505_CR110","doi-asserted-by":"crossref","unstructured":"Narodytska, N. & Kasiviswanathan, S. P. Simple Black-Box Adversarial Attacks on Deep Neural Networks. In Proc. IEEE\/CVF Conf. Comput. Vis. Pattern Recognit. Workshops (CVPRW), 1310\u20131318 (2017).","DOI":"10.1109\/CVPRW.2017.172"},{"key":"75505_CR111","doi-asserted-by":"publisher","first-page":"755","DOI":"10.1038\/s41586-024-07566-y","volume":"631","author":"I Shumailov","year":"2024","unstructured":"Shumailov, I. et al. AI models collapse when trained on recursively generated data. Nature 631, 755\u2013759 (2024).","journal-title":"Nature"},{"key":"75505_CR112","doi-asserted-by":"publisher","first-page":"45","DOI":"10.1007\/s12559-023-10179-8","volume":"16","author":"V Hassija","year":"2024","unstructured":"Hassija, V. et al. Interpreting black-box models: a review on explainable artificial intelligence. Cogn. Comput. 16, 45\u201374 (2024).","journal-title":"Cogn. Comput."},{"key":"75505_CR113","doi-asserted-by":"crossref","unstructured":"De Vries, M. et al. Geometric deep learning and multiple-instance learning for 3D cell-shape profiling. Cell Systems 16, 101229 (2025).","DOI":"10.1016\/j.cels.2025.101229"},{"key":"75505_CR114","doi-asserted-by":"publisher","first-page":"17359","DOI":"10.52202\/068431-1262","volume":"35","author":"K Meng","year":"2022","unstructured":"Meng, K., Bau, D., Andonian, A. & Belinkov, Y. Locating and editing factual associations in GPT. Adv. Neural Inf. Process. Syst. 35, 17359\u201317372 (2022).","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"75505_CR115","first-page":"143","volume":"3","author":"L Juan","year":"2009","unstructured":"Juan, L. & Gwun, O. A comparison of sift, PCA-SIFT and SURF. Int. J. Image Process. 3, 143\u2013152 (2009).","journal-title":"Int. J. Image Process."},{"key":"75505_CR116","doi-asserted-by":"publisher","first-page":"122","DOI":"10.2478\/msr-2013-0021","volume":"13","author":"J Wu","year":"2013","unstructured":"Wu, J. et al. A comparative study of SIFT and its variants. Meas. Sci. Rev. 13, 122\u2013131 (2013).","journal-title":"Meas. Sci. Rev."},{"key":"75505_CR117","unstructured":"Kuglin, C. D. & Hines, D. C. The Phase Correlation Image Alignment Method. In Proc. IEEE Int. Conf. Cybernetics and Society, 163\u2013165 (1975)."},{"key":"75505_CR118","doi-asserted-by":"publisher","first-page":"100","DOI":"10.1038\/s41592-020-01018-x","volume":"18","author":"C Stringer","year":"2021","unstructured":"Stringer, C., Wang, T., Michaelos, M. & Pachitariu, M. Cellpose: a generalist algorithm for cellular segmentation. Nat. Methods 18, 100\u2013106 (2021).","journal-title":"Nat. Methods"},{"key":"75505_CR119","doi-asserted-by":"crossref","unstructured":"Qader, W. A., Ameen, M. M. & Ahmed, B. I. An overview of bag of words; importance, implementation, applications, and challenges. In 2019 International Engineering Conference (IEC) 200\u2013204 (IEEE, 2019).","DOI":"10.1109\/IEC47844.2019.8950616"},{"key":"75505_CR120","doi-asserted-by":"crossref","unstructured":"Davies, D. L. & Bouldin, D. W. A cluster separation measure. In IEEE Transactions on Pattern Analysis and Machine Intelligence, 224\u2013227 (1979).","DOI":"10.1109\/TPAMI.1979.4766909"},{"key":"75505_CR121","doi-asserted-by":"publisher","unstructured":"Norton-Steele, A. & Zhou, F. Y. Filled, dilated, and textured MPEG-7 datasets. Zenodo. https:\/\/doi.org\/10.5281\/zenodo.20648294 (2026).","DOI":"10.5281\/zenodo.20648294"},{"key":"75505_CR122","doi-asserted-by":"publisher","unstructured":"Zhou, F. Y. & Norton-Steele, A. Code for SAM-SPOT papers by Zhou et al. Zenodo. https:\/\/doi.org\/10.5281\/zenodo.20629367 (2026).","DOI":"10.5281\/zenodo.20629367"}],"container-title":["Nature Communications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41467-026-75505-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41467-026-75505-8","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41467-026-75505-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,8,17]],"date-time":"2026-08-17T09:04:11Z","timestamp":1786957451000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41467-026-75505-8"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,8,17]]},"references-count":122,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2026,12]]}},"alternative-id":["75505"],"URL":"https:\/\/doi.org\/10.1038\/s41467-026-75505-8","relation":{},"ISSN":["2041-1723"],"issn-type":[{"value":"2041-1723","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,8,17]]},"assertion":[{"value":"4 April 2025","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"2 July 2026","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"17 August 2026","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"X.L. and F.Z. are named as inventors on a patent application (international patent application WO2024100225) based on certain subject matter contained in this article. The authors declare no further competing interests.","order":1,"name":"Ethics","label":"Competing interests","group":{"name":"EthicsHeading","label":"Ethics"}}],"article-number":"8409"}}