{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,5]],"date-time":"2026-11-05T21:01:23Z","timestamp":1793912483891,"version":"4.8.0"},"reference-count":31,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2024,2,19]],"date-time":"2024-02-19T00:00:00Z","timestamp":1708300800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,2,19]],"date-time":"2024-02-19T00:00:00Z","timestamp":1708300800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["62231018"],"award-info":[{"award-number":["62231018"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61925104"],"award-info":[{"award-number":["61925104"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100012543","name":"Shanghai Science and Technology Development Foundation","doi-asserted-by":"publisher","award":["2021SHZDZX0103"],"award-info":[{"award-number":["2021SHZDZX0103"]}],"id":[{"id":"10.13039\/100012543","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Nat Commun"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Multimode fiber (MMF) which supports parallel transmission of spatially distributed information is a promising platform for remote imaging and capacity-enhanced optical communication. However, the variability of the scattering MMF channel poses a challenge for achieving long-term accurate transmission over long distances, of which static optical propagation modeling with calibrated transmission matrix or data-driven learning will inevitably degenerate. In this paper, we present a self-supervised dynamic learning approach that achieves long-term, high-fidelity transmission of arbitrary optical fields through unstabilized MMFs. Multiple networks carrying both long- and short-term memory of the propagation model variations are adaptively updated and ensembled to achieve robust image recovery. We demonstrate &gt;99.9% accuracy in the transmission of 1024 spatial degree-of-freedom over 1\u2009km length MMFs lasting over 1000\u2009seconds. The long-term high-fidelity capability enables compressive encoded transfer of high-resolution video with orders of throughput enhancement, offering insights for artificial intelligence promoted diffusive spatial transmission in practical applications.<\/jats:p>","DOI":"10.1038\/s41467-024-45745-7","type":"journal-article","created":{"date-parts":[[2024,2,19]],"date-time":"2024-02-19T07:03:11Z","timestamp":1708326191000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":53,"title":["Self-supervised dynamic learning for long-term high-fidelity image transmission through unstabilized diffusive media"],"prefix":"10.1038","volume":"15","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7631-989X","authenticated-orcid":false,"given":"Ziwei","family":"Li","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wei","family":"Zhou","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhanhong","family":"Zhou","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shuqi","family":"Zhang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5478-3704","authenticated-orcid":false,"given":"Jianyang","family":"Shi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chao","family":"Shen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Junwen","family":"Zhang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4966-3844","authenticated-orcid":false,"given":"Nan","family":"Chi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7043-3061","authenticated-orcid":false,"given":"Qionghai","family":"Dai","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2024,2,19]]},"reference":[{"key":"45745_CR1","doi-asserted-by":"publisher","DOI":"10.1038\/ncomms2024","volume":"3","author":"T \u010ci\u017em\u00e1r","year":"2012","unstructured":"\u010ci\u017em\u00e1r, T. & Dholakia, K. Exploiting multimode waveguides for pure fibre-based imaging. Nat. Commun. 3, 1027 (2012).","journal-title":"Nat. Commun."},{"key":"45745_CR2","doi-asserted-by":"publisher","first-page":"354","DOI":"10.1038\/nphoton.2013.94","volume":"7","author":"DJ Richardson","year":"2013","unstructured":"Richardson, D. J., Fini, J. M. & Nelson, L. E. Space-division multiplexing in optical fibres. Nat. Photon. 7, 354\u2013362 (2013).","journal-title":"Nat. Photon."},{"key":"45745_CR3","doi-asserted-by":"publisher","first-page":"23149","DOI":"10.1364\/OE.459810","volume":"30","author":"F Feng","year":"2022","unstructured":"Feng, F. et al. Data transmission with up to 100 orbital angular momentum modes via commercial multi-mode fiber and parallel neural networks. Opt. Express 30, 23149\u201323162 (2022).","journal-title":"Opt. Express"},{"key":"45745_CR4","doi-asserted-by":"publisher","first-page":"635","DOI":"10.1039\/C1LC20719A","volume":"12","author":"S Bianchi","year":"2012","unstructured":"Bianchi, S. & Di Leonardo, R. A multi-mode fiber probe for holographic micromanipulation and microscopy. Lab Chip 12, 635\u2013639 (2012).","journal-title":"Lab Chip"},{"key":"45745_CR5","doi-asserted-by":"publisher","DOI":"10.1038\/s41377-018-0111-0","volume":"7","author":"SA Vasquez-Lopez","year":"2018","unstructured":"Vasquez-Lopez, S. A. et al. Subcellular spatial resolution achieved for deep-brain imaging in vivo using a minimally invasive multimode fiber. Light Sci. Appl. 7, 110 (2018).","journal-title":"Light Sci. Appl."},{"key":"45745_CR6","doi-asserted-by":"publisher","first-page":"203901","DOI":"10.1103\/PhysRevLett.109.203901","volume":"109","author":"Y Choi","year":"2012","unstructured":"Choi, Y. et al. Scanner-free and wide-field endoscopic imaging by using a single multimode optical fiber. Phys. Rev. Lett. 109, 203901 (2012).","journal-title":"Phys. Rev. Lett."},{"key":"45745_CR7","doi-asserted-by":"publisher","first-page":"5118","DOI":"10.1109\/JLT.2022.3174422","volume":"40","author":"G Rizzelli","year":"2022","unstructured":"Rizzelli, G. et al. Coherent communication over multi mode fibers for intra-datacenter ultra-high speed links. J. Lightwave Technol. 40, 5118\u20135127 (2022).","journal-title":"J. Lightwave Technol."},{"key":"45745_CR8","doi-asserted-by":"publisher","first-page":"416","DOI":"10.1038\/s41566-023-01166-4","volume":"17","author":"W Li","year":"2023","unstructured":"Li, W. et al. High-rate quantum key distribution exceeding 110\u2009Mb\u2009s\u20131. Nat. Photon. 17, 416\u2013421 (2023).","journal-title":"Nat. Photon."},{"key":"45745_CR9","doi-asserted-by":"crossref","unstructured":"Ding, Y. et al. High-dimensional quantum key distribution based on multicore fiber using silicon photonic integrated circuits. npj Quant. Inf. 3, 25 (2017).","DOI":"10.1038\/s41534-017-0026-2"},{"key":"45745_CR10","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-021-22071-w","volume":"12","author":"Y Zhou","year":"2021","unstructured":"Zhou, Y. et al. High-fidelity spatial mode transmission through a 1-km-long multimode fiber via vectorial time reversal. Nat. Commun. 12, 1866 (2021).","journal-title":"Nat. Commun."},{"key":"45745_CR11","doi-asserted-by":"publisher","first-page":"529","DOI":"10.1038\/nphoton.2015.112","volume":"9","author":"M Pl\u00f6schner","year":"2015","unstructured":"Pl\u00f6schner, M., Tyc, T. & \u010ci\u017em\u00e1r, T. Seeing through chaos in multimode fibres. Nat. Photon. 9, 529\u2013535 (2015).","journal-title":"Nat. Photon."},{"key":"45745_CR12","doi-asserted-by":"publisher","first-page":"123021","DOI":"10.1088\/1367-2630\/13\/12\/123021","volume":"13","author":"SM Popoff","year":"2011","unstructured":"Popoff, S. M., Lerosey, G., Fink, M., Boccara, A. C. & Gigan, S. Controlling light through optical disordered media: transmission matrix approach. N. J. Phys. 13, 123021 (2011).","journal-title":"N. J. Phys."},{"key":"45745_CR13","doi-asserted-by":"crossref","unstructured":"Borhani, N., Kakkava, E., Moser, C. & Psaltis, D. Learning to see through multimode fibers. Optica 5, 960\u2013966 (2018).","DOI":"10.1364\/OPTICA.5.000960"},{"key":"45745_CR14","doi-asserted-by":"publisher","DOI":"10.1038\/s41377-018-0074-1","volume":"7","author":"B Rahmani","year":"2018","unstructured":"Rahmani, B., Loterie, D., Konstantinou, G., Psaltis, D. & Moser, C. Multimode optical fiber transmission with a deep learning network. Light Sci. Appl. 7, 69 (2018).","journal-title":"Light Sci. Appl."},{"key":"45745_CR15","doi-asserted-by":"publisher","first-page":"403","DOI":"10.1038\/s42256-020-0199-9","volume":"2","author":"B Rahmani","year":"2020","unstructured":"Rahmani, B. et al. Actor neural networks for the robust control of partially measured nonlinear systems showcased for image propagation through diffuse media. Nat. Mach. Intell. 2, 403\u2013410 (2020).","journal-title":"Nat. Mach. Intell."},{"key":"45745_CR16","doi-asserted-by":"publisher","first-page":"37968","DOI":"10.1364\/OE.501167","volume":"31","author":"S Zhang","year":"2023","unstructured":"Zhang, S. et al. Spatial pilot-aided fast-adapted framework for stable image transmission over long multi-mode fiber. Opt. Express 31, 37968\u201337979 (2023).","journal-title":"Opt. Express"},{"key":"45745_CR17","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-019-10057-8","volume":"10","author":"P Caramazza","year":"2019","unstructured":"Caramazza, P., Moran, O., Murray-Smith, R. & Faccio, D. Transmission of natural scene images through a multimode fibre. Nat. Commun. 10, 2029 (2019).","journal-title":"Nat. Commun."},{"key":"45745_CR18","doi-asserted-by":"publisher","DOI":"10.1038\/s41377-021-00514-9","volume":"10","author":"S Li","year":"2021","unstructured":"Li, S. et al. Compressively sampling the optical transmission matrix of a multimode fibre. Light Sci. Appl. 10, 88 (2021).","journal-title":"Light Sci. Appl."},{"key":"45745_CR19","doi-asserted-by":"crossref","unstructured":"Fan, W., Chen, Z., Yakovlev, V. V. & Pu, J. High-fidelity image reconstruction through multimode fiber via polarization-enhanced parametric speckle imaging. Laser Photon. Rev. 15, 2000376 (2021).","DOI":"10.1002\/lpor.202000376"},{"key":"45745_CR20","doi-asserted-by":"crossref","unstructured":"Resisi, S., Popoff, S. M. & Bromberg, Y. Image transmission through a dynamically perturbed multimode fiber by deep learning. Laser Photon. Rev. 15, 2000553 (2021).","DOI":"10.1002\/lpor.202000553"},{"key":"45745_CR21","doi-asserted-by":"crossref","unstructured":"Li, Y., Xue, Y. & Tian, L. Deep speckle correlation: a deep learning approach toward scalable imaging through scattering media. Optica 5, 1181\u20131190 (2018).","DOI":"10.1364\/OPTICA.5.001181"},{"key":"45745_CR22","doi-asserted-by":"publisher","DOI":"10.1038\/s41377-022-00730-x","volume":"11","author":"W Tahir","year":"2022","unstructured":"Tahir, W., Wang, H. & Tian, L. Adaptive 3D descattering with a dynamic synthesis network. Light Sci. Appl. 11, 42 (2022).","journal-title":"Light Sci. Appl."},{"key":"45745_CR23","doi-asserted-by":"publisher","first-page":"4016","DOI":"10.1109\/TIP.2019.2903321","volume":"28","author":"JH Choi","year":"2019","unstructured":"Choi, J. H., Elgendy, O. A. & Chan, S. H. Optimal Combination of Image Denoisers. IEEE Trans. Image Process 28, 4016\u20134031 (2019).","journal-title":"IEEE Trans. Image Process"},{"key":"45745_CR24","first-page":"1493","volume":"1","author":"F Agostinelli","year":"2013","unstructured":"Agostinelli, F., Anderson, M. R. & Lee, H. Adaptive Multi-Column Deep Neural Networks with Application to Robust Image Denoising. Neural Inf. Process. Syst. 1, 1493\u20131501 (2013).","journal-title":"Neural Inf. Process. Syst."},{"key":"45745_CR25","doi-asserted-by":"publisher","DOI":"10.1038\/s41377-020-0267-2","volume":"9","author":"M Deng","year":"2020","unstructured":"Deng, M., Li, S., Goy, A., Kang, I. & Barbastathis, G. Learning to synthesize: robust phase retrieval at low photon counts. Light Sci. Appl. 9, 36 (2020).","journal-title":"Light Sci. Appl."},{"key":"45745_CR26","doi-asserted-by":"crossref","unstructured":"Fan, P. et al. Learning enabled continuous transmission of spatially distributed information through multimode fibers. Laser Photon. Rev. 15, 2000348 (2021).","DOI":"10.1002\/lpor.202000348"},{"key":"45745_CR27","doi-asserted-by":"publisher","first-page":"034049","DOI":"10.1103\/PhysRevApplied.12.034049","volume":"12","author":"W Zhao","year":"2019","unstructured":"Zhao, W. et al. Ultrahigh-speed color imaging with single-pixel detectors at low lightlevel. Phys. Rev. Appl. 12, 034049 (2019).","journal-title":"Phys. Rev. Appl."},{"key":"45745_CR28","doi-asserted-by":"publisher","first-page":"025006","DOI":"10.1088\/2515-7647\/ab83e5","volume":"2","author":"M Wang","year":"2020","unstructured":"Wang, M., Sun, M.-j & Huang, C. Single-pixel 3D reconstruction via a high-speed LED array. J. Phys. Photon. 2, 025006 (2020).","journal-title":"J. Phys. Photon."},{"key":"45745_CR29","doi-asserted-by":"publisher","first-page":"20978","DOI":"10.1364\/OE.396734","volume":"28","author":"T Zhao","year":"2020","unstructured":"Zhao, T., Ourselin, S., Vercauteren, T. & Xia, W. Seeing through multimode fibers with real-valued intensity transmission matrices. Opt. Express 28, 20978\u201320991 (2020).","journal-title":"Opt. Express"},{"key":"45745_CR30","unstructured":"Zeiler, M. D. Adadelta: an adaptive learning rate method. https:\/\/arxiv.org\/abs\/1212.5701 (2012)."},{"key":"45745_CR31","doi-asserted-by":"publisher","unstructured":"Zhou, W., Li, Z. MMDN code for self-supervised dynamic learning for long-term high-fidelity image transmission through unstabilized diffusive media. https:\/\/doi.org\/10.5281\/zenodo.10432215 (2023).","DOI":"10.5281\/zenodo.10432215"}],"container-title":["Nature Communications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41467-024-45745-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41467-024-45745-7","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41467-024-45745-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,2,19]],"date-time":"2024-02-19T07:05:12Z","timestamp":1708326312000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41467-024-45745-7"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,2,19]]},"references-count":31,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2024,12]]}},"alternative-id":["45745"],"URL":"https:\/\/doi.org\/10.1038\/s41467-024-45745-7","relation":{"has-preprint":[{"id-type":"doi","id":"10.21203\/rs.3.rs-2858332\/v1","asserted-by":"object"}]},"ISSN":["2041-1723"],"issn-type":[{"value":"2041-1723","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,2,19]]},"assertion":[{"value":"25 April 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"31 January 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"19 February 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"1498"}}