{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,15]],"date-time":"2026-06-15T14:18:15Z","timestamp":1781533095508,"version":"3.54.5"},"reference-count":49,"publisher":"Optica Publishing Group","issue":"6","license":[{"start":{"date-parts":[[2026,5,29]],"date-time":"2026-05-29T00:00:00Z","timestamp":1780012800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/doi.org\/10.1364\/OA_License_v2#VOR-OA"},{"start":{"date-parts":[[2026,5,29]],"date-time":"2026-05-29T00:00:00Z","timestamp":1780012800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/opg.optica.org\/policies\/opg-tdm-policy.json"}],"funder":[{"name":"EU Horizon project SENSEI","award":["101189545"],"award-info":[{"award-number":["101189545"]}]}],"content-domain":{"domain":["opg.optica.org"],"crossmark-restriction":false},"short-container-title":["J. Opt. Commun. Netw."],"published-print":{"date-parts":[[2026,6,1]]},"abstract":"<jats:p>The paradigm shift toward autonomous optical networking is transforming the transport layer into a widespread distributed sensing platform. However, traditional telemetry architectures, designed for low-frequency performance monitoring (typically sampled at 1\u00a0Hz or 15\u00a0min intervals), fail to meet the stringent requirements of physical sensing applications, which demand kHz-range sampling to capture seismic events by using indirect metrics such as state of polarization (SOP) rotations or the Jones rotation vector. This paper proposes a high-sampling-rate, open-source telemetry architecture designed to bridge this gap. Implemented as a containerized microservices stack orchestrated via Docker Compose, the framework leverages Apache Kafka to decouple high-velocity sensing streams from persistent storage, elevating raw sensor data to a \u201cFirst-Class Citizen\u201d for immediate consumption by AI\/ML agents. This approach facilitates multi-modal sensor fusion by enabling the temporal correlation of heterogeneous metrics in real-time. We validate the architecture through an extensive experimental scalability analysis using a Monte Carlo approach. Results demonstrate that the system sustains a throughput of over 30,000 messages\/s\u2014approximately 15 times the requirement for high-fidelity sensing\u2014while maintaining sub-second end-to-end latency (\n\t    &lt;200ms\n\t  ) in the optimal batching regime. These findings confirm the architecture\u2019s suitability for critical early warning scenarios, enabling robust, low-latency intervention in disaggregated optical networks.<\/jats:p>","DOI":"10.1364\/jocn.587846","type":"journal-article","created":{"date-parts":[[2026,4,27]],"date-time":"2026-04-27T18:00:09Z","timestamp":1777312809000},"page":"B187","update-policy":"https:\/\/doi.org\/10.1364\/crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Enabling real-time optical networks as distributed sensors via open-source telemetry architecture"],"prefix":"10.1364","volume":"18","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5102-7498","authenticated-orcid":true,"given":"Renato","family":"Ambrosone","sequence":"first","affiliation":[{"id":[{"id":"https:\/\/ror.org\/00bgk9508","id-type":"ROR","asserted-by":"publisher"}]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-9465-8801","authenticated-orcid":true,"given":"Sasipim","family":"Srivallapanondh","sequence":"additional","affiliation":[{"name":"Nokia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Riccardo","family":"Schips","sequence":"additional","affiliation":[{"id":[{"id":"https:\/\/ror.org\/00bgk9508","id-type":"ROR","asserted-by":"publisher"}]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0003-3724-0219","authenticated-orcid":true,"given":"Gulmina","family":"Malik","sequence":"additional","affiliation":[{"id":[{"id":"https:\/\/ror.org\/00bgk9508","id-type":"ROR","asserted-by":"publisher"}]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7834-2751","authenticated-orcid":true,"given":"Stefano","family":"Straullu","sequence":"additional","affiliation":[{"name":"LINKS Foundation"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8041-2392","authenticated-orcid":true,"given":"Francesco","family":"Aquilino","sequence":"additional","affiliation":[{"name":"LINKS Foundation"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0819-640X","authenticated-orcid":true,"given":"Antonino","family":"Nespola","sequence":"additional","affiliation":[{"name":"LINKS Foundation"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2682-6110","authenticated-orcid":true,"given":"Emanuele","family":"Virgillito","sequence":"additional","affiliation":[{"id":[{"id":"https:\/\/ror.org\/00bgk9508","id-type":"ROR","asserted-by":"publisher"}]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9264-9274","authenticated-orcid":true,"given":"Antonio","family":"Napoli","sequence":"additional","affiliation":[{"name":"Nokia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7289-6403","authenticated-orcid":true,"given":"Cecilia","family":"Clivati","sequence":"additional","affiliation":[{"name":"Istituto Nazionale di Ricerca Metrologica"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0691-0067","authenticated-orcid":true,"given":"Vittorio","family":"Curri","sequence":"additional","affiliation":[{"id":[{"id":"https:\/\/ror.org\/00bgk9508","id-type":"ROR","asserted-by":"publisher"}]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"285","published-online":{"date-parts":[[2026,5,29]]},"reference":[{"key":"jocn-18-6-B187-R1","doi-asserted-by":"publisher","first-page":"3142","DOI":"10.1109\/JLT.2018.2795345","type":"journal-article","volume":"36","author":"Paolucci","year":"2018","journal-title":"J. Lightwave Technol."},{"key":"jocn-18-6-B187-R2","doi-asserted-by":"crossref","first-page":"Tu3D.3","DOI":"10.1364\/OFC.2018.Tu3D.3","article-title":"High performance streaming telemetry in optical transport networks","volume-title":"Optical Fiber Communication Conference (OFC)","author":"Sadasivarao","year":"2018"},{"key":"jocn-18-6-B187-R3","doi-asserted-by":"publisher","first-page":"E42","DOI":"10.1364\/JOCN.424639","type":"journal-article","volume":"13","author":"Sgambelluri","year":"2021","journal-title":"J. Opt. Commun. Netw."},{"key":"jocn-18-6-B187-R4","doi-asserted-by":"publisher","first-page":"139","DOI":"10.1364\/JOCN.538552","type":"journal-article","volume":"17","author":"Shen","year":"2025","journal-title":"J. Opt. Commun. Netw."},{"key":"jocn-18-6-B187-R5","doi-asserted-by":"publisher","first-page":"19094","DOI":"10.1109\/JIOT.2024.3361173","type":"journal-article","volume":"11","author":"Lu","year":"2024","journal-title":"IEEE Internet Things J."},{"key":"jocn-18-6-B187-R6","doi-asserted-by":"publisher","first-page":"931","DOI":"10.1126\/science.abe6648","type":"journal-article","volume":"371","author":"Zhan","year":"2021","journal-title":"Science"},{"key":"jocn-18-6-B187-R7","doi-asserted-by":"publisher","first-page":"874","DOI":"10.1126\/science.abo1939","type":"journal-article","volume":"376","author":"Marra","year":"2022","journal-title":"Science"},{"key":"jocn-18-6-B187-R8","doi-asserted-by":"publisher","first-page":"178","DOI":"10.1038\/s43247-024-01338-2","type":"journal-article","volume":"5","author":"Donadello","year":"2024","journal-title":"Commun. Earth Environ."},{"key":"jocn-18-6-B187-R9","doi-asserted-by":"publisher","first-page":"14000","DOI":"10.1038\/s41598-022-18130-x","type":"journal-article","volume":"12","author":"Bogris","year":"2022","journal-title":"Sci. Rep."},{"key":"jocn-18-6-B187-R10","doi-asserted-by":"publisher","first-page":"788","DOI":"10.1364\/OPTICA.424307","type":"journal-article","volume":"8","author":"Mecozzi","year":"2021","journal-title":"Optica"},{"key":"jocn-18-6-B187-R11","doi-asserted-by":"crossref","DOI":"10.1109\/ECOC66593.2025.11263003","article-title":"Submarine cable deep-ocean observation of mega-thrust earthquake and tsunami with 44,000 100-m spaced sensors","volume-title":"European Conference on Optical Communications (ECOC)","author":"Mazur","year":"2025"},{"key":"jocn-18-6-B187-R12","doi-asserted-by":"publisher","first-page":"91","DOI":"10.1038\/s44172-024-00237-w","type":"journal-article","volume":"3","author":"Carver","year":"2024","journal-title":"Commun. Eng."},{"key":"jocn-18-6-B187-R13","first-page":"Tu3J.6","article-title":"Real-time monitoring of cable break in a live network using a coherent transceiver prototype","volume-title":"Optical Fiber Communication Conference (OFC)","author":"Mazur","year":"2024"},{"key":"jocn-18-6-B187-R14","doi-asserted-by":"publisher","first-page":"D1","DOI":"10.1364\/JOCN.424631","type":"journal-article","volume":"13","author":"Vilalta","year":"2021","journal-title":"J. Opt. Commun. Netw."},{"key":"jocn-18-6-B187-R15","doi-asserted-by":"crossref","DOI":"10.1109\/ICTON59386.2023.10207513","article-title":"Detection, localization and emulation of environmental activities using SOP monitoring of IMDD optical data channels","volume-title":"International Conference on Transparent Optical Networks (ICTON)","author":"Virgillito","year":"2023"},{"key":"jocn-18-6-B187-R16","doi-asserted-by":"crossref","DOI":"10.23919\/ONDM48393.2020.9132992","article-title":"Telemetry in disaggregated optical networks","volume-title":"International Conference on Optical Network Design and Modeling (ONDM)","author":"Paolucci","year":"2020"},{"key":"jocn-18-6-B187-R21","doi-asserted-by":"publisher","first-page":"676","DOI":"10.1364\/JOCN.493347","type":"journal-article","volume":"15","author":"Velasco","year":"2023","journal-title":"J. Opt. Commun. Netw."},{"key":"jocn-18-6-B187-R22","doi-asserted-by":"crossref","DOI":"10.1109\/ICTON67126.2025.11125126","article-title":"Control and telemetry in optical multiplex section enhanced by OpenConfig model","volume-title":"25th Anniversary International Conference on Transparent Optical Networks (ICTON)","author":"Schips","year":"2025"},{"key":"jocn-18-6-B187-R23","doi-asserted-by":"crossref","DOI":"10.1109\/ICTON.2019.8840320","article-title":"Open source implementation of OpenConfig telemetry-enabled NETCONF agent","volume-title":"International Conference on Transparent Optical Networks (ICTON)","author":"Sgambelluri","year":"2019"},{"key":"jocn-18-6-B187-R24","first-page":"7","article-title":"Enhancing whitebox optical SDN control using OpenROADM models","volume-title":"IEEE 25th International Conference on High Performance Switching and Routing (HPSR)","author":"Schips","year":"2024"},{"key":"jocn-18-6-B187-R25","doi-asserted-by":"publisher","first-page":"C11","DOI":"10.1364\/JOCN.450008","type":"journal-article","volume":"14","author":"Rouzic","year":"2022","journal-title":"J. Opt. Commun. Netw."},{"key":"jocn-18-6-B187-R27","doi-asserted-by":"crossref","DOI":"10.23919\/ONDM57372.2023.10144867","article-title":"Digital-twin of physical-layer as enabler for open and disaggregated optical networks","volume-title":"International Conference on Optical Network Design and Modeling (ONDM)","author":"Curri","year":"2023"},{"key":"jocn-18-6-B187-R28","doi-asserted-by":"crossref","DOI":"10.1109\/ECOC66593.2025.11262987","article-title":"In-field demonstration of multi-tech sensing on terrestrial optical data network using state of polarization and phase monitoring","volume-title":"The European Conference on Optical Communications (ECOC)","author":"Virgillito","year":"2025"},{"key":"jocn-18-6-B187-R29","doi-asserted-by":"publisher","first-page":"A196","DOI":"10.1364\/JOCN.537881","type":"journal-article","volume":"17","author":"Pellegrini","year":"2025","journal-title":"J. Opt. Commun. Netw."},{"key":"jocn-18-6-B187-R30","doi-asserted-by":"publisher","first-page":"1712","DOI":"10.1364\/OPTICA.572883","type":"journal-article","volume":"12","author":"Mecozzi","year":"2025","journal-title":"Optica"},{"key":"jocn-18-6-B187-R31","doi-asserted-by":"crossref","DOI":"10.1109\/ICTON67126.2025.11125473","article-title":"Demonstration of real-time AI-enabled smart fault detection using state-of-polarization monitoring","volume-title":"International Conference on Transparent Optical Networks (ICTON)","author":"Malik","year":"2025"},{"key":"jocn-18-6-B187-R32","doi-asserted-by":"publisher","first-page":"203","DOI":"10.1016\/S1367-5788(02)00045-7","type":"journal-article","volume":"26","author":"Sasiadek","year":"2002","journal-title":"Annu. Rev. Control."},{"key":"jocn-18-6-B187-R33","doi-asserted-by":"publisher","first-page":"3671","DOI":"10.1109\/JLT.2021.3067146","type":"journal-article","volume":"39","author":"Fan","year":"2021","journal-title":"J. Lightwave Technol."},{"key":"jocn-18-6-B187-R35","doi-asserted-by":"publisher","first-page":"486","DOI":"10.1126\/science.aat4458","type":"journal-article","volume":"361","author":"Marra","year":"2018","journal-title":"Science"},{"key":"jocn-18-6-B187-R36","doi-asserted-by":"publisher","first-page":"1472","DOI":"10.1109\/JLT.2021.3137768","type":"journal-article","volume":"40","author":"Ip","year":"2022","journal-title":"J. Lightwave Technol."},{"key":"jocn-18-6-B187-R39","doi-asserted-by":"publisher","first-page":"85333","DOI":"10.1109\/ACCESS.2023.3303810","type":"journal-article","volume":"11","author":"Raptis","year":"2023","journal-title":"IEEE Access"},{"key":"jocn-18-6-B187-R40","article-title":"Kafka: a distributed messaging system for log processing","volume-title":"Proceedings of the NetDB","author":"Kreps","year":"2011"},{"key":"jocn-18-6-B187-R41","doi-asserted-by":"crossref","DOI":"10.1109\/LISAT.2017.8001963","article-title":"Comparison of autoencoder and principal component analysis followed by neural network for e-learning using handwritten recognition","volume-title":"IEEE Long Island Systems, Applications and Technology Conference (LISAT)","author":"Almotiri","year":"2017"},{"key":"jocn-18-6-B187-R42","doi-asserted-by":"publisher","first-page":"433","DOI":"10.1002\/wics.101","type":"journal-article","volume":"2","author":"Abdi","year":"2010","journal-title":"Wiley Interdiscip. Rev. Comput. Stat."},{"key":"jocn-18-6-B187-R43","doi-asserted-by":"publisher","author":"Alnaseri","year":"2024","DOI":"10.48550\/arXiv.2412.13843","type":"preprint"},{"key":"jocn-18-6-B187-R44","doi-asserted-by":"publisher","first-page":"57","DOI":"10.1364\/JOCN.472605","type":"journal-article","volume":"15","author":"Khan","year":"2022","journal-title":"J. Opt. Commun. Netw."},{"key":"jocn-18-6-B187-R45","doi-asserted-by":"publisher","first-page":"104","DOI":"10.1016\/j.procs.2020.01.079","type":"journal-article","volume":"165","author":"Velliangiri","year":"2019","journal-title":"Procedia Comput. Sci."},{"key":"jocn-18-6-B187-R46","doi-asserted-by":"publisher","first-page":"533","DOI":"10.1038\/323533a0","type":"journal-article","volume":"323","author":"Rumelhart","year":"1986","journal-title":"Nature"},{"key":"jocn-18-6-B187-R50","doi-asserted-by":"publisher","first-page":"2195","DOI":"10.1109\/TNSM.2022.3146869","type":"journal-article","volume":"19","author":"Silva","year":"2022","journal-title":"IEEE Trans. Netw. Serv. Manag."},{"key":"jocn-18-6-B187-R52","doi-asserted-by":"crossref","DOI":"10.1109\/ICMLCN64995.2025.11140455","article-title":"Machine learning for predictive multi-event detection in fiber optic systems","volume-title":"IEEE International Conference on Machine Learning for Communication and Networking (ICMLCN)","author":"Malik","year":"2025"},{"key":"jocn-18-6-B187-R53","doi-asserted-by":"crossref","DOI":"10.23919\/SoftCOM66362.2025.11197358","article-title":"AI-driven fault prediction and restoration leveraging real-time SOP monitoring","volume-title":"International Conference on Software, Telecommunications and Computer Networks (SoftCOM)","author":"Malik","year":"2025"},{"key":"jocn-18-6-B187-R54","doi-asserted-by":"publisher","first-page":"861","DOI":"10.1109\/JLT.2025.3597192","type":"journal-article","volume":"44","author":"Wey","year":"2025","journal-title":"J. Lightwave Technol."},{"key":"jocn-18-6-B187-R55","doi-asserted-by":"publisher","first-page":"155","DOI":"10.3389\/fphy.2019.00155","type":"journal-article","volume":"7","author":"Muanenda","year":"2019","journal-title":"Front. Phys."},{"key":"jocn-18-6-B187-R56","doi-asserted-by":"publisher","first-page":"3671","DOI":"10.1109\/JLT.2021.3059771","type":"journal-article","volume":"39","author":"He","year":"2021","journal-title":"J. Lightwave Technol."},{"key":"jocn-18-6-B187-R57","first-page":"W3","article-title":"Accelerating distributed fiber optic sensing (DFOS) ecosystem development in metro and access networks","volume-title":"Optical Fiber Communication Conference (OFC)","author":"Wey","year":"2025"},{"key":"jocn-18-6-B187-R58","doi-asserted-by":"publisher","first-page":"358","DOI":"10.1109\/JLT.2021.3099726","type":"journal-article","volume":"40","author":"Liu","year":"2022","journal-title":"J. Lightwave Technol."},{"key":"jocn-18-6-B187-R59","doi-asserted-by":"publisher","first-page":"1145","DOI":"10.1088\/0034-4885\/43\/9\/002","type":"journal-article","volume":"43","author":"James","year":"1980","journal-title":"Rep. Prog. Phys."},{"key":"jocn-18-6-B187-R60","doi-asserted-by":"publisher","first-page":"589","DOI":"10.1109\/71.862209","type":"journal-article","volume":"11","author":"Jogalekar","year":"2002","journal-title":"IEEE Trans. Parallel Distrib. Syst."},{"key":"jocn-18-6-B187-R61","doi-asserted-by":"publisher","first-page":"1109","DOI":"10.1109\/TNET.2007.896240","type":"journal-article","volume":"15","author":"Li","year":"2007","journal-title":"IEEE\/ACM Trans. Netw."}],"container-title":["Journal of Optical Communications and Networking"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/opg.optica.org\/viewmedia.cfm?URI=jocn-18-6-B187&seq=0","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,6,8]],"date-time":"2026-06-08T15:30:34Z","timestamp":1780932634000},"score":1,"resource":{"primary":{"URL":"https:\/\/opg.optica.org\/abstract.cfm?URI=jocn-18-6-B187"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,5,29]]},"references-count":49,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2026]]},"published-print":{"date-parts":[[2026]]}},"URL":"https:\/\/doi.org\/10.1364\/jocn.587846","relation":{},"ISSN":["1943-0620","1943-0639"],"issn-type":[{"value":"1943-0620","type":"print"},{"value":"1943-0639","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,5,29]]},"assertion":[{"value":"Optica Publishing Group","name":"publisher","label":"This article is maintained by"},{"value":"https:\/\/doi.org\/10.1364\/JOCN.587846","name":"articlelink","label":"Crossref DOI link to publisher maintained version"},{"value":"research-article","name":"content_type","label":"Article type"},{"value":"Screened by Similarity Check","name":"cross_check","label":"Similarity check"},{"value":"Yes","order":0,"name":"peer_reviewed","label":"Peer reviewed","group":{"name":"peer_review","label":"Peer review"}},{"value":"Single blind","order":1,"name":"review_process","label":"Review process","group":{"name":"peer_review","label":"Peer review"}},{"value":"16 December 2025","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"27 April 2026","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"29 May 2026","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}},{"value":"\u00a9\n      \t\t2026 Optica Publishing Group under the terms of the Optica Open Access\n      \t\t\tPublishing Agreement","name":"copyright","label":"Copyright"}]}}