{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,2,21]],"date-time":"2025-02-21T07:20:49Z","timestamp":1740122449982,"version":"3.37.3"},"reference-count":94,"publisher":"Springer Science and Business Media LLC","issue":"4","license":[{"start":{"date-parts":[[2021,11,6]],"date-time":"2021-11-06T00:00:00Z","timestamp":1636156800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,11,6]],"date-time":"2021-11-06T00:00:00Z","timestamp":1636156800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100008982","name":"National Science Foundation","doi-asserted-by":"publisher","award":["1540933"],"award-info":[{"award-number":["1540933"]}],"id":[{"id":"10.13039\/501100008982","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Cluster Comput"],"published-print":{"date-parts":[[2022,8]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Data sharing is required for research collaborations, but effective data transfer performance continues to be difficult to achieve. The NetSage Measurement and Analysis Framework can assist in understanding research data movement. It collects a broad set of monitoring data and builds performance Dashboards to visualize the data. Each Dashboard is specifically designed to address a well-defined analysis need of the stakeholders. This paper describes the design methodology, the resulting architecture, the development approach and lessons learned, and a set of discoveries that NetSage Dashboards made possible.<\/jats:p>","DOI":"10.1007\/s10586-021-03417-x","type":"journal-article","created":{"date-parts":[[2021,11,6]],"date-time":"2021-11-06T22:02:23Z","timestamp":1636236143000},"page":"2967-2990","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["The NetSage measurement and analysis framework in practice"],"prefix":"10.1007","volume":"25","author":[{"given":"Jennifer M.","family":"Schopf","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Katrina","family":"Turner","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dan","family":"Doyle","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Andrew","family":"Lake","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jason","family":"Leigh","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Brian L.","family":"Tierney","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2021,11,6]]},"reference":[{"key":"3417_CR1","unstructured":"ANA: Advanced North Atlantic Network. https:\/\/internet2.edu\/network\/initiatives-partnerships\/global-networks-and-partnerships\/advanced-north-atlantic-ana\/"},{"key":"3417_CR2","unstructured":"Arecibo Observatory. https:\/\/www.naic.edu\/"},{"key":"3417_CR3","unstructured":"Argus. https:\/\/openargus.org\/"},{"key":"3417_CR4","unstructured":"ASN: Autonomous System Numbers. https:\/\/www.arin.net\/resources\/guide\/asn\/"},{"key":"3417_CR5","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1051\/epjconf\/201921408006","volume":"214","author":"M Babik","year":"2019","unstructured":"Babik, M., McKee, S., Bockelman, B., Hernandez, E., Martelli, E., Vukotic, I., Weitzel, D., Zvada, M.: Improving WLCG networks through monitoring and analytics. EPJ Web Conf. 214, 1 (2019). https:\/\/doi.org\/10.1051\/epjconf\/201921408006","journal-title":"EPJ Web Conf."},{"key":"3417_CR6","unstructured":"BGP: Boarder Gateway Protocol. https:\/\/en.wikipedia.org\/wiki\/Border_Gateway_Protocol"},{"key":"3417_CR7","unstructured":"Cacti. https:\/\/www.cacti.net\/"},{"key":"3417_CR8","unstructured":"CAIDA AS to Org: Center for Applied Internet Data Analysis (CAIDA) UCSD AS to Organization Mapping Dataset. https:\/\/www.caida.org\/data\/as_organizations.xml"},{"key":"3417_CR9","volume-title":"Becoming a Design Thinker","author":"M Carroll","year":"2012","unstructured":"Carroll, M., Britos, L., Goldman, S.: Becoming a Design Thinker. Berg Publishers Open University, London (2012)"},{"key":"3417_CR10","doi-asserted-by":"crossref","unstructured":"Case, J., Fedor, M., Schoffstall, M., Davin, C.: RFC 1157: Simple Network Management Protocol. Tech. rep., IETF (1990). https:\/\/doi.org\/10.17487\/rfc1157","DOI":"10.17487\/rfc1157"},{"key":"3417_CR11","doi-asserted-by":"publisher","unstructured":"Chen, Y.C., Lee, S., Hur, H., Leigh, J., Johnson, A., Renambot, L.: Design an interactive visualization system for core drilling expeditions using immersive empathic method. In: CHI \u201909 Extended Abstracts on Human Factors in Computing Systems, pp. 2671\u20132674 (2009). https:\/\/doi.org\/10.1145\/1520340.1520382","DOI":"10.1145\/1520340.1520382"},{"key":"3417_CR12","doi-asserted-by":"crossref","unstructured":"Claise, B., Trammell, B., Aitken, P.: Specification of the IP Flow Information Export (IPFIX) Protocol for the Exchange of Flow Information. Tech. Rep. RFC 7011, IETF (2013). https:\/\/tools.ietf.org\/html\/rfc7011","DOI":"10.17487\/rfc7015"},{"key":"3417_CR13","unstructured":"Cole, G., Kim, D., Sobieski, J., Li, J., Riley, D.: GLORIAD: Global Ring Network for Advanced Applications Development (GLORIAD),IRNC:ProNet, NSF #0963058, 2010-2016. https:\/\/www.nsf.gov\/awardsearch\/showAward?AWD_ID=0963058"},{"key":"3417_CR14","unstructured":"Continuing Arecibo\u2019s Legacy. https:\/\/www.tacc.utexas.edu\/-\/continuing-arecibo-s-legacy"},{"key":"3417_CR15","unstructured":"D3 Data Driven Documents. http:\/\/d3js.org"},{"key":"3417_CR16","unstructured":"Dart, E., Wehner, M.F., Prabhat: An assessment of data transfer performance for large-scale climate data analysis and recommendations for the data infrastructure for CMIP6. CoRR (2017). arXiv:1709.09575"},{"key":"3417_CR17","unstructured":"Deepfield. https:\/\/www.nokia.com\/networks\/solutions\/deepfield\/"},{"key":"3417_CR18","unstructured":"Defense in Depth. https:\/\/en.wikipedia.org\/wiki\/Defense_in_depth_(computing)"},{"key":"3417_CR19","unstructured":"Event Horizon Telescope: Downloading data from black holes. https:\/\/beta.nsf.gov\/science-matters\/downloading-data-black-holes"},{"key":"3417_CR20","unstructured":"Elastic. https:\/\/www.elastic.co\/products"},{"key":"3417_CR21","unstructured":"Elastiflow. https:\/\/github.com\/robcowart\/elastiflow"},{"key":"3417_CR22","unstructured":"EPOC RA: Engagement and Performance Operations Center Roadside Assistance and Consulting. https:\/\/epoc.global\/wp-content\/uploads\/2020\/02\/Roadside-2-pager.pdf"},{"key":"3417_CR23","unstructured":"Energy Sciences Network (ESnet). http:\/\/es.net"},{"key":"3417_CR24","unstructured":"Fox, L., Johnson, R.: Pacific Wave Expansion Supporting SDX and Experimentation, IRNC: RXP, NSF #1451050, 2015-2021. https:\/\/www.nsf.gov\/awardsearch\/showAward?AWD_ID=1451050"},{"key":"3417_CR25","unstructured":"GDPR: General Data Protection Regulation. https:\/\/gdpr-info.eu\/"},{"key":"3417_CR26","unstructured":"G\u00c9ANT Tools Portal. https:\/\/tools.geant.net\/portal\/"},{"key":"3417_CR27","unstructured":"GlobalNOC at Indiana University. https:\/\/globalnoc.iu.edu\/"},{"key":"3417_CR28","unstructured":"GlobalNOC World View. https:\/\/docs.globalnoc.iu.edu\/worldview.html"},{"key":"3417_CR29","unstructured":"Gonzales, A., Leigh, J., Peisert, S., Tierney, B., Balas, E., Radulovic, P., Schopf, J.M.: Monitoring Big Data Transfers Over International Research Network Connections. In: Proceedings of IEEE Big Data Congress 2017 (2017)"},{"key":"3417_CR30","unstructured":"Gonzalez, A., Leigh, J., Peisert, S., Tierney, B., Lee, A., Schopf, J.M.: NetSage: Open Privacy-Aware Network Measurement, Analysis, and Visualization Service. In: Proceedings of the TNC Conference 2016 (2016)"},{"key":"3417_CR31","unstructured":"Grafana. https:\/\/grafana.com"},{"key":"3417_CR32","unstructured":"Ibarra, J., Clark, R., Morgan, H.L.: AtlanticWave-Software Defined Exchange: A Distributed Intercontinental Experimental Software Defined Exchange (SDX), IRNC: RXP, NSF #1451024, 2015-2021. https:\/\/www.nsf.gov\/awardsearch\/showAward?AWD_ID=1451024"},{"key":"3417_CR33","unstructured":"Ibarra, J., Morgan, H., Cox, D.: AmLight Express and Protect (ExP), IRNC:Backbone, NSF #1451018, 2015-2021. http:\/\/nsf.gov\/awardsearch\/showAward?AWD_ID=1451018"},{"key":"3417_CR34","unstructured":"Ifa: Institute for astronomy at the university of hawaii. http:\/\/www.ifa.hawaii.edu\/"},{"key":"3417_CR35","unstructured":"IN@IU: International Networks at Indiana University. https:\/\/in.iu.edu"},{"key":"3417_CR36","unstructured":"InMon. https:\/\/inmon.com\/"},{"key":"3417_CR37","unstructured":"IRNC: International Research and education Network Connections Program . https:\/\/www.nsf.gov\/funding\/pgm_summ.jsp"},{"key":"3417_CR38","unstructured":"Kentik. https:\/\/www.kentik.com\/"},{"key":"3417_CR39","unstructured":"Lassner, D., Jacobs, G., Johnson, R., Fox, L.: PIREN: SXTransPORT Pacific Islands Research and Education Network, IRNC: Backbone, NSF #1451058, 2015-2021. https:\/\/www.nsf.gov\/awardsearch\/showAward?AWD_ID=1451058"},{"key":"3417_CR40","unstructured":"Logstash. https:\/\/www.elastic.co\/logstash"},{"key":"3417_CR41","unstructured":"Looking Glass. https:\/\/en.wikipedia.org\/wiki\/Looking_Glass_server"},{"key":"3417_CR42","doi-asserted-by":"publisher","unstructured":"Losoff, B.: Shibboleth: A project of the Internet2 middleware initiative. Collaborative Librarianship 1, 27\u201327 (2009). https:\/\/doi.org\/10.29087\/2009.1.1.04","DOI":"10.29087\/2009.1.1.04"},{"key":"3417_CR43","unstructured":"Mambretti, J., Brown, M., DeFanti, T., Chen, J.H.: StarLight SDX: A Software Defined Networking Exchange for Global Science Research and Education, IRNC: RXP, NSF #1450871, 2015-2022. http:\/\/www.nsf.gov\/awardsearch\/showAward?AWD_ID=1450871"},{"key":"3417_CR44","unstructured":"MaxMind GeoIP Service. https:\/\/www.maxmind.com\/"},{"key":"3417_CR45","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.comnet.2004.06.026","volume":"47","author":"M Mellia","year":"2005","unstructured":"Mellia, M., Lo Cigno, R., Neri, F.: Measuring IP and TCP behavior on edge nodes with Tstat. Comput. Netw. 47, 1\u201321 (2005). https:\/\/doi.org\/10.1016\/j.comnet.2004.06.026","journal-title":"Comput. Netw."},{"key":"3417_CR46","unstructured":"CERN MONIT Dashboards. https:\/\/monit.web.cern.ch\/monit\/"},{"key":"3417_CR47","unstructured":"MyESnet Portal. http:\/\/my.es.net"},{"key":"3417_CR48","unstructured":"Nagios. https:\/\/www.nagios.org\/"},{"key":"3417_CR49","unstructured":"NCAR: National Center for Atmospheric Research. https:\/\/ncar.ucar.edu\/"},{"key":"3417_CR50","unstructured":"NERSC: National Energy Research Scientific Computing Center. https:\/\/www.nersc.gov\/"},{"key":"3417_CR51","unstructured":"NetFlow - A Technical Overview (2012). https:\/\/tinyurl.com\/2cyca26s"},{"key":"3417_CR52","unstructured":"NetSage Source Code on GitHub. http:\/\/https:\/\/github.com\/netsage-project"},{"key":"3417_CR53","unstructured":"NetSage International Portal Bandwidth Dashboard. https:\/\/international.netsage.global"},{"key":"3417_CR54","unstructured":"NetSage Privacy Policy. http:\/\/www.netsage.global\/home\/netsage-privacy-policy"},{"key":"3417_CR55","unstructured":"NetSage Science Registry. https:\/\/scienceregistry.netsage.global"},{"key":"3417_CR56","unstructured":"NetSage Project Website. http:\/\/www.netsage.global"},{"key":"3417_CR57","unstructured":"NetSage All Data Portal. https:\/\/all.netsage.global"},{"key":"3417_CR58","unstructured":"NetSage All Data Portal Project Dashboard showing Pan-STARRS Project Details February 2021. https:\/\/tinyurl.com\/pcxycns9"},{"key":"3417_CR59","unstructured":"NetSage ANA Portal Bandwidth Dashboard. https:\/\/ana.netsage.global"},{"key":"3417_CR60","unstructured":"NetSage FRGP Portal Flow Data Dashboard Slope Graph. https:\/\/tinyurl.com\/2x4rtknt"},{"key":"3417_CR61","unstructured":"NetSage Front Range GigaPop Portal Top Talkers. https:\/\/tinyurl.com\/fz2smnsp"},{"key":"3417_CR62","unstructured":"NetSage Great Plains Network Portal Top Talkers over Time Dashboard. https:\/\/tinyurl.com\/2kyk76px"},{"key":"3417_CR63","unstructured":"NetSage iLight Portal Science Discipline Dashboard. https:\/\/tinyurl.com\/ur8k5645"},{"key":"3417_CR64","unstructured":"NetSage International Portal Flow Data Dashboard for TransPAC Guam-Hong Kong circuits for September 1-December 31, 2018. https:\/\/tinyurl.com\/2rfmem7e"},{"key":"3417_CR65","unstructured":"NetSage International Portal Latency Pattern Dashboard. https:\/\/tinyurl.com\/39zdc6f2"},{"key":"3417_CR66","unstructured":"NetSage International Portal Flow Analysis Dashboard for NEAAR circuit, January 25-February 11, 2018. https:\/\/tinyurl.com\/yrj8wxm5"},{"key":"3417_CR67","unstructured":"NetSage International Portal Flow Statistics Dashboard for the first week of March 2021. https:\/\/tinyurl.com\/achc9yh8"},{"key":"3417_CR68","unstructured":"NetSage KINBER Portal Individual Flow Data Dashboard for National Library of Medicine, January-May 2021 . https:\/\/tinyurl.com\/4meev2c2"},{"key":"3417_CR69","unstructured":"NetSage PacificWave Portal Individual Flows Dashboard for Zoom Video Communications for February 2020 - April 2020. https:\/\/tinyurl.com\/y42ve8kc"},{"key":"3417_CR70","unstructured":"NetSage SOX Portal Flow Data per Organization Dashboard for Emory University, January-March 2021 . https:\/\/tinyurl.com\/fw5ackud"},{"key":"3417_CR71","unstructured":"NetSage TACC Portal Individual Flows Dashboard showing data transfers between Arecibo, Puerto Rico, and the TACC science data archive. https:\/\/tinyurl.com\/2x8538ja"},{"key":"3417_CR72","unstructured":"NetSage International Portal Analysis of VLBI Traffic. https:\/\/tinyurl.com\/aa4s4ska"},{"key":"3417_CR73","unstructured":"nfdump and NfSen Overview. https:\/\/www.first.org\/conference\/2006\/papers\/haag-peter-papers.pdf"},{"key":"3417_CR74","unstructured":"ntop. https:\/\/www.ntop.org\/"},{"key":"3417_CR75","unstructured":"OmniSOC. https:\/\/omnisoc.iu.edu\/"},{"key":"3417_CR76","unstructured":"PerfSONAR. http:\/\/www.perfsonar.net\/"},{"key":"3417_CR77","unstructured":"PerSONAR Nodes Worldwide. http:\/\/stats.es.net\/ServicesDirectory\/"},{"key":"3417_CR78","doi-asserted-by":"crossref","unstructured":"Phaal, Panchen, Mckee: InMon Corporations sFlow: A Method for Monitoring Traffic in Switched and Routed Networks. Tech. Rep. RFC 376, IETF (2001). https:\/\/tools.ietf.org\/html\/rfc3176","DOI":"10.17487\/rfc3176"},{"key":"3417_CR79","unstructured":"Sankey Diagram. https:\/\/en.wikipedia.org\/wiki\/Sankey_diagram"},{"key":"3417_CR80","unstructured":"Schopf, J., Addleman, H.: TransPAC4 - Pragmatic Application-Driven International Networking, IRNC:BackBone, NSF #1450904, 2015-2021. http:\/\/www.nsf.gov\/awardsearch\/showAward?AWD_ID=1450904"},{"key":"3417_CR81","unstructured":"Schopf, J., Leigh, J., Lake, A.: NetSage - An Open, Privacy-Aware, Network Measurement, Analysis, and Visualization Service, IRNC:AMI, NSF # 1540933, 05\/2015-04\/2022. https:\/\/www.nsf.gov\/awardsearch\/showAward?AWD_ID=1540933"},{"key":"3417_CR82","unstructured":"Schopf, J., Moynihan, E., Fryer, T.: NEAAR: Networks for European, American, and African Research, IRNC: Backbone, NSF #1638863, 2016-2021. http:\/\/www.nsf.gov\/awardsearch\/showAward?AWD_ID=1638863"},{"key":"3417_CR83","unstructured":"SolarWinds. https:\/\/www.solarwinds.com"},{"key":"3417_CR84","unstructured":"Shared Who Is Project (SWIP). https:\/\/en.wikipedia.org\/wiki\/Shared_Whois_Project"},{"key":"3417_CR85","unstructured":"TACC: Texas Advanced Computing Center. https:\/\/www.tacc.utexas.edu\/"},{"key":"3417_CR86","unstructured":"Tcptrace. https:\/\/linux.die.net\/man\/1\/tcptrace"},{"key":"3417_CR87","doi-asserted-by":"crossref","unstructured":"Tierney, B., Boote, J., Boyd, E., Brown, A., Grigoriev, M., Metzger, J., Swany, M., Zekauskas, M., Zurawski, J.: perfSONAR: Instantiating a global network measurement framework\u201d. In: Proceedings of the SOSP Workshop on Real Overlays and Distributed Systems (2009)","DOI":"10.2172\/946807"},{"key":"3417_CR88","doi-asserted-by":"publisher","first-page":"148","DOI":"10.1109\/MCOM.2014.6815906","volume":"52","author":"B Trammell","year":"2014","unstructured":"Trammell, B., Casas, P., Rossi, D., Bar, A., Houidi, Z., Leontiadis, I., Szemethy, T., Mellia, M.: mPlane: an intelligent measurement plane for the internet. IEEE Commun. Mag. 52, 148\u2013156 (2014). https:\/\/doi.org\/10.1109\/MCOM.2014.6815906","journal-title":"IEEE Commun. Mag."},{"key":"3417_CR89","unstructured":"TSDS: Time Series Data System. https:\/\/docs.globalnoc.iu.edu\/software\/measurement\/tsds.html"},{"key":"3417_CR90","unstructured":"Tstat: TCP Statistic and Analysis Tool. http:\/\/tstat.polito.it\/"},{"key":"3417_CR91","volume-title":"The Visual Display of Quantitative Information","author":"E Tufte","year":"1983","unstructured":"Tufte, E.: The Visual Display of Quantitative Information. Graphics Press, Cheshire (1983)"},{"key":"3417_CR92","volume-title":"Envisioning Information","author":"E Tufte","year":"1995","unstructured":"Tufte, E.: Envisioning Information. Graphics Press, Cheshire (1995)"},{"key":"3417_CR93","doi-asserted-by":"crossref","unstructured":"Turner, K., Balas, E., Baveja, S., Doyle, D., Ensman, L., Faci, S., Gonzalez, A., Khanal, M., Lake, A., Leigh, J., Seto-Mook, T., Southworth, D., Tierney, B., Schopf, J.M.: The NetSage Measurement Framework: Design, Development, and Discoveries. In: Innovating the Network for Data-Intensive Science (INDIS) 2020 (2020)","DOI":"10.1109\/INDIS51933.2020.00010"},{"key":"3417_CR94","unstructured":"Zeek. https:\/\/zeek.org\/"}],"container-title":["Cluster Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10586-021-03417-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10586-021-03417-x\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10586-021-03417-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,7,14]],"date-time":"2022-07-14T11:26:38Z","timestamp":1657797998000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10586-021-03417-x"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,11,6]]},"references-count":94,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2022,8]]}},"alternative-id":["3417"],"URL":"https:\/\/doi.org\/10.1007\/s10586-021-03417-x","relation":{},"ISSN":["1386-7857","1573-7543"],"issn-type":[{"type":"print","value":"1386-7857"},{"type":"electronic","value":"1573-7543"}],"subject":[],"published":{"date-parts":[[2021,11,6]]},"assertion":[{"value":"5 May 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"20 July 2021","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"9 September 2021","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"6 November 2021","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}