{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,21]],"date-time":"2026-04-21T05:57:02Z","timestamp":1776751022650,"version":"3.51.2"},"publisher-location":"New York, NY, USA","reference-count":57,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,11,4]],"date-time":"2021-11-04T00:00:00Z","timestamp":1635984000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,11,10]]},"DOI":"10.1145\/3484266.3487373","type":"proceedings-article","created":{"date-parts":[[2021,11,4]],"date-time":"2021-11-04T22:31:15Z","timestamp":1636065075000},"page":"53-60","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":12,"title":["Interpretable Feedback for AutoML and a Proposal for Domain-customized AutoML for Networking"],"prefix":"10.1145","author":[{"given":"Behnaz","family":"Arzani","sequence":"first","affiliation":[{"name":"Microsoft"}]},{"given":"Kevin","family":"Hsieh","sequence":"additional","affiliation":[{"name":"Microsoft"}]},{"given":"Haoxian","family":"Chen","sequence":"additional","affiliation":[{"name":"University of Pennsylvania"}]}],"member":"320","published-online":{"date-parts":[[2021,11,4]]},"reference":[{"key":"e_1_3_2_1_1_1","unstructured":"The good the bad and the ugly of ml for networked systems. https:\/\/www.microsoft.com\/en-us\/research\/video\/the-good-the-bad-and-the-ugly-of-ml-for-networked-systems\/.  The good the bad and the ugly of ml for networked systems. https:\/\/www.microsoft.com\/en-us\/research\/video\/the-good-the-bad-and-the-ugly-of-ml-for-networked-systems\/."},{"key":"e_1_3_2_1_2_1","first-page":"110","volume-title":"2019 11th International Conference on Communication Systems & Networks (COMSNETS)","author":"Agarwal N.","year":"2019","unstructured":"N. Agarwal , S. Jabin , S. Z. Hussain , Analyzing real and fake users in facebook network based on emotions . In 2019 11th International Conference on Communication Systems & Networks (COMSNETS) , pages 110 -- 117 . IEEE, 2019 . N. Agarwal, S. Jabin, S. Z. Hussain, et al. Analyzing real and fake users in facebook network based on emotions. In 2019 11th International Conference on Communication Systems & Networks (COMSNETS), pages 110--117. IEEE, 2019."},{"key":"e_1_3_2_1_3_1","volume-title":"Aleplot: Accumulated local effects (ALE) plots and partial dependence (PD) plots","author":"Apley D.","year":"2017","unstructured":"D. Apley . Aleplot: Accumulated local effects (ALE) plots and partial dependence (PD) plots , 2017 . R package version, 1, 2017. D. Apley. Aleplot: Accumulated local effects (ALE) plots and partial dependence (PD) plots, 2017. R package version, 1, 2017."},{"key":"e_1_3_2_1_4_1","volume-title":"Visualizing the effects of predictor variables in black box supervised learning models. CoRR, abs\/1612.08468","author":"Apley D. W.","year":"2019","unstructured":"D. W. Apley and J. Zhu . Visualizing the effects of predictor variables in black box supervised learning models. CoRR, abs\/1612.08468 , 2019 . D. W. Apley and J. Zhu. Visualizing the effects of predictor variables in black box supervised learning models. CoRR, abs\/1612.08468, 2019."},{"key":"e_1_3_2_1_5_1","first-page":"419","volume-title":"15th {USENIX} Symposium on Networked Systems Design and Implementation ({NSDI} 18)","author":"Arzani B.","year":"2018","unstructured":"B. Arzani , S. Ciraci , L. Chamon , Y. Zhu , H. H. Liu , J. Padhye , B. T. Loo , and G. Outhred . 007: Democratically finding the cause of packet drops . In 15th {USENIX} Symposium on Networked Systems Design and Implementation ({NSDI} 18) , pages 419 -- 435 , 2018 . B. Arzani, S. Ciraci, L. Chamon, Y. Zhu, H. H. Liu, J. Padhye, B. T. Loo, and G. Outhred. 007: Democratically finding the cause of packet drops. In 15th {USENIX} Symposium on Networked Systems Design and Implementation ({NSDI} 18), pages 419--435, 2018."},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/2934872.2934884"},{"key":"e_1_3_2_1_7_1","volume-title":"Proceedings of the USENIX Symposium on Networked Systems Design and Implementation (NSDI)","author":"Arzani B.","year":"2020","unstructured":"B. Arzani , S. Ciraci , S. Saroiu , A. Wolman , J. Stokes , G. Outhred , and L. Diwu . PrivateEye: Scalable and privacy-preserving compromise detection in the cloud . In Proceedings of the USENIX Symposium on Networked Systems Design and Implementation (NSDI) , 2020 . B. Arzani, S. Ciraci, S. Saroiu, A. Wolman, J. Stokes, G. Outhred, and L. Diwu. PrivateEye: Scalable and privacy-preserving compromise detection in the cloud. In Proceedings of the USENIX Symposium on Networked Systems Design and Implementation (NSDI), 2020."},{"key":"e_1_3_2_1_8_1","volume-title":"Towards a domain-customized automated machine learning framework for networks and systems. CoRR, abs\/2004.11931","author":"Arzani B.","year":"2020","unstructured":"B. Arzani and B. Rouhani . Towards a domain-customized automated machine learning framework for networks and systems. CoRR, abs\/2004.11931 , 2020 . B. Arzani and B. Rouhani. Towards a domain-customized automated machine learning framework for networks and systems. CoRR, abs\/2004.11931, 2020."},{"key":"e_1_3_2_1_9_1","unstructured":"https:\/\/azure.microsoft.com\/en-us\/services\/machine-learning\/automatedml\/.  https:\/\/azure.microsoft.com\/en-us\/services\/machine-learning\/automatedml\/."},{"key":"e_1_3_2_1_10_1","volume-title":"Proceedings of the International Conference on Machine Learning (ICML)","author":"Baram Y.","year":"2003","unstructured":"Y. Baram , R. El-Yaniv , and K. Luz . Online choice of active learning algorithms . In Proceedings of the International Conference on Machine Learning (ICML) , 2003 . Y. Baram, R. El-Yaniv, and K. Luz. Online choice of active learning algorithms. In Proceedings of the International Conference on Machine Learning (ICML), 2003."},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00976"},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1214\/10-BA523"},{"key":"e_1_3_2_1_13_1","first-page":"16","article-title":"SMOTE: synthetic minority over-sampling technique","author":"Chawla N. V.","year":"2002","unstructured":"N. V. Chawla , K. W. Bowyer , L. O. Hall , and W. P. Kegelmeyer . SMOTE: synthetic minority over-sampling technique . J. Artif. Intell. Res. , 16 , 2002 . N. V. Chawla, K. W. Bowyer, L. O. Hall, and W. P. Kegelmeyer. SMOTE: synthetic minority over-sampling technique. J. Artif. Intell. Res., 16, 2002.","journal-title":"J. Artif. Intell. Res."},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDM.2016.0100"},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/3132747.3132772"},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-12334-4_18"},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D17-1063"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-05318-5_6"},{"key":"e_1_3_2_1_19_1","volume-title":"Selective sampling using the query by committee algorithm. Machine learning, 28(2)","author":"Freund Y.","year":"1997","unstructured":"Y. Freund , H. S. Seung , E. Shamir , and N. Tishby . Selective sampling using the query by committee algorithm. Machine learning, 28(2) , 1997 . Y. Freund, H. S. Seung, E. Shamir, and N. Tishby. Selective sampling using the query by committee algorithm. Machine learning, 28(2), 1997."},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/3387514.3405867"},{"key":"e_1_3_2_1_21_1","volume-title":"The automatic statistician","author":"Ghahramani Z.","year":"2014","unstructured":"Z. Ghahramani . The automatic statistician . 2014 . Z. Ghahramani. The automatic statistician. 2014."},{"key":"e_1_3_2_1_22_1","volume-title":"Proceedings of the Conference on Neural Information Processing Systems (NeurIPS)","author":"Gilad-Bachrach R.","year":"2005","unstructured":"R. Gilad-Bachrach , A. Navot , and N. Tishby . Query by committee made real . In Proceedings of the Conference on Neural Information Processing Systems (NeurIPS) , 2005 . R. Gilad-Bachrach, A. Navot, and N. Tishby. Query by committee made real. In Proceedings of the Conference on Neural Information Processing Systems (NeurIPS), 2005."},{"key":"e_1_3_2_1_23_1","volume-title":"New directions in automated traffic analysis. arXiv preprint arXiv:2008.02695","author":"Holland J.","year":"2020","unstructured":"J. Holland , P. Schmitt , N. Feamster , and P. Mittal . New directions in automated traffic analysis. arXiv preprint arXiv:2008.02695 , 2020 . J. Holland, P. Schmitt, N. Feamster, and P. Mittal. New directions in automated traffic analysis. arXiv preprint arXiv:2008.02695, 2020."},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v29i1.9597"},{"key":"e_1_3_2_1_25_1","unstructured":"https:\/\/archive.ics.uci.edu\/ml\/datasets\/Internet+Firewall+Data.  https:\/\/archive.ics.uci.edu\/ml\/datasets\/Internet+Firewall+Data."},{"key":"e_1_3_2_1_26_1","volume-title":"Internet congestion control via deep reinforcement learning. arXiv preprint arXiv:1810.03259","author":"Jay N.","year":"2018","unstructured":"N. Jay , N. H. Rotman , P. Godfrey , M. Schapira , and A. Tamar . Internet congestion control via deep reinforcement learning. arXiv preprint arXiv:1810.03259 , 2018 . N. Jay, N. H. Rotman, P. Godfrey, M. Schapira, and A. Tamar. Internet congestion control via deep reinforcement learning. arXiv preprint arXiv:1810.03259, 2018."},{"key":"e_1_3_2_1_27_1","first-page":"1","article-title":"Self-clocked rate adaptation for multimedia","volume":"8298","author":"Johansson I.","year":"2017","unstructured":"I. Johansson and Z. Sarker . Self-clocked rate adaptation for multimedia . RFC , 8298 : 1 -- 36 , 2017 . I. Johansson and Z. Sarker. Self-clocked rate adaptation for multimedia. RFC, 8298:1--36, 2017.","journal-title":"RFC"},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/1080173.1080178"},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/1592568.1592597"},{"key":"e_1_3_2_1_30_1","volume-title":"Proceedings of the Conference on Neural Information Processing Systems (NeurIPS)","author":"Konyushkova K.","year":"2017","unstructured":"K. Konyushkova , R. Sznitman , and P. Fua . Learning active learning from data . In Proceedings of the Conference on Neural Information Processing Systems (NeurIPS) , 2017 . K. Konyushkova, R. Sznitman, and P. Fua. Learning active learning from data. In Proceedings of the Conference on Neural Information Processing Systems (NeurIPS), 2017."},{"key":"e_1_3_2_1_31_1","volume-title":"Deep learning. nature, 521(7553):436","author":"LeCun Y.","year":"2015","unstructured":"Y. LeCun , Y. Bengio , and G. Hinton . Deep learning. nature, 521(7553):436 , 2015 . Y. LeCun, Y. Bengio, and G. Hinton. Deep learning. nature, 521(7553):436, 2015."},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4471-2099-5_1"},{"key":"e_1_3_2_1_33_1","volume-title":"The mythos of model interpretability. Commun. ACM, 61(10)","author":"Lipton Z. C.","year":"2018","unstructured":"Z. C. Lipton . The mythos of model interpretability. Commun. ACM, 61(10) , 2018 . Z. C. Lipton. The mythos of model interpretability. Commun. ACM, 61(10), 2018."},{"key":"e_1_3_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/3005745.3005750"},{"key":"e_1_3_2_1_35_1","volume-title":"et al. Park: An open platform for learning augmented computer systems","author":"Mao H.","year":"2019","unstructured":"H. Mao , A. Narayan , P. Negi , H. Wang , J. Yang , H. Wang , M. Khani , S. He , R. Addanki , R. Marcus , et al. Park: An open platform for learning augmented computer systems . 2019 . H. Mao, A. Narayan, P. Negi, H. Wang, J. Yang, H. Wang, M. Khani, S. He, R. Addanki, R. Marcus, et al. Park: An open platform for learning augmented computer systems. 2019."},{"key":"e_1_3_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/3098822.3098843"},{"key":"e_1_3_2_1_37_1","volume-title":"Insights from the social sciences. CoRR, abs\/1706.07269","author":"Miller T.","year":"2017","unstructured":"T. Miller . Explanation in artificial intelligence : Insights from the social sciences. CoRR, abs\/1706.07269 , 2017 . T. Miller. Explanation in artificial intelligence: Insights from the social sciences. CoRR, abs\/1706.07269, 2017."},{"key":"e_1_3_2_1_38_1","volume-title":"Interpretable Machine Learning. Lulu. com","author":"Molnar C.","year":"2020","unstructured":"C. Molnar . Interpretable Machine Learning. Lulu. com , 2020 . C. Molnar. Interpretable Machine Learning. Lulu. com, 2020."},{"key":"e_1_3_2_1_39_1","volume-title":"The bayes net toolbox for matlab. Computing science and statistics, 33(2):1024--1034","author":"K. Murphy","year":"2001","unstructured":"K. Murphy et al. The bayes net toolbox for matlab. Computing science and statistics, 33(2):1024--1034 , 2001 . K. Murphy et al. The bayes net toolbox for matlab. Computing science and statistics, 33(2):1024--1034, 2001."},{"key":"e_1_3_2_1_40_1","volume-title":"Tutorial on maximum likelihood estimation. Journal of mathematical Psychology, 47(1):90--100","author":"Myung I. J.","year":"2003","unstructured":"I. J. Myung . Tutorial on maximum likelihood estimation. Journal of mathematical Psychology, 47(1):90--100 , 2003 . I. J. Myung. Tutorial on maximum likelihood estimation. Journal of mathematical Psychology, 47(1):90--100, 2003."},{"key":"e_1_3_2_1_41_1","volume-title":"Proceedings of the Workshop on Automatic Machine Learning (AutoML@ICML). PMLR","author":"Olson R. S.","year":"2016","unstructured":"R. S. Olson and J. H. Moore . TPOT: A tree-based pipeline optimization tool for automating machine learning . In Proceedings of the Workshop on Automatic Machine Learning (AutoML@ICML). PMLR , 2016 . R. S. Olson and J. H. Moore. TPOT: A tree-based pipeline optimization tool for automating machine learning. In Proceedings of the Workshop on Automatic Machine Learning (AutoML@ICML). PMLR, 2016."},{"key":"e_1_3_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/3278532.3278572"},{"key":"e_1_3_2_1_43_1","first-page":"595","volume-title":"14th {USENIX} Symposium on Networked Systems Design and Implementation ({NSDI} 17)","author":"Roy A.","year":"2017","unstructured":"A. Roy , H. Zeng , J. Bagga , and A. C. Snoeren . Passive realtime datacenter fault detection and localization . In 14th {USENIX} Symposium on Networked Systems Design and Implementation ({NSDI} 17) , pages 595 -- 612 , 2017 . A. Roy, H. Zeng, J. Bagga, and A. C. Snoeren. Passive realtime datacenter fault detection and localization. In 14th {USENIX} Symposium on Networked Systems Design and Implementation ({NSDI} 17), pages 595--612, 2017."},{"key":"e_1_3_2_1_44_1","volume-title":"Proceedings of the International Conference on Machine Learning (ICML)","author":"Roy N.","year":"2001","unstructured":"N. Roy and A. McCallum . Toward optimal active learning through sampling estimation of error reduction . In Proceedings of the International Conference on Machine Learning (ICML) , 2001 . N. Roy and A. McCallum. Toward optimal active learning through sampling estimation of error reduction. In Proceedings of the International Conference on Machine Learning (ICML), 2001."},{"key":"e_1_3_2_1_45_1","volume-title":"Active learning literature survey. Technical report","author":"Settles B.","year":"2009","unstructured":"B. Settles . Active learning literature survey. Technical report , University of Wisconsin-Madison Department of Computer Sciences , 2009 . B. Settles. Active learning literature survey. Technical report, University of Wisconsin-Madison Department of Computer Sciences, 2009."},{"key":"e_1_3_2_1_46_1","volume-title":"Proceedings of the Conference on Neural Information Processing Systems (NeurIPS)","author":"Settles B.","year":"2007","unstructured":"B. Settles , M. Craven , and S. Ray . Multiple-instance active learning . In Proceedings of the Conference on Neural Information Processing Systems (NeurIPS) , 2007 . B. Settles, M. Craven, and S. Ray. Multiple-instance active learning. In Proceedings of the Conference on Neural Information Processing Systems (NeurIPS), 2007."},{"key":"e_1_3_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/130385.130417"},{"key":"e_1_3_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2019.00607"},{"key":"e_1_3_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-05318-5_9"},{"key":"e_1_3_2_1_50_1","first-page":"2","article-title":"Support vector machine active learning with applications to text classification","author":"Tong S.","year":"2001","unstructured":"S. Tong and D. Koller . Support vector machine active learning with applications to text classification . J. Mach. Learn. Res. , 2 , 2001 . S. Tong and D. Koller. Support vector machine active learning with applications to text classification. J. Mach. Learn. Res., 2, 2001.","journal-title":"J. Mach. Learn. Res."},{"key":"e_1_3_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/3152434.3152441"},{"key":"e_1_3_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/2486001.2486020"},{"key":"e_1_3_2_1_53_1","first-page":"1","volume-title":"Wiley encyclopedia of clinical trials","author":"Woolson R.","year":"2007","unstructured":"R. Woolson . Wilcoxon signed-rank test. Wiley encyclopedia of clinical trials , pages 1 -- 3 , 2007 . R. Woolson. Wilcoxon signed-rank test. Wiley encyclopedia of clinical trials, pages 1--3, 2007."},{"key":"e_1_3_2_1_54_1","volume-title":"Proceedings of the USENIX Annual Technical Conference (USENIX ATC).","author":"Yan F. Y.","unstructured":"F. Y. Yan , J. Ma , G. D. Hill , D. Raghavan , R. S. Wahby , P. Levis , and K. Winstein . Pantheon: the training ground for internet congestion-control research . In Proceedings of the USENIX Annual Technical Conference (USENIX ATC). F. Y. Yan, J. Ma, G. D. Hill, D. Raghavan, R. S. Wahby, P. Levis, and K. Winstein. Pantheon: the training ground for internet congestion-control research. In Proceedings of the USENIX Annual Technical Conference (USENIX ATC)."},{"key":"e_1_3_2_1_55_1","first-page":"519","volume-title":"15th {USENIX} Symposium on Networked Systems Design and Implementation ({NSDI} 18)","author":"Zhang Q.","year":"2018","unstructured":"Q. Zhang , G. Yu , C. Guo , Y. Dang , N. Swanson , X. Yang , R. Yao , M. Chintalapati , A. Krishnamurthy , and T. Anderson . Deepview: Virtual disk failure diagnosis and pattern detection for azure . In 15th {USENIX} Symposium on Networked Systems Design and Implementation ({NSDI} 18) , pages 519 -- 532 , 2018 . Q. Zhang, G. Yu, C. Guo, Y. Dang, N. Swanson, X. Yang, R. Yao, M. Chintalapati, A. Krishnamurthy, and T. Anderson. Deepview: Virtual disk failure diagnosis and pattern detection for azure. In 15th {USENIX} Symposium on Networked Systems Design and Implementation ({NSDI} 18), pages 519--532, 2018."},{"key":"e_1_3_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.5555\/844380.844719"},{"key":"e_1_3_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/3098822.3098849"}],"event":{"name":"HotNets '21: The 20th ACM Workshop on Hot Topics in Networks","location":"Virtual Event United Kingdom","acronym":"HotNets '21","sponsor":["SIGCOMM ACM Special Interest Group on Data Communication"]},"container-title":["Proceedings of the Twentieth ACM Workshop on Hot Topics in Networks"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3484266.3487373","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3484266.3487373","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:17:13Z","timestamp":1750191433000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3484266.3487373"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,11,4]]},"references-count":57,"alternative-id":["10.1145\/3484266.3487373","10.1145\/3484266"],"URL":"https:\/\/doi.org\/10.1145\/3484266.3487373","relation":{},"subject":[],"published":{"date-parts":[[2021,11,4]]},"assertion":[{"value":"2021-11-04","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}