{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,4]],"date-time":"2026-07-04T10:31:12Z","timestamp":1783161072666,"version":"3.54.6"},"reference-count":325,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2020,8,3]],"date-time":"2020-08-03T00:00:00Z","timestamp":1596412800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Comput. Surv."],"published-print":{"date-parts":[[2021,7,31]]},"abstract":"<jats:p>Machine Learning (ML) and Internet of Things (IoT) are complementary advances: ML techniques unlock the potential of IoT with intelligence, and IoT applications increasingly feed data collected by sensors into ML models, thereby employing results to improve their business processes and services. Hence, orchestrating ML pipelines that encompass model training and implication involved in the holistic development lifecycle of an IoT application often leads to complex system integration. This article provides a comprehensive and systematic survey of the development lifecycle of ML-based IoT applications. We outline the core roadmap and taxonomy and subsequently assess and compare existing standard techniques used at individual stages.<\/jats:p>","DOI":"10.1145\/3398020","type":"journal-article","created":{"date-parts":[[2020,7,7]],"date-time":"2020-07-07T12:38:30Z","timestamp":1594125510000},"page":"1-47","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":73,"title":["Orchestrating the Development Lifecycle of Machine Learning-based IoT Applications"],"prefix":"10.1145","volume":"53","author":[{"given":"Bin","family":"Qian","sequence":"first","affiliation":[{"name":"Newcastle University, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jie","family":"Su","sequence":"additional","affiliation":[{"name":"Newcastle University, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2914-912X","authenticated-orcid":false,"given":"Zhenyu","family":"Wen","sequence":"additional","affiliation":[{"name":"Newcastle University, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Devki Nandan","family":"Jha","sequence":"additional","affiliation":[{"name":"Newcastle University, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yinhao","family":"Li","sequence":"additional","affiliation":[{"name":"Newcastle University, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yu","family":"Guan","sequence":"additional","affiliation":[{"name":"Newcastle University, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Deepak","family":"Puthal","sequence":"additional","affiliation":[{"name":"Newcastle University, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Philip","family":"James","sequence":"additional","affiliation":[{"name":"Newcastle University, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Renyu","family":"Yang","sequence":"additional","affiliation":[{"name":"University of Leeds, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Albert Y.","family":"Zomaya","sequence":"additional","affiliation":[{"name":"The University of Sydney, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3597-2646","authenticated-orcid":false,"given":"Omer","family":"Rana","sequence":"additional","affiliation":[{"name":"Cardiff University, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lizhe","family":"Wang","sequence":"additional","affiliation":[{"name":"China University of Geoscience (Wuhan), China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Maciej","family":"Koutny","sequence":"additional","affiliation":[{"name":"Newcastle University, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Rajiv","family":"Ranjan","sequence":"additional","affiliation":[{"name":"Newcastle University, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2020,8,3]]},"reference":[{"key":"e_1_2_2_1_1","volume-title":"Proceedings of the 12th USENIX Symposium on Operating Systems Design and Implementation (OSDI\u201916)","author":"Abadi Mart\u00edn","year":"2016","unstructured":"Mart\u00edn Abadi , Paul Barham , Jianmin Chen , Zhifeng Chen , Andy Davis , Jeffrey Dean , Matthieu Devin , Sanjay Ghemawat , Geoffrey Irving , Michael Isard , et\u00a0al. 2016 . Tensorflow: A system for large-scale machine learning . In Proceedings of the 12th USENIX Symposium on Operating Systems Design and Implementation (OSDI\u201916) . 265--283. Mart\u00edn Abadi, Paul Barham, Jianmin Chen, Zhifeng Chen, Andy Davis, Jeffrey Dean, Matthieu Devin, Sanjay Ghemawat, Geoffrey Irving, Michael Isard, et\u00a0al. 2016. Tensorflow: A system for large-scale machine learning. In Proceedings of the 12th USENIX Symposium on Operating Systems Design and Implementation (OSDI\u201916). 265--283."},{"key":"e_1_2_2_2_1","volume-title":"Proceedings of the Symposium on SDN Research. ACM, 8--20","author":"Achleitner Stefan","year":"2017","unstructured":"Stefan Achleitner , Thomas La Porta , Trent Jaeger , and Patrick McDaniel . 2017 . Adversarial network forensics in software defined networking . In Proceedings of the Symposium on SDN Research. ACM, 8--20 . Stefan Achleitner, Thomas La Porta, Trent Jaeger, and Patrick McDaniel. 2017. Adversarial network forensics in software defined networking. In Proceedings of the Symposium on SDN Research. ACM, 8--20."},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D17-1045"},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2017.2697839"},{"key":"e_1_2_2_5_1","first-page":"4102","article-title":"Review of data preprocessing techniques in data mining","volume":"12","author":"Alasadi Suad A.","year":"2017","unstructured":"Suad A. Alasadi and Wesam S. Bhaya . 2017 . Review of data preprocessing techniques in data mining . J. Eng. Appl. Sci. 12 , 16 (2017), 4102 -- 4107 . Suad A. Alasadi and Wesam S. Bhaya. 2017. Review of data preprocessing techniques in data mining. J. Eng. Appl. Sci. 12, 16 (2017), 4102--4107.","journal-title":"J. Eng. Appl. Sci."},{"key":"e_1_2_2_6_1","volume-title":"Proceedings of the Annual Conference on Neural Information Processing Systems (NIPS\u201917)","author":"Alistarh Dan","year":"2017","unstructured":"Dan Alistarh , Demjan Grubic , Jerry Li , Ryota Tomioka , and Milan Vojnovic . 2017 . QSGD: Communication-efficient SGD via gradient quantization and encoding . In Proceedings of the Annual Conference on Neural Information Processing Systems (NIPS\u201917) . 1709--1720. Dan Alistarh, Demjan Grubic, Jerry Li, Ryota Tomioka, and Milan Vojnovic. 2017. QSGD: Communication-efficient SGD via gradient quantization and encoding. In Proceedings of the Annual Conference on Neural Information Processing Systems (NIPS\u201917). 1709--1720."},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/TGCN.2018.2801725"},{"key":"e_1_2_2_8_1","volume-title":"Optimizing performance of recurrent neural networks on GPUs. arXiv preprint arXiv:1604.01946","author":"Appleyard Jeremy","year":"2016","unstructured":"Jeremy Appleyard , Tomas Kocisky , and Phil Blunsom . 2016. Optimizing performance of recurrent neural networks on GPUs. arXiv preprint arXiv:1604.01946 ( 2016 ). Jeremy Appleyard, Tomas Kocisky, and Phil Blunsom. 2016. Optimizing performance of recurrent neural networks on GPUs. arXiv preprint arXiv:1604.01946 (2016)."},{"key":"e_1_2_2_9_1","volume-title":"Miles Brundage, and Anil Anthony Bharath.","author":"Arulkumaran Kai","year":"2017","unstructured":"Kai Arulkumaran , Marc Peter Deisenroth , Miles Brundage, and Anil Anthony Bharath. 2017 . A brief survey of deep reinforcement learning. arXiv preprint arXiv:1708.05866 (2017). Kai Arulkumaran, Marc Peter Deisenroth, Miles Brundage, and Anil Anthony Bharath. 2017. A brief survey of deep reinforcement learning. arXiv preprint arXiv:1708.05866 (2017)."},{"key":"e_1_2_2_10_1","volume-title":"Hacking smart machines with smarter ones: How to extract meaningful data from machine learning classifiers. arXiv","author":"Ateniese Giuseppe","year":"2013","unstructured":"Giuseppe Ateniese , Giovanni Felici , Luigi V. Mancini , Angelo Spognardi , Antonio Villani , and Domenico Vitali . 2013. Hacking smart machines with smarter ones: How to extract meaningful data from machine learning classifiers. arXiv ( 2013 ). Giuseppe Ateniese, Giovanni Felici, Luigi V. Mancini, Angelo Spognardi, Antonio Villani, and Domenico Vitali. 2013. Hacking smart machines with smarter ones: How to extract meaningful data from machine learning classifiers. arXiv (2013)."},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.image.2007.05.010"},{"key":"e_1_2_2_12_1","volume-title":"5th International Conference on Learning Representations Toulon","author":"Ba Jimmy","year":"2016","unstructured":"Jimmy Ba , Roger Grosse , and James Martens . 2016 . Distributed second-order optimization using Kronecker-factored approximations . In 5th International Conference on Learning Representations Toulon , France, April 24-26, 2017, Conference Track Proceedings. https:\/\/openreview.net\/forum?id=SkkTMpjex. Jimmy Ba, Roger Grosse, and James Martens. 2016. Distributed second-order optimization using Kronecker-factored approximations. In 5th International Conference on Learning Representations Toulon, France, April 24-26, 2017, Conference Track Proceedings. https:\/\/openreview.net\/forum?id=SkkTMpjex."},{"key":"e_1_2_2_13_1","volume-title":"Accelerating neural architecture search using performance prediction. arXiv preprint arXiv:1705.10823","author":"Baker Bowen","year":"2017","unstructured":"Bowen Baker , Otkrist Gupta , Ramesh Raskar , and Nikhil Naik . 2017. Accelerating neural architecture search using performance prediction. arXiv preprint arXiv:1705.10823 ( 2017 ). Bowen Baker, Otkrist Gupta, Ramesh Raskar, and Nikhil Naik. 2017. Accelerating neural architecture search using performance prediction. arXiv preprint arXiv:1705.10823 (2017)."},{"key":"e_1_2_2_14_1","volume-title":"Proceedings of the Annual Conference on Neural Information Processing Systems (NIPS\u201915)","author":"Balan Anoop Korattikara","year":"2015","unstructured":"Anoop Korattikara Balan , Vivek Rathod , Kevin P. Murphy , and Max Welling . 2015 . Bayesian dark knowledge . In Proceedings of the Annual Conference on Neural Information Processing Systems (NIPS\u201915) . 3438--3446. Anoop Korattikara Balan, Vivek Rathod, Kevin P. Murphy, and Max Welling. 2015. Bayesian dark knowledge. In Proceedings of the Annual Conference on Neural Information Processing Systems (NIPS\u201915). 3438--3446."},{"key":"e_1_2_2_15_1","volume-title":"Proceedings of ICML Workshop on Unsupervised and Transfer Learning. 37--49","author":"Baldi Pierre","year":"2012","unstructured":"Pierre Baldi . 2012 . Autoencoders, unsupervised learning, and deep architectures . In Proceedings of ICML Workshop on Unsupervised and Transfer Learning. 37--49 . Pierre Baldi. 2012. Autoencoders, unsupervised learning, and deep architectures. In Proceedings of ICML Workshop on Unsupervised and Transfer Learning. 37--49."},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/72.298224"},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCNS.2014.2309751"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/2807591.2807611"},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.5555\/117115.117118"},{"key":"e_1_2_2_20_1","volume-title":"Neural Networks: Tricks of the Trade","author":"Bengio Yoshua","unstructured":"Yoshua Bengio . 2012. Practical recommendations for gradient-based training of deep architectures . In Neural Networks: Tricks of the Trade . Springer , 437--478. Yoshua Bengio. 2012. Practical recommendations for gradient-based training of deep architectures. In Neural Networks: Tricks of the Trade. Springer, 437--478."},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/1791314.1791349"},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jag.2015.01.017"},{"key":"e_1_2_2_23_1","volume-title":"Poisoning attacks against support vector machines. arXiv preprint arXiv:1206.6389","author":"Biggio Battista","year":"2012","unstructured":"Battista Biggio , Blaine Nelson , and Pavel Laskov . 2012. Poisoning attacks against support vector machines. arXiv preprint arXiv:1206.6389 ( 2012 ). Battista Biggio, Blaine Nelson, and Pavel Laskov. 2012. Poisoning attacks against support vector machines. arXiv preprint arXiv:1206.6389 (2012)."},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/2666652.2666666"},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/JIOT.2015.2502182"},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2014.2360027"},{"key":"e_1_2_2_27_1","volume-title":"Lozano","author":"Bl\u00e1zquez-Garc\u00eda Ane","year":"2020","unstructured":"Ane Bl\u00e1zquez-Garc\u00eda , Angel Conde , Usue Mori , and Jose A . Lozano . 2020 . A review on outlier\/anomaly detection in time series data. arXiv preprint arXiv:2002.04236 (2020). Ane Bl\u00e1zquez-Garc\u00eda, Angel Conde, Usue Mori, and Jose A. Lozano. 2020. A review on outlier\/anomaly detection in time series data. arXiv preprint arXiv:2002.04236 (2020)."},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.14778\/3007263.3007279"},{"key":"e_1_2_2_29_1","volume-title":"et\u00a0al","author":"Bonawitz Keith","year":"2019","unstructured":"Keith Bonawitz , Hubert Eichner , Wolfgang Grieskamp , Dzmitry Huba , Alex Ingerman , Vladimir Ivanov , Chloe Kiddon , Jakub Konecny , Stefano Mazzocchi , H. Brendan McMahan , et\u00a0al . 2019 . Towards federated learning at scale: System de sign. arXiv preprint arXiv:1902.01046 (2019). Keith Bonawitz, Hubert Eichner, Wolfgang Grieskamp, Dzmitry Huba, Alex Ingerman, Vladimir Ivanov, Chloe Kiddon, Jakub Konecny, Stefano Mazzocchi, H. Brendan McMahan, et\u00a0al. 2019. Towards federated learning at scale: System design. arXiv preprint arXiv:1902.01046 (2019)."},{"key":"e_1_2_2_30_1","volume-title":"Federated learning with autotuned communication-efficient secure aggregation. arXiv preprint arXiv:1912.00131","author":"Bonawitz Keith","year":"2019","unstructured":"Keith Bonawitz , Fariborz Salehi , Jakub Kone\u010dn\u1ef3 , Brendan McMahan , and Marco Gruteser . 2019. Federated learning with autotuned communication-efficient secure aggregation. arXiv preprint arXiv:1912.00131 ( 2019 ). Keith Bonawitz, Fariborz Salehi, Jakub Kone\u010dn\u1ef3, Brendan McMahan, and Marco Gruteser. 2019. Federated learning with autotuned communication-efficient secure aggregation. arXiv preprint arXiv:1912.00131 (2019)."},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-7908-2604-3_16"},{"key":"e_1_2_2_32_1","volume-title":"Neural Networks: Tricks of the Trade","author":"Bottou L\u00e9on","unstructured":"L\u00e9on Bottou . 2012. Stochastic gradient descent tricks . In Neural Networks: Tricks of the Trade . Springer , 421--436. L\u00e9on Bottou. 2012. Stochastic gradient descent tricks. In Neural Networks: Tricks of the Trade. Springer, 421--436."},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1137\/16M1080173"},{"key":"e_1_2_2_34_1","volume-title":"Proceedings of the Summer School on Machine Learning. Springer, 169--207","author":"Bousquet Olivier","year":"2003","unstructured":"Olivier Bousquet , Stephane Boucheron , and Gabor Lugosi . 2003 . Introduction to statistical learning theory . In Proceedings of the Summer School on Machine Learning. Springer, 169--207 . Olivier Bousquet, Stephane Boucheron, and Gabor Lugosi. 2003. Introduction to statistical learning theory. In Proceedings of the Summer School on Machine Learning. Springer, 169--207."},{"key":"e_1_2_2_35_1","volume-title":"Parallel coordinate descent for l1-regularized loss minimization. arXiv preprint arXiv:1105.5379","author":"Bradley Joseph K","year":"2011","unstructured":"Joseph K Bradley , Aapo Kyrola , Danny Bickson , and Carlos Guestrin . 2011. Parallel coordinate descent for l1-regularized loss minimization. arXiv preprint arXiv:1105.5379 ( 2011 ). Joseph K Bradley, Aapo Kyrola, Danny Bickson, and Carlos Guestrin. 2011. Parallel coordinate descent for l1-regularized loss minimization. arXiv preprint arXiv:1105.5379 (2011)."},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1010933404324"},{"key":"e_1_2_2_37_1","volume-title":"Classification and Regression Trees","author":"Breiman Leo","unstructured":"Leo Breiman . 2017. Classification and Regression Trees . Routledge . Leo Breiman. 2017. Classification and Regression Trees. Routledge."},{"key":"e_1_2_2_38_1","unstructured":"Uwe Breitenbucher Kalman Kepes Frank Leymann and Michael Wurster. 2017. Declarative vs. imperative: How to model the automated deployment of IoT applications? InProceedings of the Summer School on Service Oriented Computing (SummerSOC\u201917) 18--27.  Uwe Breitenbucher Kalman Kepes Frank Leymann and Michael Wurster. 2017. Declarative vs. imperative: How to model the automated deployment of IoT applications? InProceedings of the Summer School on Service Oriented Computing (SummerSOC\u201917) 18--27."},{"key":"e_1_2_2_39_1","volume-title":"SMASH: One-shot model architecture search through hypernetworks. arXiv preprint arXiv:1708.05344","author":"Brock Andrew","year":"2017","unstructured":"Andrew Brock , Theodore Lim , James M. Ritchie , and Nick Weston . 2017 . SMASH: One-shot model architecture search through hypernetworks. arXiv preprint arXiv:1708.05344 (2017). Andrew Brock, Theodore Lim, James M. Ritchie, and Nick Weston. 2017. SMASH: One-shot model architecture search through hypernetworks. arXiv preprint arXiv:1708.05344 (2017)."},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1137\/140954362"},{"key":"e_1_2_2_41_1","volume-title":"SlideShare","author":"Cab\u00e9 Benjamin","year":"2018","unstructured":"Benjamin Cab\u00e9 , Eclipse IoT Working Group , et\u00a0al. 2018 . IoT developer survey 2018 . SlideShare , April 13 (2018). Benjamin Cab\u00e9, Eclipse IoT Working Group, et\u00a0al. 2018. IoT developer survey 2018. SlideShare, April 13 (2018)."},{"key":"e_1_2_2_42_1","volume-title":"Proceedings of the USENIX Symposium on Operating Systems Design and Implementation (OSDI\u201999)","volume":"99","author":"Castro Miguel","year":"1999","unstructured":"Miguel Castro , Barbara Liskov , et\u00a0al. 1999 . Practical Byzantine fault tolerance . In Proceedings of the USENIX Symposium on Operating Systems Design and Implementation (OSDI\u201999) , Vol. 99 . 173--186. Miguel Castro, Barbara Liskov, et\u00a0al. 1999. Practical Byzantine fault tolerance. In Proceedings of the USENIX Symposium on Operating Systems Design and Implementation (OSDI\u201999), Vol. 99. 173--186."},{"key":"e_1_2_2_43_1","volume-title":"Proceedings of the 27th USENIX Security Symposium (USENIXSecurity\u201918)","author":"Celik Z. Berkay","unstructured":"Z. Berkay Celik , Leonardo Babun , Amit Kumar Sikder , Hidayet Aksu , Gang Tan , Patrick McDaniel , and A. Selcuk Uluagac . 2018. Sensitive information tracking in commodity IoT . In Proceedings of the 27th USENIX Security Symposium (USENIXSecurity\u201918) . 1687--1704. Z. Berkay Celik, Leonardo Babun, Amit Kumar Sikder, Hidayet Aksu, Gang Tan, Patrick McDaniel, and A. Selcuk Uluagac. 2018. Sensitive information tracking in commodity IoT. In Proceedings of the 27th USENIX Security Symposium (USENIXSecurity\u201918). 1687--1704."},{"key":"e_1_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/1007730.1007733"},{"key":"e_1_2_2_45_1","volume-title":"Proceedings of the International Conference on Frontiers in Handwriting Recognition (IWFHR\u201906)","author":"Chellapilla Kumar","year":"2006","unstructured":"Kumar Chellapilla , Sidd Puri , and Patrice Simard . 2006 . High performance convolutional neural networks for document processing . In Proceedings of the International Conference on Frontiers in Handwriting Recognition (IWFHR\u201906) . Suvisoft. Kumar Chellapilla, Sidd Puri, and Patrice Simard. 2006. High performance convolutional neural networks for document processing. In Proceedings of the International Conference on Frontiers in Handwriting Recognition (IWFHR\u201906). Suvisoft."},{"key":"e_1_2_2_46_1","volume-title":"Efficient and robust parallel DNN training through model parallelism on multi-GPU platform. arXiv preprint arXiv:1809.02839","author":"Chen Chi-Chung","year":"2018","unstructured":"Chi-Chung Chen , Chia-Lin Yang , and Hsiang-Yun Cheng . 2018. Efficient and robust parallel DNN training through model parallelism on multi-GPU platform. arXiv preprint arXiv:1809.02839 ( 2018 ). Chi-Chung Chen, Chia-Lin Yang, and Hsiang-Yun Cheng. 2018. Efficient and robust parallel DNN training through model parallelism on multi-GPU platform. arXiv preprint arXiv:1809.02839 (2018)."},{"key":"e_1_2_2_47_1","volume-title":"Revisiting distributed synchronous SGD. arXiv preprint arXiv:1604.00981","author":"Chen Jianmin","year":"2016","unstructured":"Jianmin Chen , Xinghao Pan , Rajat Monga , Samy Bengio , and Rafal Jozefowicz . 2016. Revisiting distributed synchronous SGD. arXiv preprint arXiv:1604.00981 ( 2016 ). Jianmin Chen, Xinghao Pan, Rajat Monga, Samy Bengio, and Rafal Jozefowicz. 2016. Revisiting distributed synchronous SGD. arXiv preprint arXiv:1604.00981 (2016)."},{"key":"e_1_2_2_48_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-01219-9_26"},{"key":"e_1_2_2_49_1","volume-title":"Proceedings of the 13th USENIX Symposium on Operating Systems Design and Implementation (OSDI\u201918)","author":"Chen Tianqi","year":"2018","unstructured":"Tianqi Chen , Thierry Moreau , Ziheng Jiang , Lianmin Zheng , Eddie Yan , Haichen Shen , Meghan Cowan , Leyuan Wang , Yuwei Hu , Luis Ceze , et\u00a0al. 2018 . TVM: An automated end-to-end optimizing compiler for deep learning . In Proceedings of the 13th USENIX Symposium on Operating Systems Design and Implementation (OSDI\u201918) . 578--594. Tianqi Chen, Thierry Moreau, Ziheng Jiang, Lianmin Zheng, Eddie Yan, Haichen Shen, Meghan Cowan, Leyuan Wang, Yuwei Hu, Luis Ceze, et\u00a0al. 2018. TVM: An automated end-to-end optimizing compiler for deep learning. In Proceedings of the 13th USENIX Symposium on Operating Systems Design and Implementation (OSDI\u201918). 578--594."},{"key":"e_1_2_2_50_1","volume-title":"Targeted backdoor attacks on deep learning systems using data poisoning. arXiv preprint arXiv:1712.05526","author":"Chen Xinyun","year":"2017","unstructured":"Xinyun Chen , Chang Liu , Bo Li , Kimberly Lu , and Dawn Song . 2017. Targeted backdoor attacks on deep learning systems using data poisoning. arXiv preprint arXiv:1712.05526 ( 2017 ). Xinyun Chen, Chang Liu, Bo Li, Kimberly Lu, and Dawn Song. 2017. Targeted backdoor attacks on deep learning systems using data poisoning. arXiv preprint arXiv:1712.05526 (2017)."},{"key":"e_1_2_2_51_1","volume-title":"A survey of model compression and acceleration for deep neural networks. arXiv preprint arXiv:1710.09282","author":"Cheng Yu","year":"2017","unstructured":"Yu Cheng , Duo Wang , Pan Zhou , and Tao Zhang . 2017. A survey of model compression and acceleration for deep neural networks. arXiv preprint arXiv:1710.09282 ( 2017 ). Yu Cheng, Duo Wang, Pan Zhou, and Tao Zhang. 2017. A survey of model compression and acceleration for deep neural networks. arXiv preprint arXiv:1710.09282 (2017)."},{"key":"e_1_2_2_52_1","volume-title":"cudnn: Efficient primitives for deep learning. arXiv preprint arXiv:1410.0759","author":"Chetlur Sharan","year":"2014","unstructured":"Sharan Chetlur , Cliff Woolley , Philippe Vandermersch , Jonathan Cohen , John Tran , Bryan Catanzaro , and Evan Shelhamer . 2014. cudnn: Efficient primitives for deep learning. arXiv preprint arXiv:1410.0759 ( 2014 ). Sharan Chetlur, Cliff Woolley, Philippe Vandermersch, Jonathan Cohen, John Tran, Bryan Catanzaro, and Evan Shelhamer. 2014. cudnn: Efficient primitives for deep learning. arXiv preprint arXiv:1410.0759 (2014)."},{"key":"e_1_2_2_53_1","volume-title":"Proceedings of the 11th USENIX Symposium on Operating Systems Design and Implementation (OSDI\u201914)","author":"Chilimbi Trishul","year":"2014","unstructured":"Trishul Chilimbi , Yutaka Suzue , Johnson Apacible , and Karthik Kalyanaraman . 2014 . Project adam: Building an efficient and scalable deep learning training system . In Proceedings of the 11th USENIX Symposium on Operating Systems Design and Implementation (OSDI\u201914) . 571--582. Trishul Chilimbi, Yutaka Suzue, Johnson Apacible, and Karthik Kalyanaraman. 2014. Project adam: Building an efficient and scalable deep learning training system. In Proceedings of the 11th USENIX Symposium on Operating Systems Design and Implementation (OSDI\u201914). 571--582."},{"key":"e_1_2_2_54_1","doi-asserted-by":"publisher","DOI":"10.1109\/FTCS.1994.315624"},{"key":"e_1_2_2_55_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICNN.1993.298655"},{"key":"e_1_2_2_56_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.195"},{"key":"e_1_2_2_57_1","first-page":"1","article-title":"Fault detection and classification by unsupervised feature extraction and dimensionality reduction","volume":"1","author":"Chopra Praveen","year":"2015","unstructured":"Praveen Chopra and Sandeep Kumar Yadav . 2015 . Fault detection and classification by unsupervised feature extraction and dimensionality reduction . Complex Intell. Systems 1 , 1 \u2013 4 (2015), 25\u201333. Praveen Chopra and Sandeep Kumar Yadav. 2015. Fault detection and classification by unsupervised feature extraction and dimensionality reduction. Complex Intell. Systems 1, 1\u20134 (2015), 25\u201333.","journal-title":"Complex Intell. Systems"},{"key":"e_1_2_2_58_1","volume-title":"Proceedings of the Annual Conference on Neural Information Processing Systems (NIPS\u2019","author":"Chu Cheng-Tao","year":"2007","unstructured":"Cheng-Tao Chu , Sang K. Kim , Yi-An Lin , YuanYuan Yu , Gary Bradski , Kunle Olukotun , and Andrew Y. Ng . 2007. Map-reduce for machine learning on multicore . In Proceedings of the Annual Conference on Neural Information Processing Systems (NIPS\u2019 ( 2007 ). 281--288. Cheng-Tao Chu, Sang K. Kim, Yi-An Lin, YuanYuan Yu, Gary Bradski, Kunle Olukotun, and Andrew Y. Ng. 2007. Map-reduce for machine learning on multicore. In Proceedings of the Annual Conference on Neural Information Processing Systems (NIPS\u2019 (2007). 281--288."},{"key":"e_1_2_2_59_1","volume-title":"Proceedings of the International Joint Conference on Neural Networks (IJCNN\u201990)","author":"Chu L.-C.","unstructured":"L.-C. Chu and Benjamin W. Wah . 1990. Fault tolerant neural networks with hybrid redundancy . In Proceedings of the International Joint Conference on Neural Networks (IJCNN\u201990) . IEEE. L.-C. Chu and Benjamin W. Wah. 1990. Fault tolerant neural networks with hybrid redundancy. In Proceedings of the International Joint Conference on Neural Networks (IJCNN\u201990). IEEE."},{"key":"e_1_2_2_60_1","volume-title":"Proceedings of the Annual Conference on Neural Information Processing Systems (NIPS\u201919)","author":"Colin Igor","year":"2019","unstructured":"Igor Colin , Ludovic Dos Santos , and Kevin Scaman . 2019 . Theoretical limits of pipeline parallel optimization and application to distributed deep learning . In Proceedings of the Annual Conference on Neural Information Processing Systems (NIPS\u201919) . 12350--12359. Igor Colin, Ludovic Dos Santos, and Kevin Scaman. 2019. Theoretical limits of pipeline parallel optimization and application to distributed deep learning. In Proceedings of the Annual Conference on Neural Information Processing Systems (NIPS\u201919). 12350--12359."},{"key":"e_1_2_2_61_1","doi-asserted-by":"publisher","DOI":"10.1561\/1900000004"},{"key":"e_1_2_2_62_1","unstructured":"NVIDIA Corporation. 2015. NVIDIA Collective Communications Library (NCCL). Retrieved from https:\/\/developer.nvidia.com\/nccl.  NVIDIA Corporation. 2015. NVIDIA Collective Communications Library (NCCL). Retrieved from https:\/\/developer.nvidia.com\/nccl."},{"key":"e_1_2_2_63_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF00994018"},{"key":"e_1_2_2_64_1","volume-title":"Binarized neural networks: Training deep neural networks with weights and activations constrained to+ 1 or-1. arXiv","author":"Courbariaux Matthieu","year":"2016","unstructured":"Matthieu Courbariaux , Itay Hubara , Daniel Soudry , Ran El-Yaniv , and Yoshua Bengio . 2016. Binarized neural networks: Training deep neural networks with weights and activations constrained to+ 1 or-1. arXiv ( 2016 ). Matthieu Courbariaux, Itay Hubara, Daniel Soudry, Ran El-Yaniv, and Yoshua Bengio. 2016. Binarized neural networks: Training deep neural networks with weights and activations constrained to+ 1 or-1. arXiv (2016)."},{"key":"e_1_2_2_65_1","volume-title":"InferLine: ML inference pipeline composition framework. arXiv preprint arXiv:1812.01776","author":"Crankshaw Daniel","year":"2018","unstructured":"Daniel Crankshaw , Gur-Eyal Sela , Corey Zumar , Xiangxi Mo , Joseph E. Gonzalez , Ion Stoica , and Alexey Tumanov . 2018. InferLine: ML inference pipeline composition framework. arXiv preprint arXiv:1812.01776 ( 2018 ). Daniel Crankshaw, Gur-Eyal Sela, Corey Zumar, Xiangxi Mo, Joseph E. Gonzalez, Ion Stoica, and Alexey Tumanov. 2018. InferLine: ML inference pipeline composition framework. arXiv preprint arXiv:1812.01776 (2018)."},{"key":"e_1_2_2_66_1","volume-title":"Proceedings of the 14th USENIX Symposium on NSDI. 613--627","author":"Crankshaw Daniel","year":"2017","unstructured":"Daniel Crankshaw , Xin Wang , Guilio Zhou , Michael J. Franklin , Joseph E. Gonzalez , and Ion Stoica . 2017 . Clipper: A low-latency online prediction serving system . In Proceedings of the 14th USENIX Symposium on NSDI. 613--627 . Daniel Crankshaw, Xin Wang, Guilio Zhou, Michael J. Franklin, Joseph E. Gonzalez, and Ion Stoica. 2017. Clipper: A low-latency online prediction serving system. In Proceedings of the 14th USENIX Symposium on NSDI. 613--627."},{"key":"e_1_2_2_67_1","volume-title":"Proceedings of the European Conference on Computer Systems (EuroSys\u201916)","author":"Cui Henggang","unstructured":"Henggang Cui , Hao Zhang , Gregory R. Ganger , Phillip B. Gibbons , and Eric P. Xing . 2016. Geeps: Scalable deep learning on distributed GPUs with a GPU-specialized parameter server . In Proceedings of the European Conference on Computer Systems (EuroSys\u201916) . 1--16. Henggang Cui, Hao Zhang, Gregory R. Ganger, Phillip B. Gibbons, and Eric P. Xing. 2016. Geeps: Scalable deep learning on distributed GPUs with a GPU-specialized parameter server. In Proceedings of the European Conference on Computer Systems (EuroSys\u201916). 1--16."},{"key":"e_1_2_2_68_1","doi-asserted-by":"publisher","DOI":"10.5220\/0006243303580367"},{"key":"e_1_2_2_69_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0004-3702(03)00079-1"},{"key":"e_1_2_2_70_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.inffus.2019.03.006"},{"key":"e_1_2_2_71_1","volume-title":"Proceedings of the Annual Conference on Neural Information Processing Systems (NIPS\u201915)","author":"De Sa Christopher M","year":"2015","unstructured":"Christopher M De Sa , Ce Zhang , Kunle Olukotun , and Christopher R\u00e9 . 2015 . Taming the wild: A unified analysis of hogwild-style algorithms . In Proceedings of the Annual Conference on Neural Information Processing Systems (NIPS\u201915) . 2674--2682. Christopher M De Sa, Ce Zhang, Kunle Olukotun, and Christopher R\u00e9. 2015. Taming the wild: A unified analysis of hogwild-style algorithms. In Proceedings of the Annual Conference on Neural Information Processing Systems (NIPS\u201915). 2674--2682."},{"key":"e_1_2_2_72_1","volume-title":"Proceedings of the Annual Conference on Neural Information Processing Systems (NIPS\u201912)","author":"Dean Jeffrey","year":"2012","unstructured":"Jeffrey Dean , Greg Corrado , Rajat Monga , Kai Chen , Matthieu Devin , Mark Mao , Andrew Senior , Paul Tucker , Ke Yang , Quoc V. Le , et\u00a0al. 2012 . Large scale distributed deep networks . In Proceedings of the Annual Conference on Neural Information Processing Systems (NIPS\u201912) . 1223--1231. Jeffrey Dean, Greg Corrado, Rajat Monga, Kai Chen, Matthieu Devin, Mark Mao, Andrew Senior, Paul Tucker, Ke Yang, Quoc V. Le, et\u00a0al. 2012. Large scale distributed deep networks. In Proceedings of the Annual Conference on Neural Information Processing Systems (NIPS\u201912). 1223--1231."},{"key":"e_1_2_2_73_1","volume-title":"Optimal distributed online prediction using mini-batches. J. Mach. Learn. Res. 13 (Jan","author":"Dekel Ofer","year":"2012","unstructured":"Ofer Dekel , Ran Gilad-Bachrach , Ohad Shamir , and Lin Xiao . 2012. Optimal distributed online prediction using mini-batches. J. Mach. Learn. Res. 13 (Jan . 2012 ), 165--202. Ofer Dekel, Ran Gilad-Bachrach, Ohad Shamir, and Lin Xiao. 2012. Optimal distributed online prediction using mini-batches. J. Mach. Learn. Res. 13 (Jan. 2012), 165--202."},{"key":"e_1_2_2_74_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"e_1_2_2_75_1","first-page":"3442","article-title":"Machine learning-based traffic congestion prediction in a IoT-based smart city","volume":"4","author":"Devi Suguna","year":"2017","unstructured":"Suguna Devi and T. Neetha . 2017 . Machine learning-based traffic congestion prediction in a IoT-based smart city . Int. Res. J. Eng. Technol. 4 (2017), 3442 \u2013 3445 . Suguna Devi and T. Neetha. 2017. Machine learning-based traffic congestion prediction in a IoT-based smart city. Int. Res. J. Eng. Technol. 4 (2017), 3442\u20133445.","journal-title":"Int. Res. J. Eng. Technol."},{"key":"e_1_2_2_76_1","volume-title":"Proceedings of the International Conference on Machine Learning. 2024--2033","author":"Diamos Greg","year":"2016","unstructured":"Greg Diamos , Shubho Sengupta , Bryan Catanzaro , Mike Chrzanowski , Adam Coates , Erich Elsen , Jesse Engel , Awni Hannun , and Sanjeev Satheesh . 2016 . Persistent rnns: Stashing recurrent weights on-chip . In Proceedings of the International Conference on Machine Learning. 2024--2033 . Greg Diamos, Shubho Sengupta, Bryan Catanzaro, Mike Chrzanowski, Adam Coates, Erich Elsen, Jesse Engel, Awni Hannun, and Sanjeev Satheesh. 2016. Persistent rnns: Stashing recurrent weights on-chip. In Proceedings of the International Conference on Machine Learning. 2024--2033."},{"key":"e_1_2_2_77_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-01252-6_32"},{"key":"e_1_2_2_78_1","doi-asserted-by":"publisher","DOI":"10.1109\/RTSS.2013.28"},{"key":"e_1_2_2_79_1","doi-asserted-by":"publisher","DOI":"10.1109\/IPDPS.2019.00031"},{"key":"e_1_2_2_80_1","doi-asserted-by":"publisher","DOI":"10.1145\/3295500.3356207"},{"key":"e_1_2_2_81_1","doi-asserted-by":"publisher","DOI":"10.1109\/MLHPC.2016.004"},{"key":"e_1_2_2_82_1","volume-title":"Adaptive subgradient methods for online learning and stochastic optimization. J. Mach. Learn. Res. 12 (July","author":"Duchi John","year":"2011","unstructured":"John Duchi , Elad Hazan , and Yoram Singer . 2011. Adaptive subgradient methods for online learning and stochastic optimization. J. Mach. Learn. Res. 12 (July 2011 ), 2121--2159. John Duchi, Elad Hazan, and Yoram Singer. 2011. Adaptive subgradient methods for online learning and stochastic optimization. J. Mach. Learn. Res. 12 (July 2011), 2121--2159."},{"key":"e_1_2_2_83_1","doi-asserted-by":"publisher","DOI":"10.1109\/JIOT.2017.2787959"},{"key":"e_1_2_2_84_1","unstructured":"Anne Elk. 2019. Distributed Machine Learning Toolkit: Big Data Big Model Flexibility Efficiency. Retrieved from http:\/\/www.dmtk.io.  Anne Elk. 2019. Distributed Machine Learning Toolkit: Big Data Big Model Flexibility Efficiency. Retrieved from http:\/\/www.dmtk.io."},{"key":"e_1_2_2_85_1","volume-title":"Jan Hendrik Metzen, and Frank Hutter","author":"Elsken Thomas","year":"2018","unstructured":"Thomas Elsken , Jan Hendrik Metzen, and Frank Hutter . 2018 . Multi-objective architecture search for cnns. arXiv preprint arXiv:1804.09081 2 (2018). Thomas Elsken, Jan Hendrik Metzen, and Frank Hutter. 2018. Multi-objective architecture search for cnns. arXiv preprint arXiv:1804.09081 2 (2018)."},{"key":"e_1_2_2_86_1","doi-asserted-by":"publisher","DOI":"10.1109\/72.248456"},{"key":"e_1_2_2_87_1","volume-title":"Deep learning for launching and mitigating wireless jamming attacks. TCCN","author":"Erpek Tugba","year":"2018","unstructured":"Tugba Erpek , Yalin E. Sagduyu , and Yi Shi . 2018. Deep learning for launching and mitigating wireless jamming attacks. TCCN ( 2018 ). Tugba Erpek, Yalin E. Sagduyu, and Yi Shi. 2018. Deep learning for launching and mitigating wireless jamming attacks. TCCN (2018)."},{"key":"e_1_2_2_88_1","doi-asserted-by":"publisher","DOI":"10.1145\/2140522.2140530"},{"key":"e_1_2_2_89_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-009-0275-4"},{"key":"e_1_2_2_90_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10618-019-00619-1"},{"key":"e_1_2_2_91_1","doi-asserted-by":"publisher","DOI":"10.1109\/MELCON.2016.7495395"},{"key":"e_1_2_2_92_1","doi-asserted-by":"publisher","DOI":"10.1080\/17538947.2016.1208685"},{"key":"e_1_2_2_93_1","doi-asserted-by":"publisher","DOI":"10.1145\/2523813"},{"key":"e_1_2_2_94_1","doi-asserted-by":"publisher","DOI":"10.1109\/MCC.2018.053711662"},{"key":"e_1_2_2_95_1","volume-title":"AMPNet: Asynchronous model-parallel training for dynamic neural networks. arXiv preprint arXiv:1705.09786","author":"Gaunt Alexander L.","year":"2017","unstructured":"Alexander L. Gaunt , Matthew A. Johnson , Maik Riechert , Daniel Tarlow , Ryota Tomioka , Dimitrios Vytiniotis , and Sam Webster . 2017. AMPNet: Asynchronous model-parallel training for dynamic neural networks. arXiv preprint arXiv:1705.09786 ( 2017 ). Alexander L. Gaunt, Matthew A. Johnson, Maik Riechert, Daniel Tarlow, Ryota Tomioka, Dimitrios Vytiniotis, and Sam Webster. 2017. AMPNet: Asynchronous model-parallel training for dynamic neural networks. arXiv preprint arXiv:1705.09786 (2017)."},{"key":"e_1_2_2_96_1","doi-asserted-by":"publisher","DOI":"10.1145\/3210377.3210394"},{"key":"e_1_2_2_97_1","doi-asserted-by":"publisher","DOI":"10.1134\/S0361768818060142"},{"key":"e_1_2_2_98_1","volume-title":"Genetic Algorithms in Search, Optimization and Machine Learning","author":"Goldberg David E.","unstructured":"David E. Goldberg . 1989. Genetic Algorithms in Search, Optimization and Machine Learning ( 1 st ed.). Addison-Wesley Longman Publishing , Boston, MA . David E. Goldberg. 1989. Genetic Algorithms in Search, Optimization and Machine Learning (1st ed.). Addison-Wesley Longman Publishing, Boston, MA.","edition":"1"},{"key":"e_1_2_2_99_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10994-017-5642-8"},{"key":"e_1_2_2_100_1","volume-title":"Proceedings of the Annual Conference on Neural Information Processing Systems (NIPS\u201914)","author":"Goodfellow Ian","year":"2014","unstructured":"Ian Goodfellow , Jean Pouget-Abadie , Mehdi Mirza , Bing Xu , David Warde-Farley , Sherjil Ozair , Aaron Courville , and Yoshua Bengio . 2014 . Generative adversarial nets . In Proceedings of the Annual Conference on Neural Information Processing Systems (NIPS\u201914) . 2672--2680. Ian Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio. 2014. Generative adversarial nets. In Proceedings of the Annual Conference on Neural Information Processing Systems (NIPS\u201914). 2672--2680."},{"key":"e_1_2_2_101_1","volume-title":"Explaining and harnessing adversarial examples. arXiv preprint arXiv:1412.6572","author":"Goodfellow Ian J","year":"2014","unstructured":"Ian J Goodfellow , Jonathon Shlens , and Christian Szegedy . 2014. Explaining and harnessing adversarial examples. arXiv preprint arXiv:1412.6572 ( 2014 ). Ian J Goodfellow, Jonathon Shlens, and Christian Szegedy. 2014. Explaining and harnessing adversarial examples. arXiv preprint arXiv:1412.6572 (2014)."},{"key":"e_1_2_2_102_1","volume-title":"large minibatch sgd: Training imagenet in 1 hour. arXiv preprint arXiv:1706.02677","author":"Goyal Priya","year":"2017","unstructured":"Priya Goyal , Piotr Doll\u00e1r , Ross Girshick , Pieter Noordhuis , Lukasz Wesolowski , Aapo Kyrola , Andrew Tulloch , Yangqing Jia , and Kaiming He. 2017. Accurate , large minibatch sgd: Training imagenet in 1 hour. arXiv preprint arXiv:1706.02677 ( 2017 ). Priya Goyal, Piotr Doll\u00e1r, Ross Girshick, Pieter Noordhuis, Lukasz Wesolowski, Aapo Kyrola, Andrew Tulloch, Yangqing Jia, and Kaiming He. 2017. Accurate, large minibatch sgd: Training imagenet in 1 hour. arXiv preprint arXiv:1706.02677 (2017)."},{"key":"e_1_2_2_103_1","doi-asserted-by":"publisher","DOI":"10.1109\/WD.2010.5657743"},{"key":"e_1_2_2_104_1","volume-title":"Proceedings of the International Conference on Acoustics, Speech, and Signal Processing (ICASSP\u201913)","author":"Graves Alex","unstructured":"Alex Graves , Abdel Rahman Mohamed , and Geoffrey E. Hinton . 2013. Speech recognition with deep recurrent neural networks . In Proceedings of the International Conference on Acoustics, Speech, and Signal Processing (ICASSP\u201913) . 6645--6649. Alex Graves, Abdel Rahman Mohamed, and Geoffrey E. Hinton. 2013. Speech recognition with deep recurrent neural networks. In Proceedings of the International Conference on Acoustics, Speech, and Signal Processing (ICASSP\u201913). 6645--6649."},{"key":"e_1_2_2_105_1","volume-title":"Heitor Murilo Gomes, and Albert Bifet","author":"Grzenda Maciej","year":"2019","unstructured":"Maciej Grzenda , Heitor Murilo Gomes, and Albert Bifet . 2019 . Delayed labelling evaluation for data streams. Data Min. Knowl. Discov . (2019), 1--30. Maciej Grzenda, Heitor Murilo Gomes, and Albert Bifet. 2019. Delayed labelling evaluation for data streams. Data Min. Knowl. Discov. (2019), 1--30."},{"key":"e_1_2_2_106_1","volume-title":"Badnets: Identifying vulnerabilities in the machine learning model supply chain. arXiv preprint arXiv:1708.06733","author":"Gu Tianyu","year":"2017","unstructured":"Tianyu Gu , Brendan Dolan-Gavitt , and Siddharth Garg . 2017 . Badnets: Identifying vulnerabilities in the machine learning model supply chain. arXiv preprint arXiv:1708.06733 (2017). Tianyu Gu, Brendan Dolan-Gavitt, and Siddharth Garg. 2017. Badnets: Identifying vulnerabilities in the machine learning model supply chain. arXiv preprint arXiv:1708.06733 (2017)."},{"key":"e_1_2_2_107_1","volume-title":"XPipe: Efficient pipeline model parallelism for multi-GPU DNN training. arXiv preprint arXiv:1911.04610","author":"Guan Lei","year":"2019","unstructured":"Lei Guan , Wotao Yin , Dongsheng Li , and Xicheng Lu. 2019. XPipe: Efficient pipeline model parallelism for multi-GPU DNN training. arXiv preprint arXiv:1911.04610 ( 2019 ). Lei Guan, Wotao Yin, Dongsheng Li, and Xicheng Lu. 2019. XPipe: Efficient pipeline model parallelism for multi-GPU DNN training. arXiv preprint arXiv:1911.04610 (2019)."},{"key":"e_1_2_2_108_1","doi-asserted-by":"publisher","DOI":"10.1145\/3090076"},{"key":"e_1_2_2_109_1","volume-title":"Proceedings of the International Conference on Machine Learning (ICML\u201915)","author":"Gupta Suyog","year":"2015","unstructured":"Suyog Gupta , Ankur Agrawal , Kailash Gopalakrishnan , and Pritish Narayanan . 2015 . Deep learning with limited numerical precision . In Proceedings of the International Conference on Machine Learning (ICML\u201915) . 1737--1746. Suyog Gupta, Ankur Agrawal, Kailash Gopalakrishnan, and Pritish Narayanan. 2015. Deep learning with limited numerical precision. In Proceedings of the International Conference on Machine Learning (ICML\u201915). 1737--1746."},{"key":"e_1_2_2_110_1","volume-title":"Pattern analysis for machine olfaction: A review","author":"Gutierrez-Osuna Ricardo","year":"2002","unstructured":"Ricardo Gutierrez-Osuna . 2002. Pattern analysis for machine olfaction: A review . IEEE Sensors journal ( 2002 ). Ricardo Gutierrez-Osuna. 2002. Pattern analysis for machine olfaction: A review. IEEE Sensors journal (2002)."},{"key":"e_1_2_2_111_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.future.2018.03.007"},{"key":"e_1_2_2_112_1","volume-title":"Proceedings of the Seventeenth International Conference on Machine Learning (ICML'00)","author":"Hall Mark A.","year":"2000","unstructured":"Mark A. Hall . 2000 . Correlation-based feature selection of discrete and numeric class machine learning . In Proceedings of the Seventeenth International Conference on Machine Learning (ICML'00) . Morgan Kaufmann Publishers Inc., 359\u2013366. Mark A. Hall. 2000. Correlation-based feature selection of discrete and numeric class machine learning. In Proceedings of the Seventeenth International Conference on Machine Learning (ICML'00). Morgan Kaufmann Publishers Inc., 359\u2013366."},{"key":"e_1_2_2_113_1","volume-title":"Tamas Abraham, Benjamin IP Rubinstein, Christopher Leckie, Tansu Alpcan, and Sarah Erfani.","author":"Han Yi","year":"2019","unstructured":"Yi Han , David Hubczenko , Paul Montague , Olivier De Vel , Tamas Abraham, Benjamin IP Rubinstein, Christopher Leckie, Tansu Alpcan, and Sarah Erfani. 2019 . Adversarial reinforcement learning under partial observability in software-defined networking. arXiv:1902.09062 (2019). Yi Han, David Hubczenko, Paul Montague, Olivier De Vel, Tamas Abraham, Benjamin IP Rubinstein, Christopher Leckie, Tansu Alpcan, and Sarah Erfani. 2019. Adversarial reinforcement learning under partial observability in software-defined networking. arXiv:1902.09062 (2019)."},{"key":"e_1_2_2_114_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10479-009-0657-6"},{"key":"e_1_2_2_115_1","volume-title":"Pipedream: Fast and efficient pipeline parallel dnn training. arXiv preprint arXiv:1806.03377","author":"Harlap Aaron","year":"2018","unstructured":"Aaron Harlap , Deepak Narayanan , Amar Phanishayee , Vivek Seshadri , Nikhil Devanur , Greg Ganger , and Phil Gibbons . 2018 . Pipedream: Fast and efficient pipeline parallel dnn training. arXiv preprint arXiv:1806.03377 (2018). Aaron Harlap, Deepak Narayanan, Amar Phanishayee, Vivek Seshadri, Nikhil Devanur, Greg Ganger, and Phil Gibbons. 2018. Pipedream: Fast and efficient pipeline parallel dnn training. arXiv preprint arXiv:1806.03377 (2018)."},{"key":"e_1_2_2_116_1","article-title":"Algorithm\u00a0AS 136: A k-means clustering algorithm","volume":"28","author":"Hartigan John A.","year":"1979","unstructured":"John A. Hartigan and Manchek A. Wong . 1979 . Algorithm\u00a0AS 136: A k-means clustering algorithm . J. Roy. Stat. Soc. Ser. C (Appl. Stat.) 28 , 1 (1979). John A. Hartigan and Manchek A. Wong. 1979. Algorithm\u00a0AS 136: A k-means clustering algorithm. J. Roy. Stat. Soc. Ser. C (Appl. Stat.) 28, 1 (1979).","journal-title":"J. Roy. Stat. Soc. Ser. C (Appl. Stat.)"},{"key":"e_1_2_2_117_1","volume-title":"Mask R-CNN. Proceedings of the IEEE International Conference on Computer Vision (ICCV\u201917)","author":"He Kaiming","unstructured":"Kaiming He , Georgia Gkioxari , Piotr Dollar , and Ross B. Girshick . 2017 . Mask R-CNN. Proceedings of the IEEE International Conference on Computer Vision (ICCV\u201917) . 2980--2988. Kaiming He, Georgia Gkioxari, Piotr Dollar, and Ross B. Girshick. 2017. Mask R-CNN. Proceedings of the IEEE International Conference on Computer Vision (ICCV\u201917). 2980--2988."},{"key":"e_1_2_2_118_1","volume-title":"Proceedings of the Workshops at the 31st AAAI Conference on Artificial Intelligence.","author":"He Xi","year":"2017","unstructured":"Xi He , Dheevatssa Mudigere , Mikhail Smelyanskiy , and Martin Tak\u00e1c . 2017 . Distributed hessian-free optimization for deep neural network . In Proceedings of the Workshops at the 31st AAAI Conference on Artificial Intelligence. Xi He, Dheevatssa Mudigere, Mikhail Smelyanskiy, and Martin Tak\u00e1c. 2017. Distributed hessian-free optimization for deep neural network. In Proceedings of the Workshops at the 31st AAAI Conference on Artificial Intelligence."},{"key":"e_1_2_2_119_1","unstructured":"Geoffrey Hinton. 2019. RMSprop. Retrieved from http:\/\/www.cs.toronto.edu\/ tijmen\/csc321\/slides\/lecture_slides_lec6.pdf.  Geoffrey Hinton. 2019. RMSprop. Retrieved from http:\/\/www.cs.toronto.edu\/ tijmen\/csc321\/slides\/lecture_slides_lec6.pdf."},{"key":"e_1_2_2_120_1","volume-title":"Distilling the knowledge in a neural network. arXiv preprint arXiv:1503.02531","author":"Hinton Geoffrey","year":"2015","unstructured":"Geoffrey Hinton , Oriol Vinyals , and Jeff Dean . 2015. Distilling the knowledge in a neural network. arXiv preprint arXiv:1503.02531 ( 2015 ). Geoffrey Hinton, Oriol Vinyals, and Jeff Dean. 2015. Distilling the knowledge in a neural network. arXiv preprint arXiv:1503.02531 (2015)."},{"key":"e_1_2_2_121_1","volume-title":"Proceedings of the Annual Conference on Neural Information Processing Systems (NIPS\u201913)","author":"Ho Qirong","year":"2013","unstructured":"Qirong Ho , James Cipar , Henggang Cui , Seunghak Lee , Jin Kyu Kim , Phillip B. Gibbons , Garth A. Gibson , Greg Ganger , and Eric P Xing . 2013 . More effective distributed ml via a stale synchronous parallel parameter server . In Proceedings of the Annual Conference on Neural Information Processing Systems (NIPS\u201913) . 1223--1231. Qirong Ho, James Cipar, Henggang Cui, Seunghak Lee, Jin Kyu Kim, Phillip B. Gibbons, Garth A. Gibson, Greg Ganger, and Eric P Xing. 2013. More effective distributed ml via a stale synchronous parallel parameter server. In Proceedings of the Annual Conference on Neural Information Processing Systems (NIPS\u201913). 1223--1231."},{"key":"e_1_2_2_122_1","doi-asserted-by":"publisher","DOI":"10.1162\/neco.1997.9.8.1735"},{"key":"e_1_2_2_123_1","volume-title":"Proceedings of the 23rd International Conference on Machine Learning (ICML\u201906)","author":"Hoi Steven C. H.","unstructured":"Steven C. H. Hoi , Rong Jin , Jianke Zhu , and Michael R. Lyu . 2006. Batch mode active learning and its application to medical image classification . In Proceedings of the 23rd International Conference on Machine Learning (ICML\u201906) . ACM, 417--424. Steven C. H. Hoi, Rong Jin, Jianke Zhu, and Michael R. Lyu. 2006. Batch mode active learning and its application to medical image classification. In Proceedings of the 23rd International Conference on Machine Learning (ICML\u201906). ACM, 417--424."},{"key":"e_1_2_2_124_1","volume-title":"Online learning: A comprehensive survey. arXiv preprint arXiv:1802.02871","author":"Hoi Steven C. H.","year":"2018","unstructured":"Steven C. H. Hoi , Doyen Sahoo , Jing Lu , and Peilin Zhao . 2018. Online learning: A comprehensive survey. arXiv preprint arXiv:1802.02871 ( 2018 ). Steven C. H. Hoi, Doyen Sahoo, Jing Lu, and Peilin Zhao. 2018. Online learning: A comprehensive survey. arXiv preprint arXiv:1802.02871 (2018)."},{"key":"e_1_2_2_125_1","volume-title":"Proceedings of the International Conference on Learning Representations.","author":"Hou Lu","unstructured":"Lu Hou , Ruiliang Zhang , and James T. Kwok . 2019. Analysis of quantized models . In Proceedings of the International Conference on Learning Representations. Retrieved from https:\/\/openreview.net\/forum?id=ryM_IoAqYX. Lu Hou, Ruiliang Zhang, and James T. Kwok. 2019. Analysis of quantized models. In Proceedings of the International Conference on Learning Representations. Retrieved from https:\/\/openreview.net\/forum?id=ryM_IoAqYX."},{"key":"e_1_2_2_126_1","volume-title":"Mobilenets: Efficient convolutional neural networks for mobile vision applications. arXiv preprint arXiv:1704.04861","author":"Howard Andrew G.","year":"2017","unstructured":"Andrew G. Howard , Menglong Zhu , Bo Chen , Dmitry Kalenichenko , Weijun Wang , Tobias Weyand , Marco Andreetto , and Hartwig Adam . 2017 . Mobilenets: Efficient convolutional neural networks for mobile vision applications. arXiv preprint arXiv:1704.04861 (2017). Andrew G. Howard, Menglong Zhu, Bo Chen, Dmitry Kalenichenko, Weijun Wang, Tobias Weyand, Marco Andreetto, and Hartwig Adam. 2017. Mobilenets: Efficient convolutional neural networks for mobile vision applications. arXiv preprint arXiv:1704.04861 (2017)."},{"key":"e_1_2_2_127_1","volume-title":"Proceedings of the 14th USENIX Symposium on Networked Systems Design and Implementation (NSDI\u201917)","author":"Hsieh Kevin","year":"2017","unstructured":"Kevin Hsieh , Aaron Harlap , Nandita Vijaykumar , Dimitris Konomis , Gregory R. Ganger , Phillip B. Gibbons , and Onur Mutlu . 2017 . Gaia: Geo-distributed machine learning approaching LAN speeds . In Proceedings of the 14th USENIX Symposium on Networked Systems Design and Implementation (NSDI\u201917) . 629--647. Kevin Hsieh, Aaron Harlap, Nandita Vijaykumar, Dimitris Konomis, Gregory R. Ganger, Phillip B. Gibbons, and Onur Mutlu. 2017. Gaia: Geo-distributed machine learning approaching LAN speeds. In Proceedings of the 14th USENIX Symposium on Networked Systems Design and Implementation (NSDI\u201917). 629--647."},{"key":"e_1_2_2_128_1","volume-title":"Monas: Multi-objective neural architecture search using reinforcement learning. arXiv preprint arXiv:1806.10332","author":"Hsu Chi-Hung","year":"2018","unstructured":"Chi-Hung Hsu , Shu-Huan Chang , Jhao-Hong Liang , Hsin-Ping Chou , Chun-Hao Liu , Shih-Chieh Chang , Jia-Yu Pan , Yu-Ting Chen , Wei Wei , and Da-Cheng Juan . 2018 . Monas: Multi-objective neural architecture search using reinforcement learning. arXiv preprint arXiv:1806.10332 (2018). Chi-Hung Hsu, Shu-Huan Chang, Jhao-Hong Liang, Hsin-Ping Chou, Chun-Hao Liu, Shih-Chieh Chang, Jia-Yu Pan, Yu-Ting Chen, Wei Wei, and Da-Cheng Juan. 2018. Monas: Multi-objective neural architecture search using reinforcement learning. arXiv preprint arXiv:1806.10332 (2018)."},{"key":"e_1_2_2_129_1","first-page":"e1327","article-title":"No free lunch theorem for concept drift detection in streaming data classification: A review. Wires data Min","volume":"10","author":"Hu Hanqing","year":"2019","unstructured":"Hanqing Hu , Mehmed Kantardzic , and Tegjyot S. Sethi . 2019 . No free lunch theorem for concept drift detection in streaming data classification: A review. Wires data Min . Knowl. 10 , 2 (2019), e1327 . Hanqing Hu, Mehmed Kantardzic, and Tegjyot S. Sethi. 2019. No free lunch theorem for concept drift detection in streaming data classification: A review. Wires data Min. Knowl. 10, 2 (2019), e1327.","journal-title":"Knowl."},{"key":"e_1_2_2_130_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMC.2010.28"},{"key":"e_1_2_2_131_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201918)","author":"Huang Gao","unstructured":"Gao Huang , Shichen Liu , Laurens Van der Maaten , and Kilian Q. Weinberger . 2018. Condensenet: An efficient densenet using learned group convolutions . In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201918) . 2752--2761. Gao Huang, Shichen Liu, Laurens Van der Maaten, and Kilian Q. Weinberger. 2018. Condensenet: An efficient densenet using learned group convolutions. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201918). 2752--2761."},{"key":"e_1_2_2_132_1","volume-title":"Proceedings of the Annual Conference on Neural Information Processing Systems (NIPS\u201919)","author":"Huang Yanping","year":"2019","unstructured":"Yanping Huang , Youlong Cheng , Ankur Bapna , Orhan Firat , Dehao Chen , Mia Chen , HyoukJoong Lee , Jiquan Ngiam , Quoc V Le , Yonghui Wu , et\u00a0al. 2019 . Gpipe: Efficient training of giant neural networks using pipeline parallelism . In Proceedings of the Annual Conference on Neural Information Processing Systems (NIPS\u201919) . 103--112. Yanping Huang, Youlong Cheng, Ankur Bapna, Orhan Firat, Dehao Chen, Mia Chen, HyoukJoong Lee, Jiquan Ngiam, Quoc V Le, Yonghui Wu, et\u00a0al. 2019. Gpipe: Efficient training of giant neural networks using pipeline parallelism. In Proceedings of the Annual Conference on Neural Information Processing Systems (NIPS\u201919). 103--112."},{"key":"e_1_2_2_133_1","doi-asserted-by":"publisher","DOI":"10.5555\/3122009.3242044"},{"key":"e_1_2_2_134_1","volume-title":"Decoupled parallel backpropagation with convergence guarantee. arXiv preprint arXiv:1804.10574","author":"Huo Zhouyuan","year":"2018","unstructured":"Zhouyuan Huo , Bin Gu , Qian Yang , and Heng Huang . 2018. Decoupled parallel backpropagation with convergence guarantee. arXiv preprint arXiv:1804.10574 ( 2018 ). Zhouyuan Huo, Bin Gu, Qian Yang, and Heng Huang. 2018. Decoupled parallel backpropagation with convergence guarantee. arXiv preprint arXiv:1804.10574 (2018)."},{"key":"e_1_2_2_135_1","volume-title":"Batch normalization: Accelerating deep network training by reducing internal covariate shift. arXiv preprint arXiv:1502.03167","author":"Ioffe Sergey","year":"2015","unstructured":"Sergey Ioffe and Christian Szegedy . 2015. Batch normalization: Accelerating deep network training by reducing internal covariate shift. arXiv preprint arXiv:1502.03167 ( 2015 ). Sergey Ioffe and Christian Szegedy. 2015. Batch normalization: Accelerating deep network training by reducing internal covariate shift. arXiv preprint arXiv:1502.03167 (2015)."},{"key":"e_1_2_2_136_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-32790-2_61"},{"key":"e_1_2_2_137_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSPCS.2011.6140824"},{"key":"e_1_2_2_138_1","unstructured":"Sylvain Jeaugey. 2017. NCCL 2.0. Retrieved from http:\/\/on-demand.gputechconf.com\/gtc\/2017\/presentation\/s7155-jeaugey-nccl.pdf.  Sylvain Jeaugey. 2017. NCCL 2.0. Retrieved from http:\/\/on-demand.gputechconf.com\/gtc\/2017\/presentation\/s7155-jeaugey-nccl.pdf."},{"key":"e_1_2_2_139_1","volume-title":"Multi-objective deployment of data analysis operations in heterogeneous IoT infrastructure","author":"Jha Devki Nandan","year":"2019","unstructured":"Devki Nandan Jha , Peter Michalak , Zhenyu Wen , Paul Watson , and Rajiv Ranjan . 2019. Multi-objective deployment of data analysis operations in heterogeneous IoT infrastructure . IEEE Trans. Industr. Inform . ( 2019 ), 1--1. Devki Nandan Jha, Peter Michalak, Zhenyu Wen, Paul Watson, and Rajiv Ranjan. 2019. Multi-objective deployment of data analysis operations in heterogeneous IoT infrastructure. IEEE Trans. Industr. Inform. (2019), 1--1."},{"key":"e_1_2_2_140_1","volume-title":"Beyond data and model parallelism for deep neural networks. arXiv preprint arXiv:1807.05358","author":"Jia Zhihao","year":"2018","unstructured":"Zhihao Jia , Matei Zaharia , and Alex Aiken . 2018. Beyond data and model parallelism for deep neural networks. arXiv preprint arXiv:1807.05358 ( 2018 ). Zhihao Jia, Matei Zaharia, and Alex Aiken. 2018. Beyond data and model parallelism for deep neural networks. arXiv preprint arXiv:1807.05358 (2018)."},{"key":"e_1_2_2_141_1","volume-title":"6th International Conference on Learning Representations (ICLR'17)","author":"Jin Peter","year":"2018","unstructured":"Peter Jin , Boris Ginsburg , and Kurt Keutzer . 2018 . Spatially parallel convolutions . In 6th International Conference on Learning Representations (ICLR'17) . https:\/\/openreview.net\/forum?id=S1Yt0d1vG. Peter Jin, Boris Ginsburg, and Kurt Keutzer. 2018. Spatially parallel convolutions. In 6th International Conference on Learning Representations (ICLR'17). https:\/\/openreview.net\/forum?id=S1Yt0d1vG."},{"key":"e_1_2_2_142_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2009.5206627"},{"key":"e_1_2_2_143_1","doi-asserted-by":"publisher","DOI":"10.1021\/ac00119a015"},{"key":"e_1_2_2_144_1","volume-title":"Keith Bonawitz, Zachary Charles, Graham Cormode, Rachel Cummings et\u00a0al.","author":"Kairouz Peter","year":"2019","unstructured":"Peter Kairouz , H. Brendan McMahan , Brendan Avent , Aur\u00e9lien Bellet , Mehdi Bennis , Arjun Nitin Bhagoji , Keith Bonawitz, Zachary Charles, Graham Cormode, Rachel Cummings et\u00a0al. 2019 . Advances and open problems in federated learning. arXiv preprint arXiv:1912.04977 (2019). Peter Kairouz, H. Brendan McMahan, Brendan Avent, Aur\u00e9lien Bellet, Mehdi Bennis, Arjun Nitin Bhagoji, Keith Bonawitz, Zachary Charles, Graham Cormode, Rachel Cummings et\u00a0al. 2019. Advances and open problems in federated learning. arXiv preprint arXiv:1912.04977 (2019)."},{"key":"e_1_2_2_145_1","volume-title":"Proceedings of the AAAI Conference on Artificial Intelligence.","author":"Kemker Ronald","year":"2018","unstructured":"Ronald Kemker , Marc McClure , Angelina Abitino , Tyler L. Hayes , and Christopher Kanan . 2018 . Measuring catastrophic forgetting in neural networks . In Proceedings of the AAAI Conference on Artificial Intelligence. Ronald Kemker, Marc McClure, Angelina Abitino, Tyler L. Hayes, and Christopher Kanan. 2018. Measuring catastrophic forgetting in neural networks. In Proceedings of the AAAI Conference on Artificial Intelligence."},{"key":"e_1_2_2_146_1","volume-title":"Nsml: Meet the mlaas platform with a real-world case study. arXiv preprint arXiv:1810","author":"Kim Hanjoo","year":"2018","unstructured":"Hanjoo Kim , Minkyu Kim , Dongjoo Seo , Jinwoong Kim , Heungseok Park , Soeun Park , Hyunwoo Jo , KyungHyun Kim , Youngil Yang , Youngkwan Kim , et\u00a0al. 2018 . Nsml: Meet the mlaas platform with a real-world case study. arXiv preprint arXiv:1810 .09957 (2018). Hanjoo Kim, Minkyu Kim, Dongjoo Seo, Jinwoong Kim, Heungseok Park, Soeun Park, Hyunwoo Jo, KyungHyun Kim, Youngil Yang, Youngkwan Kim, et\u00a0al. 2018. Nsml: Meet the mlaas platform with a real-world case study. arXiv preprint arXiv:1810.09957 (2018)."},{"key":"e_1_2_2_147_1","volume-title":"Proceedings of the European Conference on Computer Systems (EuroSys\u201916)","author":"Kim Jin Kyu","unstructured":"Jin Kyu Kim , Qirong Ho , Seunghak Lee , Xun Zheng , Wei Dai , Garth A. Gibson , and Eric P. Xing . 2016. STRADS: A distributed framework for scheduled model parallel machine learning . In Proceedings of the European Conference on Computer Systems (EuroSys\u201916) . 1--16. Jin Kyu Kim, Qirong Ho, Seunghak Lee, Xun Zheng, Wei Dai, Garth A. Gibson, and Eric P. Xing. 2016. STRADS: A distributed framework for scheduled model parallel machine learning. In Proceedings of the European Conference on Computer Systems (EuroSys\u201916). 1--16."},{"key":"e_1_2_2_148_1","volume-title":"Kingma and Jimmy Ba","author":"Diederik","year":"2014","unstructured":"Diederik P. Kingma and Jimmy Ba . 2014 . Adam : A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014). Diederik P. Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014)."},{"key":"e_1_2_2_149_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10207-016-0335-z"},{"key":"e_1_2_2_150_1","volume-title":"Proceedings of the Annual Conference on Neural Information Processing Systems (NIPS\u201900)","author":"Vijay","unstructured":"Vijay R. Konda and John N. Tsitsiklis. 2000. Actor-critic algorithms . In Proceedings of the Annual Conference on Neural Information Processing Systems (NIPS\u201900) . 1008--1014. Vijay R. Konda and John N. Tsitsiklis. 2000. Actor-critic algorithms. In Proceedings of the Annual Conference on Neural Information Processing Systems (NIPS\u201900). 1008--1014."},{"key":"e_1_2_2_151_1","volume-title":"Federated optimization: Distributed machine learning for on-device intelligence. arXiv preprint arXiv:1610.02527","author":"Kone\u010dn\u1ef3 Jakub","year":"2016","unstructured":"Jakub Kone\u010dn\u1ef3 , H. Brendan McMahan , Daniel Ramage , and Peter Richt\u00e1rik . 2016. Federated optimization: Distributed machine learning for on-device intelligence. arXiv preprint arXiv:1610.02527 ( 2016 ). Jakub Kone\u010dn\u1ef3, H. Brendan McMahan, Daniel Ramage, and Peter Richt\u00e1rik. 2016. Federated optimization: Distributed machine learning for on-device intelligence. arXiv preprint arXiv:1610.02527 (2016)."},{"key":"e_1_2_2_152_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSG.2017.2753802"},{"key":"e_1_2_2_153_1","doi-asserted-by":"publisher","DOI":"10.1109\/IPSN.2008.62"},{"key":"e_1_2_2_154_1","volume-title":"One weird trick for parallelizing convolutional neural networks. arXiv preprint arXiv:1404.5997","author":"Krizhevsky Alex","year":"2014","unstructured":"Alex Krizhevsky . 2014. One weird trick for parallelizing convolutional neural networks. arXiv preprint arXiv:1404.5997 ( 2014 ). Alex Krizhevsky. 2014. One weird trick for parallelizing convolutional neural networks. arXiv preprint arXiv:1404.5997 (2014)."},{"key":"e_1_2_2_155_1","doi-asserted-by":"publisher","DOI":"10.1145\/1247660.1247669"},{"key":"e_1_2_2_156_1","doi-asserted-by":"publisher","DOI":"10.5555\/3063157.3063245"},{"key":"e_1_2_2_157_1","volume-title":"Adversarial machine learning at scale. arXiv preprint arXiv:1611.01236","author":"Kurakin Alexey","year":"2016","unstructured":"Alexey Kurakin , Ian Goodfellow , and Samy Bengio . 2016. Adversarial machine learning at scale. arXiv preprint arXiv:1611.01236 ( 2016 ). Alexey Kurakin, Ian Goodfellow, and Samy Bengio. 2016. Adversarial machine learning at scale. arXiv preprint arXiv:1611.01236 (2016)."},{"key":"e_1_2_2_158_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.inffus.2019.05.004"},{"key":"e_1_2_2_159_1","volume-title":"Speeding-up convolutional neural networks using fine-tuned cp-decomposition. arXiv preprint arXiv:1412.6553","author":"Lebedev Vadim","year":"2014","unstructured":"Vadim Lebedev , Yaroslav Ganin , Maksim Rakhuba , Ivan Oseledets , and Victor Lempitsky . 2014. Speeding-up convolutional neural networks using fine-tuned cp-decomposition. arXiv preprint arXiv:1412.6553 ( 2014 ). Vadim Lebedev, Yaroslav Ganin, Maksim Rakhuba, Ivan Oseledets, and Victor Lempitsky. 2014. Speeding-up convolutional neural networks using fine-tuned cp-decomposition. arXiv preprint arXiv:1412.6553 (2014)."},{"key":"e_1_2_2_160_1","volume-title":"Proceedings of the Annual Conference on Neural Information Processing Systems (NIPS\u201914)","author":"Lee Seunghak","unstructured":"Seunghak Lee , Jin Kyu Kim , Xun Zheng , Qirong Ho , Garth A. Gibson , and Eric P. Xing . 2014. On model parallelization and scheduling strategies for distributed machine learning . In Proceedings of the Annual Conference on Neural Information Processing Systems (NIPS\u201914) . 2834--2842. Seunghak Lee, Jin Kyu Kim, Xun Zheng, Qirong Ho, Garth A. Gibson, and Eric P. Xing. 2014. On model parallelization and scheduling strategies for distributed machine learning. In Proceedings of the Annual Conference on Neural Information Processing Systems (NIPS\u201914). 2834--2842."},{"key":"e_1_2_2_161_1","volume-title":"Proceedings of the International Conference on Machine Learning. 221--229","author":"Li Hongyang","year":"2016","unstructured":"Hongyang Li , Wanli Ouyang , and Xiaogang Wang . 2016 . Multi-bias non-linear activation in deep neural networks . In Proceedings of the International Conference on Machine Learning. 221--229 . Hongyang Li, Wanli Ouyang, and Xiaogang Wang. 2016. Multi-bias non-linear activation in deep neural networks. In Proceedings of the International Conference on Machine Learning. 221--229."},{"key":"e_1_2_2_162_1","doi-asserted-by":"publisher","DOI":"10.1109\/WCNC.2018.8377343"},{"key":"e_1_2_2_163_1","volume-title":"Deep reinforcement learning for dialogue generation. arXiv preprint arXiv:1606.01541","author":"Li Jiwei","year":"2016","unstructured":"Jiwei Li , Will Monroe , Alan Ritter , Michel Galley , Jianfeng Gao , and Dan Jurafsky . 2016. Deep reinforcement learning for dialogue generation. arXiv preprint arXiv:1606.01541 ( 2016 ). Jiwei Li, Will Monroe, Alan Ritter, Michel Galley, Jianfeng Gao, and Dan Jurafsky. 2016. Deep reinforcement learning for dialogue generation. arXiv preprint arXiv:1606.01541 (2016)."},{"key":"e_1_2_2_164_1","doi-asserted-by":"publisher","DOI":"10.1109\/JAS.2016.7508798"},{"key":"e_1_2_2_165_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v33i01.33011544"},{"key":"e_1_2_2_166_1","doi-asserted-by":"publisher","DOI":"10.5555\/2685048.2685095"},{"key":"e_1_2_2_167_1","volume-title":"Proceedings of the Annual Conference on Neural Information Processing Systems (NIPS\u2019","author":"Li Mu","year":"2014","unstructured":"Mu Li , David G. Andersen , Alexander J. Smola , and Kai Yu . 2014 . Communication efficient distributed machine learning with the parameter server . In Proceedings of the Annual Conference on Neural Information Processing Systems (NIPS\u2019 (2014). Mu Li, David G. Andersen, Alexander J. Smola, and Kai Yu. 2014. Communication efficient distributed machine learning with the parameter server. In Proceedings of the Annual Conference on Neural Information Processing Systems (NIPS\u2019 (2014)."},{"key":"e_1_2_2_168_1","doi-asserted-by":"publisher","DOI":"10.1145\/3308897.3308964"},{"key":"e_1_2_2_169_1","doi-asserted-by":"publisher","DOI":"10.1109\/JIOT.2017.2683200"},{"key":"e_1_2_2_170_1","volume-title":"Kumar Kshitij Patel, and Martin Jaggi","author":"Lin Tao","year":"2018","unstructured":"Tao Lin , Sebastian U. Stich , Kumar Kshitij Patel, and Martin Jaggi . 2018 . Don\u2019t use large mini-batches, use local SGD. arXiv preprint arXiv:1808.07217 (2018). Tao Lin, Sebastian U. Stich, Kumar Kshitij Patel, and Martin Jaggi. 2018. Don\u2019t use large mini-batches, use local SGD. arXiv preprint arXiv:1808.07217 (2018)."},{"key":"e_1_2_2_171_1","volume-title":"Dally","author":"Lin Yujun","year":"2017","unstructured":"Yujun Lin , Song Han , Huizi Mao , Yu Wang , and William J . Dally . 2017 . Deep gradient compression: Reducing the communication bandwidth for distributed training. arXiv preprint arXiv:1712.01887 (2017). Yujun Lin, Song Han, Huizi Mao, Yu Wang, and William J. Dally. 2017. Deep gradient compression: Reducing the communication bandwidth for distributed training. arXiv preprint arXiv:1712.01887 (2017)."},{"key":"e_1_2_2_172_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-01246-5_2"},{"key":"e_1_2_2_173_1","volume-title":"Hierarchical representations for efficient architecture search. arXiv preprint arXiv:1711.00436","author":"Liu Hanxiao","year":"2017","unstructured":"Hanxiao Liu , Karen Simonyan , Oriol Vinyals , Chrisantha Fernando , and Koray Kavukcuoglu . 2017. Hierarchical representations for efficient architecture search. arXiv preprint arXiv:1711.00436 ( 2017 ). Hanxiao Liu, Karen Simonyan, Oriol Vinyals, Chrisantha Fernando, and Koray Kavukcuoglu. 2017. Hierarchical representations for efficient architecture search. arXiv preprint arXiv:1711.00436 (2017)."},{"key":"e_1_2_2_174_1","doi-asserted-by":"publisher","DOI":"10.1109\/CCGrid.2014.83"},{"key":"e_1_2_2_175_1","volume-title":"Conditional variational autoencoder for prediction and feature recovery applied to intrusion detection in iot. Sensors 17, 9","author":"Lopez-Martin Manuel","year":"1967","unstructured":"Manuel Lopez-Martin , Belen Carro , Antonio Sanchez-Esguevillas , and Jaime Lloret . 1967. Conditional variational autoencoder for prediction and feature recovery applied to intrusion detection in iot. Sensors 17, 9 ( 1967 ). Manuel Lopez-Martin, Belen Carro, Antonio Sanchez-Esguevillas, and Jaime Lloret. 1967. Conditional variational autoencoder for prediction and feature recovery applied to intrusion detection in iot. Sensors 17, 9 (1967)."},{"key":"e_1_2_2_176_1","doi-asserted-by":"publisher","DOI":"10.5555\/1711875.1711883"},{"key":"e_1_2_2_177_1","volume-title":"Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP\u201915)","author":"Luong Minh-Thang","year":"2015","unstructured":"Minh-Thang Luong , Hieu Pham , and Christopher D. Manning . 2015. Effective approaches to attention-based neural machine translation . In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP\u201915) ( 2015 ). Minh-Thang Luong, Hieu Pham, and Christopher D. Manning. 2015. Effective approaches to attention-based neural machine translation. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP\u201915) (2015)."},{"key":"e_1_2_2_178_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-01264-9_8"},{"key":"e_1_2_2_179_1","volume-title":"MacKay","author":"MacKay David J. C.","year":"2003","unstructured":"David J. C. MacKay and David J. C . MacKay . 2003 . Information Theory, Inference and Learning Algorithms. Cambridge University Press . David J. C. MacKay and David J. C. MacKay. 2003. Information Theory, Inference and Learning Algorithms. Cambridge University Press."},{"key":"e_1_2_2_180_1","doi-asserted-by":"publisher","DOI":"10.1109\/JSAC.2010.101209"},{"key":"e_1_2_2_181_1","doi-asserted-by":"publisher","DOI":"10.1109\/TNET.2009.2034850"},{"key":"e_1_2_2_182_1","doi-asserted-by":"publisher","DOI":"10.1145\/3005745.3005750"},{"key":"e_1_2_2_183_1","doi-asserted-by":"publisher","DOI":"10.1145\/3098822.3098843"},{"key":"e_1_2_2_184_1","volume-title":"Proceedings of the Annual Conference of the IEEE Industrial Electronics Society (IECON\u201910)","author":"A","unstructured":"A Marcano-Cedeno et al. 2010. Feature selection using sequential forward selection and classification applying artificial metaplasticity neural network . In Proceedings of the Annual Conference of the IEEE Industrial Electronics Society (IECON\u201910) . IEEE. A Marcano-Cedeno et al. 2010. Feature selection using sequential forward selection and classification applying artificial metaplasticity neural network. In Proceedings of the Annual Conference of the IEEE Industrial Electronics Society (IECON\u201910). IEEE."},{"key":"e_1_2_2_185_1","volume-title":"Fast training of convolutional networks through ffts. arXiv preprint arXiv:1312.5851","author":"Mathieu Michael","year":"2013","unstructured":"Michael Mathieu , Mikael Henaff , and Yann LeCun . 2013. Fast training of convolutional networks through ffts. arXiv preprint arXiv:1312.5851 ( 2013 ). Michael Mathieu, Mikael Henaff, and Yann LeCun. 2013. Fast training of convolutional networks through ffts. arXiv preprint arXiv:1312.5851 (2013)."},{"key":"e_1_2_2_186_1","volume-title":"Bulk synchronous parallel computing. Abstract Machine Models for Highly Parallel Computers","author":"McColl W. F.","year":"1995","unstructured":"W. F. McColl . 1995. Bulk synchronous parallel computing. Abstract Machine Models for Highly Parallel Computers , Oxford University Press , Oxford ( 1995 ). W. F. McColl. 1995. Bulk synchronous parallel computing. Abstract Machine Models for Highly Parallel Computers, Oxford University Press, Oxford (1995)."},{"key":"e_1_2_2_187_1","volume-title":"Proceedings of the Annual Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT\u201910)","author":"McDonald Ryan","year":"2010","unstructured":"Ryan McDonald , Keith Hall , and Gideon Mann . 2010 . Distributed training strategies for the structured perceptron . In Proceedings of the Annual Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT\u201910) . Association for Computational Linguistics, 456--464. Ryan McDonald, Keith Hall, and Gideon Mann. 2010. Distributed training strategies for the structured perceptron. In Proceedings of the Annual Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT\u201910). Association for Computational Linguistics, 456--464."},{"key":"e_1_2_2_188_1","volume-title":"et\u00a0al","author":"McMahan H. Brendan","year":"2016","unstructured":"H. Brendan McMahan , Eider Moore , Daniel Ramage , Seth Hampson , et\u00a0al . 2016 . Communication-efficient learning of deep networks from decentralized data. arXiv preprint arXiv:1602.05629 (2016). H. Brendan McMahan, Eider Moore, Daniel Ramage, Seth Hampson, et\u00a0al. 2016. Communication-efficient learning of deep networks from decentralized data. arXiv preprint arXiv:1602.05629 (2016)."},{"key":"e_1_2_2_189_1","volume-title":"Proceedings of the International Conference on Learning Representations (ICLR\u201918)","author":"McMahan H. Brendan","year":"2017","unstructured":"H. Brendan McMahan , Daniel Ramage , Kunal Talwar , and Li Zhang . 2017 . Learning differentially private recurrent language models . Proceedings of the International Conference on Learning Representations (ICLR\u201918) . H. Brendan McMahan, Daniel Ramage, Kunal Talwar, and Li Zhang. 2017. Learning differentially private recurrent language models. Proceedings of the International Conference on Learning Representations (ICLR\u201918)."},{"key":"e_1_2_2_190_1","doi-asserted-by":"publisher","DOI":"10.5555\/2946645.2946679"},{"key":"e_1_2_2_191_1","doi-asserted-by":"publisher","DOI":"10.1109\/IGARSS.2015.7326432"},{"key":"e_1_2_2_192_1","volume-title":"Proceedings of the International Parallel and Distributed Processing Symposium (IPDPS\u201917)","author":"El Mhamdi E. M.","year":"2017","unstructured":"E. M. El Mhamdi and R. Guerraoui . 2017. When neurons fail . In Proceedings of the International Parallel and Distributed Processing Symposium (IPDPS\u201917) . 1028--1037. DOI:https:\/\/doi.org\/10.1109\/IPDPS. 2017 .66 10.1109\/IPDPS.2017.66 E. M. El Mhamdi and R. Guerraoui. 2017. When neurons fail. In Proceedings of the International Parallel and Distributed Processing Symposium (IPDPS\u201917). 1028--1037. DOI:https:\/\/doi.org\/10.1109\/IPDPS.2017.66"},{"key":"e_1_2_2_193_1","volume-title":"International Conference on Learning Representations. https:\/\/openreview.net\/forum?id=Hkc-TeZ0W.","author":"Mirhoseini Azalia","year":"2018","unstructured":"Azalia Mirhoseini , Anna Goldie , Hieu Pham , Benoit Steiner , Quoc V. Le , and Jeff Dean . 2018 . A hierarchical model for device placement . In International Conference on Learning Representations. https:\/\/openreview.net\/forum?id=Hkc-TeZ0W. Azalia Mirhoseini, Anna Goldie, Hieu Pham, Benoit Steiner, Quoc V. Le, and Jeff Dean. 2018. A hierarchical model for device placement. In International Conference on Learning Representations. https:\/\/openreview.net\/forum?id=Hkc-TeZ0W."},{"key":"e_1_2_2_194_1","volume-title":"Proceedings of the International Conference of Machine Learning (ICML\u201917)","author":"Mirhoseini Azalia","year":"2017","unstructured":"Azalia Mirhoseini , Hieu Pham , Quoc V. Le , Benoit Steiner , Rasmus Larsen , Yuefeng Zhou , Naveen Kumar , Mohammad Norouzi , Samy Bengio , and Jeff Dean . 2017 . Device placement optimization with reinforcement learning . In Proceedings of the International Conference of Machine Learning (ICML\u201917) . JMLR.org, 2430--2439. Azalia Mirhoseini, Hieu Pham, Quoc V. Le, Benoit Steiner, Rasmus Larsen, Yuefeng Zhou, Naveen Kumar, Mohammad Norouzi, Samy Bengio, and Jeff Dean. 2017. Device placement optimization with reinforcement learning. In Proceedings of the International Conference of Machine Learning (ICML\u201917). JMLR.org, 2430--2439."},{"key":"e_1_2_2_195_1","doi-asserted-by":"publisher","DOI":"10.1145\/319382.319388"},{"key":"e_1_2_2_196_1","volume-title":"Proceedings of the International Conference on Machine Learning (ICML\u201916)","author":"Mnih Volodymyr","year":"2016","unstructured":"Volodymyr Mnih , Adria Puigdomenech Badia , Mehdi Mirza , Alex Graves , Timothy Lillicrap , Tim Harley , David Silver , and Koray Kavukcuoglu . 2016 . Asynchronous methods for deep reinforcement learning . In Proceedings of the International Conference on Machine Learning (ICML\u201916) . 1928--1937. Volodymyr Mnih, Adria Puigdomenech Badia, Mehdi Mirza, Alex Graves, Timothy Lillicrap, Tim Harley, David Silver, and Koray Kavukcuoglu. 2016. Asynchronous methods for deep reinforcement learning. In Proceedings of the International Conference on Machine Learning (ICML\u201916). 1928--1937."},{"key":"e_1_2_2_197_1","doi-asserted-by":"publisher","DOI":"10.1109\/COMST.2018.2844341"},{"key":"e_1_2_2_198_1","volume-title":"Proceedings of the Conference on Artificial Intelligence and Statistics. 249--258","author":"Moritz Philipp","year":"2016","unstructured":"Philipp Moritz , Robert Nishihara , and Michael Jordan . 2016 . A linearly convergent stochastic L-BFGS algorithm . In Proceedings of the Conference on Artificial Intelligence and Statistics. 249--258 . Philipp Moritz, Robert Nishihara, and Michael Jordan. 2016. A linearly convergent stochastic L-BFGS algorithm. In Proceedings of the Conference on Artificial Intelligence and Statistics. 249--258."},{"key":"e_1_2_2_199_1","volume-title":"Proceedings of the 13th USENIX Symposium on Operating Systems Design and Implementation (OSDI\u201918)","author":"Moritz Philipp","year":"2018","unstructured":"Philipp Moritz , Robert Nishihara , Stephanie Wang , Alexey Tumanov , Richard Liaw , Eric Liang , Melih Elibol , Zongheng Yang , William Paul , Michael I. Jordan , et\u00a0al. 2018 . Ray: A distributed framework for emerging AI applications . In Proceedings of the 13th USENIX Symposium on Operating Systems Design and Implementation (OSDI\u201918) . 561--577. Philipp Moritz, Robert Nishihara, Stephanie Wang, Alexey Tumanov, Richard Liaw, Eric Liang, Melih Elibol, Zongheng Yang, William Paul, Michael I. Jordan, et\u00a0al. 2018. Ray: A distributed framework for emerging AI applications. In Proceedings of the 13th USENIX Symposium on Operating Systems Design and Implementation (OSDI\u201918). 561--577."},{"key":"e_1_2_2_200_1","volume-title":"Md Golam Rabiul Alam, Do Hyeon Kim, and Choong Seon Hong.","author":"Munir Md Shirajum","year":"2017","unstructured":"Md Shirajum Munir , Sarder Fakhrul Abedin , Md Golam Rabiul Alam, Do Hyeon Kim, and Choong Seon Hong. 2017 . RNN-based energy demand prediction for smart-home in smart-grid framework. Journal of Korean Information Science Society ( 2017), 437--439. Md Shirajum Munir, Sarder Fakhrul Abedin, Md Golam Rabiul Alam, Do Hyeon Kim, and Choong Seon Hong. 2017. RNN-based energy demand prediction for smart-home in smart-grid framework. Journal of Korean Information Science Society (2017), 437--439."},{"key":"e_1_2_2_201_1","volume-title":"Kerstin Bach, and Gavin Taylor.","author":"Murad Abdulmajid","year":"2019","unstructured":"Abdulmajid Murad , Frank Alexander Kraemer , Kerstin Bach, and Gavin Taylor. 2019 . Autonomous management of energy-harvesting IoT nodes using deep reinforcement learning. arXiv:1905.04181 (2019). Abdulmajid Murad, Frank Alexander Kraemer, Kerstin Bach, and Gavin Taylor. 2019. Autonomous management of energy-harvesting IoT nodes using deep reinforcement learning. arXiv:1905.04181 (2019)."},{"key":"e_1_2_2_202_1","volume-title":"Deep double descent: Where bigger models and more data hurt. arXiv preprint arXiv:1912.02292","author":"Nakkiran Preetum","year":"2019","unstructured":"Preetum Nakkiran , Gal Kaplun , Yamini Bansal , Tristan Yang , Boaz Barak , and Ilya Sutskever . 2019. Deep double descent: Where bigger models and more data hurt. arXiv preprint arXiv:1912.02292 ( 2019 ). Preetum Nakkiran, Gal Kaplun, Yamini Bansal, Tristan Yang, Boaz Barak, and Ilya Sutskever. 2019. Deep double descent: Where bigger models and more data hurt. arXiv preprint arXiv:1912.02292 (2019)."},{"key":"e_1_2_2_203_1","volume-title":"Proceedings of the Future Technologies Conference (FTC\u201916)","author":"Naraei P.","unstructured":"P. Naraei , A. Abhari , and A. Sadeghian . 2016. Application of multilayer perceptron neural networks and support vector machines in classification of healthcare data . In Proceedings of the Future Technologies Conference (FTC\u201916) . 848--852. P. Naraei, A. Abhari, and A. Sadeghian. 2016. Application of multilayer perceptron neural networks and support vector machines in classification of healthcare data. In Proceedings of the Future Technologies Conference (FTC\u201916). 848--852."},{"key":"e_1_2_2_204_1","first-page":"1293","article-title":"Query strategies for evading convex-inducing classifiers","author":"Nelson Blaine","year":"2012","unstructured":"Blaine Nelson , Benjamin I. P. Rubinstein , Ling Huang , Anthony D. Joseph , Steven J. Lee , Satish Rao , and J. D. Tygar . 2012 . Query strategies for evading convex-inducing classifiers . J. Mach. Learn. Res. 13 , May (2012), 1293 -- 1332 . Blaine Nelson, Benjamin I. P. Rubinstein, Ling Huang, Anthony D. Joseph, Steven J. Lee, Satish Rao, and J. D. Tygar. 2012. Query strategies for evading convex-inducing classifiers. J. Mach. Learn. Res. 13, May (2012), 1293--1332.","journal-title":"J. Mach. Learn. Res. 13"},{"key":"e_1_2_2_205_1","doi-asserted-by":"publisher","DOI":"10.3390\/s18051308"},{"key":"e_1_2_2_206_1","volume-title":"Second-order optimization method for large mini-batch: Training resnet-50 on imagenet in 35 epochs. arXiv preprint:1811.12019","author":"Osawa Kazuki","year":"2018","unstructured":"Kazuki Osawa , Yohei Tsuji , Yuichiro Ueno , Akira Naruse , Rio Yokota , and Satoshi Matsuoka . 2018. Second-order optimization method for large mini-batch: Training resnet-50 on imagenet in 35 epochs. arXiv preprint:1811.12019 ( 2018 ). Kazuki Osawa, Yohei Tsuji, Yuichiro Ueno, Akira Naruse, Rio Yokota, and Satoshi Matsuoka. 2018. Second-order optimization method for large mini-batch: Training resnet-50 on imagenet in 35 epochs. arXiv preprint:1811.12019 (2018)."},{"key":"e_1_2_2_207_1","volume-title":"Proceedings of the Annual Conference on Neural Information Processing Systems (NIPS\u201916)","author":"Pan Xinghao","year":"2016","unstructured":"Xinghao Pan , Maximilian Lam , Stephen Tu , Dimitris Papailiopoulos , Ce Zhang , Michael I. Jordan , Kannan Ramchandran , and Christopher Re . 2016 . Cyclades: Conflict-free asynchronous machine learning . In Proceedings of the Annual Conference on Neural Information Processing Systems (NIPS\u201916) . 2568--2576. Xinghao Pan, Maximilian Lam, Stephen Tu, Dimitris Papailiopoulos, Ce Zhang, Michael I. Jordan, Kannan Ramchandran, and Christopher Re. 2016. Cyclades: Conflict-free asynchronous machine learning. In Proceedings of the Annual Conference on Neural Information Processing Systems (NIPS\u201916). 2568--2576."},{"key":"e_1_2_2_208_1","doi-asserted-by":"publisher","DOI":"10.1145\/3052973.3053009"},{"key":"e_1_2_2_209_1","doi-asserted-by":"publisher","DOI":"10.1109\/EuroSP.2016.36"},{"key":"e_1_2_2_210_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neunet.2019.01.012"},{"key":"e_1_2_2_211_1","volume-title":"Proceedings of the Annual Conference on Neural Information Processing Systems (NIPS\u201998)","author":"Parr Ronald","unstructured":"Ronald Parr and Stuart J. Russell . 1998. Reinforcement learning with hierarchies of machines . In Proceedings of the Annual Conference on Neural Information Processing Systems (NIPS\u201998) . Ronald Parr and Stuart J. Russell. 1998. Reinforcement learning with hierarchies of machines. In Proceedings of the Annual Conference on Neural Information Processing Systems (NIPS\u201998)."},{"key":"e_1_2_2_212_1","doi-asserted-by":"publisher","DOI":"10.1145\/3240765.3240783"},{"key":"e_1_2_2_213_1","doi-asserted-by":"publisher","DOI":"10.1109\/72.286892"},{"key":"e_1_2_2_214_1","volume-title":"Efficient neural architecture search via parameter sharing. arXiv preprint arXiv:1802.03268","author":"Pham Hieu","year":"2018","unstructured":"Hieu Pham , Melody Y. Guan , Barret Zoph , Quoc V. Le , and Jeff Dean . 2018. Efficient neural architecture search via parameter sharing. arXiv preprint arXiv:1802.03268 ( 2018 ). Hieu Pham, Melody Y. Guan, Barret Zoph, Quoc V. Le, and Jeff Dean. 2018. Efficient neural architecture search via parameter sharing. arXiv preprint arXiv:1802.03268 (2018)."},{"key":"e_1_2_2_215_1","doi-asserted-by":"publisher","DOI":"10.1109\/BigData.2016.7840877"},{"key":"e_1_2_2_216_1","volume-title":"Proceedings of the International Conference on Learning Representations (ICLR\u201919)","author":"Povey Daniel","year":"2017","unstructured":"Daniel Povey , Xioahui Zhang , and Sanjeev Khudanpur . 2017 . Parallel training of DNNs with Natural Gradient and Parameter Averaging . Proceedings of the International Conference on Learning Representations (ICLR\u201919) 2015. Daniel Povey, Xioahui Zhang, and Sanjeev Khudanpur. 2017. Parallel training of DNNs with Natural Gradient and Parameter Averaging. Proceedings of the International Conference on Learning Representations (ICLR\u201919) 2015."},{"key":"e_1_2_2_217_1","doi-asserted-by":"publisher","DOI":"10.1109\/72.238315"},{"key":"e_1_2_2_218_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0893-6080(98)00116-6"},{"key":"e_1_2_2_219_1","volume-title":"Xing","author":"Qiao Aurick","year":"2018","unstructured":"Aurick Qiao , Bryon Aragam , Bingjing Zhang , and Eric P . Xing . 2018 . Fault tolerance in iterative-convergent machine learning. arXiv preprint arXiv:1810.07354 (2018). Aurick Qiao, Bryon Aragam, Bingjing Zhang, and Eric P. Xing. 2018. Fault tolerance in iterative-convergent machine learning. arXiv preprint arXiv:1810.07354 (2018)."},{"key":"e_1_2_2_220_1","doi-asserted-by":"publisher","DOI":"10.1038\/ng1032"},{"key":"e_1_2_2_221_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA.2018.8461039"},{"key":"e_1_2_2_222_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF00116251"},{"key":"e_1_2_2_223_1","volume-title":"5: Programs for Machine Learning","author":"Quinlan J. Ross","unstructured":"J. Ross Quinlan . 2014. C4. 5: Programs for Machine Learning . Elsevier . J. Ross Quinlan. 2014. C4. 5: Programs for Machine Learning. Elsevier."},{"key":"e_1_2_2_224_1","volume-title":"Proceedings of the 26th Annual International Conference on machime Learning (ICML\u201909)","author":"Raina Rajat","unstructured":"Rajat Raina , Anand Madhavan , and Andrew Y. Ng . 2009. Large-scale deep unsupervised learning using graphics processors . In Proceedings of the 26th Annual International Conference on machime Learning (ICML\u201909) . ACM. Rajat Raina, Anand Madhavan, and Andrew Y. Ng. 2009. Large-scale deep unsupervised learning using graphics processors. In Proceedings of the 26th Annual International Conference on machime Learning (ICML\u201909). ACM."},{"key":"e_1_2_2_225_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICMLA.2018.00035"},{"key":"e_1_2_2_226_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.1975.6312842"},{"key":"e_1_2_2_227_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-46493-0_32"},{"key":"e_1_2_2_228_1","volume-title":"Proceedings of the AAAI Conference on Artificial Intelligence.","author":"Real Esteban","unstructured":"Esteban Real , Alok Aggarwal , Yanping Huang , and Quoc V. Le . 2019. Regularized evolution for image classifier architecture search . In Proceedings of the AAAI Conference on Artificial Intelligence. Esteban Real, Alok Aggarwal, Yanping Huang, and Quoc V. Le. 2019. Regularized evolution for image classifier architecture search. In Proceedings of the AAAI Conference on Artificial Intelligence."},{"key":"e_1_2_2_229_1","volume-title":"Proceedings of the Annual Conference on Neural Information Processing Systems (NIPS\u201911)","author":"Recht Benjamin","year":"2011","unstructured":"Benjamin Recht , Christopher Re , Stephen Wright , and Feng Niu . 2011 . Hogwild: A lock-free approach to parallelizing stochastic gradient descent . In Proceedings of the Annual Conference on Neural Information Processing Systems (NIPS\u201911) . 693--701. Benjamin Recht, Christopher Re, Stephen Wright, and Feng Niu. 2011. Hogwild: A lock-free approach to parallelizing stochastic gradient descent. In Proceedings of the Annual Conference on Neural Information Processing Systems (NIPS\u201911). 693--701."},{"key":"e_1_2_2_230_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-01240-3_42"},{"key":"e_1_2_2_231_1","doi-asserted-by":"publisher","DOI":"10.5555\/2011216.2011217"},{"key":"e_1_2_2_232_1","doi-asserted-by":"publisher","DOI":"10.1145\/3303849"},{"key":"e_1_2_2_233_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.comnet.2012.12.018"},{"key":"e_1_2_2_234_1","volume-title":"Antoine Chassang, Carlo Gatta, and Yoshua Bengio.","author":"Romero Adriana","year":"2014","unstructured":"Adriana Romero , Nicolas Ballas , Samira Ebrahimi Kahou , Antoine Chassang, Carlo Gatta, and Yoshua Bengio. 2014 . Fitnets : Hints for thin deep nets. arXiv preprint arXiv:1412.6550 (2014). Adriana Romero, Nicolas Ballas, Samira Ebrahimi Kahou, Antoine Chassang, Carlo Gatta, and Yoshua Bengio. 2014. Fitnets: Hints for thin deep nets. arXiv preprint arXiv:1412.6550 (2014)."},{"key":"e_1_2_2_235_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSG.2016.2517211"},{"key":"e_1_2_2_236_1","doi-asserted-by":"publisher","DOI":"10.1109\/TGRS.2013.2294398"},{"key":"e_1_2_2_237_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00474"},{"key":"e_1_2_2_238_1","volume-title":"Proximal policy optimization algorithms. arXiv preprint arXiv:1707.06347","author":"Schulman John","year":"2017","unstructured":"John Schulman , Filip Wolski , Prafulla Dhariwal , Alec Radford , and Oleg Klimov . 2017. Proximal policy optimization algorithms. arXiv preprint arXiv:1707.06347 ( 2017 ). John Schulman, Filip Wolski, Prafulla Dhariwal, Alec Radford, and Oleg Klimov. 2017. Proximal policy optimization algorithms. arXiv preprint arXiv:1707.06347 (2017)."},{"key":"e_1_2_2_239_1","doi-asserted-by":"publisher","DOI":"10.21437\/Interspeech.2014-274"},{"key":"e_1_2_2_240_1","volume-title":"Horovod: Fast and easy distributed deep learning in TensorFlow. arXiv preprint arXiv:1802.05799","author":"Sergeev Alexander","year":"2018","unstructured":"Alexander Sergeev and Mike Del Balso . 2018 . Horovod: Fast and easy distributed deep learning in TensorFlow. arXiv preprint arXiv:1802.05799 (2018). Alexander Sergeev and Mike Del Balso. 2018. Horovod: Fast and easy distributed deep learning in TensorFlow. arXiv preprint arXiv:1802.05799 (2018)."},{"key":"e_1_2_2_241_1","doi-asserted-by":"publisher","DOI":"10.2200\/S00429ED1V01Y201207AIM018"},{"key":"e_1_2_2_242_1","volume-title":"Proceedings of the Annual Conference on Neural Information Processing Systems (NIPS\u201918)","author":"Shafahi Ali","year":"2018","unstructured":"Ali Shafahi , W. Ronny Huang , Mahyar Najibi , Octavian Suciu , Christoph Studer , Tudor Dumitras , and Tom Goldstein . 2018 . Poison frogs! Targeted clean-label poisoning attacks on neural networks . In Proceedings of the Annual Conference on Neural Information Processing Systems (NIPS\u201918) . Ali Shafahi, W. Ronny Huang, Mahyar Najibi, Octavian Suciu, Christoph Studer, Tudor Dumitras, and Tom Goldstein. 2018. Poison frogs! Targeted clean-label poisoning attacks on neural networks. In Proceedings of the Annual Conference on Neural Information Processing Systems (NIPS\u201918)."},{"key":"e_1_2_2_243_1","volume-title":"Proceedings of the International Conference on Machine Learning (ICML\u201916)","author":"Shang Wenling","year":"2016","unstructured":"Wenling Shang , Kihyuk Sohn , Diogo Almeida , and Honglak Lee . 2016 . Understanding and improving convolutional neural networks via concatenated rectified linear units . In Proceedings of the International Conference on Machine Learning (ICML\u201916) . 2217--2225. Wenling Shang, Kihyuk Sohn, Diogo Almeida, and Honglak Lee. 2016. Understanding and improving convolutional neural networks via concatenated rectified linear units. In Proceedings of the International Conference on Machine Learning (ICML\u201916). 2217--2225."},{"key":"e_1_2_2_244_1","volume-title":"Proceedings of the International Conference on Neural Information Processing Systems.","author":"Shazeer Noam","year":"2018","unstructured":"Noam Shazeer , Youlong Cheng , Niki Parmar , Dustin Tran , Ashish Vaswani , Penporn Koanantakool , Peter Hawkins , HyoukJoong Lee , Mingsheng Hong , Cliff Young , Ryan Sepassi , and Blake Hechtman . 2018 . Mesh-TensorFlow: Deep learning for supercomputers . In Proceedings of the International Conference on Neural Information Processing Systems. Noam Shazeer, Youlong Cheng, Niki Parmar, Dustin Tran, Ashish Vaswani, Penporn Koanantakool, Peter Hawkins, HyoukJoong Lee, Mingsheng Hong, Cliff Young, Ryan Sepassi, and Blake Hechtman. 2018. Mesh-TensorFlow: Deep learning for supercomputers. In Proceedings of the International Conference on Neural Information Processing Systems."},{"key":"e_1_2_2_245_1","doi-asserted-by":"publisher","DOI":"10.1109\/JIOT.2016.2579198"},{"key":"e_1_2_2_246_1","volume-title":"A tutorial on principal component analysis. arXiv preprint arXiv:1404.1100","author":"Shlens Jonathon","year":"2014","unstructured":"Jonathon Shlens . 2014. A tutorial on principal component analysis. arXiv preprint arXiv:1404.1100 ( 2014 ). Jonathon Shlens. 2014. A tutorial on principal component analysis. arXiv preprint arXiv:1404.1100 (2014)."},{"key":"e_1_2_2_247_1","doi-asserted-by":"publisher","DOI":"10.1109\/SP.2017.41"},{"key":"e_1_2_2_248_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.proeng.2017.09.594"},{"key":"e_1_2_2_249_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.comnet.2014.11.008"},{"key":"e_1_2_2_250_1","volume-title":"Rigid-motion scattering for image classification. Ph. D. Dissertation. Ecole Normale Superieure","author":"Sifre Laurent","unstructured":"Laurent Sifre and St\u00e9phane Mallat . 2014. Rigid-motion scattering for image classification. Ph. D. Dissertation. Ecole Normale Superieure , Paris, France . Laurent Sifre and St\u00e9phane Mallat. 2014. Rigid-motion scattering for image classification. Ph. D. Dissertation. Ecole Normale Superieure, Paris, France."},{"key":"e_1_2_2_251_1","volume-title":"Proceedings of the 26th USENIX Security Symposium. 397--414","author":"Sikder Amit Kumar","unstructured":"Amit Kumar Sikder , Hidayet Aksu , and A. Selcuk Uluagac . 2017. 6thsense: A context-aware sensor-based attack detector for smart devices . In Proceedings of the 26th USENIX Security Symposium. 397--414 . Amit Kumar Sikder, Hidayet Aksu, and A. Selcuk Uluagac. 2017. 6thsense: A context-aware sensor-based attack detector for smart devices. In Proceedings of the 26th USENIX Security Symposium. 397--414."},{"key":"e_1_2_2_252_1","doi-asserted-by":"publisher","DOI":"10.1109\/MCE.2016.2640718"},{"key":"e_1_2_2_253_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10723-015-9359-2"},{"key":"e_1_2_2_254_1","doi-asserted-by":"publisher","DOI":"10.5555\/1867135.1867167"},{"key":"e_1_2_2_255_1","volume-title":"Le","author":"Smith Samuel L.","year":"2017","unstructured":"Samuel L. Smith , Pieter-Jan Kindermans , Chris Ying , and Quoc V . Le . 2017 . Don\u2019t de cay the learning rate, increase the batch size. arXiv preprint arXiv:1711.00489 (2017). Samuel L. Smith, Pieter-Jan Kindermans, Chris Ying, and Quoc V. Le. 2017. Don\u2019t decay the learning rate, increase the batch size. arXiv preprint arXiv:1711.00489 (2017)."},{"key":"e_1_2_2_256_1","doi-asserted-by":"publisher","DOI":"10.1145\/2806777.2806945"},{"key":"e_1_2_2_257_1","doi-asserted-by":"publisher","DOI":"10.5555\/2627435.2670313"},{"key":"e_1_2_2_258_1","volume-title":"Proceedings of the Annual Conference on Neural Information Processing Systems (NIPS\u2019","author":"Steinhardt Jacob","year":"2017","unstructured":"Jacob Steinhardt , Pang Wei W. Koh , and Percy S. Liang . 2017. Certified defenses for data poisoning attacks . In Proceedings of the Annual Conference on Neural Information Processing Systems (NIPS\u2019 ( 2017 ). 3517--3529. Jacob Steinhardt, Pang Wei W. Koh, and Percy S. Liang. 2017. Certified defenses for data poisoning attacks. In Proceedings of the Annual Conference on Neural Information Processing Systems (NIPS\u2019 (2017). 3517--3529."},{"key":"e_1_2_2_259_1","volume-title":"Proceedings of the International Conference on Learning Representations (ICLR\u201919)","author":"Stich Sebastian Urban","year":"2019","unstructured":"Sebastian Urban Stich . 2019 . Local SGD converges fast and communicates little . In Proceedings of the International Conference on Learning Representations (ICLR\u201919) . Sebastian Urban Stich. 2019. Local SGD converges fast and communicates little. In Proceedings of the International Conference on Learning Representations (ICLR\u201919)."},{"key":"e_1_2_2_260_1","volume-title":"David Patterson, Michael W. Mahoney, Randy Katz, Anthony D. Joseph, Michael Jordan, Joseph M. Hellerstein, Joseph E. Gonzalez, et\u00a0al.","author":"Stoica Ion","year":"2017","unstructured":"Ion Stoica , Dawn Song , Raluca Ada Popa , David Patterson, Michael W. Mahoney, Randy Katz, Anthony D. Joseph, Michael Jordan, Joseph M. Hellerstein, Joseph E. Gonzalez, et\u00a0al. 2017 . A Berkeley view of systems challenges for ai. arXiv preprint arXiv:1712.05855 (2017). Ion Stoica, Dawn Song, Raluca Ada Popa, David Patterson, Michael W. Mahoney, Randy Katz, Anthony D. Joseph, Michael Jordan, Joseph M. Hellerstein, Joseph E. Gonzalez, et\u00a0al. 2017. A Berkeley view of systems challenges for ai. arXiv preprint arXiv:1712.05855 (2017)."},{"key":"e_1_2_2_261_1","doi-asserted-by":"publisher","DOI":"10.21437\/Interspeech.2015-354"},{"key":"e_1_2_2_262_1","volume-title":"Proceedings of the USENIX Security Symposium (USENIXSecurity\u201918)","author":"Suciu Octavian","year":"2018","unstructured":"Octavian Suciu , Radu Marginean , Yigitcan Kaya , Hal Daume III, and Tudor Dumitras . 2018 . When does machine learning FAIL? Generalized transferability for evasion and poisoning attacks . In Proceedings of the USENIX Security Symposium (USENIXSecurity\u201918) . 1299--1316. Octavian Suciu, Radu Marginean, Yigitcan Kaya, Hal Daume III, and Tudor Dumitras. 2018. When does machine learning FAIL? Generalized transferability for evasion and poisoning attacks. In Proceedings of the USENIX Security Symposium (USENIXSecurity\u201918). 1299--1316."},{"key":"e_1_2_2_263_1","doi-asserted-by":"publisher","DOI":"10.1145\/2668332.2668351"},{"key":"e_1_2_2_264_1","volume-title":"Proceedings of the International Conference on Computer Vision (ICCV\u201917)","author":"Deva Ramanan James","year":"2017","unstructured":"James Supancic III and Deva Ramanan . 2017 . Tracking as online decision-making: Learning a policy from streaming videos with reinforcement learning . In Proceedings of the International Conference on Computer Vision (ICCV\u201917) . 322--331. James Supancic III and Deva Ramanan. 2017. Tracking as online decision-making: Learning a policy from streaming videos with reinforcement learning. In Proceedings of the International Conference on Computer Vision (ICCV\u201917). 322--331."},{"key":"e_1_2_2_265_1","volume-title":"Barto","author":"Sutton Richard S.","year":"2018","unstructured":"Richard S. Sutton and Andrew G . Barto . 2018 . Reinforcement Learning : An Introduction. MIT Press . Richard S. Sutton and Andrew G. Barto. 2018. Reinforcement Learning: An Introduction. MIT Press."},{"key":"e_1_2_2_266_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-01424-7_27"},{"key":"e_1_2_2_267_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201919)","author":"Tan Mingxing","unstructured":"Mingxing Tan , Bo Chen , Ruoming Pang , Vijay Vasudevan , Mark Sandler , Andrew Howard , and Quoc V. Le . 2019. Mnasnet: Platform-aware neural architecture search for mobile . In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201919) . Mingxing Tan, Bo Chen, Ruoming Pang, Vijay Vasudevan, Mark Sandler, Andrew Howard, and Quoc V. Le. 2019. Mnasnet: Platform-aware neural architecture search for mobile. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201919)."},{"key":"e_1_2_2_268_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICIP.2019.8803654"},{"key":"e_1_2_2_269_1","unstructured":"TensorFlow. 2019. High performance inference with TensorRT Integration. Retrieved from https:\/\/medium.com\/tensorflow\/high-performance-inference-with-tensorrt-integration-c4d78795fbfe.  TensorFlow. 2019. High performance inference with TensorRT Integration. Retrieved from https:\/\/medium.com\/tensorflow\/high-performance-inference-with-tensorrt-integration-c4d78795fbfe."},{"key":"e_1_2_2_270_1","volume-title":"Proceedings of the Annual Conference on Neural Information Processing Systems (NIPS\u201995)","author":"Thrun Sebastian","year":"1995","unstructured":"Sebastian Thrun and Anton Schwartz . 1995 . Finding structure in reinforcement learning . In Proceedings of the Annual Conference on Neural Information Processing Systems (NIPS\u201995) . Sebastian Thrun and Anton Schwartz. 1995. Finding structure in reinforcement learning. In Proceedings of the Annual Conference on Neural Information Processing Systems (NIPS\u201995)."},{"key":"e_1_2_2_271_1","doi-asserted-by":"publisher","DOI":"10.3758\/BF03213026"},{"key":"e_1_2_2_272_1","doi-asserted-by":"publisher","DOI":"10.5555\/3241094.3241142"},{"key":"e_1_2_2_273_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2017.2778011"},{"key":"e_1_2_2_274_1","doi-asserted-by":"publisher","DOI":"10.1109\/SPED.2015.7343100"},{"key":"e_1_2_2_275_1","doi-asserted-by":"publisher","DOI":"10.1145\/800057.808710"},{"key":"e_1_2_2_276_1","volume-title":"Proceedings of the Deep Learning and Unsupervised Feature Learning Workshop (NIPS'11)","author":"Vanhoucke Vincent","unstructured":"Vincent Vanhoucke , Andrew Senior , and Mark Z. Mao . 2011. Improving the speed of neural networks on CPUs . In Proceedings of the Deep Learning and Unsupervised Feature Learning Workshop (NIPS'11) . Vincent Vanhoucke, Andrew Senior, and Mark Z. Mao. 2011. Improving the speed of neural networks on CPUs. In Proceedings of the Deep Learning and Unsupervised Feature Learning Workshop (NIPS'11)."},{"key":"e_1_2_2_277_1","volume-title":"Meta-learning: A survey. arXiv preprint arXiv:1810.03548","author":"Vanschoren Joaquin","year":"2018","unstructured":"Joaquin Vanschoren . 2018 . Meta-learning: A survey. arXiv preprint arXiv:1810.03548 (2018). Joaquin Vanschoren. 2018. Meta-learning: A survey. arXiv preprint arXiv:1810.03548 (2018)."},{"key":"e_1_2_2_278_1","volume-title":"Translating videos to natural language using deep recurrent neural networks. arXiv preprint arXiv:1412.4729","author":"Venugopalan Subhashini","year":"2014","unstructured":"Subhashini Venugopalan , Huijuan Xu , Jeff Donahue , Marcus Rohrbach , Raymond Mooney , and Kate Saenko . 2014. Translating videos to natural language using deep recurrent neural networks. arXiv preprint arXiv:1412.4729 ( 2014 ). Subhashini Venugopalan, Huijuan Xu, Jeff Donahue, Marcus Rohrbach, Raymond Mooney, and Kate Saenko. 2014. Translating videos to natural language using deep recurrent neural networks. arXiv preprint arXiv:1412.4729 (2014)."},{"key":"e_1_2_2_279_1","volume-title":"Proceedings of the Annual Conference on Neural Information Processing Systems (NIPS\u201918)","author":"Volpi Riccardo","year":"2018","unstructured":"Riccardo Volpi , Hongseok Namkoong , Ozan Sener , John C. Duchi , Vittorio Murino , and Silvio Savarese . 2018 . Generalizing to unseen domains via adversarial data augmentation . In Proceedings of the Annual Conference on Neural Information Processing Systems (NIPS\u201918) . 5334--5344. Riccardo Volpi, Hongseok Namkoong, Ozan Sener, John C. Duchi, Vittorio Murino, and Silvio Savarese. 2018. Generalizing to unseen domains via adversarial data augmentation. In Proceedings of the Annual Conference on Neural Information Processing Systems (NIPS\u201918). 5334--5344."},{"key":"e_1_2_2_280_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2010.02.102"},{"key":"e_1_2_2_281_1","unstructured":"Jason Wang and Luis Perez. 2017. The effectiveness of data augmentation in image classification using deep learning. arXiv preprint arXiv:1712.04621.  Jason Wang and Luis Perez. 2017. The effectiveness of data augmentation in image classification using deep learning. arXiv preprint arXiv:1712.04621."},{"key":"e_1_2_2_282_1","doi-asserted-by":"publisher","DOI":"10.1145\/1899412.1899414"},{"key":"e_1_2_2_283_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSC.2007.14"},{"key":"e_1_2_2_284_1","doi-asserted-by":"publisher","DOI":"10.1145\/3302424.3303953"},{"key":"e_1_2_2_285_1","doi-asserted-by":"publisher","DOI":"10.1109\/INFOCOM.2018.8486403"},{"key":"e_1_2_2_286_1","doi-asserted-by":"publisher","DOI":"10.1145\/3054177"},{"key":"e_1_2_2_287_1","volume-title":"Proceedings of the ACM Symposium on Cloud Computing (SoCC\u201915)","author":"Wei Jinliang","unstructured":"Jinliang Wei , Wei Dai , Aurick Qiao , Qirong Ho , Henggang Cui , Gregory R. Ganger , Phillip B. Gibbons , Garth A. Gibson , and Eric P. Xing . 2015. Managed communication and consistency for fast data-parallel iterative analytics . In Proceedings of the ACM Symposium on Cloud Computing (SoCC\u201915) . ACM, 381--394. Jinliang Wei, Wei Dai, Aurick Qiao, Qirong Ho, Henggang Cui, Gregory R. Ganger, Phillip B. Gibbons, Garth A. Gibson, and Eric P. Xing. 2015. Managed communication and consistency for fast data-parallel iterative analytics. In Proceedings of the ACM Symposium on Cloud Computing (SoCC\u201915). ACM, 381--394."},{"key":"e_1_2_2_288_1","volume-title":"Proceedings of the Annual Conference on Neural Information Processing Systems (NIPS\u201917)","author":"Wen Wei","year":"2017","unstructured":"Wei Wen , Cong Xu , Feng Yan , Chunpeng Wu , Yandan Wang , Yiran Chen , and Hai Li . 2017 . Terngrad: Ternary gradients to reduce communication in distributed deep learning . In Proceedings of the Annual Conference on Neural Information Processing Systems (NIPS\u201917) . 1509--1519. Wei Wen, Cong Xu, Feng Yan, Chunpeng Wu, Yandan Wang, Yiran Chen, and Hai Li. 2017. Terngrad: Ternary gradients to reduce communication in distributed deep learning. In Proceedings of the Annual Conference on Neural Information Processing Systems (NIPS\u201917). 1509--1519."},{"key":"e_1_2_2_289_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDCS.2018.00048"},{"key":"e_1_2_2_290_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSG.2015.2396993"},{"key":"e_1_2_2_291_1","doi-asserted-by":"publisher","DOI":"10.1109\/MIC.2017.36"},{"key":"e_1_2_2_292_1","volume-title":"International Conference on Learning Representations.","author":"Wu Shuang","year":"2018","unstructured":"Shuang Wu , Guoqi Li , Feng Chen , and Luping Shi . 2018 . Training and inference with integers in deep neural networks . In International Conference on Learning Representations. Shuang Wu, Guoqi Li, Feng Chen, and Luping Shi. 2018. Training and inference with integers in deep neural networks. In International Conference on Learning Representations."},{"key":"e_1_2_2_293_1","volume-title":"et\u00a0al","author":"Wu Yonghui","year":"2016","unstructured":"Yonghui Wu , Mike Schuster , Zhifeng Chen , Quoc V. Le , Mohammad Norouzi , Wolfgang Macherey , Maxim Krikun , Yuan Cao , Qin Gao , Klaus Macherey , et\u00a0al . 2016 . Google\u2019s neural machine translation system: Bridging the gap between human and machine translation. arXiv preprint:1609.08144 (2016). Yonghui Wu, Mike Schuster, Zhifeng Chen, Quoc V. Le, Mohammad Norouzi, Wolfgang Macherey, Maxim Krikun, Yuan Cao, Qin Gao, Klaus Macherey, et\u00a0al. 2016. Google\u2019s neural machine translation system: Bridging the gap between human and machine translation. arXiv preprint:1609.08144 (2016)."},{"key":"e_1_2_2_294_1","volume-title":"Proceedings of the European Conference on Artificial Intelligence (ECAI\u201912)","author":"Xiao Han","year":"2012","unstructured":"Han Xiao , Huang Xiao , and Claudia Eckert . 2012 . Adversarial label flips attack on support vector machines . In Proceedings of the European Conference on Artificial Intelligence (ECAI\u201912) . 870--875. Han Xiao, Huang Xiao, and Claudia Eckert. 2012. Adversarial label flips attack on support vector machines. In Proceedings of the European Conference on Artificial Intelligence (ECAI\u201912). 870--875."},{"key":"e_1_2_2_295_1","doi-asserted-by":"publisher","DOI":"10.1109\/TBDATA.2015.2472014"},{"key":"e_1_2_2_296_1","volume-title":"Mixed objective and deep residual coattention for question answering. arXiv preprint arXiv:1711.00106","author":"Xiong Caiming","year":"2017","unstructured":"Caiming Xiong , Victor Zhong , and Richard Socher . 2017. Dcn+ : Mixed objective and deep residual coattention for question answering. arXiv preprint arXiv:1711.00106 ( 2017 ). Caiming Xiong, Victor Zhong, and Richard Socher. 2017. Dcn+: Mixed objective and deep residual coattention for question answering. arXiv preprint arXiv:1711.00106 (2017)."},{"key":"e_1_2_2_297_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2016.11.001"},{"key":"e_1_2_2_298_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICC.2017.7997286"},{"key":"e_1_2_2_299_1","doi-asserted-by":"publisher","DOI":"10.5555\/2946645.3007059"},{"key":"e_1_2_2_300_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSIPN.2018.2790361"},{"key":"e_1_2_2_301_1","doi-asserted-by":"publisher","DOI":"10.1109\/AIMS.2017.14"},{"key":"e_1_2_2_302_1","volume-title":"Large batch training of convolutional networks. arXiv preprint arXiv:1708.03888","author":"You Yang","year":"2017","unstructured":"Yang You , Igor Gitman , and Boris Ginsburg . 2017. Large batch training of convolutional networks. arXiv preprint arXiv:1708.03888 ( 2017 ). Yang You, Igor Gitman, and Boris Ginsburg. 2017. Large batch training of convolutional networks. arXiv preprint arXiv:1708.03888 (2017)."},{"key":"e_1_2_2_303_1","volume-title":"Parallel restarted SGD for non-convex optimization with faster convergence and less communication. arXiv preprint:1807.06629 2, 4","author":"Yu Hao","year":"2018","unstructured":"Hao Yu , Sen Yang , and Shenghuo Zhu . 2018. Parallel restarted SGD for non-convex optimization with faster convergence and less communication. arXiv preprint:1807.06629 2, 4 ( 2018 ), 7. Hao Yu, Sen Yang, and Shenghuo Zhu. 2018. Parallel restarted SGD for non-convex optimization with faster convergence and less communication. arXiv preprint:1807.06629 2, 4 (2018), 7."},{"key":"e_1_2_2_304_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v33i01.33015693"},{"key":"e_1_2_2_305_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.148"},{"key":"e_1_2_2_306_1","unstructured":"Sergey Zagoruyko et al. 2016. Paying more attention to attention: Improving performance of convolutional neural networks via attention transfer. arXiv:1612.03928 (2016).  Sergey Zagoruyko et al. 2016. Paying more attention to attention: Improving performance of convolutional neural networks via attention transfer. arXiv:1612.03928 (2016)."},{"key":"e_1_2_2_307_1","volume-title":"Proceedings of the Annual Conference on Neural Information Processing Systems (NIPS\u2019","author":"Zhai Shuangfei","year":"2016","unstructured":"Shuangfei Zhai , Yu Cheng , Zhongfei Mark Zhang , and Weining Lu . 2016 . Doubly convolutional neural networks . In Proceedings of the Annual Conference on Neural Information Processing Systems (NIPS\u2019 (2016). 1082--1090. Shuangfei Zhai, Yu Cheng, Zhongfei Mark Zhang, and Weining Lu. 2016. Doubly convolutional neural networks. In Proceedings of the Annual Conference on Neural Information Processing Systems (NIPS\u2019 (2016). 1082--1090."},{"key":"e_1_2_2_308_1","doi-asserted-by":"publisher","DOI":"10.1145\/2788397"},{"key":"e_1_2_2_309_1","doi-asserted-by":"publisher","DOI":"10.1145\/2877204"},{"key":"e_1_2_2_310_1","doi-asserted-by":"publisher","DOI":"10.1109\/COMST.2019.2904897"},{"key":"e_1_2_2_311_1","volume-title":"Proceedings of the International Conference on Machine Learning (ICML\u201917)","author":"Zhang Hantian","year":"2017","unstructured":"Hantian Zhang , Jerry Li , Kaan Kara , Dan Alistarh , Ji Liu , and Ce Zhang . 2017 . Zipml: Training linear models with end-to-end low precision, and a little bit of deep learning . In Proceedings of the International Conference on Machine Learning (ICML\u201917) . JMLR.org, 4035--4043. Hantian Zhang, Jerry Li, Kaan Kara, Dan Alistarh, Ji Liu, and Ce Zhang. 2017. Zipml: Training linear models with end-to-end low precision, and a little bit of deep learning. In Proceedings of the International Conference on Machine Learning (ICML\u201917). JMLR.org, 4035--4043."},{"key":"e_1_2_2_312_1","volume-title":"Ioannis Mitliagkas, and Christopher R\u00e9.","author":"Zhang Jian","year":"2016","unstructured":"Jian Zhang , Christopher De Sa , Ioannis Mitliagkas, and Christopher R\u00e9. 2016 . Parallel SGD : When does averaging help? arXiv preprint arXiv:1606.07365 (2016). Jian Zhang, Christopher De Sa, Ioannis Mitliagkas, and Christopher R\u00e9. 2016. Parallel SGD: When does averaging help? arXiv preprint arXiv:1606.07365 (2016)."},{"key":"e_1_2_2_313_1","doi-asserted-by":"publisher","DOI":"10.1631\/FITEE.1700808"},{"key":"e_1_2_2_314_1","volume-title":"Proceedings of the Annual Conference on Neural Information Processing Systems (NIPS\u201915)","author":"Zhang Sixin","year":"2015","unstructured":"Sixin Zhang , Anna E Choromanska , and Yann LeCun . 2015 . Deep learning with elastic averaging SGD . In Proceedings of the Annual Conference on Neural Information Processing Systems (NIPS\u201915) . 685--693. Sixin Zhang, Anna E Choromanska, and Yann LeCun. 2015. Deep learning with elastic averaging SGD. In Proceedings of the Annual Conference on Neural Information Processing Systems (NIPS\u201915). 685--693."},{"key":"e_1_2_2_315_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2018.2825538"},{"key":"e_1_2_2_316_1","doi-asserted-by":"publisher","DOI":"10.1109\/TAC.2015.2498701"},{"key":"e_1_2_2_317_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00716"},{"key":"e_1_2_2_318_1","doi-asserted-by":"publisher","DOI":"10.3390\/app8122664"},{"key":"e_1_2_2_319_1","doi-asserted-by":"publisher","DOI":"10.3390\/app8122351"},{"key":"e_1_2_2_320_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCDS.2016.2614675"},{"key":"e_1_2_2_321_1","doi-asserted-by":"publisher","DOI":"10.1109\/VETECF.2010.5594435"},{"key":"e_1_2_2_322_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2013.04.017"},{"key":"e_1_2_2_323_1","volume-title":"Dorefa-net: Training low bitwidth convolutional neural networks with low bitwidth gradients. arXiv preprint arXiv:1606.06160","author":"Zhou Shuchang","year":"2016","unstructured":"Shuchang Zhou , Yuxin Wu , Zekun Ni , Xinyu Zhou , He Wen , and Yuheng Zou . 2016 . Dorefa-net: Training low bitwidth convolutional neural networks with low bitwidth gradients. arXiv preprint arXiv:1606.06160 (2016). Shuchang Zhou, Yuxin Wu, Zekun Ni, Xinyu Zhou, He Wen, and Yuheng Zou. 2016. Dorefa-net: Training low bitwidth convolutional neural networks with low bitwidth gradients. arXiv preprint arXiv:1606.06160 (2016)."},{"key":"e_1_2_2_324_1","volume-title":"Resource-efficient neural architect. arXiv preprint arXiv:1806.07912","author":"Zhou Yanqi","year":"2018","unstructured":"Yanqi Zhou , Siavash Ebrahimi , Sercan \u00d6. Ar\u0131k , Haonan Yu , Hairong Liu , and Greg Diamos . 2018. Resource-efficient neural architect. arXiv preprint arXiv:1806.07912 ( 2018 ). Yanqi Zhou, Siavash Ebrahimi, Sercan \u00d6. Ar\u0131k, Haonan Yu, Hairong Liu, and Greg Diamos. 2018. Resource-efficient neural architect. arXiv preprint arXiv:1806.07912 (2018)."},{"key":"e_1_2_2_325_1","volume-title":"Proceedings of the Annual Conference on Neural Information Processing Systems (NIPS\u201910)","author":"Zinkevich Martin","unstructured":"Martin Zinkevich , Markus Weimer , Lihong Li , and Alex J. Smola . 2010. Parallelized stochastic gradient descent . In Proceedings of the Annual Conference on Neural Information Processing Systems (NIPS\u201910) . 2595--2603. Martin Zinkevich, Markus Weimer, Lihong Li, and Alex J. Smola. 2010. Parallelized stochastic gradient descent. In Proceedings of the Annual Conference on Neural Information Processing Systems (NIPS\u201910). 2595--2603."}],"container-title":["ACM Computing Surveys"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3398020","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3398020","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T22:38:53Z","timestamp":1750199933000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3398020"}},"subtitle":["A Taxonomy and Survey"],"short-title":[],"issued":{"date-parts":[[2020,8,3]]},"references-count":325,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2021,7,31]]}},"alternative-id":["10.1145\/3398020"],"URL":"https:\/\/doi.org\/10.1145\/3398020","relation":{},"ISSN":["0360-0300","1557-7341"],"issn-type":[{"value":"0360-0300","type":"print"},{"value":"1557-7341","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,8,3]]},"assertion":[{"value":"2019-10-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-05-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-08-03","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}