{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,24]],"date-time":"2026-06-24T14:40:07Z","timestamp":1782312007692,"version":"3.54.5"},"reference-count":45,"publisher":"Association for Computing Machinery (ACM)","issue":"4s","license":[{"start":{"date-parts":[[2016,11,2]],"date-time":"2016-11-02T00:00:00Z","timestamp":1478044800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100001348","name":"A*STAR","doi-asserted-by":"crossref","award":["1321202073"],"award-info":[{"award-number":["1321202073"]}],"id":[{"id":"10.13039\/501100001348","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61472348"],"award-info":[{"award-number":["61472348"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"National Research Foundation, Prime Minister's Office, Singapore under its Competitive Research Programme","award":["CRP Award No. NRF-CRP8-2011-08"],"award-info":[{"award-number":["CRP Award No. NRF-CRP8-2011-08"]}]},{"name":"National Research Foundation, Energy Innovation Programme Office, Singapore under Energy Innovation Research Programme","award":["EIRP, Award No. NRF2014EWTEIRP002-026"],"award-info":[{"award-number":["EIRP, Award No. NRF2014EWTEIRP002-026"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Multimedia Comput. Commun. Appl."],"published-print":{"date-parts":[[2016,11,18]]},"abstract":"<jats:p>\n            Recently, deep learning techniques have enjoyed success in various multimedia applications, such as image classification and multimodal data analysis. Large deep learning models are developed for learning rich representations of complex data. There are two challenges to overcome before deep learning can be widely adopted in multimedia and other applications. One is usability, namely the implementation of different models and training algorithms must be done by nonexperts without much effort, especially when the model is large and complex. The other is scalability, namely the deep learning system must be able to provision for a huge demand of computing resources for training large models with massive datasets. To address these two challenges, in this article we design a distributed deep learning platform called\n            <jats:italic>SINGA<\/jats:italic>\n            , which has an intuitive programming model based on the common layer abstraction of deep learning models. Good scalability is achieved through flexible distributed training architecture and specific optimization techniques. SINGA runs on both GPUs and CPUs, and we show that it outperforms many other state-of-the-art deep learning systems. Our experience with developing and training deep learning models for real-life multimedia applications in SINGA shows that the platform is both usable and scalable.\n          <\/jats:p>","DOI":"10.1145\/2996464","type":"journal-article","created":{"date-parts":[[2016,11,4]],"date-time":"2016-11-04T12:49:04Z","timestamp":1478263744000},"page":"1-25","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":12,"title":["Deep Learning at Scale and at Ease"],"prefix":"10.1145","volume":"12","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5367-7056","authenticated-orcid":false,"given":"Wei","family":"Wang","sequence":"first","affiliation":[{"name":"National University of Singapore"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Gang","family":"Chen","sequence":"additional","affiliation":[{"name":"Zhejiang University, Hangzhou, PR China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Haibo","family":"Chen","sequence":"additional","affiliation":[{"name":"NetEase Inc., Zhejiang, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tien Tuan Anh","family":"Dinh","sequence":"additional","affiliation":[{"name":"National University of Singapore"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jinyang","family":"Gao","sequence":"additional","affiliation":[{"name":"National University of Singapore"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Beng Chin","family":"Ooi","sequence":"additional","affiliation":[{"name":"National University of Singapore"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kian-Lee","family":"Tan","sequence":"additional","affiliation":[{"name":"National University of Singapore"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sheng","family":"Wang","sequence":"additional","affiliation":[{"name":"National University of Singapore"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Meihui","family":"Zhang","sequence":"additional","affiliation":[{"name":"Singapore University of Technology and Design"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2016,11,2]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"Corrado et al","author":"Abadi Mart\u00edn","year":"2015","unstructured":"Mart\u00edn Abadi , Ashish Agarwal , Paul Barham , Eugene Brevdo , Zhifeng Chen , Craig Citro , Greg S. Corrado et al . 2015 . TensorFlow : Large-scale machine learning on heterogeneous systems. arXiv:1603.04467. http:\/\/tensorflow.org\/. Mart\u00edn Abadi, Ashish Agarwal, Paul Barham, Eugene Brevdo, Zhifeng Chen, Craig Citro, Greg S. Corrado et al. 2015. TensorFlow: Large-scale machine learning on heterogeneous systems. arXiv:1603.04467. http:\/\/tensorflow.org\/."},{"key":"e_1_2_1_2_1","volume-title":"Proceedings of the Deep Learning Workshop (NIPS\u201912)","author":"Bastien Fr\u00e9d\u00e9ric","year":"2012","unstructured":"Fr\u00e9d\u00e9ric Bastien , Pascal Lamblin , Razvan Pascanu , James Bergstra , Ian J. Goodfellow , Arnaud Bergeron , Nicolas Bouchard , and Yoshua Bengio . 2012 . Theano: New features and speed improvements . In Proceedings of the Deep Learning Workshop (NIPS\u201912) . Fr\u00e9d\u00e9ric Bastien, Pascal Lamblin, Razvan Pascanu, James Bergstra, Ian J. Goodfellow, Arnaud Bergeron, Nicolas Bouchard, and Yoshua Bengio. 2012. Theano: New features and speed improvements. In Proceedings of the Deep Learning Workshop (NIPS\u201912)."},{"key":"e_1_2_1_3_1","unstructured":"Tianqi Chen Bing Xu Chiyuan Zhang and Carlos Guestrin. 2016b. Training deep nets with sublinear memory cost. arXiv:1604.06174. http:\/\/arxiv.org\/abs\/1604.06174  Tianqi Chen Bing Xu Chiyuan Zhang and Carlos Guestrin. 2016b. Training deep nets with sublinear memory cost. arXiv:1604.06174. http:\/\/arxiv.org\/abs\/1604.06174"},{"key":"e_1_2_1_4_1","unstructured":"Tianqi Chen Mu Li Yutian Li Min Lin Naiyan Wang Minjie Wang Tianjun Xiao Bing Xu Chiyuan Zhang and Zheng Zhang. 2015. MXNet: A flexible and efficient machine learning library for heterogeneous distributed systems. arXiv:1512.01274.  Tianqi Chen Mu Li Yutian Li Min Lin Naiyan Wang Minjie Wang Tianjun Xiao Bing Xu Chiyuan Zhang and Zheng Zhang. 2015. MXNet: A flexible and efficient machine learning library for heterogeneous distributed systems. arXiv:1512.01274."},{"key":"e_1_2_1_5_1","unstructured":"Jianmin Chen Rajat Monga Samy Bengio and Rafal J\u00f3zefowicz. 2016a. Revisiting distributed synchronous SGD. arXiv:1604.00981. http:\/\/arxiv.org\/abs\/1604.00981  Jianmin Chen Rajat Monga Samy Bengio and Rafal J\u00f3zefowicz. 2016a. Revisiting distributed synchronous SGD. arXiv:1604.00981. http:\/\/arxiv.org\/abs\/1604.00981"},{"key":"e_1_2_1_6_1","volume-title":"Proceedings of the 11th USENIX Conference on Operating Systems Design and Implementation (OSDI\u201914)","author":"Chilimbi Trishul","year":"2014","unstructured":"Trishul Chilimbi , Yutaka Suzue , Johnson Apacible , and Karthik Kalyanaraman . 2014 . Project Adam: Building an efficient and scalable deep learning training system . In Proceedings of the 11th USENIX Conference on Operating Systems Design and Implementation (OSDI\u201914) . 571--582. https:\/\/www.usenix.org\/conference\/osdi14\/technical-sessions\/presentation\/chilimbi. Trishul Chilimbi, Yutaka Suzue, Johnson Apacible, and Karthik Kalyanaraman. 2014. Project Adam: Building an efficient and scalable deep learning training system. In Proceedings of the 11th USENIX Conference on Operating Systems Design and Implementation (OSDI\u201914). 571--582. https:\/\/www.usenix.org\/conference\/osdi14\/technical-sessions\/presentation\/chilimbi."},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/1646396.1646452"},{"key":"e_1_2_1_8_1","volume-title":"Luca Maria Gambardella, and J\u00fcrgen Schmidhuber","author":"Ciresan Dan Claudiu","year":"2010","unstructured":"Dan Claudiu Ciresan , Ueli Meier , Luca Maria Gambardella, and J\u00fcrgen Schmidhuber . 2010 . Deep big simple neural nets excel on handwritten digit recognition. arXiv:1003.0358. Dan Claudiu Ciresan, Ueli Meier, Luca Maria Gambardella, and J\u00fcrgen Schmidhuber. 2010. Deep big simple neural nets excel on handwritten digit recognition. arXiv:1003.0358."},{"key":"e_1_2_1_9_1","volume-title":"Proceedings of the 30th International Conference on Machine Learning (ICML\u201913)","author":"Coates Adam","unstructured":"Adam Coates , Brody Huval , Tao Wang , David J. Wu , Bryan C. Catanzaro , and Andrew Y. Ng . 2013. Deep learning with COTS HPC systems . In Proceedings of the 30th International Conference on Machine Learning (ICML\u201913) . 1337--1345. Adam Coates, Brody Huval, Tao Wang, David J. Wu, Bryan C. Catanzaro, and Andrew Y. Ng. 2013. Deep learning with COTS HPC systems. In Proceedings of the 30th International Conference on Machine Learning (ICML\u201913). 1337--1345."},{"key":"e_1_2_1_10_1","volume-title":"Proceedings of the BigLearn Workshop (NIPS\u201911)","author":"Collobert R.","unstructured":"R. Collobert , K. Kavukcuoglu , and C. Farabet . 2011. Torch7: A Matlab-like environment for machine learning . In Proceedings of the BigLearn Workshop (NIPS\u201911) . R. Collobert, K. Kavukcuoglu, and C. Farabet. 2011. Torch7: A Matlab-like environment for machine learning. In Proceedings of the BigLearn Workshop (NIPS\u201911)."},{"key":"e_1_2_1_11_1","volume-title":"Seunghak Lee, Junming Yin, Qirong Ho, and Eric P. Xing.","author":"Dai Wei","year":"2013","unstructured":"Wei Dai , Jinliang Wei , Xun Zheng , Jin Kyu Kim , Seunghak Lee, Junming Yin, Qirong Ho, and Eric P. Xing. 2013 . Petuum : A framework for iterative-convergent distributed ML. arXiv:1312.7651. http:\/\/arxiv.org\/abs\/1312.7651 Wei Dai, Jinliang Wei, Xun Zheng, Jin Kyu Kim, Seunghak Lee, Junming Yin, Qirong Ho, and Eric P. Xing. 2013. Petuum: A framework for iterative-convergent distributed ML. arXiv:1312.7651. http:\/\/arxiv.org\/abs\/1312.7651"},{"key":"e_1_2_1_12_1","volume-title":"Ng","author":"Dean Jeffrey","year":"2012","unstructured":"Jeffrey Dean , Greg Corrado , Rajat Monga , Kai Chen , Matthieu Devin , Quoc V. Le , Mark Z. Mao , Marc\u2019Aurelio Ranzato , Andrew W. Senior , Paul A. Tucker , Ke Yang , and Andrew Y . Ng . 2012 . Large scale distributed deep networks. In Advances in Neural Information Processing Systems (NIPS\u2019 12). 1232--1240. Jeffrey Dean, Greg Corrado, Rajat Monga, Kai Chen, Matthieu Devin, Quoc V. Le, Mark Z. Mao, Marc\u2019Aurelio Ranzato, Andrew W. Senior, Paul A. Tucker, Ke Yang, and Andrew Y. Ng. 2012. Large scale distributed deep networks. In Advances in Neural Information Processing Systems (NIPS\u201912). 1232--1240."},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.5555\/1953048.2021068"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/2647868.2654902"},{"key":"e_1_2_1_15_1","unstructured":"Kaiming He Xiangyu Zhang Shaoqing Ren and Jian Sun. 2015. Deep residual learning for image recognition. arXiv:1512.03385.  Kaiming He Xiangyu Zhang Shaoqing Ren and Jian Sun. 2015. Deep residual learning for image recognition. arXiv:1512.03385."},{"key":"e_1_2_1_16_1","doi-asserted-by":"crossref","unstructured":"Geoffrey Hinton and Ruslan Salakhutdinov. 2006. Reducing the dimensionality of data with neural networks. Science 313 5786 504--507.  Geoffrey Hinton and Ruslan Salakhutdinov. 2006. Reducing the dimensionality of data with neural networks. Science 313 5786 504--507.","DOI":"10.1126\/science.1127647"},{"key":"e_1_2_1_17_1","volume-title":"Caffe: Convolutional architecture for fast feature embedding. arXiv:1408.5093.","author":"Jia Yangqing","year":"2014","unstructured":"Yangqing Jia , Evan Shelhamer , Jeff Donahue , Sergey Karayev , Jonathan Long , Ross Girshick , Sergio Guadarrama , and Trevor Darrell . 2014 . Caffe: Convolutional architecture for fast feature embedding. arXiv:1408.5093. Yangqing Jia, Evan Shelhamer, Jeff Donahue, Sergey Karayev, Jonathan Long, Ross Girshick, Sergio Guadarrama, and Trevor Darrell. 2014. Caffe: Convolutional architecture for fast feature embedding. arXiv:1408.5093."},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.14778\/2732286.2732291"},{"key":"e_1_2_1_19_1","unstructured":"Alex Krizhevsky. 2014. One weird trick for parallelizing convolutional neural networks. arXiv:1404.5997.  Alex Krizhevsky. 2014. One weird trick for parallelizing convolutional neural networks. arXiv:1404.5997."},{"key":"e_1_2_1_20_1","volume-title":"Hinton","author":"Krizhevsky Alex","year":"2012","unstructured":"Alex Krizhevsky , Ilya Sutskever , and Geoffrey E . Hinton . 2012 . ImageNet classification with deep convolutional neural networks. In Advances in Neural Information Processing Systems 25 (NIPS\u2019 12). 1106--1114. Alex Krizhevsky, Ilya Sutskever, and Geoffrey E. Hinton. 2012. ImageNet classification with deep convolutional neural networks. In Advances in Neural Information Processing Systems 25 (NIPS\u201912). 1106--1114."},{"key":"e_1_2_1_21_1","volume-title":"Proceedings of the International Conference on Machine Learning (ICML\u201912)","author":"Le Quoc V.","unstructured":"Quoc V. Le , Marc\u2019Aurelio Ranzato , Rajat Monga , Matthieu Devin , Greg Corrado , Kai Chen , Jeffrey Dean , and Andrew Y. Ng . 2012. Building high-level features using large scale unsupervised learning . In Proceedings of the International Conference on Machine Learning (ICML\u201912) . Quoc V. Le, Marc\u2019Aurelio Ranzato, Rajat Monga, Matthieu Devin, Greg Corrado, Kai Chen, Jeffrey Dean, and Andrew Y. Ng. 2012. Building high-level features using large scale unsupervised learning. In Proceedings of the International Conference on Machine Learning (ICML\u201912)."},{"key":"e_1_2_1_22_1","volume-title":"Neural Networks: Tricks of the Trade","author":"LeCun Yann","unstructured":"Yann LeCun , L\u00e9on Bottou , Genevieve B. Orr , and Klaus-Robert M\u00fcller . 1996. Efficient BackProp . In Neural Networks: Tricks of the Trade . Springer , 9--50. DOI:http:\/\/dx.doi.org\/10.1007\/3-540-49430-8_2 10.1007\/3-540-49430-8_2 Yann LeCun, L\u00e9on Bottou, Genevieve B. Orr, and Klaus-Robert M\u00fcller. 1996. Efficient BackProp. In Neural Networks: Tricks of the Trade. Springer, 9--50. DOI:http:\/\/dx.doi.org\/10.1007\/3-540-49430-8_2"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.5555\/2685048.2685095"},{"key":"e_1_2_1_24_1","unstructured":"Tomas Mikolov Ilya Sutskever Kai Chen Gregory S. Corrado and Jeffrey Dean. 2013. Distributed representations of words and phrases and their compositionality. In Advances in Neural Information Processing Systems (NIPS\u201913). 3111--3119.   Tomas Mikolov Ilya Sutskever Kai Chen Gregory S. Corrado and Jeffrey Dean. 2013. Distributed representations of words and phrases and their compositionality. In Advances in Neural Information Processing Systems (NIPS\u201913). 3111--3119."},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICASSP.2011.5947611"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/2733373.2807410"},{"key":"e_1_2_1_27_1","volume-title":"Huang","author":"Paine Thomas","year":"2013","unstructured":"Thomas Paine , Hailin Jin , Jianchao Yang , Zhe Lin , and Thomas S . Huang . 2013 . GPU asynchronous stochastic gradient descent to speed up neural network training. arXiv:1312.6186. Thomas Paine, Hailin Jin, Jianchao Yang, Zhe Lin, and Thomas S. Huang. 2013. GPU asynchronous stochastic gradient descent to speed up neural network training. arXiv:1312.6186."},{"key":"e_1_2_1_28_1","volume-title":"Hogwild: A lock-free approach to parallelizing stochastic gradient descent. In Advances in Neural Information Processing Systems (NIPS\u201911). 693--701.","author":"Recht Benjamin","year":"2011","unstructured":"Benjamin Recht , Christopher Re , Stephen J. Wright , and Feng Niu . 2011 . Hogwild: A lock-free approach to parallelizing stochastic gradient descent. In Advances in Neural Information Processing Systems (NIPS\u201911). 693--701. Benjamin Recht, Christopher Re, Stephen J. Wright, and Feng Niu. 2011. Hogwild: A lock-free approach to parallelizing stochastic gradient descent. In Advances in Neural Information Processing Systems (NIPS\u201911). 693--701."},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.21437\/Interspeech.2014-274"},{"key":"e_1_2_1_30_1","unstructured":"Karen Simonyan and Andrew Zisserman. 2014. Very deep convolutional networks for large-scale image recognition. arXiv:1409.1556. http:\/\/arxiv.org\/abs\/1409.1556  Karen Simonyan and Andrew Zisserman. 2014. Very deep convolutional networks for large-scale image recognition. arXiv:1409.1556. http:\/\/arxiv.org\/abs\/1409.1556"},{"key":"e_1_2_1_31_1","doi-asserted-by":"crossref","unstructured":"Christian Szegedy Wei Liu Yangqing Jia Pierre Sermanet Scott Reed Dragomir Anguelov Dumitru Erhan Vincent Vanhoucke and Andrew Rabinovich. 2014. Going deeper with convolutions. arXiv:1409.4842.  Christian Szegedy Wei Liu Yangqing Jia Pierre Sermanet Scott Reed Dragomir Anguelov Dumitru Erhan Vincent Vanhoucke and Andrew Rabinovich. 2014. Going deeper with convolutions. arXiv:1409.4842.","DOI":"10.1109\/CVPR.2015.7298594"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/354384.376098"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/2814710.2814717"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/2647868.2654948"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/2647868.2654940"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.14778\/2732296.2732301"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/2733373.2806232"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00778-015-0391-4"},{"key":"e_1_2_1_39_1","volume-title":"Deep Image: Scaling up image recognition. arXiv:1501.02876","author":"Wu Ren","year":"2015","unstructured":"Ren Wu , Shengen Yan , Yi Shan , Qingqing Dang , and Gang Sun . 2015 . Deep Image: Scaling up image recognition. arXiv:1501.02876 . http:\/\/arxiv.org\/abs\/1501.02876 Ren Wu, Shengen Yan, Yi Shan, Qingqing Dang, and Gang Sun. 2015. Deep Image: Scaling up image recognition. arXiv:1501.02876. http:\/\/arxiv.org\/abs\/1501.02876"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/2647868.2654931"},{"key":"e_1_2_1_41_1","unstructured":"Omry Yadan Keith Adams Yaniv Taigman and Marc\u2019Aurelio Ranzato. 2013. Multi-GPU training of ConvNets. arXiv:1312.5853.  Omry Yadan Keith Adams Yaniv Taigman and Marc\u2019Aurelio Ranzato. 2013. Multi-GPU training of ConvNets. arXiv:1312.5853."},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/2733373.2806284"},{"key":"e_1_2_1_43_1","volume-title":"Frank Seide et al","author":"Yu Dong","year":"2014","unstructured":"Dong Yu , Adam Eversole , Mike Seltzer , Kaisheng Yao , Oleksii Kuchaiev , Yu Zhang , Frank Seide et al . 2014 . An Introduction to Computational Networks and the Computational Network Toolkit. Microsoft Technical Report MSR-TR-2014-112. Microsoft Research . Dong Yu, Adam Eversole, Mike Seltzer, Kaisheng Yao, Oleksii Kuchaiev, Yu Zhang, Frank Seide et al. 2014. An Introduction to Computational Networks and the Computational Network Toolkit. Microsoft Technical Report MSR-TR-2014-112. Microsoft Research."},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.14778\/2732977.2733001"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/2647868.2654915"}],"container-title":["ACM Transactions on Multimedia Computing, Communications, and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2996464","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2996464","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:23:11Z","timestamp":1750220591000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2996464"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,11,2]]},"references-count":45,"journal-issue":{"issue":"4s","published-print":{"date-parts":[[2016,11,18]]}},"alternative-id":["10.1145\/2996464"],"URL":"https:\/\/doi.org\/10.1145\/2996464","relation":{},"ISSN":["1551-6857","1551-6865"],"issn-type":[{"value":"1551-6857","type":"print"},{"value":"1551-6865","type":"electronic"}],"subject":[],"published":{"date-parts":[[2016,11,2]]},"assertion":[{"value":"2016-02-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2016-08-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2016-11-02","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}