{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,23]],"date-time":"2026-02-23T21:48:50Z","timestamp":1771883330623,"version":"3.50.1"},"reference-count":51,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2019,4,16]],"date-time":"2019-04-16T00:00:00Z","timestamp":1555372800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100001691","name":"Japan Society for the Promotion of Science","doi-asserted-by":"publisher","award":["JP16K00117"],"award-info":[{"award-number":["JP16K00117"]}],"id":[{"id":"10.13039\/501100001691","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100011923","name":"KDDI Foundation","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100011923","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Internet Technol."],"published-print":{"date-parts":[[2019,5,31]]},"abstract":"<jats:p>Mobile crowdsensing becomes a promising technology for the emerging Internet of Things (IoT) applications in smart environments. Fog computing is enabling a new breed of IoT services, which is also a new opportunity for mobile crowdsensing. Thus, in this article, we introduce a framework enabling mobile crowdsensing in fog environments with a hierarchical scheduling strategy. We first introduce the crowdsensing framework that has a hierarchical structure to organize different resources. Since different positions and performance of fog nodes influence the quality of service (QoS) of IoT applications, we formulate a scheduling problem in the hierarchical fog structure and solve it by using a deep reinforcement learning\u2013based strategy. From extensive simulation results, our solution outperforms other scheduling solutions for mobile crowdsensing in the given fog computing environment.<\/jats:p>","DOI":"10.1145\/3234463","type":"journal-article","created":{"date-parts":[[2019,4,16]],"date-time":"2019-04-16T08:04:11Z","timestamp":1555401851000},"page":"1-18","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":103,"title":["Deep Reinforcement Scheduling for Mobile Crowdsensing in Fog Computing"],"prefix":"10.1145","volume":"19","author":[{"given":"He","family":"Li","sequence":"first","affiliation":[{"name":"Muroran Institute of Technology, Muroran, Hokkaido, Japan"}]},{"given":"Kaoru","family":"Ota","sequence":"additional","affiliation":[{"name":"Muroran Institute of Technology, Muroran, Hokkaido, Japan"}]},{"given":"Mianxiong","family":"Dong","sequence":"additional","affiliation":[{"name":"Muroran Institute of Technology, Muroran, Hokkaido, Japan"}]}],"member":"320","published-online":{"date-parts":[[2019,4,16]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.5555\/1855711.1855730"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/MNET.2016.7474340"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.5555\/518904.878893"},{"key":"e_1_2_1_4_1","volume-title":"Proceedings of the 2017 15th International Symposium on Modeling and Optimization in Mobile, Ad Hoc, and Wireless Networks (WiOpt\u201917)","author":"Atallah R.","unstructured":"R. Atallah, C. Assi, and M. Khabbaz. 2017. Deep reinforcement learning-based scheduling for roadside communication networks. In Proceedings of the 2017 15th International Symposium on Modeling and Optimization in Mobile, Ad Hoc, and Wireless Networks (WiOpt\u201917). 1--8."},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/JIOT.2017.2666783"},{"key":"e_1_2_1_6_1","volume-title":"Dynamic Programming","author":"Bellman Richard","unstructured":"Richard Bellman. 2013. Dynamic Programming. Courier Corporation."},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/CLOUD.2012.83"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/MCC.2017.27"},{"key":"e_1_2_1_9_1","volume-title":"Fog Computing: A Platform for Internet of Things and Analytics","author":"Bonomi Flavio","year":"2014","unstructured":"Flavio Bonomi, Rodolfo Milito, Preethi Natarajan, and Jiang Zhu. 2014. Fog Computing: A Platform for Internet of Things and Analytics. Springer International Publishing, Cham, 169--186."},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/2342509.2342513"},{"key":"e_1_2_1_11_1","volume-title":"Proceedings of the 2016 IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS). 848--853","author":"Bruneo D.","unstructured":"D. Bruneo, S. Distefano, F. Longo, G. Merlino, A. Puliafito, V. D\u2019Amico, M. Sapienza, and G. Torrisi. 2016. Stack4Things as a fog computing platform for smart city applications. In Proceedings of the 2016 IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS). 848--853."},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/1143549.1143668"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/2370216.2370288"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10723-015-9338-7"},{"key":"e_1_2_1_15_1","unstructured":"Nathan Eagle and Alex (Sandy) Pentland. 2005. CRAWDAD dataset mit\/reality (v. 2005-07-01). Downloaded from https:\/\/crawdad.org\/mit\/reality\/20050701."},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.5555\/648300.755315"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/MCOM.2011.6069707"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.5555\/3023549.3023573"},{"key":"e_1_2_1_19_1","volume-title":"FBRC: Optimization of task scheduling in fog-based region and cloud. In 2017 IEEE Trustcom\/BigDataSE\/ICESS. 1109--1114.","author":"Hoang D.","year":"2017","unstructured":"D. Hoang and T. D. Dang. 2017. FBRC: Optimization of task scheduling in fog-based region and cloud. In 2017 IEEE Trustcom\/BigDataSE\/ICESS. 1109--1114."},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/2491266.2491270"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2015.2455712"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/JSAC.2017.2659478"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/JSAC.2017.2676598"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1109\/INFCOM.2012.6195845"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/MNET.2018.1700202"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/MCOM.2017.1600719"},{"key":"e_1_2_1_27_1","first-page":"1","article-title":"Multimedia processing pricing strategy in GPU-accelerated cloud computing","volume":"99","author":"Li H.","year":"2017","unstructured":"H. Li, K. Ota, M. Dong, A. Vasilakos, and K. Nagano. 2017. Multimedia processing pricing strategy in GPU-accelerated cloud computing. IEEE Transactions on Cloud Computing PP, 99 (2017), 1--1.","journal-title":"IEEE Transactions on Cloud Computing PP"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPDS.2017.2740294"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2017.2756826"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.adhoc.2015.07.006"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/3005745.3005750"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.future.2015.09.017"},{"key":"e_1_2_1_33_1","volume-title":"Riedmiller","author":"Mnih Volodymyr","year":"2013","unstructured":"Volodymyr Mnih, Koray Kavukcuoglu, David Silver, Alex Graves, Ioannis Antonoglou, Daan Wierstra, and Martin A. Riedmiller. 2013. Playing atari with deep reinforcement learning. CoRR abs\/1312.5602 (2013). arxiv:1312.5602 http:\/\/arxiv.org\/abs\/1312.5602"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/JIOT.2017.2712560"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/APNOMS.2016.7737240"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/1810931.1810936"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1109\/MPRV.2015.32"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2017.2682640"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/MDM.2012.58"},{"key":"e_1_2_1_40_1","volume-title":"Mastering the game of Go without human knowledge. Nature 550 (Oct","author":"Silver David","year":"2017","unstructured":"David Silver, Julian Schrittwieser, Karen Simonyan, Ioannis Antonoglou, Aja Huang, Arthur Guez, Thomas Hubert, Lucas Baker, Matthew Lai, Adrian Bolton, Yutian Chen, Timothy Lillicrap, Fan Hui, Laurent Sifre, George van den Driessche, Thore Graepel, and Demis Hassabis. 2017. Mastering the game of Go without human knowledge. Nature 550 (Oct. 2017), 354."},{"key":"e_1_2_1_41_1","volume-title":"Very deep convolutional networks for large-scale image recognition. CoRR abs\/1409.1556","author":"Simonyan Karen","year":"2014","unstructured":"Karen Simonyan and Andrew Zisserman. 2014. Very deep convolutional networks for large-scale image recognition. CoRR abs\/1409.1556 (2014). arxiv:1409.1556 http:\/\/arxiv.org\/abs\/1409.1556"},{"key":"e_1_2_1_42_1","first-page":"16","article-title":"Scalable distributed computing hierarchy: Cloud, fog and dew computing","volume":"2","author":"Skala Karolj","year":"2015","unstructured":"Karolj Skala, Davor Davidovic, Enis Afgan, Ivan Sovic, and Zorislav Sojat. 2015. Scalable distributed computing hierarchy: Cloud, fog and dew computing. Open Journal of Cloud Computing (OJCC) 2, 1 (2015), 16--24.","journal-title":"Open Journal of Cloud Computing (OJCC)"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/MNET.2017.1700200"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF00992698"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIFS.2017.2737968"},{"key":"e_1_2_1_46_1","unstructured":"L. Xiao X. Wan C. Dai X. Du X. Chen and M. Guizani. 2018. Security in mobile edge caching with reinforcement learning. ArXiv e-prints (Jan. 2018). arxiv:cs.CR\/1801.05915"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/2444776.2444789"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/2757384.2757397"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.5555\/1643031.1643044"},{"key":"e_1_2_1_50_1","volume-title":"Proceedings of the IEEE Conference on Computer Communications (IEEE INFOCOM\u201914)","author":"Zhao D.","unstructured":"D. Zhao, X. Y. Li, and H. Ma. 2014. How to crowdsource tasks truthfully without sacrificing utility: Online incentive mechanisms with budget constraint. In Proceedings of the IEEE Conference on Computer Communications (IEEE INFOCOM\u201914). 1213--1221."},{"key":"e_1_2_1_51_1","volume-title":"Proceedings of the 2011 IEEE Global Telecommunications Conference (GLOBECOM\u201911)","author":"Zheng Z.","unstructured":"Z. Zheng, L. X. Cai, M. Dong, X. Shen, and H. V. Poor. 2011. Constrained energy-aware AP placement with rate adaptation in WLAN mesh networks. In Proceedings of the 2011 IEEE Global Telecommunications Conference (GLOBECOM\u201911). 1--5."}],"container-title":["ACM Transactions on Internet Technology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3234463","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3234463","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,20]],"date-time":"2025-10-20T16:19:29Z","timestamp":1760977169000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3234463"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,4,16]]},"references-count":51,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2019,5,31]]}},"alternative-id":["10.1145\/3234463"],"URL":"https:\/\/doi.org\/10.1145\/3234463","relation":{},"ISSN":["1533-5399","1557-6051"],"issn-type":[{"value":"1533-5399","type":"print"},{"value":"1557-6051","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,4,16]]},"assertion":[{"value":"2017-12-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2018-06-01","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2019-04-16","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}