{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,2,21]],"date-time":"2025-02-21T21:54:08Z","timestamp":1740174848364,"version":"3.37.3"},"reference-count":15,"publisher":"Wiley","license":[{"start":{"date-parts":[[2017,1,1]],"date-time":"2017-01-01T00:00:00Z","timestamp":1483228800000},"content-version":"unspecified","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61672200","61572163","2015AA01A303","LY16F020018","LY17F020029","2013M541780","2013M540492","SJJD2014005","Y201016492"],"award-info":[{"award-number":["61672200","61572163","2015AA01A303","LY16F020018","LY17F020029","2013M541780","2013M540492","SJJD2014005","Y201016492"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61672200","61572163","2015AA01A303","LY16F020018","LY17F020029","2013M541780","2013M540492","SJJD2014005","Y201016492"],"award-info":[{"award-number":["61672200","61572163","2015AA01A303","LY16F020018","LY17F020029","2013M541780","2013M540492","SJJD2014005","Y201016492"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"National High Technology Research and Development Program of China","award":["61672200","61572163","2015AA01A303","LY16F020018","LY17F020029","2013M541780","2013M540492","SJJD2014005","Y201016492"],"award-info":[{"award-number":["61672200","61572163","2015AA01A303","LY16F020018","LY17F020029","2013M541780","2013M540492","SJJD2014005","Y201016492"]}]},{"DOI":"10.13039\/501100004731","name":"Natural Science Foundation of Zhejiang Province","doi-asserted-by":"publisher","award":["61672200","61572163","2015AA01A303","LY16F020018","LY17F020029","2013M541780","2013M540492","SJJD2014005","Y201016492"],"award-info":[{"award-number":["61672200","61572163","2015AA01A303","LY16F020018","LY17F020029","2013M541780","2013M540492","SJJD2014005","Y201016492"]}],"id":[{"id":"10.13039\/501100004731","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004731","name":"Natural Science Foundation of Zhejiang Province","doi-asserted-by":"publisher","award":["61672200","61572163","2015AA01A303","LY16F020018","LY17F020029","2013M541780","2013M540492","SJJD2014005","Y201016492"],"award-info":[{"award-number":["61672200","61572163","2015AA01A303","LY16F020018","LY17F020029","2013M541780","2013M540492","SJJD2014005","Y201016492"]}],"id":[{"id":"10.13039\/501100004731","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100002338","name":"Ministry of Education of the People\u2019s Republic of China","doi-asserted-by":"publisher","award":["61672200","61572163","2015AA01A303","LY16F020018","LY17F020029","2013M541780","2013M540492","SJJD2014005","Y201016492"],"award-info":[{"award-number":["61672200","61572163","2015AA01A303","LY16F020018","LY17F020029","2013M541780","2013M540492","SJJD2014005","Y201016492"]}],"id":[{"id":"10.13039\/501100002338","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100002858","name":"China Postdoctoral Science Foundation","doi-asserted-by":"publisher","award":["61672200","61572163","2015AA01A303","LY16F020018","LY17F020029","2013M541780","2013M540492","SJJD2014005","Y201016492"],"award-info":[{"award-number":["61672200","61572163","2015AA01A303","LY16F020018","LY17F020029","2013M541780","2013M540492","SJJD2014005","Y201016492"]}],"id":[{"id":"10.13039\/501100002858","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100002858","name":"China Postdoctoral Science Foundation","doi-asserted-by":"publisher","award":["61672200","61572163","2015AA01A303","LY16F020018","LY17F020029","2013M541780","2013M540492","SJJD2014005","Y201016492"],"award-info":[{"award-number":["61672200","61572163","2015AA01A303","LY16F020018","LY17F020029","2013M541780","2013M540492","SJJD2014005","Y201016492"]}],"id":[{"id":"10.13039\/501100002858","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003467","name":"Hangzhou Dianzi University","doi-asserted-by":"publisher","award":["61672200","61572163","2015AA01A303","LY16F020018","LY17F020029","2013M541780","2013M540492","SJJD2014005","Y201016492"],"award-info":[{"award-number":["61672200","61572163","2015AA01A303","LY16F020018","LY17F020029","2013M541780","2013M540492","SJJD2014005","Y201016492"]}],"id":[{"id":"10.13039\/501100003467","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Zhejiang Provincial Department of Education","award":["61672200","61572163","2015AA01A303","LY16F020018","LY17F020029","2013M541780","2013M540492","SJJD2014005","Y201016492"],"award-info":[{"award-number":["61672200","61572163","2015AA01A303","LY16F020018","LY17F020029","2013M541780","2013M540492","SJJD2014005","Y201016492"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Mobile Information Systems"],"published-print":{"date-parts":[[2017]]},"abstract":"<jats:p>With the development of the mobile systems, we gain a lot of benefits and convenience by leveraging mobile devices; at the same time, the information gathered by smartphones, such as location and environment, is also valuable for business to provide more intelligent services for customers. More and more machine learning methods have been used in the field of mobile information systems to study user behavior and classify usage patterns, especially convolutional neural network. With the increasing of model training parameters and data scale, the traditional single machine training method cannot meet the requirements of time complexity in practical application scenarios. The current training framework often uses simple data parallel or model parallel method to speed up the training process, which is why heterogeneous computing resources have not been fully utilized. To solve these problems, our paper proposes a delay synchronization convolutional neural network parallel strategy, which leverages the heterogeneous system. The strategy is based on both synchronous parallel and asynchronous parallel approaches; the model training process can reduce the dependence on the heterogeneous architecture in the premise of ensuring the model convergence, so the convolution neural network framework is more adaptive to different heterogeneous system environments. The experimental results show that the proposed delay synchronization strategy can achieve at least three times the speedup compared to the traditional data parallelism.<\/jats:p>","DOI":"10.1155\/2017\/3824765","type":"journal-article","created":{"date-parts":[[2017,3,21]],"date-time":"2017-03-21T18:26:08Z","timestamp":1490120768000},"page":"1-12","source":"Crossref","is-referenced-by-count":8,"title":["A Parallel Strategy for Convolutional Neural Network Based on Heterogeneous Cluster for Mobile Information System"],"prefix":"10.1155","volume":"2017","author":[{"given":"Jilin","family":"Zhang","sequence":"first","affiliation":[{"name":"School of Computer and Technology, Hangzhou Dianzi University, Hangzhou 310018, China"},{"name":"Key Laboratory of Complex Systems Modeling and Simulation, Ministry of Education, Hangzhou, China"},{"name":"College of Electrical Engineering, Zhejiang University, Hangzhou 310058, China"},{"name":"School of Information and Electronic Engineering, Zhejiang University of Science & Technology, Hangzhou 310023, China"}]},{"given":"Junfeng","family":"Xiao","sequence":"additional","affiliation":[{"name":"School of Computer and Technology, Hangzhou Dianzi University, Hangzhou 310018, China"},{"name":"Key Laboratory of Complex Systems Modeling and Simulation, Ministry of Education, Hangzhou, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0775-4254","authenticated-orcid":true,"given":"Jian","family":"Wan","sequence":"additional","affiliation":[{"name":"School of Computer and Technology, Hangzhou Dianzi University, Hangzhou 310018, China"},{"name":"Key Laboratory of Complex Systems Modeling and Simulation, Ministry of Education, Hangzhou, China"},{"name":"School of Information and Electronic Engineering, Zhejiang University of Science & Technology, Hangzhou 310023, China"},{"name":"Zhejiang Provincial Engineering Center on Media Data Cloud Processing and Analysis, Hangzhou, Zhejiang, China"}]},{"given":"Jianhua","family":"Yang","sequence":"additional","affiliation":[{"name":"College of Computer Science and Technology, Zhejiang University, Hangzhou 310018, China"}]},{"given":"Yongjian","family":"Ren","sequence":"additional","affiliation":[{"name":"School of Computer and Technology, Hangzhou Dianzi University, Hangzhou 310018, China"},{"name":"Key Laboratory of Complex Systems Modeling and Simulation, Ministry of Education, Hangzhou, China"}]},{"given":"Huayou","family":"Si","sequence":"additional","affiliation":[{"name":"School of Computer and Technology, Hangzhou Dianzi University, Hangzhou 310018, China"},{"name":"Key Laboratory of Complex Systems Modeling and Simulation, Ministry of Education, Hangzhou, China"}]},{"given":"Li","family":"Zhou","sequence":"additional","affiliation":[{"name":"School of Computer and Technology, Hangzhou Dianzi University, Hangzhou 310018, China"},{"name":"Key Laboratory of Complex Systems Modeling and Simulation, Ministry of Education, Hangzhou, China"}]},{"given":"Hangdi","family":"Tu","sequence":"additional","affiliation":[{"name":"School of Computer and Technology, Hangzhou Dianzi University, Hangzhou 310018, China"},{"name":"Key Laboratory of Complex Systems Modeling and Simulation, Ministry of Education, Hangzhou, China"}]}],"member":"311","reference":[{"first-page":"396","volume-title":"Handwritten digit recognition with a back-propagation network","year":"1990","key":"19"},{"key":"17","doi-asserted-by":"publisher","DOI":"10.1109\/72.554195"},{"key":"4","doi-asserted-by":"publisher","DOI":"10.1016\/j.neunet.2012.02.023"},{"key":"8","doi-asserted-by":"publisher","DOI":"10.1109\/TNN.2010.2066286"},{"key":"2","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2010.226"},{"issue":"2","key":"21","first-page":"101","volume":"26","year":"2013","journal-title":"Malaysian Journal of Computer Science"},{"first-page":"835","volume-title":"Face detection using HMM-SVM method","year":"2012","key":"29"},{"key":"34","doi-asserted-by":"publisher","DOI":"10.1109\/TITS.2011.2114346"},{"key":"36","doi-asserted-by":"publisher","DOI":"10.1109\/mic.2014.62"},{"first-page":"1223","volume-title":"More effective distributed ML via a stale synchronous parallel parameter server","year":"2013","key":"12"},{"key":"38","doi-asserted-by":"publisher","DOI":"10.1016\/j.sysarc.2015.08.003"},{"key":"13","doi-asserted-by":"publisher","DOI":"10.1109\/TIE.2012.2189533"},{"issue":"2","key":"23","first-page":"322","volume":"92","year":"2016","journal-title":"Journal of Theoretical & Applied Information Technology"},{"key":"33","doi-asserted-by":"publisher","DOI":"10.1007\/s10766-016-0451-4"},{"first-page":"1223","volume-title":"Large scale distributed deep networks","year":"2012","key":"7"}],"container-title":["Mobile Information Systems"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/downloads.hindawi.com\/journals\/misy\/2017\/3824765.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/downloads.hindawi.com\/journals\/misy\/2017\/3824765.xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/downloads.hindawi.com\/journals\/misy\/2017\/3824765.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2017,3,21]],"date-time":"2017-03-21T18:26:18Z","timestamp":1490120778000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.hindawi.com\/journals\/misy\/2017\/3824765\/"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017]]},"references-count":15,"alternative-id":["3824765","3824765"],"URL":"https:\/\/doi.org\/10.1155\/2017\/3824765","relation":{},"ISSN":["1574-017X","1875-905X"],"issn-type":[{"type":"print","value":"1574-017X"},{"type":"electronic","value":"1875-905X"}],"subject":[],"published":{"date-parts":[[2017]]}}}