{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,2]],"date-time":"2026-02-02T21:30:41Z","timestamp":1770067841796,"version":"3.49.0"},"reference-count":99,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2023,2,8]],"date-time":"2023-02-08T00:00:00Z","timestamp":1675814400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100003329","name":"MEIC\/AEI\/10.13039\/501100011033","doi-asserted-by":"publisher","award":["DPI2017-87494-R"],"award-info":[{"award-number":["DPI2017-87494-R"]}],"id":[{"id":"10.13039\/501100003329","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003329","name":"MEIC\/AEI\/10.13039\/501100011033","doi-asserted-by":"publisher","award":["PDC2021-121644-I00"],"award-info":[{"award-number":["PDC2021-121644-I00"]}],"id":[{"id":"10.13039\/501100003329","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004837","name":"MCIN\/AEI\/10.13039\/501100011033","doi-asserted-by":"publisher","award":["DPI2017-87494-R"],"award-info":[{"award-number":["DPI2017-87494-R"]}],"id":[{"id":"10.13039\/501100004837","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004837","name":"MCIN\/AEI\/10.13039\/501100011033","doi-asserted-by":"publisher","award":["PDC2021-121644-I00"],"award-info":[{"award-number":["PDC2021-121644-I00"]}],"id":[{"id":"10.13039\/501100004837","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Motivated by the pervasiveness of artificial intelligence (AI) and the Internet of Things (IoT) in the current \u201csmart everything\u201d scenario, this article provides a comprehensive overview of the most recent research at the intersection of both domains, focusing on the design and development of specific mechanisms for enabling a collaborative inference across edge devices towards the in situ execution of highly complex state-of-the-art deep neural networks (DNNs), despite the resource-constrained nature of such infrastructures. In particular, the review discusses the most salient approaches conceived along those lines, elaborating on the specificities of the partitioning schemes and the parallelism paradigms explored, providing an organized and schematic discussion of the underlying workflows and associated communication patterns, as well as the architectural aspects of the DNNs that have driven the design of such techniques, while also highlighting both the primary challenges encountered at the design and operational levels and the specific adjustments or enhancements explored in response to them.<\/jats:p>","DOI":"10.3390\/s23041911","type":"journal-article","created":{"date-parts":[[2023,2,8]],"date-time":"2023-02-08T06:00:05Z","timestamp":1675836005000},"page":"1911","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":15,"title":["Horizontally Distributed Inference of Deep Neural Networks for AI-Enabled IoT"],"prefix":"10.3390","volume":"23","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9619-4852","authenticated-orcid":false,"given":"Ivan","family":"Rodriguez-Conde","sequence":"first","affiliation":[{"name":"Department of Computer Science, University of Arkansas at Little Rock, 2801 South University Avenue, Little Rock, AR 72204, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8849-4989","authenticated-orcid":false,"given":"Celso","family":"Campos","sequence":"additional","affiliation":[{"name":"Department of Computer Science, ESEI\u2014Escuela Superior de Ingenier\u00eda Inform\u00e1tica, Universidade de Vigo, 32004 Ourense, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3943-8013","authenticated-orcid":false,"given":"Florentino","family":"Fdez-Riverola","sequence":"additional","affiliation":[{"name":"CINBIO, Department of Computer Science, ESEI\u2014Escuela Superior de Ingenier\u00eda Inform\u00e1tica, Universidade de Vigo, 32004 Ourense, Spain"},{"name":"SING Research Group, Galicia Sur Health Research Institute (IIS Galicia Sur), SERGAS-UVIGO, 36213 Vigo, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2023,2,8]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Zheng, L.-R., Tenhunen, H., and Zou, Z. (2018). Smart Electronic Systems: Heterogeneous Integration of Silicon and Printed Electronicsl, John Wiley & Sons.","DOI":"10.1002\/9783527691685"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"97","DOI":"10.1016\/j.eswa.2019.05.014","article-title":"The Internet of Things: Review and theoretical framework","volume":"133","author":"Nord","year":"2019","journal-title":"Expert Syst. Appl."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"3152","DOI":"10.1109\/TITS.2019.2929020","article-title":"Deep Learning for Intelligent Transportation Systems: A Survey of Emerging Trends","volume":"21","author":"Veres","year":"2020","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"156237","DOI":"10.1109\/ACCESS.2019.2949703","article-title":"A Survey on the Role of IoT in Agriculture for the Implementation of Smart Farming","volume":"7","author":"Farooq","year":"2019","journal-title":"IEEE Access"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"312","DOI":"10.1016\/j.jmsy.2020.06.010","article-title":"Smart manufacturing process and system automation\u2014A critical review of the standards and envisioned scenarios","volume":"56","author":"Lu","year":"2020","journal-title":"J. Manuf. Syst."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"26521","DOI":"10.1109\/ACCESS.2017.2775180","article-title":"Internet of Things for Smart Healthcare: Technologies, Challenges, and Opportunities","volume":"5","author":"Baker","year":"2017","journal-title":"IEEE Access"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"5455","DOI":"10.1007\/s10462-020-09825-6","article-title":"A survey of the recent architectures of deep convolutional neural networks","volume":"53","author":"Khan","year":"2020","journal-title":"Artif. Intell. Rev."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"450","DOI":"10.1109\/JIOT.2017.2750180","article-title":"Mobile Edge Computing: A Survey","volume":"5","author":"Abbas","year":"2018","journal-title":"IEEE Internet Things J."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Rodriguez-Conde, I., Campos, C., and Fdez-Riverola, F. (Neurocomputing, 2022). Cloud-Assisted Collaborative Inference of Convolutional Neural Networks for Vision Tasks on Resource-Constrained Devices, Neurocomputing, submitted for publication.","DOI":"10.1016\/j.neucom.2023.126835"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1109\/MCOM.2015.7120041","article-title":"On the computation offloading at ad hoc cloudlet: Architecture and service modes","volume":"53","author":"Chen","year":"2015","journal-title":"IEEE Commun. Mag."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1738","DOI":"10.1109\/JPROC.2019.2918951","article-title":"Edge Intelligence: Paving the Last Mile of Artificial Intelligence with Edge Computing","volume":"107","author":"Zhou","year":"2019","journal-title":"Proc. IEEE"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1655","DOI":"10.1109\/JPROC.2019.2921977","article-title":"Deep Learning with Edge Computing: A Review","volume":"107","author":"Chen","year":"2019","journal-title":"Proc. IEEE"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Mej\u00edas, B., and Roy, P.V. (2010, January 27\u201328). From Mini-clouds to Cloud Computing. Proceedings of the 2010 Fourth IEEE International Conference on Self-Adaptive and Self-Organizing Systems Workshop, Budapest, Hungary.","DOI":"10.1109\/SASOW.2010.67"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"8","DOI":"10.1109\/MIC.2017.35","article-title":"On Using Micro-Clouds to Deliver the Fog","volume":"21","author":"Elkhatib","year":"2017","journal-title":"IEEE Internet Comput."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Bonomi, F., Milito, R., Zhu, J., and Addepalli, S. (2012, January 17). Fog Computing and its Role in the Internet of Things. Proceedings of the First Edition of the MCC Workshop on Mobile Cloud Computing, Helsinki, Finland.","DOI":"10.1145\/2342509.2342513"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Yao, J., Zhang, S., Yao, Y., Wang, F., Ma, J., Zhang, J., Chu, Y., Ji, L., Jia, K., and Shen, T. (2022). Edge-Cloud Polarization and Collaboration: A Comprehensive Survey for AI. IEEE Trans. Knowl. Data Eng., 1.","DOI":"10.1109\/TKDE.2022.3178211"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Filho, C.P., Marques, E., Chang, V., dos Santos, L., Bernardini, F., Pires, P.F., Ochi, L., and Delicato, F.C. (2022). A Systematic Literature Review on Distributed Machine Learning in Edge Computing. Sensors, 22.","DOI":"10.3390\/s22072665"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"869","DOI":"10.1109\/COMST.2020.2970550","article-title":"Convergence of Edge Computing and Deep Learning: A Comprehensive Survey","volume":"22","author":"Wang","year":"2020","journal-title":"IEEE Commun. Surv. Tutor."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3527155","article-title":"Split computing and early exiting for deep learning applications: Survey and research challenges","volume":"55","author":"Matsubara","year":"2022","journal-title":"ACM Comput. Surv."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Rausch, T., and Dustdar, S. (2019, January 24\u201327). Edge Intelligence: The Convergence of Humans, Things, and AI. Proceedings of the 2019 IEEE International Conference on Cloud Engineering (IC2E), Milan, Italy.","DOI":"10.1109\/IC2E.2019.00022"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3469029","article-title":"Machine Learning at the Network Edge: A Survey","volume":"54","author":"Murshed","year":"2021","journal-title":"ACM Comput. Surv."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"7457","DOI":"10.1109\/JIOT.2020.2984887","article-title":"Edge Intelligence: The Confluence of Edge Computing and Artificial Intelligence","volume":"7","author":"Deng","year":"2020","journal-title":"IEEE Internet Things J."},{"key":"ref_23","unstructured":"Xu, D., Li, T., Li, Y., Su, X., Tarkoma, S., and Jiang, T. (2020). Edge intelligence: Architectures, challenges, and applications. arXiv."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3377454","article-title":"A Survey on Distributed Machine Learning","volume":"53","author":"Verbraeken","year":"2020","journal-title":"ACM Comput. Surv."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3214306","article-title":"Edge cloud offloading algorithms: Issues, methods, and perspectives","volume":"52","author":"Wang","year":"2019","journal-title":"ACM Comput. Surv."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"2167","DOI":"10.1109\/COMST.2020.3007787","article-title":"Communication-Efficient Edge AI: Algorithms and Systems","volume":"22","author":"Shi","year":"2020","journal-title":"IEEE Commun. Surv. Tutor."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1584","DOI":"10.1109\/JPROC.2019.2922285","article-title":"Computation Offloading Toward Edge Computing","volume":"107","author":"Lin","year":"2019","journal-title":"Proc. IEEE"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Zou, Z., Jin, Y., Nevalainen, P., Huan, Y., Heikkonen, J., and Westerlund, T. (2019, January 18\u201320). Edge and Fog Computing Enabled AI for IoT-An Overview. Proceedings of the 2019 IEEE International Conference on Artificial Intelligence Circuits and Systems (AICAS), Hsinchu, Taiwan.","DOI":"10.1109\/AICAS.2019.8771621"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"71","DOI":"10.1016\/j.jpdc.2022.04.004","article-title":"Distributed intelligence on the Edge-to-Cloud Continuum: A systematic literature review","volume":"166","author":"Rosendo","year":"2022","journal-title":"J. Parallel Distrib. Comput."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Lane, N.D., Bhattacharya, S., Georgiev, P., Forlivesi, C., Jiao, L., Qendro, L., and Kawsar, F. (2016, January 11\u201314). DeepX: A Software Accelerator for Low-Power Deep Learning Inference on Mobile Devices. Proceedings of the 2016 15th ACM\/IEEE International Conference on Information Processing in Sensor Networks (IPSN), Vienna, Austria.","DOI":"10.1109\/IPSN.2016.7460664"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Li, H., Ng, J.K., and Abdelzaher, T. (2022, January 23\u201325). Enabling Real-time AI Inference on Mobile Devices via GPU-CPU Collaborative Execution. Proceedings of the 2022 IEEE 28th International Conference on Embedded and Real-Time Computing Systems and Applications (RTCSA), Taipei, Taiwan.","DOI":"10.1109\/RTCSA55878.2022.00027"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Dagli, I., Cieslewicz, A., McClurg, J., and Belviranli, M.E. (2021, January 5\u20139). AxoNN: Energy-aware execution of neural network inference on multi-accelerator heterogeneous SoCs. Proceedings of the 59th ACM\/IEEE Design Automation Conference, San Francisco, CA, USA.","DOI":"10.1145\/3489517.3530572"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep Residual Learning for Image Recognition. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_34","unstructured":"Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"84","DOI":"10.1145\/3065386","article-title":"ImageNet classification with deep convolutional neural networks","volume":"60","author":"Krizhevsky","year":"2017","journal-title":"Commun. ACM"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Liu, S., and Deng, W. (2015, January 3\u20136). Very deep convolutional neural network based image classification using small training sample size. Proceedings of the 2015 3rd IAPR Asian Conference on Pattern Recognition (ACPR), Kuala Lumpur, Malaysia.","DOI":"10.1109\/ACPR.2015.7486599"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., and Anguelov, D. (2015, January 7\u201312). Going deeper with convolutions. Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298594"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Chen, T., Du, Z., Sun, N., Wang, J., Wu, C., Chen, Y., and Temam, O. (2014, January 1\u20135). DianNao: A small-footprint high-throughput accelerator for ubiquitous ma-chine-learning. Proceedings of the 19th International Conference on Architectural Support for Programming Languages and Operating Systems, Salt Lake City, UT, USA.","DOI":"10.1145\/2541940.2541967"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"292","DOI":"10.1109\/JETCAS.2019.2910232","article-title":"Eyeriss v2: A Flexible Accelerator for Emerging Deep Neural Networks on Mobile Devices","volume":"9","author":"Chen","year":"2019","journal-title":"IEEE J. Emerg. Sel. Top. Circuits Syst."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Yin, X., Chen, L., Zhang, X., and Gao, Z. (2018, January 6\u20138). Object Detection Implementation and Optimization on Embedded GPU System. Proceedings of the 2018 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB), Valencia, Spain.","DOI":"10.1109\/BMSB.2018.8436848"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Andargie, F.A., Rose, J., Austin, T., and Bertacco, V. (2017). Energy efficient object detection on the mobile GP-GPU. IEEE Africon, 945\u2013950.","DOI":"10.1109\/AFRCON.2017.8095609"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Zhang, C., Li, P., Sun, G., Guan, Y., Xiao, B., and Cong, J. (2015, January 22\u201324). Optimizing FPGA-based Accelerator Design for Deep Convolutional Neural Net-works. Proceedings of the 2015 ACM\/SIGDA International Symposium on Field-Programmable Gate Arrays, Monterey, CA, USA.","DOI":"10.1145\/2684746.2689060"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3289185","article-title":"[DL] A Survey of FPGA-based Neural Network Inference Accelerators","volume":"12","author":"Guo","year":"2019","journal-title":"ACM Trans. Reconfigurable Technol. Syst."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"64","DOI":"10.1631\/FITEE.1700789","article-title":"Recent advances in efficient computation of deep convolutional neural networks","volume":"19","author":"Cheng","year":"2018","journal-title":"Front. Inf. Technol. Electron. Eng."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"485","DOI":"10.1109\/JPROC.2020.2976475","article-title":"Model Compression and Hardware Acceleration for Neural Networks: A Comprehensive Survey","volume":"108","author":"Deng","year":"2020","journal-title":"Proc. IEEE"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Bhattacharya, S., and Lane, N.D. (2016, January 14\u201316). Sparsification and Separation of Deep Learning Layers for Constrained Resource Inference on Wearables. Proceedings of the 14th ACM Conference on Embedded Networked Sensor Systems (SenSys), Stanford, CA, USA.","DOI":"10.1145\/2994551.2994564"},{"key":"ref_47","unstructured":"Howard, A.G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., and Weyand, T. (2017). MobileNets: Efficient convolutional neural networks for mobile vision applications. arXiv."},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Redmon, J., and Farhadi, A. (2017, January 21\u201326). YOLO9000: Better, Faster, Stronger. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.690"},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"10469","DOI":"10.1007\/s00521-021-06830-w","article-title":"Optimized convolutional neural network architectures for efficient on-device vision-based object detection","volume":"34","author":"Campos","year":"2022","journal-title":"Neural Comput. Appl."},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Rodriguez-Conde, I., Campos, C., and Fdez-Riverola, F. (2021). On-Device Object Detection for More Efficient and Privacy-Compliant Visual Perception in Context-Aware Systems. Appl. Sci., 11.","DOI":"10.3390\/app11199173"},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Al-Turjman, F. (2019). Artificial Intelligence in IoT, Springer.","DOI":"10.1007\/978-3-030-04110-6"},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"65","DOI":"10.1109\/MNET.2019.1800339","article-title":"The Cognitive Internet of Vehicles for Autonomous Driving","volume":"33","author":"Lu","year":"2019","journal-title":"IEEE Netw."},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Strom, N. (2015, January 6\u201310). Scalable distributed DNN training using commodity GPU cloud computing. Proceedings of the Interspeech 2015, Dresden, Germany.","DOI":"10.21437\/Interspeech.2015-354"},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"393","DOI":"10.1109\/SURV.2013.062613.00160","article-title":"A Survey of Mobile Cloud Computing Application Models","volume":"16","author":"Khan","year":"2014","journal-title":"IEEE Commun. Surv. Tutor."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"1275","DOI":"10.1109\/JIOT.2018.2805263","article-title":"Edge Computing for the Internet of Things: A Case Study","volume":"5","author":"Premsankar","year":"2018","journal-title":"IEEE Internet Things J."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"2091","DOI":"10.1109\/JBHI.2018.2878878","article-title":"Large-Scale Multi-Class Image-Based Cell Classification with Deep Learning","volume":"23","author":"Meng","year":"2018","journal-title":"IEEE J. Biomed. Health Inform."},{"key":"ref_57","doi-asserted-by":"crossref","unstructured":"Hauswald, J., Kang, Y., Laurenzano, M.A., Chen, Q., Li, C., and Mudge, T. (2015, January 13\u201317). DjiNN and Tonic: DNN as a service and its implications for future warehouse scale computers. Proceedings of the 2015 ACM\/IEEE 42nd Annual International Symposium on Computer Architecture (ISCA), Portland, OR, USA.","DOI":"10.1145\/2749469.2749472"},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"106582","DOI":"10.1016\/j.asoc.2020.106582","article-title":"Deep learning architectures in emerging cloud computing architectures: Recent development, challenges and next research trend","volume":"96","author":"Jauro","year":"2020","journal-title":"Appl. Soft Comput."},{"key":"ref_59","doi-asserted-by":"crossref","first-page":"849","DOI":"10.1016\/j.future.2017.09.020","article-title":"Next generation cloud computing: New trends and research directions","volume":"79","author":"Varghese","year":"2018","journal-title":"Future Gener. Comput. Syst."},{"key":"ref_60","doi-asserted-by":"crossref","first-page":"8099","DOI":"10.1109\/JIOT.2020.2996784","article-title":"Collaborate Edge and Cloud Computing with Distributed Deep Learning for Smart City Internet of Things","volume":"7","author":"Wu","year":"2020","journal-title":"IEEE Internet Things J."},{"key":"ref_61","doi-asserted-by":"crossref","first-page":"587139","DOI":"10.3389\/fdata.2020.587139","article-title":"Securing Machine Learning in the Cloud: A Systematic Review of Cloud Machine Learning Security","volume":"3","author":"Qayyum","year":"2020","journal-title":"Front. Big Data"},{"key":"ref_62","doi-asserted-by":"crossref","unstructured":"Huang, D., and Wu, H. (2018). Mobile Cloud Computing, Morgan Kaufmann.","DOI":"10.1016\/B978-0-12-809641-3.00002-8"},{"key":"ref_63","doi-asserted-by":"crossref","first-page":"84","DOI":"10.1016\/j.future.2012.05.023","article-title":"Mobile cloud computing: A survey","volume":"29","author":"Fernando","year":"2013","journal-title":"Future Gener. Comput. Syst."},{"key":"ref_64","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1109\/MPRV.2009.82","article-title":"The Case for VM-Based Cloudlets in Mobile Computing","volume":"8","author":"Satyanarayanan","year":"2009","journal-title":"IEEE Pervasive Comput."},{"key":"ref_65","doi-asserted-by":"crossref","unstructured":"Tong, L., Li, Y., and Gao, W. (2016, January 10\u201314). A Hierarchical Edge Cloud Architecture for Mobile Computing. Proceedings of the IEEE INFOCOM 2016\u2014The 35th Annual IEEE International Conference on Computer Communications, San Francisco, CA, USA.","DOI":"10.1109\/INFOCOM.2016.7524340"},{"key":"ref_66","doi-asserted-by":"crossref","first-page":"615","DOI":"10.1145\/3093336.3037698","article-title":"Neurosurgeon: Collaborative intelligence between the cloud and mobile edge","volume":"52","author":"Kang","year":"2017","journal-title":"ACM SIGPLAN Not."},{"key":"ref_67","unstructured":"Jeong, H.-J., Lee, H.-J., Shin, C.H., and Moon, S.-M. (2018). Proceedings of the ACM Symposium on Cloud Computing, Association for Computing Machinery."},{"key":"ref_68","doi-asserted-by":"crossref","unstructured":"Hu, C., Bao, W., Wang, D., and Liu, F. (May, January 29). Dynamic Adaptive DNN Surgery for Inference Acceleration on the Edge. Proceedings of the IEEE INFOCOM 2019\u2014IEEE Conference on Computer Communications, Paris, France.","DOI":"10.1109\/INFOCOM.2019.8737614"},{"key":"ref_69","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3432192","article-title":"Towards Real-time Cooperative Deep Inference over the Cloud and Edge End Devices","volume":"4","author":"Zhang","year":"2020","journal-title":"Proc. ACM Interact. Mob. Wearable Ubiquitous Technol."},{"key":"ref_70","doi-asserted-by":"crossref","unstructured":"Mao, J., Chen, X., Nixon, K.W., and Krieger, C. (2017, January 27\u201331). MoDNN: Local distributed mobile computing system for Deep Neural Network. Proceedings of the Design, Automation & Test in Europe Conference & Exhibition (DATE), Lausanne, Switzerland.","DOI":"10.23919\/DATE.2017.7927211"},{"key":"ref_71","doi-asserted-by":"crossref","unstructured":"Mao, J., Yang, Z., Wen, W., Wu, C., Song, L., Nixon, K.W., Chen, X., Li, H., and Chen, Y. (2017, January 13\u201316). MeDNN: A distributed mobile system with enhanced partition and deployment for large-scale DNNs. Proceedings of the 2017 IEEE\/ACM International Conference on Computer-Aided Design (ICCAD), Irvine, CA, USA.","DOI":"10.1109\/ICCAD.2017.8203852"},{"key":"ref_72","doi-asserted-by":"crossref","unstructured":"Hadidi, R., Cao, J., Woodward, M., Ryoo, M.S., and Kim, H. (2018). Musical chair: Efficient real-time recognition using collaborative iot devices. arXiv.","DOI":"10.1145\/3229762.3229765"},{"key":"ref_73","doi-asserted-by":"crossref","first-page":"2348","DOI":"10.1109\/TCAD.2018.2858384","article-title":"DeepThings: Distributed Adaptive Deep Learning Inference on Resource-Constrained IoT Edge Clusters","volume":"37","author":"Zhao","year":"2018","journal-title":"IEEE Trans. Comput. Des. Integr. Circuits Syst."},{"key":"ref_74","doi-asserted-by":"crossref","unstructured":"Du, J., Shen, M., and Du, Y. (2020, January 18\u201321). A Distributed In-Situ CNN Inference System for IoT Applications. Proceedings of the 2020 IEEE 38th International Conference on Computer Design (ICCD), Hartford, CT, USA.","DOI":"10.1109\/ICCD50377.2020.00055"},{"key":"ref_75","unstructured":"Hadidi, R., Asgari, B., Cao, J., Bae, Y., Shim, D.E., and Kim, H. (2020). LCP: A low-communication parallelization method for fast neural network in-ference in image recognition. arXiv."},{"key":"ref_76","doi-asserted-by":"crossref","first-page":"4950","DOI":"10.1109\/JIOT.2020.2972000","article-title":"Toward Collaborative Inferencing of Deep Neural Networks on Internet-of-Things Devices","volume":"7","author":"Hadidi","year":"2020","journal-title":"IEEE Internet Things J."},{"key":"ref_77","doi-asserted-by":"crossref","unstructured":"Hu, D., and Krishnamachari, B. (2020, January 21\u201324). Fast and Accurate Streaming CNN Inference via Communication Compression on the Edge. Proceedings of the 2020 IEEE\/ACM Fifth International Conference on Internet-of-Things Design and Implementation (IoTDI), Sydney, Australia.","DOI":"10.1109\/IoTDI49375.2020.00023"},{"key":"ref_78","doi-asserted-by":"crossref","unstructured":"Miao, W., Zeng, Z., Wei, L., Li, S., Jiang, C., and Zhang, Z. (2020, January 2\u20134). Adaptive DNN Partition in Edge Computing Environments. Proceedings of the 2020 IEEE 26th International Conference on Parallel and Distributed Systems (ICPADS), Hong Kong, China.","DOI":"10.1109\/ICPADS51040.2020.00097"},{"key":"ref_79","doi-asserted-by":"crossref","first-page":"314","DOI":"10.1109\/TMC.2019.2893250","article-title":"DeepWear: Adaptive Local Offloading for On-Wearable Deep Learning","volume":"19","author":"Xu","year":"2019","journal-title":"IEEE Trans. Mob. Comput."},{"key":"ref_80","doi-asserted-by":"crossref","unstructured":"Xue, F., Fang, W., Xu, W., Wang, Q., Ma, X., and Ding, Y. (2020, January 14\u201316). EdgeLD: Locally Distributed Deep Learning Inference on Edge Device Clusters. Proceedings of the 2020 IEEE 22nd International Conference on High Performance Computing and Communications; IEEE 18th International Conference on Smart City; IEEE 6th International Conference on Data Science and Systems (HPCC\/SmartCity\/DSS), Yanuca Island, Cuvu, Fiji.","DOI":"10.1109\/HPCC-SmartCity-DSS50907.2020.00078"},{"key":"ref_81","doi-asserted-by":"crossref","unstructured":"Zhang, S.Q., Lin, J., and Zhang, Q. (2020, January 17\u201320). Adaptive distributed convolutional neural network inference at the network edge with ADCNN. Proceedings of the 49th International Conference on Parallel Processing-ICPP, Edmonton, AB, Canada.","DOI":"10.1145\/3404397.3404473"},{"key":"ref_82","doi-asserted-by":"crossref","unstructured":"Dhuheir, M., Baccour, E., Erbad, A., Sabeeh, S., and Hamdi, M. (July, January 28). Efficient Real-Time Image Recognition Using Collaborative Swarm of UAVs and Convolutional Networks. Proceedings of the 2021 International Wireless Communications and Mobile Computing (IWCMC), Harbin, China.","DOI":"10.1109\/IWCMC51323.2021.9498967"},{"key":"ref_83","first-page":"1665","article-title":"Model Parallelism Optimization for Distributed Inference via Decoupled CNN Structure","volume":"32","author":"Du","year":"2020","journal-title":"IEEE Trans. Parallel Distrib. Syst."},{"key":"ref_84","doi-asserted-by":"crossref","first-page":"160607","DOI":"10.1109\/ACCESS.2021.3131396","article-title":"Low Latency Deep Learning Inference Model for Distributed Intelligent IoT Edge Clusters","volume":"9","author":"Naveen","year":"2021","journal-title":"IEEE Access"},{"key":"ref_85","doi-asserted-by":"crossref","unstructured":"Yang, X., Qi, Q., Wang, J., Guo, S., and Liao, J. (2021, January 7\u201310). Towards Efficient Inference: Adaptively Cooperate in Heterogeneous IoT Edge Cluster. Proceedings of the 2021 IEEE 41st International Conference on Distributed Computing Systems (ICDCS), Washington, DC, USA.","DOI":"10.1109\/ICDCS51616.2021.00011"},{"key":"ref_86","doi-asserted-by":"crossref","first-page":"595","DOI":"10.1109\/TNET.2020.3042320","article-title":"CoEdge: Cooperative DNN Inference with Adaptive Workload Partitioning Over Heterogeneous Edge Devices","volume":"29","author":"Zeng","year":"2020","journal-title":"IEEE\/ACM Trans. Netw."},{"key":"ref_87","doi-asserted-by":"crossref","first-page":"2175","DOI":"10.1109\/TPDS.2021.3058532","article-title":"DeepSlicing: Collaborative and Adaptive CNN Inference with Low Latency","volume":"32","author":"Miao","year":"2021","journal-title":"IEEE Trans. Parallel Distrib. Syst."},{"key":"ref_88","doi-asserted-by":"crossref","unstructured":"Goel, A., Tung, C., Hu, X., Thiruvathukal, G.K., Davis, J.C., and Lu, Y.H. (2022, January 17\u201320). Efficient Computer Vision on Edge Devices with Pipeline-Parallel Hi-erarchical Neural Networks. Proceedings of the 2022 27th Asia and South Pacific Design Automation Conference (ASP-DAC), Taipei, Taiwan.","DOI":"10.1109\/ASP-DAC52403.2022.9712574"},{"key":"ref_89","doi-asserted-by":"crossref","unstructured":"Hu, C., and Li, B. (2022, January 2\u20135). Distributed Inference with Deep Learning Models across Heterogeneous Edge Devices. Proceedings of the IEEE INFOCOM 2022\u2014IEEE Conference on Computer Communications, Virtual.","DOI":"10.1109\/INFOCOM48880.2022.9796896"},{"key":"ref_90","doi-asserted-by":"crossref","first-page":"1227","DOI":"10.1109\/JIOT.2021.3079164","article-title":"Distributed CNN Inference on Resource-Constrained UAVs for Surveillance Systems: Design and Optimization","volume":"9","author":"Jouhari","year":"2022","journal-title":"IEEE Internet Things J."},{"key":"ref_91","doi-asserted-by":"crossref","unstructured":"Parthasarathy, A., and Krishnamachari, B. (2022, January 4\u20138). DEFER: Distributed Edge Inference for Deep Neural Networks. Proceedings of the 2022 14th International Conference on COMmunication Systems & NETworkS (COMSNETS), Bengaluru, India.","DOI":"10.1109\/COMSNETS53615.2022.9668515"},{"key":"ref_92","first-page":"337","article-title":"An Evolutionary Secure Energy Efficient Routing Protocol in Internet of Things","volume":"10","author":"Reddy","year":"2017","journal-title":"Int. J. Intell. Eng. Syst."},{"key":"ref_93","unstructured":"Coates, A., Huval, B., Wang, T., Wu, D., Catanzaro, B., and Andrew, N. (2013, January 16\u201321). Deep learning with COTS HPC systems. Proceedings of the International Conference on Machine Learning, Atlanta, GA, USA."},{"key":"ref_94","doi-asserted-by":"crossref","unstructured":"He, Y., Liu, X., Zhong, H., and Ma, Y. (2019, January 7\u201311). AddressNet: Shift-based primitives for efficient convolutional neural networks. Proceedings\u20142019 IEEE Winter Conference on Applications of Computer Vision, WACV 2019, Waikoloa Village, HI, USA.","DOI":"10.1109\/WACV.2019.00134"},{"key":"ref_95","doi-asserted-by":"crossref","unstructured":"Xie, X., Zhou, Y., and Kung, S.Y. (2020, January 25\u201328). Exploring Highly Efficient Compact Neural Networks for Image Classification. Proceedings of the 2020 IEEE International Conference on Image Processing (ICIP), Abu Dhabi, United Arab Emirates.","DOI":"10.1109\/ICIP40778.2020.9191334"},{"key":"ref_96","doi-asserted-by":"crossref","unstructured":"Zhang, X., Zhou, X., Lin, M., and Sun, J. (2018, January 18\u201322). ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devices. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00716"},{"key":"ref_97","doi-asserted-by":"crossref","unstructured":"Fiergolla, S., and Wolf, P. (2021, January 23\u201326). Improving Run Length Encoding by Preprocessing. Proceedings of the 2021 Data Compression Conference (DCC), Virtual.","DOI":"10.1109\/DCC50243.2021.00051"},{"key":"ref_98","doi-asserted-by":"crossref","unstructured":"Gia, T.N., Qingqing, L., Queralta, J.P., Tenhunen, H., Zou, Z., and Westerlund, T. (2019, January 4\u20136). Lossless Compression Techniques in Edge Computing for Mis-sion-Critical Applications in the IoT. Proceedings of the 2019 Twelfth International Conference on Mobile Computing and Ubiquitous Network (ICMU), Kathmandu, Nepal.","DOI":"10.23919\/ICMU48249.2019.9006647"},{"key":"ref_99","doi-asserted-by":"crossref","unstructured":"Merenda, M., Porcaro, C., and Iero, D. (2020). Edge Machine Learning for AI-Enabled IoT Devices: A Review. Sensors, 20.","DOI":"10.3390\/s20092533"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/4\/1911\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T18:28:13Z","timestamp":1760120893000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/4\/1911"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,2,8]]},"references-count":99,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2023,2]]}},"alternative-id":["s23041911"],"URL":"https:\/\/doi.org\/10.3390\/s23041911","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,2,8]]}}}