{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,18]],"date-time":"2026-06-18T08:11:12Z","timestamp":1781770272122,"version":"3.54.5"},"reference-count":25,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2023,2,14]],"date-time":"2023-02-14T00:00:00Z","timestamp":1676332800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Chinese Universities Industry-University-Research Innovation Fund","award":["2020HYA02011"],"award-info":[{"award-number":["2020HYA02011"]}]},{"name":"Chinese Universities Industry-University-Research Innovation Fund","award":["ZR2019LZH002"],"award-info":[{"award-number":["ZR2019LZH002"]}]},{"name":"Chinese Universities Industry-University-Research Innovation Fund","award":["ZR2019LZH002"],"award-info":[{"award-number":["ZR2019LZH002"]}]},{"name":"Natural Science Foundation of Shandong Province","award":["2020HYA02011"],"award-info":[{"award-number":["2020HYA02011"]}]},{"name":"Natural Science Foundation of Shandong Province","award":["ZR2019LZH002"],"award-info":[{"award-number":["ZR2019LZH002"]}]},{"name":"Natural Science Foundation of Shandong Province","award":["ZR2019LZH002"],"award-info":[{"award-number":["ZR2019LZH002"]}]},{"name":"Shanghai science and technology committee","award":["2020HYA02011"],"award-info":[{"award-number":["2020HYA02011"]}]},{"name":"Shanghai science and technology committee","award":["ZR2019LZH002"],"award-info":[{"award-number":["ZR2019LZH002"]}]},{"name":"Shanghai science and technology committee","award":["ZR2019LZH002"],"award-info":[{"award-number":["ZR2019LZH002"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Algorithms"],"abstract":"<jats:p>Convolutional neural networks (CNNs) have made impressive achievements in image classification and object detection. For hardware with limited resources, it is not easy to achieve CNN inference with a large number of parameters without external storage. Model parallelism is an effective way to reduce resource usage by distributing CNN inference among several devices. However, parallelizing a CNN model is not easy, because CNN models have an essentially tightly-coupled structure. In this work, we propose a novel model parallelism method to decouple the CNN structure with group convolution and a new channel shuffle procedure. Our method could eliminate inter-device synchronization while reducing the memory footprint of each device. Using the proposed model parallelism method, we designed a parallel FPGA accelerator for the classic CNN model ShuffleNet. This accelerator was further optimized with features such as aggregate read and kernel vectorization to fully exploit the hardware-level parallelism of the FPGA. We conducted experiments with ShuffleNet on two FPGA boards, each of which had an Intel Arria 10 GX1150 and 16GB DDR3 memory. The experimental results showed that when using two devices, ShuffleNet achieved a 1.42\u00d7 speed increase and reduced its memory footprint by 34%, as compared to its non-parallel counterpart, while maintaining accuracy.<\/jats:p>","DOI":"10.3390\/a16020110","type":"journal-article","created":{"date-parts":[[2023,2,14]],"date-time":"2023-02-14T01:41:06Z","timestamp":1676338866000},"page":"110","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":13,"title":["Model Parallelism Optimization for CNN FPGA Accelerator"],"prefix":"10.3390","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0936-3612","authenticated-orcid":false,"given":"Jinnan","family":"Wang","sequence":"first","affiliation":[{"name":"School of Computer Engineering and Science, Shanghai University, Shanghai 200444, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Weiqin","family":"Tong","sequence":"additional","affiliation":[{"name":"School of Computer Engineering and Science, Shanghai University, Shanghai 200444, China"},{"name":"Shanghai Engineering Research Center of Intelligent Computing System, Shanghai University, Shanghai 200444, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xiaoli","family":"Zhi","sequence":"additional","affiliation":[{"name":"School of Computer Engineering and Science, Shanghai University, Shanghai 200444, China"},{"name":"Shanghai Engineering Research Center of Intelligent Computing System, Shanghai University, Shanghai 200444, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2023,2,14]]},"reference":[{"key":"ref_1","first-page":"6999","article-title":"A survey of Convolutional Neural Networks: Analysis, applications, and prospects","volume":"32","author":"Li","year":"2021","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Ma, Y., and Huang, C. (2021, January 26\u201328). Facial expression recognition based on deep learning and attention mechanism. Proceedings of the 2021 3rd International Conference on Advanced Information Science and System (AISS 2021), Sanya, China.","DOI":"10.1145\/3503047.3503052"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"6180317","DOI":"10.1155\/2020\/6180317","article-title":"Image Recognition Based on Multiscale Pooling Deep Convolution Neural Networks","volume":"2020","author":"Sang","year":"2020","journal-title":"Complexity"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Zhang, C., Li, P., Sun, G., Guan, Y., Xiao, B., and Cong, J. (2015, January 22\u201324). Optimizing FPGA-based accelerator design for deep convolutional Neural Networks. Proceedings of the 2015 ACM\/SIGDA International Symposium on Field-Programmable Gate Arrays, Monterey, CA, USA.","DOI":"10.1145\/2684746.2689060"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Gokhale, V., Jin, J., Dundar, A., Martini, B., and Culurciello, E. (2014, January 23\u201328). A 240 G-ops\/S mobile coprocessor for Deep Neural Networks. Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops, Columbus, OH, USA.","DOI":"10.1109\/CVPRW.2014.106"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Chen, Y., Luo, T., Liu, S., Zhang, S., He, L., Wang, J., Li, L., Chen, T., Xu, Z., and Sun, N. (2014, January 13\u201317). Dadiannao: A machine-learning supercomputer. Proceedings of the 2014 47th Annual IEEE\/ACM International Symposium on Microarchitecture, Cambridge, UK.","DOI":"10.1109\/MICRO.2014.58"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Munshi, A. (2009, January 23\u201325). The opencl specification. Proceedings of the 2009 IEEE Hot Chips 21 Symposium (HCS), Stanford, CA, USA.","DOI":"10.1109\/HOTCHIPS.2009.7478342"},{"key":"ref_8","first-page":"1665","article-title":"Model parallelism optimization for distributed inference via decoupled CNN structure","volume":"32","author":"Du","year":"2021","journal-title":"IEEE Trans. Parallel Distrib. Syst."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Zhang, X., Zhou, X., Lin, M., and Sun, J. (2018, January 18\u201322). ShuffleNet: An extremely efficient convolutional neural network for mobile devices. Proceedings of the 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00716"},{"key":"ref_10","unstructured":"Howard, A.G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., and Adam, H. (2017). Mobilenets: Efficient convolutional neural networks for mobile vision applications. arXiv."},{"key":"ref_11","unstructured":"Intel (2022, August 23). Intel FPGA SDK for Opencl Pro Edition: Programming Guide. Available online: https:\/\/www.mouser.com\/datasheet\/2\/612\/aocl_programming_guide-1301807.pdf."},{"key":"ref_12","unstructured":"Xilinx (2022, August 23). Vivado High Level Synthesis. Available online: https:\/\/www.xilinx.com\/video\/hardware\/vivado-high-level-synthesis.html."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Canis, A., Choi, J., Fort, B., Lian, R., Huang, Q., Calagar, N., Gort, M., Qin, J.J., Aldham, M., and Czajkowski, T. (October, January 29). From software to accelerators with LegUp high-level synthesis. Proceedings of the 2013 International Conference on Compilers, Architecture and Synthesis for Embedded Systems (CASES), Montreal, QC, Canada.","DOI":"10.1109\/CASES.2013.6662524"},{"key":"ref_14","unstructured":"Krizhevsky, A. (2014). One weird trick for parallelizing convolutional neural networks. arXiv."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"5449","DOI":"10.3233\/JIFS-171329","article-title":"Single binding of data and model parallelisms to parallelize convolutional neural networks through multiple machines","volume":"35","author":"Jin","year":"2018","journal-title":"J. Intell. Fuzzy Syst."},{"key":"ref_16","unstructured":"Mao, J., Chen, X., Nixon, K.W., Krieger, C., and Chen, Y. (2017). Design, Automation & Test in Europe Conference & Exhibition (DATE), IEEE."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"2348","DOI":"10.1109\/TCAD.2018.2858384","article-title":"DeepThings: Distributed Adaptive Deep Learning Inference on resource-constrained IOT edge clusters","volume":"37","author":"Zhao","year":"2018","journal-title":"IEEE Trans. Comput.-Aided Des. Integr. Circuits Syst."},{"key":"ref_18","unstructured":"Michael, M., Mikael, H., and Yann, L.C. (2013). Fast training of convolutional networks through ffts. arXiv."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Kang, D., Kim, E., Bae, I., Egger, B., and Ha, S. (2018, January 5\u20138). C-good. Proceedings of the International Conference on Computer-Aided Design (ICCAD), San Diego, CA, USA.","DOI":"10.1145\/3240765.3240786"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Huynh, L.N., Balan, R.K., and Lee, Y. (2016, January 30). DeepSense. Proceedings of the 2016 Workshop on Wearable Systems and Applications\u2014WearSys \u201916, Singapore.","DOI":"10.1145\/2935643.2935650"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Huynh, L.N., Lee, Y., and Balan, R.K. (2017, January 19\u201323). Deepmon. Proceedings of the 15th Annual International Conference on Mobile Systems, Applications, and Services, Niagara Falls, NY, USA.","DOI":"10.1145\/3081333.3081360"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"17","DOI":"10.1145\/3079758","article-title":"Throughput-optimized FPGA accelerator for deep convolutional neural networks","volume":"10","author":"Liu","year":"2017","journal-title":"ACM Trans. Reconfigurable Technol. Syst."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Wang, D., An, J., and Ke, X. (2016). PipeCNN: An OpenCL-Based FPGA Accelerator for Large-Scale Convolution Neuron Networks. arXiv.","DOI":"10.1109\/FPT.2017.8280160"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Suda, N., Chandra, V., Dasika, G., Mohanty, A., Ma, Y., Vrudhula, S., Seo, J.S., and Cao, Y. (2016, January 21\u201323). Throughput-optimized opencl-based FPGA accelerator for large-scale convolutional neural networks. Proceedings of the 2016 ACM\/SIGDA International Symposium on Field-Programmable Gate Arrays, Monterey, CA, USA.","DOI":"10.1145\/2847263.2847276"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Aydonat, U., O\u2019Connell, S., Capalija, D., Ling, A.C., and Chiu, G.R. (2017, January 22\u201324). An opencl\u2122 deep learning accelerator on arria 10. Proceedings of the 2017 ACM\/SIGDA International Symposium on Field-Programmable Gate Arrays, Monterey, CA, USA.","DOI":"10.1145\/3020078.3021738"}],"container-title":["Algorithms"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-4893\/16\/2\/110\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T18:34:24Z","timestamp":1760121264000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-4893\/16\/2\/110"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,2,14]]},"references-count":25,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2023,2]]}},"alternative-id":["a16020110"],"URL":"https:\/\/doi.org\/10.3390\/a16020110","relation":{},"ISSN":["1999-4893"],"issn-type":[{"value":"1999-4893","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,2,14]]}}}