{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T01:50:05Z","timestamp":1760233805796,"version":"build-2065373602"},"reference-count":33,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2021,2,24]],"date-time":"2021-02-24T00:00:00Z","timestamp":1614124800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JSAN"],"abstract":"<jats:p>Cyber-Physical Systems (CPSs) are a mature research technology topic that deals with Artificial Intelligence (AI) and Embedded Systems (ES). They interact with the physical world via sensors\/actuators to solve problems in several applications (robotics, transportation, health, etc.). These CPSs deal with data analysis, which need powerful algorithms combined with robust hardware architectures. On one hand, Deep Learning (DL) is proposed as the main solution algorithm. On the other hand, the standard design and prototyping methodologies for ES are not adapted to modern DL-based CPS. In this paper, we investigate AI design for CPS around embedded DL. The main contribution of this work is threefold: (1) We define an embedded DL methodology based on a Multi-CPU\/FPGA platform. (2) We propose a new hardware design architecture of a Neural Network Processor (NNP) for DL algorithms. The computation time of a feed forward sequence is estimated to 23 ns for each parameter. (3) We validate the proposed methodology and the DL-based NNP using a smart LIDAR application use-case. The input of our NNP is a voxel grid hardware computed from 3D point cloud. Finally, the results show that our NNP is able to process Dense Neural Network (DNN) architecture without bias.<\/jats:p>","DOI":"10.3390\/jsan10010018","type":"journal-article","created":{"date-parts":[[2021,2,26]],"date-time":"2021-02-26T09:47:20Z","timestamp":1614332840000},"page":"18","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Embedded Deep Learning Prototyping Approach for Cyber-Physical Systems: Smart LIDAR Case Study"],"prefix":"10.3390","volume":"10","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8146-9243","authenticated-orcid":false,"given":"Quentin","family":"Cabanes","sequence":"first","affiliation":[{"name":"INSEEC U Research Center, 75015 Paris, France"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Benaoumeur","family":"Senouci","sequence":"additional","affiliation":[{"name":"INSEEC U Research Center, 75015 Paris, France"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Amar","family":"Ramdane-Cherif","sequence":"additional","affiliation":[{"name":"Laboratoire LISV, Universit\u00e9 Versailles Saint-Quentin, 78035 Versailles, France"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,2,24]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"436","DOI":"10.1038\/nature14539","article-title":"Deep learning","volume":"521","author":"LeCun","year":"2015","journal-title":"Nature"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Wickramasinghe, C.S., Marino, D.L., Amarasinghe, K., and Manic, M. (2018, January 21\u201323). Generalization of Deep Learning for Cyber-Physical System Security: A Survey. Proceedings of the IECON 2018\u201444th Annual Conference of the IEEE Industrial Electronics Society, Washington, DC, USA.","DOI":"10.1109\/IECON.2018.8591773"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Arif, A., Barrigon, F.A., Gregoretti, F., Iqbal, J., Lavagno, L., Lazarescu, M.T., Ma, L., Palomino, M., and Segura, J.L.L. (2018). Performance and energy-efficient implementation of a smart city application on FPGAs. J. Real-Time Image Process.","DOI":"10.1007\/s11554-018-0792-x"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Wang, C., Yu, Q., Gong, L., Li, X., Xie, Y., and Zhou, X. (2016). DLAU: A Scalable Deep Learning Accelerator Unit on FPGA. arXiv.","DOI":"10.1109\/TCAD.2016.2587683"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"159","DOI":"10.1007\/s11554-012-0267-4","article-title":"A comprehensive comparison of GPU- and FPGA-based acceleration of reflection image reconstruction for 3D ultrasound computer tomography","volume":"9","author":"Birk","year":"2014","journal-title":"J. Real-Time Image Process."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"537","DOI":"10.1145\/1142980.1142982","article-title":"System level design paradigms: Platform-based design and communication synthesis","volume":"11","author":"Pinto","year":"2006","journal-title":"ACM Trans. Des. Autom. Electron. Syst."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"2104","DOI":"10.1109\/JPROC.2015.2453253","article-title":"A Platform-Based Design Methodology With Contracts and Related Tools for the Design of Cyber-Physical Systems","volume":"103","author":"Nuzzo","year":"2015","journal-title":"Proc. IEEE"},{"key":"ref_8","unstructured":"Lacey, G., Taylor, G.W., and Areibi, S. (2016). Deep Learning on FPGAs: Past, Present, and Future. arXiv."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Sze, V., Chen, Y.H., Yang, T.J., and Emer, J. (2017). Efficient Processing of Deep Neural Networks: A Tutorial and Survey. arXiv.","DOI":"10.1109\/JPROC.2017.2761740"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"746","DOI":"10.1007\/s11704-016-6159-1","article-title":"A survey of neural network accelerators","volume":"11","author":"Li","year":"2017","journal-title":"Front. Comput. Sci."},{"key":"ref_11","unstructured":"Abdelouahab, K., Pelcat, M., Serot, J., and Berry, F. (2018). Accelerating CNN inference on FPGAs: A Survey. arXiv."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3289185","article-title":"[DL] A Survey of FPGA-based Neural Network Inference Accelerators","volume":"12","author":"Guo","year":"2019","journal-title":"ACM Trans. Reconfig. Technol. Syst."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.sysarc.2018.12.010","article-title":"An integrated hardware\/software design methodology for signal processing systems","volume":"93","author":"Li","year":"2019","journal-title":"J. Syst. Archit."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"7823","DOI":"10.1109\/ACCESS.2018.2890150","article-title":"FPGA-Based Accelerators of Deep Learning Networks for Learning and Classification: A Review","volume":"7","author":"Shawahna","year":"2019","journal-title":"IEEE Access"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Maturana, D., and Scherer, S. (October, January 28). VoxNet: A 3D Convolutional Neural Network for real-time object recognition. Proceedings of the 2015 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Hamburg, Germany.","DOI":"10.1109\/IROS.2015.7353481"},{"key":"ref_16","unstructured":"Brock, A., Lim, T., Ritchie, J.M., and Weston, N. (2016). Generative and Discriminative Voxel Modeling with Convolutional Neural Networks. arXiv."},{"key":"ref_17","unstructured":"Huang, J., and You, S. (2016, January 4\u20138). Point cloud labeling using 3D Convolutional Neural Network. Proceedings of the 2016 23rd International Conference on Pattern Recognition (ICPR), Cancun, Mexico."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Charles, R.Q., Su, H., Kaichun, M., and Guibas, L.J. (2017, January 21\u201326). PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.16"},{"key":"ref_19","unstructured":"Zhi, S., Liu, Y., Li, X., and Guo, Y. (2017, January 23\u201324). LightNet: A Lightweight 3D Convolutional Neural Network for Real-Time 3D Object Recognition. Proceedings of the Eurographics Workshop on 3D Object Retrieval, Lyon, France."},{"key":"ref_20","unstructured":"Cabanes, Q. (2021, February 22). Automation Script of Bootable SDcard for Zynq Board. Available online: https:\/\/github.com\/Tigralt\/zynq-boot."},{"key":"ref_21","unstructured":"Cabanes, Q. (2021, February 22). Hardware Neural Network Processor. Available online: https:\/\/github.com\/Tigralt\/hardware-neural-network-processor."},{"key":"ref_22","unstructured":"(2021, February 22). Xilinx. Vivado Design Suite HLx Editions, 2018.3. Available online: https:\/\/www.xilinx.com\/support\/download\/index.html\/content\/xilinx\/en\/downloadNav\/vivado-design-tools\/archive.html."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Spinello, L., Arras, K.O., Triebel, R., and Siegwart, R. (2010, January 11\u201315). A Layered Approach to People Detection in 3D Range Data. Proceedings of the AAAI Conference on Artificial Intelligence (AAAI), Atlanta, GR, USA.","DOI":"10.1609\/aaai.v24i1.7728"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Spinello, L., Luber, M., and Arras, K.O. (2011, January 9\u201313). Tracking people in 3D using a bottom-up top-down detector. Proceedings of the 2011 IEEE International Conference on Robotics and Automation, Shanghai, China.","DOI":"10.1109\/ICRA.2011.5980085"},{"key":"ref_25","unstructured":"(2021, February 22). ZedBoard Zynq-7000 ARM\/FPGA SoC Development Board. Available online: https:\/\/store.digilentinc.com\/zedboard-zynq-7000-arm-fpga-soc-development-board\/."},{"key":"ref_26","unstructured":"(2021, February 22). Xilinx Zynq-7000 SoC. Available online: https:\/\/www.xilinx.com\/products\/silicon-devices\/soc\/zynq-7000.html."},{"key":"ref_27","unstructured":"Abadi, M., Barham, P., Chen, J., Chen, Z., Davis, A., Dean, J., Devin, M., Ghemawat, S., Irving, G., and Isard, M. (2021, February 22). TensorFlow: A System for Large-Scale Machine Learning. Available online: https:\/\/www.tensorflow.org\/."},{"key":"ref_28","unstructured":"LeCun, Y., and Cortes, C. (2021, February 22). MNIST Handwritten Digit Database. Available online: http:\/\/yann.lecun.com\/exdb\/mnist\/."},{"key":"ref_29","unstructured":"Krizhevsky, A. (2021, February 22). Learning Multiple Layers of Features from Tiny Images. Available online: https:\/\/www.cs.toronto.edu\/~kriz\/cifar.html."},{"key":"ref_30","unstructured":"Deuge, M.D., Quadros, A., Hung, C., and Douillard, B. (2021, February 22). Unsupervised Feature Learning for Classification of Outdoor 3D Scans 2013. Available online: http:\/\/www.acfr.usyd.edu.au\/papers\/SydneyUrbanObjectsDataset.shtml."},{"key":"ref_31","unstructured":"Quadros, A.J. (2013). Representing 3D Shape in Sparse Range Images for Urban Object Classification. [PhD Thesis, The University of Sydney]. Available online: http:\/\/www.acfr.usyd.edu.au\/papers\/SydneyUrbanObjectsDataset.shtml."},{"key":"ref_32","unstructured":"Oliphant, T. (2006). NumPy: A Guide to NumPy, Trelgol Publishing. Available online: https:\/\/numpy.org\/."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Cabanes, Q., Senouci, B., and Ramdane-Cherif, A. (2019, January 20\u201323). A Complete Multi-CPU\/FPGA-based Design and Prototyping Methodology for Autonomous Vehicles: Multiple Object Detection and Recognition Case Study. Proceedings of the 2019 International Conference on Artificial Intelligence in Information and Communication (ICAIIC), Okinawa, Japan.","DOI":"10.1109\/ICAIIC.2019.8669047"}],"container-title":["Journal of Sensor and Actuator Networks"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2224-2708\/10\/1\/18\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T05:27:35Z","timestamp":1760160455000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2224-2708\/10\/1\/18"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,2,24]]},"references-count":33,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2021,3]]}},"alternative-id":["jsan10010018"],"URL":"https:\/\/doi.org\/10.3390\/jsan10010018","relation":{},"ISSN":["2224-2708"],"issn-type":[{"type":"electronic","value":"2224-2708"}],"subject":[],"published":{"date-parts":[[2021,2,24]]}}}