{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,11]],"date-time":"2026-06-11T16:08:26Z","timestamp":1781194106048,"version":"3.54.1"},"reference-count":46,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2021,5,31]],"date-time":"2021-05-31T00:00:00Z","timestamp":1622419200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001863","name":"New Energy and Industrial Technology Development Organization","doi-asserted-by":"publisher","award":["JPNP20006"],"award-info":[{"award-number":["JPNP20006"]}],"id":[{"id":"10.13039\/501100001863","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100002241","name":"Japan Science and Technology Agency","doi-asserted-by":"publisher","award":["JPMJAX190I"],"award-info":[{"award-number":["JPMJAX190I"]}],"id":[{"id":"10.13039\/501100002241","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>In many robotics studies, deep neural networks (DNNs) are being actively studied due to their good performance. However, existing robotic techniques and DNNs have not been systematically integrated, and packages for beginners are yet to be developed. In this study, we proposed a basic educational kit for robotic system development with DNNs. Our goal was to educate beginners in both robotics and machine learning, especially the use of DNNs. Initially, we required the kit to (1) be easy to understand, (2) employ experience-based learning, and (3) be applicable in many areas. To clarify the learning objectives and important parts of the basic educational kit, we analyzed the research and development (R&amp;D) of DNNs and divided the process into three steps of data collection (DC), machine learning (ML), and task execution (TE). These steps were configured under a hierarchical system flow with the ability to be executed individually at the development stage. To evaluate the practicality of the proposed system flow, we implemented it for a physical robotic grasping system using robotics middleware. We also demonstrated that the proposed system can be effectively applied to other hardware, sensor inputs, and robot tasks.<\/jats:p>","DOI":"10.3390\/s21113804","type":"journal-article","created":{"date-parts":[[2021,5,31]],"date-time":"2021-05-31T05:53:38Z","timestamp":1622440418000},"page":"3804","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["Development of a Basic Educational Kit for Robotic System with Deep Neural Networks"],"prefix":"10.3390","volume":"21","author":[{"given":"Momomi","family":"Kanamura","sequence":"first","affiliation":[{"name":"Department of Intermedia Art and Science, School of Fundamental Science and Engineering, Waseda University, Tokyo 169-8050, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7122-7649","authenticated-orcid":false,"given":"Kanata","family":"Suzuki","sequence":"additional","affiliation":[{"name":"Department of Intermedia Art and Science, School of Fundamental Science and Engineering, Waseda University, Tokyo 169-8050, Japan"},{"name":"Artificial Intelligence Laboratories, Fujitsu Laboratories Ltd., Kanagawa 211-8588, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yuki","family":"Suga","sequence":"additional","affiliation":[{"name":"Department of Intermedia Art and Science, School of Fundamental Science and Engineering, Waseda University, Tokyo 169-8050, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tetsuya","family":"Ogata","sequence":"additional","affiliation":[{"name":"Department of Intermedia Art and Science, School of Fundamental Science and Engineering, Waseda University, Tokyo 169-8050, Japan"},{"name":"National Institute of Advanced Industrial Science and Technology, Tokyo 100-8921, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2021,5,31]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Qureshi, A.H., Simeonov, A., Bency, M.J., and Yip, M.C. (2019, January 20\u201324). Motion Planning Networks. Proceedings of the 2019 International Conference on Robotics and Automation (ICRA), Montreal, QC, Canada.","DOI":"10.1109\/ICRA.2019.8793889"},{"key":"ref_2","first-page":"555","article-title":"Eye in hand robot arm based automated object grasping system","volume":"7","author":"Ishak","year":"2019","journal-title":"Period. Eng. Nat. Sci."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"397","DOI":"10.1109\/LRA.2016.2633383","article-title":"Repeatable Folding Task by Humanoid Robot Worker using Deep Learning","volume":"2","author":"Yang","year":"2016","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Ota, K., Sasaki, Y., Jha, D.K., Yoshiyasu, Y., and Kanezaki, A. (January, January 24). Efficient Exploration in Constrained Environments with Goal-Oriented Reference Path. Proceedings of the 2020 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Las Vegas, NV, USA.","DOI":"10.1109\/IROS45743.2020.9341620"},{"key":"ref_5","unstructured":"Yonetani, R., Taniai, T., Barekatain, M., Nishimura, M., and Kanezaki, A. (2020). Path Planning using Neural A* Search. arXiv."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Matsumoto, E., Saito, M., Kume, A., and Tan, J. (2020). End-to-end learning of object grasp poses in the amazon robotics challenge. Advances on Robotic Item Picking, Springer Nature.","DOI":"10.1007\/978-3-030-35679-8_6"},{"key":"ref_7","first-page":"1334","article-title":"End-to-end training of deep visuomotor policies","volume":"17","author":"Levine","year":"2016","journal-title":"J. Mach. Learn. Res."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Kawaharazuka, K., Ogawa, T., Tamura, J., and Nabeshima, C. (2019, January 20\u201324). Dynamic manipulation of flexible objects with torque sequence using a deep neural network. Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), Montreal, QC, Canada.","DOI":"10.1109\/ICRA.2019.8793513"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Kase, K., Suzuki, K., Yang, P.C., Mori, H., and Ogata, T. (2018, January 21\u201325). Put-In-Box Task Generated from Multiple Discrete Tasks by a Humanoid Robot Using Deep Learning. Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), Brisbane, QLD, Australia.","DOI":"10.1109\/ICRA.2018.8460623"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"3475","DOI":"10.1109\/LRA.2021.3063702","article-title":"Compensation for undefined behaviors during robot task execution by switching controllers depending on embedded dynamics in RNN","volume":"6","author":"Suzuki","year":"2021","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Ando, N., Suehiro, T., Kitagaki, K., Kotoku, T., and Yoon, W.K. (2005, January 2\u20136). RT-middleware: Distributed component middleware for RT (robot technology). Proceedings of the 2005 IEEE\/RSJ International Conference on Intelligent Robots and Systems, Edmonton, AB, Canada.","DOI":"10.1109\/IROS.2005.1545521"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"219534","DOI":"10.1109\/ACCESS.2020.3042555","article-title":"Educational Robotics: Platforms, Competitions and Expected Learning Outcomes","volume":"8","author":"Evripidou","year":"2020","journal-title":"IEEE Access"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Burbaite, R., Stuikys, V., and Damasevicius, R. (2013, January 4\u20136). Educational robots as collaborative learning objects for teaching computer science. Proceedings of the International Conference on System Science and Engineering (ICSSE), Budapest, Hungary.","DOI":"10.1109\/ICSSE.2013.6614661"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Plauska, I., and Damasevicius, R. (2014). Educational robots for internet-of-things supported collaborative learning. Proceedings of the International Conference on Information and Software Technologies, Springer.","DOI":"10.1007\/978-3-319-11958-8_28"},{"key":"ref_15","first-page":"1","article-title":"Ros: An open-source robot operating system","volume":"3","author":"Quigley","year":"2009","journal-title":"ICRA Workshop Open Source Softw."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"646","DOI":"10.4218\/etrij.10.1510.0138","article-title":"Opros: A new component-based robot software platform","volume":"32","author":"Jang","year":"2010","journal-title":"ETRI J."},{"key":"ref_17","unstructured":"Abadi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., Corrado, G.S., Davis, A., Dean, J., and Devin, M. (2015). et al. TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems. arXiv."},{"key":"ref_18","first-page":"8024","article-title":"PyTorch: An Imperative Style, High-Performance Deep Learning Library","volume":"32","author":"Paszke","year":"2019","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Tokui, S., Okuta, R., Akiba, T., Niitani, Y., Ogawa, T., Saito, S., Suzuki, S., Uenishi, K., Vogel, B., and Yamazaki V., H. (2019, January 3\u20137). Chainer: A Deep Learning Framework for Accelerating the Research Cycle. Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining (KDD), Anchorage, AK, USA.","DOI":"10.1145\/3292500.3330756"},{"key":"ref_20","unstructured":"Chollet, F. (2021, May 29). Keras. Available online: https:\/\/keras.io."},{"key":"ref_21","unstructured":"(2021, May 29). Jupyter Notebook. Available online: https:\/\/jupyter.org."},{"key":"ref_22","unstructured":"(2021, May 29). Google Colaboratory. Available online: https:\/\/colab.research.google.com\/notebooks\/intro.ipynb?hl=ja."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"705","DOI":"10.1177\/0278364914549607","article-title":"Deep learning for detecting robotic grasps","volume":"34","author":"Lenz","year":"2015","journal-title":"Int. J. Robot. Res."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Zeng, A., Song, S., Yu, K., Donjon, E., Hogan, R.F., Bauza, M., Ma, D., Taylor, O., Liu, M., and Romo, E. (2018, January 21\u201325). Robotic Pick-and-Place of Novel Objects in Clutter with Multi-Affordance Grasping and Cross-Domain Image Matching. Proceedings of the 2018 IEEE International Conference on Robotics and Automation (ICRA), Brisbane, QLD, Australia.","DOI":"10.1109\/ICRA.2018.8461044"},{"key":"ref_25","first-page":"25","article-title":"Ideal image of good teaching materials: A study based on Mindmapping research","volume":"61","author":"Hayashi","year":"2011","journal-title":"J. Lit. Soc. Yamaguchi Univ."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Deng, J., Dong, W., Socher, R., Li, L., Li, K., and Fei-Fei, L. (2009, January 20\u201325). ImageNet: A large-scale hierarchical image database. Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA.","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"ref_27","unstructured":"LeCun, Y., Cortes, C., and Burges C.C., J. (2021, May 29). The MNIST Database of Handwritten Digits. Available online: http:\/\/yann.lecun.com\/exdb\/mnist\/."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Asato, T., Suga, Y., and Ogata, T. (2016, January 13\u201315). A reusability-based hierarchical fault-detection architecture for robot middleware and its implementation in an autonomous mobile robot system. Proceedings of the IEEE\/SICE International Symposium on System Integration (SII), Sapporo, Japan.","DOI":"10.1109\/SII.2016.7843990"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Ando, N., Suehiro, T., and Kotoku, T. (2008). A Software Platform for Component Based RT-System Development: OpenRTM-Aist. International Conference on Simulation Modeling Programming Autonomous Robots, Springer.","DOI":"10.1007\/978-3-540-89076-8_12"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Pinto, L., and Gupta, A. (2016, January 16\u201321). Supersizing self-supervision: Learning to grasp from 50k tries and 700 robot hours. Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), Stockholm, Sweden.","DOI":"10.1109\/ICRA.2016.7487517"},{"key":"ref_31","first-page":"421","article-title":"Learning Hand-Eye Coordination for Robotic Grasping with Large-Scale Data Collection","volume":"37","author":"Levine","year":"2016","journal-title":"Int. Symp. Exp. Robot."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"James, S., Wohlhart, P., Kalakrishnan, M., Kalashnikov, D., Irpan, A., Ibarz, J., Levine, S., Hadsell, R., and Bousmalis, K. (2019, January 15\u201320). Sim-To-Real via Sim-To-Sim: Data-Efficient Robotic Grasping via Randomized-To-Canonical Adaptation Networks. Proceedings of the 2019 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.01291"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"541","DOI":"10.1162\/neco.1989.1.4.541","article-title":"Backpropagation applied to handwritten zip code recognition","volume":"1","author":"LeCun","year":"1989","journal-title":"Neural Comput."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"2278","DOI":"10.1109\/5.726791","article-title":"Gradient-based learning applied to document recognition","volume":"86","author":"LeCun","year":"1998","journal-title":"Proc. IEEE"},{"key":"ref_35","unstructured":"(2021, May 29). MikataArm 6DOF EDU | ROBOTIS e-Shop. Available online: https:\/\/e-shop.robotis.co.jp\/product.php?id=320."},{"key":"ref_36","unstructured":"(2021, May 29). Logitech. Available online: https:\/\/www.logitech.com\/en-us#."},{"key":"ref_37","unstructured":"(2021, May 29). MikataArmRTC. Available online: https:\/\/github.com\/ogata-lab\/MikataArmRTC."},{"key":"ref_38","unstructured":"(2021, May 29). WebCamera RTC. Available online: https:\/\/github.com\/rsdlab\/WebCamera."},{"key":"ref_39","unstructured":"Kingma, P.D., and Ba, L.J. (2017). Adam: A Method for Stochastic Optimization. arXiv."},{"key":"ref_40","unstructured":"Goodfellow, I., Bengio, Y., and Courville, A. (2021, May 29). Deep Learning Book. Available online: https:\/\/www.deeplearningbook.org."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Yamashita, T., Kashihara, N., Eryu, A., Kumazawa, S., and Sakamoto, N. Development of Reference Hardware Robotic System for Testing Intelligent RT Software Components. Proceedings of the JSME Annual Conference On Robotics and Mechatronics (Robomec), Available online: https:\/\/www.jstage.jst.go.jp\/article\/jsmermd\/2009\/0\/2009__2A1-D01_1\/_article\/-char\/en.","DOI":"10.1299\/jsmermd.2009._2A1-D01_1"},{"key":"ref_42","unstructured":"(2021, May 29). Intel Corporation. Available online: https:\/\/www.intel.co.jp\/content\/www\/jp\/ja\/homepage.html."},{"key":"ref_43","unstructured":"(2021, May 29). RealSense3D. Available online: https:\/\/github.com\/Kanamura24\/RealSense3D."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"3481","DOI":"10.1109\/LRA.2018.2853651","article-title":"Motion switching with sensory and instruction signals by designing dynamical systems using deep neural network","volume":"3","author":"Suzuki","year":"2018","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Suzuki, K., Kanamura, M., Suga, Y., Mori, H., and Ogata, T. (2021). In-air Knotting of Rope using Dual-Arm Robot based on Deep Learning. arXiv.","DOI":"10.1109\/IROS51168.2021.9635954"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Zurita, G., Baloian, N., Penafiel, S., and Jerez, O. (2019). Applying Pedagogical Usability for Designing a Mobile Learning Application that Support Reading Comprehension. Proceedings, 31.","DOI":"10.3390\/proceedings2019031006"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/11\/3804\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T06:09:18Z","timestamp":1760162958000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/11\/3804"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,5,31]]},"references-count":46,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2021,6]]}},"alternative-id":["s21113804"],"URL":"https:\/\/doi.org\/10.3390\/s21113804","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,5,31]]}}}