{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,21]],"date-time":"2026-01-21T05:12:41Z","timestamp":1768972361731,"version":"3.49.0"},"reference-count":63,"publisher":"MDPI AG","issue":"5","license":[{"start":{"date-parts":[[2020,3,9]],"date-time":"2020-03-09T00:00:00Z","timestamp":1583712000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>This article presents the novel Python, C# and JavaScript libraries of Node Primitives (NEP), a high-level, open, distributed, and component-based framework designed to enable easy development of cross-platform software architectures. NEP is built on top of low-level, high-performance and robust sockets libraries (ZeroMQ and Nanomsg) and robot middlewares (ROS 1 and ROS 2). This enables platform-independent development of Human\u2013Robot Interaction (HRI) software architectures. We show minimal code examples for enabling Publish\/Subscribe communication between Internet of Things (IoT) and Robotics modules. Two user cases performed outside laboratories are briefly described in order to prove the technological feasibility of NEP for developing real-world applications. The first user case briefly shows the potential of using NEP for enabling the creation of End-User Development (EUD) interfaces for IoT-aided Human\u2013Robot Interaction. The second user case briefly describes a software architecture integrating state-of-art sensory devices, deep learning perceptual modules, and a ROS -based humanoid robot to enable IoT-aided HRI in a public space. Finally, a comparative study showed better latency results of NEP over a popular state-of-art tool (ROS using rosbridge) for connecting different nodes executed in local-host and local area network (LAN).<\/jats:p>","DOI":"10.3390\/s20051500","type":"journal-article","created":{"date-parts":[[2020,3,10]],"date-time":"2020-03-10T11:59:36Z","timestamp":1583841576000},"page":"1500","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":22,"title":["Towards IoT-Aided Human\u2013Robot Interaction Using NEP and ROS: A Platform-Independent, Accessible and Distributed Approach"],"prefix":"10.3390","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5444-377X","authenticated-orcid":false,"given":"Enrique","family":"Coronado","sequence":"first","affiliation":[{"name":"Department of Mechanical Systems Engineering, Tokyo University of Agriculture and Technology, Tokyo 184-0012, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7767-4765","authenticated-orcid":false,"given":"Gentiane","family":"Venture","sequence":"additional","affiliation":[{"name":"Department of Mechanical Systems Engineering, Tokyo University of Agriculture and Technology, Tokyo 184-0012, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2020,3,9]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Coronado, E., Indurkhya, X., and Venture, G. (2019, January 3\u20135). Robots Meet Children, Development of Semi-Autonomous Control Systems for Children-Robot Interaction in the Wild. Proceedings of the 2019 IEEE 4th International Conference on Advanced Robotics and Mechatronics (ICARM), Toyonaka, Japan.","DOI":"10.1109\/ICARM.2019.8833751"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Coronado, E., Mastrogiovanni, F., and Venture, G. (2019). Design of a Human-Centered Robot Framework for End-User Programming and Applications. ROMANSY 22\u2013Robot Design, Dynamics and Control, Springer.","DOI":"10.1007\/978-3-319-78963-7_56"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Simoens, P., Dragone, M., and Saffiotti, A. (2018). The Internet of Robotic Things: A review of concept, added value and applications. Int. J. Adv. Robot. Syst., 15.","DOI":"10.1177\/1729881418759424"},{"key":"ref_4","unstructured":"Tsardoulias, E., and Mitkas, P. (2017). Robotic frameworks, architectures and middleware comparison. arXiv."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"8","DOI":"10.5772\/5761","article-title":"YARP: Yet another robot platform","volume":"3","author":"Metta","year":"2006","journal-title":"Int. J. Adv. Robot. Syst."},{"key":"ref_6","unstructured":"Quigley, M., Conley, K., Gerkey, B., Faust, J., Foote, T., Leibs, J., Wheeler, R., and Ng, A.Y. (2019, December 28). ROS: An Open-Source Robot Operating System. Available online: http:\/\/www.willowgarage.com\/sites\/default\/files\/icraoss09-ROS.pdf."},{"key":"ref_7","unstructured":"Guti\u00e9rrez, C.S.V., Juan, L.U.S., Ugarte, I.Z., and Vilches, V.M. (2018). Towards a distributed and real-time framework for robots: Evaluation of ROS 2.0 communications for real-time robotic applications. arXiv."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Crick, C., Jay, G., Osentoski, S., Pitzer, B., and Jenkins, O.C. (2017). Rosbridge: Ros for non-ros users. Robotics Research, Springer.","DOI":"10.1007\/978-3-319-29363-9_28"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"67","DOI":"10.3389\/frobt.2017.00067","article-title":"Connecting YARP to the Web with Yarp.js","volume":"4","author":"Ciliberto","year":"2017","journal-title":"Front. Robot. AI"},{"key":"ref_10","unstructured":"(2019, December 28). Rosbridge Suite. Available online: http:\/\/wiki.ros.org\/rosbridge_suite."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Coronado, E., Mastrogiovanni, F., and Venture, G. (2018, January 27\u201329). Development of Intelligent Behaviors for Social Robots via User-Friendly and Modular Programming Tools. Proceedings of the 2018 IEEE Workshop on Advanced Robotics and its Social Impacts (ARSO), Genova, Italy.","DOI":"10.1109\/ARSO.2018.8625839"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Kortenkamp, D., Simmons, R., and Brugali, D. (2016). Robotic systems architectures and programming. Handbook of Robotics, Springer.","DOI":"10.1007\/978-3-319-32552-1_12"},{"key":"ref_13","unstructured":"Hintjens, P. (2013). ZeroMQ: Messaging for Many Applications, O\u2019Reilly Media, Inc."},{"key":"ref_14","unstructured":"Sustrik, M. (2019, December 28). NanoMSG. Available online: https:\/\/github.com\/nanomsg\/nanomsg\/blob\/master\/rfc\/sp-ipc-mapping-01.txt."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Toris, R., Kammerl, J., Lu, D.V., Lee, J., Jenkins, O.C., Osentoski, S., Wills, M., and Chernova, S. (October, January 28). Robot web tools: Efficient messaging for cloud robotics. Proceedings of the 2015 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Hamburg, Germany.","DOI":"10.1109\/IROS.2015.7354021"},{"key":"ref_16","unstructured":"Joseph, L., and Cacace, J. (2018). Mastering ROS for Robotics Programming: Design, Build, and Simulate Complex Robots Using the Robot Operating System, Packt Publishing Ltd."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Frank, F., Paraschos, A., and van der Smagt, P. (2019, January 25\u201327). ORC\u2014A Lightweight, Lightning-Fast Middleware. Proceedings of the 2019 Third IEEE International Conference on Robotic Computing (IRC), Naples, Italy.","DOI":"10.1109\/IRC.2019.00061"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Morckos, M., and Karray, F. (2014). Axon: A middleware for robotic platforms in an experimental environment. Robot Intelligence Technology and Applications 2, Springer.","DOI":"10.1007\/978-3-319-05582-4_80"},{"key":"ref_19","first-page":"64","article-title":"Middleware Interoperability for Robotics: A RoS\u2013YARP Framework","volume":"3","author":"Moreno","year":"2016","journal-title":"Front. Robot. AI"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Metta, G., Sandini, G., Vernon, D., Natale, L., and Nori, F. (2008, January 19\u201321). The iCub humanoid robot: An open platform for research in embodied cognition. Proceedings of the 8th Workshop on Performance Metrics for Intelligent Systems, Gaithersburg, MD, USA.","DOI":"10.1145\/1774674.1774683"},{"key":"ref_21","unstructured":"Schmidt, D.C. (2019, December 28). The ADAPTIVE Communication Environment: An Object-Oriented Network Programming Toolkit for Developing Communication Software. Available online: http:\/\/citeseerx.ist.psu.edu\/viewdoc\/summary?doi=10.1.1.42.8614."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Chitic, S.G., Ponge, J., and Simonin, O. (2014). Are middlewares ready for multi-robots systems. International Conference on Simulation, Modeling, and Programming for Autonomous Robots, Springer.","DOI":"10.1007\/978-3-319-11900-7_24"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"2","DOI":"10.1145\/3208975","article-title":"Robots in the Wild: A Time for More Robust Theories of Human-Robot Interaction","volume":"7","author":"Jung","year":"2018","journal-title":"ACM Trans. Hum.-Robot. Interact."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Shiizuka, H., and Hashizume, A. (2011). The role of Kansei\/affective engineering and its expected in aging society. Intelligent Decision Technologies, Springer.","DOI":"10.1109\/INCoS.2011.107"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"50","DOI":"10.1145\/1978822.1978833","article-title":"Reimagining HCI: Toward a more human-centered perspective","volume":"18","author":"Bannon","year":"2011","journal-title":"Interactions"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"101","DOI":"10.1016\/j.jss.2018.11.041","article-title":"End-user development, end-user programming and end-user software engineering: A systematic mapping study","volume":"149","author":"Barricelli","year":"2019","journal-title":"J. Syst. Softw."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Glas, D., Satake, S., Kanda, T., and Hagita, N. (2012). An interaction design framework for social robots. Robotics: Science and Systems, MIT Press.","DOI":"10.15607\/RSS.2011.VII.014"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Patern\u00f2, F., and Wulf, V. (2017). New Perspectives in End-User Development, Springer.","DOI":"10.1007\/978-3-319-60291-2"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Jaimes, A., Sebe, N., and Gatica-Perez, D. (2006, January 23\u201327). Human-centered computing: A multimedia perspective. Proceedings of the 14th ACM International Conference on Multimedia, Santa Barbara, CA, USA.","DOI":"10.1145\/1180639.1180829"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"4961","DOI":"10.1080\/00207543.2018.1492161","article-title":"A review of methodologies for integrating human factors and ergonomics in engineering design","volume":"57","author":"Sun","year":"2019","journal-title":"Int. J. Prod. Res."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Rosenthal-von der P\u00fctten, A.M., Weiss, A., and \u0160abanovi\u0107, S. (2016, January 7\u201310). The challenge (not) to go wild! Challenges and Best Practices to Study HRI in Natural Interaction Settings. Proceedings of the 2016 11th ACM\/IEEE International Conference on Human-Robot Interaction (HRI), Christchurch, New Zealand.","DOI":"10.1109\/HRI.2016.7451867"},{"key":"ref_32","unstructured":"(2019, February 25). Keras: The Python Deep Learning Library. Available online: https:\/\/keras.io\/."},{"key":"ref_33","unstructured":"Abadi, M., Barham, P., Chen, J., Chen, Z., Davis, A., Dean, J., Devin, M., Ghemawat, S., Irving, G., and Isard, M. (2016, January 2\u20134). Tensorflow: A system for large-scale machine learning. Proceedings of the 12th USENIX Conference on Operating Systems Design and Implementation, Savannah, GA, USA."},{"key":"ref_34","first-page":"1","article-title":"Theano: Deep learning on gpus with python","volume":"3","author":"Bergstra","year":"2011","journal-title":"J. Mach. Learn. Res."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Rebelo Moreira, J.L., Ferreira Pires, L., and Van Sinderen, M. (2018). Semantic Interoperability for the IoT: Analysis of JSON for Linked Data, Wiley.","DOI":"10.1002\/9781119564034.ch20"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"369","DOI":"10.1016\/j.future.2016.05.041","article-title":"Modular and Generic IoT Management on the Cloud","volume":"78","author":"Douzis","year":"2018","journal-title":"Future Gener. Comput. Syst."},{"key":"ref_37","unstructured":"Agarwal, P., and Alam, M. (2018). Investigating IoT Middleware Platforms for Smart Application Development. arXiv."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"9489","DOI":"10.1109\/ACCESS.2017.2647747","article-title":"Internet of robotic things: Concept, technologies, and challenges","volume":"4","author":"Ray","year":"2016","journal-title":"IEEE Access"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"12017","DOI":"10.1088\/1742-6596\/396\/1\/012017","article-title":"The new cern controls middleware","volume":"396","author":"Dworak","year":"2012","journal-title":"J. Phys. Conf. Ser."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"072001","DOI":"10.1088\/1742-6596\/664\/7\/072001","article-title":"ALFA: The new ALICE-FAIR software framework","volume":"664","author":"Buncic","year":"2015","journal-title":"J. Phys. Conf. Ser."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"C10007","DOI":"10.1088\/1748-0221\/14\/10\/C10007","article-title":"ZDAQ, a light data acquisition framework based on ZeroMQ","volume":"14","author":"Mirabito","year":"2019","journal-title":"J. Instrum."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Babaians, E., Tamiz, M., Sarti, Y., Mogoei, A., and Mehrabi, E. (2018, January 10). ROS2Unity3D; High-Performance Plugin to Interface ROS with Unity3d engine. Proceedings of the 2018 9th Conference on Artificial Intelligence and Robotics and 2nd Asia-Pacific International Symposium, Kish Island, Iran.","DOI":"10.1109\/AIAR.2018.8769798"},{"key":"ref_43","unstructured":"(2019, December 28). Operating System Share by Version. Available online: https:\/\/netmarketshare.com\/operating-system-market-share.aspx?id=platformsDesktopVersions."},{"key":"ref_44","unstructured":"(2019, December 28). ZeroMQ Message Transport Protocol. Available online: https:\/\/rfc.zeromq.org\/spec\/15\/."},{"key":"ref_45","unstructured":"Kuffner, J. (2010, January 6\u20138). Cloud-enabled robots. Proceedings of the 10th IEEE-RAS International Conference on Humanoid Robots, Nashville, TN, USA."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"398","DOI":"10.1109\/TASE.2014.2376492","article-title":"A survey of research on cloud robotics and automation","volume":"12","author":"Kehoe","year":"2015","journal-title":"IEEE Trans. Autom. Sci. Eng."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"481","DOI":"10.1109\/TASE.2014.2329556","article-title":"Rapyuta: A cloud robotics platform","volume":"12","author":"Mohanarajah","year":"2014","journal-title":"IEEE Trans. Autom. Sci. Eng."},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Beetz, M., Tenorth, M., and Winkler, J. (2015, January 26\u201330). Open-ease. Proceedings of the 2015 IEEE International Conference on Robotics and Automation (ICRA), Seattle, WA, USA.","DOI":"10.1109\/ICRA.2015.7139458"},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Pattar, S.P., Coronado, E., Ardila, L.R., and Venture, G. (2019, January 3\u20135). Intention and Engagement Recognition for Personalized Human-Robot Interaction, an integrated and Deep Learning approach. Proceedings of the 2019 IEEE 4th International Conference on Advanced Robotics and Mechatronics (ICARM), Toyonaka, Japan.","DOI":"10.1109\/ICARM.2019.8834226"},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Fankhauser, P., Bloesch, M., Rodriguez, D., Kaestner, R., Hutter, M., and Siegwart, R. (2015, January 27\u201331). Kinect v2 for mobile robot navigation: Evaluation and modeling. Proceedings of the 2015 International Conference on Advanced Robotics (ICAR), Istanbul, Turkey.","DOI":"10.1109\/ICAR.2015.7251485"},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Andaluz, V.H., Quevedo, W.X., Chicaiza, F.A., Varela, J., Gallardo, C., S\u00e1nchez, J.S., and Arteaga, O. (2016, January 15\u201318). Transparency of a bilateral tele-operation scheme of a mobile manipulator robot. Proceedings of the International Conference on Augmented Reality, Virtual Reality and Computer Graphics, Lecce, Italy.","DOI":"10.1007\/978-3-319-40621-3_18"},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Bartneck, C., Soucy, M., Fleuret, K., and Sandoval, E.B. (September, January 31). The robot engine\u2014Making the unity 3D game engine work for HRI. Proceedings of the 2015 24th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN), Kobe, Japan.","DOI":"10.1109\/ROMAN.2015.7333561"},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Pakrasi, I., Chakraborty, N., and LaViers, A. (2018, January 28). A design methodology for abstracting character archetypes onto robotic systems. Proceedings of the 5th International Conference on Movement and Computing, New York, NY, USA.","DOI":"10.1145\/3212721.3212809"},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"091006","DOI":"10.1115\/1.4032878","article-title":"Analysis of recoverable falls via Microsoft Kinect: Identification of third-order ankle dynamics","volume":"138","author":"Segura","year":"2016","journal-title":"J. Dyn. Syst. Meas. Contr."},{"key":"ref_55","unstructured":"(2019, December 28). Json.NET. Available online: https:\/\/www.newtonsoft.com\/json."},{"key":"ref_56","doi-asserted-by":"crossref","unstructured":"Zubrycki, I., Kolesi\u0144ski, M., and Granosik, G. (2017). Graphical Programming Interface for Enabling Non-technical Professionals to Program Robots and Internet-of-Things Devices, Springer.","DOI":"10.1007\/978-3-319-59147-6_53"},{"key":"ref_57","doi-asserted-by":"crossref","unstructured":"Fischer, G. (2013). End-User Development: From Creating Technologies to Transforming Cultures, Springer.","DOI":"10.1007\/978-3-642-38706-7_16"},{"key":"ref_58","doi-asserted-by":"crossref","unstructured":"Fischer, G. (2012). End user development and meta-design: Foundations for cultures of participation. End-User Computing, Development, and Software Engineering: New Challenges, IGI Global.","DOI":"10.4018\/978-1-4666-0140-6.ch010"},{"key":"ref_59","unstructured":"Lourens, T. (2019, December 28). Examples How to Use TiViPE. Available online: http:\/\/www.tivipe.com\/TVPeducation\/TVPuse.pdf."},{"key":"ref_60","doi-asserted-by":"crossref","first-page":"704","DOI":"10.1016\/j.robot.2012.08.001","article-title":"End-user programming architecture facilitates the uptake of robots in social therapies","volume":"61","author":"Barakova","year":"2013","journal-title":"Robot. Autom. Syst."},{"key":"ref_61","unstructured":"(2019, December 15). IREX International Robot Exhibition 2019. Available online: https:\/\/biz.nikkan.co.jp\/eve\/irex\/english\/."},{"key":"ref_62","doi-asserted-by":"crossref","unstructured":"Maruyama, Y., Kato, S., and Azumi, T. (2016, January 2\u20137). Exploring the performance of ROS2. Proceedings of the 13th International Conference on Embedded Software, Pittsburgh, PA, USA.","DOI":"10.1145\/2968478.2968502"},{"key":"ref_63","unstructured":"(2019, December 15). Node Primitives. Available online: https:\/\/enriquecoronadozu.github.io\/NEP\/."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/5\/1500\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T09:05:33Z","timestamp":1760173533000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/5\/1500"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,3,9]]},"references-count":63,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2020,3]]}},"alternative-id":["s20051500"],"URL":"https:\/\/doi.org\/10.3390\/s20051500","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,3,9]]}}}