{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,25]],"date-time":"2026-06-25T07:10:52Z","timestamp":1782371452636,"version":"3.54.5"},"reference-count":51,"publisher":"Emerald","issue":"4","license":[{"start":{"date-parts":[[2018,8,15]],"date-time":"2018-08-15T00:00:00Z","timestamp":1534291200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/www.emerald.com\/insight\/site-policies"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IR"],"published-print":{"date-parts":[[2018,8,29]]},"abstract":"<jats:sec>\n<jats:title content-type=\"abstract-subheading\">Purpose<\/jats:title>\n<jats:p>Human\u2013robot collaboration (HRC) is on the rise in a bid for improved flexibility in production cells. In the context of overlapping workspace between a human operator and an industrial robot, the major cause for concern rests on the safety of the former.<\/jats:p>\n<\/jats:sec>\n<jats:sec>\n<jats:title content-type=\"abstract-subheading\">Design\/methodology\/approach<\/jats:title>\n<jats:p>In light of recent advances and trends, this paper proposes to implement a monitoring system for the shared workspace HRC, which supplements the robot, to locate the human operator and to ensure that at all times a minimum safe distance is respected by the robot with respect to its human partner. The monitoring system consists of four neural networks, namely, an object detector, two neural networks responsible for assessing the detections and a simple, custom speech recognizer.<\/jats:p>\n<\/jats:sec>\n<jats:sec>\n<jats:title content-type=\"abstract-subheading\">Findings<\/jats:title>\n<jats:p>It was observed that with due consideration of the production cell, it is possible to create excellent data sets which result in promising performances of the neural networks. Each neural network can be further improved by using its mistakes as examples thrown back in the data set. Thus, the whole monitoring system can achieve a reliable performance.<\/jats:p>\n<\/jats:sec>\n<jats:sec>\n<jats:title content-type=\"abstract-subheading\">Practical implications<\/jats:title>\n<jats:p>Success of the proposed framework may lead to any industrial robot being suitable for use in HRC.<\/jats:p>\n<\/jats:sec>\n<jats:sec>\n<jats:title content-type=\"abstract-subheading\">Originality\/value<\/jats:title>\n<jats:p>This paper proposes a system comprising neural networks in most part, and it looks at a digital representation of the workspace from a different angle. The exclusive use of neural networks is seen as an attempt to propose a system which can be relatively easily deployed in industrial settings as neural networks can be fine-tuned for adjustments.<\/jats:p>\n<\/jats:sec>","DOI":"10.1108\/ir-04-2018-0079","type":"journal-article","created":{"date-parts":[[2018,8,15]],"date-time":"2018-08-15T09:08:25Z","timestamp":1534324105000},"page":"481-491","source":"Crossref","is-referenced-by-count":28,"title":["A neural network based monitoring system for safety in shared work-space human-robot collaboration"],"prefix":"10.1108","volume":"45","author":[{"given":"Hemant","family":"Rajnathsing","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chenggang","family":"Li","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"140","published-online":{"date-parts":[[2018,8,15]]},"reference":[{"key":"key2022103114520704700_ref001","article-title":"Vehicle pose detection using region based convolutional neural network","volume-title":"2016 International Conference on Control, Automation and Information Sciences (ICCAIS)","year":"2016"},{"key":"key2022103114520704700_ref002","article-title":"Practical recommendations for gradient-based training of deep architectures","year":"2012"},{"key":"key2022103114520704700_ref003","article-title":"Scaling learning algorithms towards AI","volume-title":"Large Scale Kernel Machines","year":"2007"},{"issue":"7","key":"key2022103114520704700_ref004","article-title":"Multitask learning of deep neural networks for low-resource speech recognition","volume":"23","year":"2015","journal-title":"IEEE, ACM Transactions On Audio, Speech, and Language Processing"},{"key":"key2022103114520704700_ref005","doi-asserted-by":"publisher","DOI":"10.5772\/50988","article-title":"Cooperative tasks between humans and robots in industrial environments","year":"2012","journal-title":"International Journal of Advanced Robotic Systems"},{"key":"key2022103114520704700_ref006","article-title":"Human Identi\ufb01cation and localization by robots in collaborative environments","volume-title":"International Conference on Computational Science, ICCS 2017, 12-14 June 2017","year":"2017"},{"issue":"7","key":"key2022103114520704700_ref007","doi-asserted-by":"crossref","first-page":"760","DOI":"10.1177\/027836499801700706","article-title":"Motion planning in dynamic environments using velocity obstacles","volume":"17","year":"1998","journal-title":"The International Journal of Robotics Research"},{"key":"key2022103114520704700_ref008","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.169","article-title":"Fast R-CNN","volume-title":"2015 IEEE International Conference on Computer Vision","year":"2015"},{"key":"key2022103114520704700_ref009","article-title":"Computational design of mixed-initiative human-robot teaming that considers human factors: situational awareness, workload, and Workflow preferences","year":"2017"},{"key":"key2022103114520704700_ref010","article-title":"Speech emotion recognition with deep learning","volume-title":"IEEE, 2017 4th International Conference on Signal Processing and Integrated Networks (SPIN)","year":"2017"},{"key":"key2022103114520704700_ref011","article-title":"Deep residual learning for image recognition","volume-title":"CVPR 2016","year":"2016"},{"issue":"7","key":"key2022103114520704700_ref012","doi-asserted-by":"crossref","first-page":"1527","DOI":"10.1162\/neco.2006.18.7.1527","article-title":"A fast learning algorithm for deep belief nets","volume":"18","year":"2006","journal-title":"Neural Computation"},{"key":"key2022103114520704700_ref013","article-title":"Speed\/accuracy trade-offs for modern convolutional object detectors","volume-title":"CVPR 2017","year":"2017"},{"key":"key2022103114520704700_ref014","article-title":"Object detection from video tubelets with convolutional neural networks","volume-title":"2016 IEEE Conference on Computer Vision and Pattern Recognition","year":"2016"},{"key":"key2022103114520704700_ref015","first-page":"2186","article-title":"Fast vision-based minimum distance determination between known and unkown objects","volume-title":"Proceedings IEEE\/RSJ International Conference on Intelligent Robots and SystemsIROS","year":"2007"},{"key":"key2022103114520704700_ref016","article-title":"Joint acoustic factor learning for robust deep neural network based automatic speech recognition","volume-title":"ICASSP 2016","year":"2016"},{"key":"key2022103114520704700_ref017","volume-title":"New Types of Deep Neural Network Learning for Speech Recognition and Related Applications: An Overview","year":"2013"},{"key":"key2022103114520704700_ref018","unstructured":"Logitech Specifications (2018), Available at: http:\/\/support.logitech.com\/en_in\/product\/webcam-c100\/specs (15 September 2017)."},{"issue":"2","key":"key2022103114520704700_ref019","doi-asserted-by":"crossref","first-page":"220","DOI":"10.1108\/IR-09-2017-0165","article-title":"An industrial security system for human-robot coexistence","volume":"45","year":"2018","journal-title":"Industrial Robot: An International Journal"},{"issue":"2","key":"key2022103114520704700_ref020","doi-asserted-by":"crossref","first-page":"405","DOI":"10.1109\/TASE.2013.2237904","article-title":"Performance metrics of speed and separation monitoring in shared workspaces","volume":"10","year":"2013","journal-title":"IEEE Transactions on Automation Science and Engineering"},{"issue":"2017","key":"key2022103114520704700_ref021","first-page":"144","article-title":"Implementing speed and separation monitoring in collaborative robot workcells","volume":"44","year":"2017","journal-title":"Robotics and Computer-Integrated Manufacturing"},{"key":"key2022103114520704700_ref022","doi-asserted-by":"publisher","article-title":"\u2018Enhancing safe human-robot collaboration through natural multimodal communication","year":"2016","DOI":"10.1109\/ETFA.2016.7733573"},{"key":"key2022103114520704700_ref023","article-title":"The design of human-robot spatial cognition interaction system","volume-title":"2016 International Conference on Information System and Artificial Intelligence","year":"2016"},{"issue":"1","key":"key2022103114520704700_ref024","doi-asserted-by":"publisher","DOI":"10.5772\/53939","article-title":"Safe human-robot cooperation in an industrial environment","volume":"10","year":"2013","journal-title":"International Journal of Advanced Robotic Systems"},{"key":"key2022103114520704700_ref025","article-title":"A real-time deep learning pedestrian detector for robot navigation","volume-title":"2017 IEEE International Conference on Autonomous Robot Systems and Competitions (ICARSC)","year":"2017"},{"key":"key2022103114520704700_ref026","article-title":"Intervertebral disc detection in X-Ray Images Using Faster R-CNN","year":"2017"},{"key":"key2022103114520704700_ref027","article-title":"Contact-less and programming-less human-robot collaboration","volume-title":"Forty Sixth CIRP Conference on Manufacturing Systems 2013","year":"2013"},{"key":"key2022103114520704700_ref028","article-title":"A deep neural network integrated with filterbank learning for speech recognition","volume-title":"IEEE, ICASSP 2017","year":"2017"},{"key":"key2022103114520704700_ref029","article-title":"Safe collaboration of humans and SCARA robots","volume-title":"Proceedings of the 4th International Conference on Robotics and Mechatronics October 26-28, 2016","year":"2016"},{"key":"key2022103114520704700_ref030","first-page":"1","article-title":"Triple stereo vision system for safety monitoring of human-robot collaboration in cellular manufacturing","volume-title":"IEEE\/CIRP International Symposium on Assembly and Manufacturing","year":"2011"},{"issue":"5","key":"key2022103114520704700_ref031","doi-asserted-by":"crossref","first-page":"416","DOI":"10.1108\/IR-03-2015-0059","article-title":"The integration of contactless static pose recognition and dynamic hand motion tracking control system for industrial human and robot collaboration","volume":"42","year":"2015","journal-title":"Industrial Robot: An International Journal"},{"key":"key2022103114520704700_ref032","article-title":"Use of machine vision in collaborative robotics: an industrial case","year":"2016"},{"key":"key2022103114520704700_ref033","unstructured":"Train an Object Detector from Ground Truth Data. (2018), \u201cTrain an object detector from ground truth data\u201d, available at: www.mathworks.com\/help\/vision\/ug\/train-an-object-detector-from-ground-truth-data.html (31 October 2017)."},{"key":"key2022103114520704700_ref034","unstructured":"Usage of activations. (2018), \u201cUsage of activation\u201d, available at: https:\/\/keras.io\/activations\/ (accessed 17 December 2017)."},{"key":"key2022103114520704700_ref035","doi-asserted-by":"publisher","article-title":"Human \u2013 robot collaboration in industry","year":"2016","DOI":"10.17973\/MMSJ.2016_06_201611"},{"issue":"8","key":"key2022103114520704700_ref036","article-title":"An end-to-end deep learning approach to simultaneous speech dereverberation and acoustic modeling for robust speech recognition","volume":"11","year":"2017","journal-title":"IEEE Journal of Selected Topics in Signal Processing"},{"issue":"2","key":"key2022103114520704700_ref037","article-title":"Safety in human-robot collaborative manufacturing environments: metrics and control","volume":"13","year":"2016","journal-title":"IEEE Transactions on Automation Science and Engineering"},{"issue":"3","key":"key2022103114520704700_ref038","doi-asserted-by":"crossref","first-page":"264","DOI":"10.1108\/IR-12-2015-0222","article-title":"Ensuring safety in human-robot coexisting environment based on two-level protection","volume":"43","year":"2016","journal-title":"Industrial Robot: An International Journal"},{"key":"key2022103114520704700_ref039","article-title":"A faster RCNN-based pedestrian detection system","year":"2016"},{"key":"key2022103114520704700_ref040","article-title":"Cross-language transfer speech recognition using deep learning","year":"2014"},{"key":"key2022103114520704700_ref041","doi-asserted-by":"publisher","article-title":"Deep learning based affective model for speech emotion recognition","year":"2016","DOI":"10.1109\/UIC-ATC-ScalCom-CBDCom-IoP-SmartWorld.2016.42"},{"key":"key2022103114520704700_ref042","unstructured":"Deep Learning, Object Detection and Recognition (2018), \u201cDeep learning, object detection and recognition\u201d, available at: www.mathworks.com\/help\/vision\/deep-learning-object-detection-and-recognition.html (accessed 30 October 2017)."},{"key":"key2022103114520704700_ref043","unstructured":"Fast R-CNN (2018), \u201cChoose among R-CNN, Fast R-CNN, or faster R-CNN object detectors\u201d, available at: www.mathworks.com\/help\/vision\/ug\/choose-among-r-cnn-fast-r-cnn-or-faster-r-cnn-object-detectors.html (accessed 2 November 2017)."},{"key":"key2022103114520704700_ref044","article-title":"Face detection with the faster R-CNN","volume-title":"2017 IEEE 12th International Conference on Automatic Face & Gesture Recognition","year":"2017"},{"key":"key2022103114520704700_ref045","unstructured":"Lazarte, M. (2018), \u201cRobots and humans can work together with new ISO guidance\u201d, 8 March 2016, available at: www.iso.org\/news\/2016\/03\/Ref2057.html (accessed 14 March 2017)."},{"key":"key2022103114520704700_ref046","unstructured":"Tensorflow detection model zoo. (2018), \u201cTensorflow detection model zoo\u201d, available at: https:\/\/github.com\/tensorflow\/models\/blob\/fd7b6887fb294e90356d5664724083d1f61671ef\/research\/object_detection\/g3doc\/detection_model_zoo.md (27 February 2018)."},{"key":"key2022103114520704700_ref047","unstructured":"Usage of loss functions. (2018), \u201cUsage of loss functions\u201d, available at: https:\/\/keras.io\/losses\/ (accessed 17 December 2017)."},{"key":"key2022103114520704700_ref048","article-title":"Use fast R-CNN and cascade structure for face detection","volume-title":"VCIP 2016, Nov. 27 - 30, 2016","year":"2016"},{"key":"key2022103114520704700_ref049","unstructured":"What is Deep Learning? (2018), Available at: www.mathworks.com\/discovery\/deep-learning.html (accessed 30 October 2017)."},{"key":"key2022103114520704700_ref050","unstructured":"Why Alexa (2008), Available at: https:\/\/developer.amazon.com\/alexa (18 February 2018)."},{"key":"key2022103114520704700_ref051","article-title":"How transferable are features in deep neural networks?","volume-title":"Neural Information Processing Systems (NIPS), 2014","year":"2014"}],"container-title":["Industrial Robot: An International Journal"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/IR-04-2018-0079\/full\/xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/IR-04-2018-0079\/full\/html","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,24]],"date-time":"2025-07-24T21:38:52Z","timestamp":1753393132000},"score":1,"resource":{"primary":{"URL":"http:\/\/www.emerald.com\/ir\/article\/45\/4\/481-491\/187346"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,8,15]]},"references-count":51,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2018,8,15]]},"published-print":{"date-parts":[[2018,8,29]]}},"alternative-id":["10.1108\/IR-04-2018-0079"],"URL":"https:\/\/doi.org\/10.1108\/ir-04-2018-0079","relation":{},"ISSN":["0143-991X"],"issn-type":[{"value":"0143-991X","type":"print"}],"subject":[],"published":{"date-parts":[[2018,8,15]]}}}