{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,20]],"date-time":"2026-06-20T02:01:05Z","timestamp":1781920865860,"version":"3.54.5"},"reference-count":56,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2021,4,1]],"date-time":"2021-04-01T00:00:00Z","timestamp":1617235200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Slovak Grant Agency APVV","award":["APVV-17-0214"],"award-info":[{"award-number":["APVV-17-0214"]}]},{"name":"Scientific Grant Agency VEGA","award":["1\/0317\/17"],"award-info":[{"award-number":["1\/0317\/17"]}]},{"name":"Scientific Grant Agency KEGA","award":["007STU-4\/2021, 024STU-4\/2020"],"award-info":[{"award-number":["007STU-4\/2021, 024STU-4\/2020"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Human\u2013robot collaboration is becoming ever more widespread in industry because of its adaptability. Conventional safety elements are used when converting a workplace into a collaborative one, although new technologies are becoming more widespread. This work proposes a safe robotic workplace that can adapt its operation and speed depending on the surrounding stimuli. The benefit lies in its use of promising technologies that combine safety and collaboration. Using a depth camera operating on the passive stereo principle, safety zones are created around the robotic workplace, while objects moving around the workplace are identified, including their distance from the robotic system. Passive stereo employs two colour streams that enable distance computation based on pixel shift. The colour stream is also used in the human identification process. Human identification is achieved using the Histogram of Oriented Gradients, pre-learned precisely for this purpose. The workplace also features autonomous trolleys for material supply. Unequivocal trolley identification is achieved using a real-time location system through tags placed on each trolley. The robotic workplace\u2019s speed and the halting of its work depend on the positions of objects within safety zones. The entry of a trolley with an exception to a safety zone does not affect the workplace speed. This work simulates individual scenarios that may occur at a robotic workplace with an emphasis on compliance with safety measures. The novelty lies in the integration of a real-time location system into a vision-based safety system, which are not new technologies by themselves, but their interconnection to achieve exception handling in order to reduce downtimes in the collaborative robotic system is innovative.<\/jats:p>","DOI":"10.3390\/s21072419","type":"journal-article","created":{"date-parts":[[2021,4,1]],"date-time":"2021-04-01T10:44:01Z","timestamp":1617273841000},"page":"2419","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":10,"title":["Vision and RTLS Safety Implementation in an Experimental Human\u2014Robot Collaboration Scenario"],"prefix":"10.3390","volume":"21","author":[{"given":"Juraj","family":"Slov\u00e1k","sequence":"first","affiliation":[{"name":"Department of Applied Informatics, Automation and Mechatronics, Faculty of Mechanical Engineering, Slovak University of Technology in Bratislava, 81231 Bratislava, Slovakia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0020-8808","authenticated-orcid":false,"given":"Markus","family":"Melicher","sequence":"additional","affiliation":[{"name":"Department of Applied Informatics, Automation and Mechatronics, Faculty of Mechanical Engineering, Slovak University of Technology in Bratislava, 81231 Bratislava, Slovakia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Matej","family":"\u0160imovec","sequence":"additional","affiliation":[{"name":"Department of Applied Informatics, Automation and Mechatronics, Faculty of Mechanical Engineering, Slovak University of Technology in Bratislava, 81231 Bratislava, Slovakia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1533-5914","authenticated-orcid":false,"given":"J\u00e1n","family":"Vach\u00e1lek","sequence":"additional","affiliation":[{"name":"Department of Applied Informatics, Automation and Mechatronics, Faculty of Mechanical Engineering, Slovak University of Technology in Bratislava, 81231 Bratislava, Slovakia"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2021,4,1]]},"reference":[{"key":"ref_1","unstructured":"Vargas, S. (2018). Robots in the workplace. Safety and Health Magazine, The National Safety Council."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"169","DOI":"10.1016\/0278-6125(90)90031-C","article-title":"Design for robotic cell safety","volume":"9","author":"Jiang","year":"1990","journal-title":"J. Manuf. Syst."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"903","DOI":"10.17973\/MMSJ.2016_06_201611","article-title":"Human\u2014Robot collaboration in industry","volume":"39","author":"Vysocky","year":"2016","journal-title":"MM Sci. J."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1355","DOI":"10.1007\/s00170-018-03247-z","article-title":"Collaborative and traditional robotic assembly: A comparison model","volume":"102","author":"Faccio","year":"2019","journal-title":"Int. J. Adv. Manuf. Technol."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"328","DOI":"10.1016\/j.procir.2019.03.057","article-title":"Safeguarding of an automated assembly process using a Balanced Decoupling Unit and the HRC switching mode","volume":"81","author":"Koch","year":"2019","journal-title":"Procedia CIRP"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Luka\u010d, D. (2015, January 24\u201326). The Fourth ICT-Based Industrial Revolution \u201cIndustry 4.0\u201d\u2014HMI and the Case of CAE\/CAD Innovation with EPLAN P8. Proceedings of the 2015 23rd Telecommunications Forum Telfor (TELFOR), Belgrade, Serbia.","DOI":"10.1109\/TELFOR.2015.7377595"},{"key":"ref_7","unstructured":"Duffy, V.G. (2020). Research Project beyondSPAI\u2014The Safe and Reliable Monitoring of Adaptive Safety Zones in the Proximity of Collaborating Industrial Robots Using an Intelligent InGaAs Camera System. Digital Human Modeling and Applications in Health, Safety, Ergonomics and Risk Management. Posture, Motion and Health, Springer."},{"key":"ref_8","unstructured":"(2021, February 01). Veo Robotics\u2014FreeMove. Available online: https:\/\/www.veobot.com\/freemove."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"233","DOI":"10.1016\/j.rcim.2018.10.003","article-title":"A cyber physical system (CPS) approach for safe human-robot collaboration in a shared workplace","volume":"56","author":"Nikolakis","year":"2019","journal-title":"Robot. Comput. Integr. Manuf."},{"key":"ref_10","unstructured":"Klette, R., Schluns, K., and Koschan, A. (1998). Computer Vision. Three-Dimensional Data from Images, Springer."},{"key":"ref_11","unstructured":"Jernej Mrovlje, D.V. (2008, January 1\u20133). Distance Measuring Based on Stereoscopic Pictures. Proceedings of the 9th International PhD Workshop on Systems and Control, Izola, Slovenia."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Itu, R., and Danescu, R.G. (2020). A Self-Calibrating Probabilistic Framework for 3D Environment Perception Using Monocular Vision. Sensors, 20.","DOI":"10.3390\/s20051280"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"329","DOI":"10.1016\/j.rcim.2018.11.008","article-title":"A geometric approach for kinematic identification of an industrial robot using a monocular camera","volume":"57","author":"Hayat","year":"2019","journal-title":"Robot. Comput. Integr. Manuf."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Godard, C., Aodha, O., and Gabriel, J. (2017, January 21\u201326). Unsupervised Monocular Depth Estimation with Left-Right Consistency. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.699"},{"key":"ref_15","unstructured":"Saxena, A., Schulte, J., and Ng, A. Depth Estimation Using Monocular and Stereo Cues; In Proceedings of the 20th International Joint Conference on Artifical Intelligence, Nagoya, Japan, 6\u201312 January 2007."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Hansard, M., Lee, S., Choi, O., and Horaud, R. (2013). Time of Flight Cameras: Principles, Methods, and Applications, Springer.","DOI":"10.1007\/978-1-4471-4658-2"},{"key":"ref_17","unstructured":"Li, L. (2014). Time-of-Flight Camera\u2014An Introduction. SLOA190B\u2014January 2014 Revised May 2014\u2014Technical White Paper, Texas Instruments."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Fanello, S.R., Rhemann, C., Tankovich, V., Kowdle, A., Escolano, S.O., Kim, D., and Izadi, S. (2016). HyperDepth: Learning Depth from Structured Light without Matching. Procedia CVPR, 5441\u20135450.","DOI":"10.1109\/CVPR.2016.587"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1206","DOI":"10.1109\/TIE.2005.855696","article-title":"Teleoperation of a robot manipulator using a vision-based human-robot interface","volume":"52","author":"Kofman","year":"2005","journal-title":"IEEE Trans. Ind. Electron."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"672","DOI":"10.1109\/LRA.2017.2737485","article-title":"Vision-Based Calibration of Dual RCM-Based Robot Arms in Human-Robot Collaborative Minimally Invasive Surgery","volume":"3","author":"Wang","year":"2018","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"2144","DOI":"10.1109\/TIFS.2014.2359577","article-title":"Unconstrained Face Recognition: Identifying a Person of Interest From a Media Collection","volume":"9","author":"Han","year":"2014","journal-title":"IEEE Trans. Inf. Forensics Secur."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"956","DOI":"10.1016\/j.patcog.2011.06.005","article-title":"Automated human identification using ear imaging","volume":"45","author":"Kumar","year":"2012","journal-title":"Pattern Recognit."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s00202-017-0609-0","article-title":"Visual system-based object tracking using image segmentation for biomedical applications","volume":"99","author":"Koniar","year":"2017","journal-title":"Electr. Eng."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"107541","DOI":"10.1016\/j.ijpe.2019.107541","article-title":"Introduction of a real time location system to enhance the warehouse safety and operational efficiency","volume":"224","author":"Halawa","year":"2020","journal-title":"Int. J. Prod. Econ."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"547","DOI":"10.1177\/0278364913500364","article-title":"Accurate indoor localization with ultra-wideband using spatial models and collaboration","volume":"33","author":"Prorok","year":"2014","journal-title":"Int. J. Robot. Res."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"184","DOI":"10.1016\/j.jretconser.2018.11.005","article-title":"A business application of RTLS technology in Intelligent Retail Environment: Defining the shopper\u2019s preferred path and its segmentation","volume":"47","author":"Ferracuti","year":"2019","journal-title":"J. Retail. Consum. Serv."},{"key":"ref_27","unstructured":"ISO 10218-1:2011 (2011). Robots and Robotic Devices\u2014Safety Requirements for Industrial Robots\u2014Part 1: Robot Systems and Integration, International Organization for Standardization."},{"key":"ref_28","unstructured":"ISO 10218-2:2011 (2011). Robots and Robotic Devices\u2014Safety Requirements for Industrial Robots\u2014Part 2: Robots, International Organization for Standardization."},{"key":"ref_29","unstructured":"ISO 13857:2019 (2019). Safety of Machinery\u2014Safety Distances to Prevent Hazard Zones being Reached by Upper and Lower Limbs, International Organization for Standardization."},{"key":"ref_30","unstructured":"ISO 13849-1:2015 (2015). Safety of Machinery. Safety-Related Parts of Control Systems. Part 1: General Principles for Design, International Organization for Standardization."},{"key":"ref_31","unstructured":"ISO 13855:2010 (2010). Safety of Machinery. Positioning of Safeguards with Respect to the Approach Speeds of Parts of the Human Body, International Organization for Standardization."},{"key":"ref_32","unstructured":"ISO 12100:2010 (2010). Safety of Machinery\u2014General Principles for Design\u2014Risk Assessment and Risk Reduction, International Organization for Standardization."},{"key":"ref_33","unstructured":"ISO\/TS 15066:2016 (2016). Robots and Robotic Devices\u2014Safety Requirements for Industrial Robots\u2014Collaborative Operation, International Organization for Standardization."},{"key":"ref_34","unstructured":"(2021, February 01). IEEE Spectrum\u2014Why Co-Bots Will Be a Huge Innovation and Growth Driver for Robotics Industry. Available online: https:\/\/spectrum.ieee.org\/automaton\/robotics\/industrial-robots\/collaborative-robots-innovation-growth-driver."},{"key":"ref_35","unstructured":"(2021, February 01). Is Sale of Universal Robots Classic Innovator\u2019s Dilemma?. Available online: https:\/\/www.roboticsbusinessreview.com\/manufacturing\/is_sale_of_universal_robots_classic_innovators_dilemma\/."},{"key":"ref_36","unstructured":"Malik, A. (2009). RTLS For Dummies, For Dummies by John Wiley & Sons, Inc."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Zhang, N., and Meng, J. (2008, January 12\u201317). Reflection Characteristics Analysis of IR-UWB Signal. Proceedings of the 2008 4th International Conference on Wireless Communications, Networking and Mobile Computing, Dalian, China.","DOI":"10.1109\/WiCom.2008.265"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"701","DOI":"10.1007\/s10559-019-00181-0","article-title":"Principles of Organization of the Human Eye Retina and Their Use in Computer Vision Systems","volume":"55","author":"Boyun","year":"2019","journal-title":"Cybern. Syst. Anal."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Zeng, H., Yang, B., Wang, X., Liu, J., and Fu, D. (2019). RGB-D Object Recognition Using Multi-Modal Deep Neural Network and DS Evidence Theory. Sensors, 19.","DOI":"10.3390\/s19030529"},{"key":"ref_40","first-page":"25","article-title":"Texture Feature Extraction of RGB, HSV, YIQ and Dithered Images using GLCM, Wavelet Decomposition Techniques","volume":"68","author":"Lumb","year":"2013","journal-title":"Int. J. Comput. Appl."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Hiremath, P., Dhanddra, B., Hegadi, R., and Rajput, G. (2004). Abnormality Detection in Endoscopic Images Using Color Segmentation and Curvature Computation, Springer.","DOI":"10.1007\/978-3-540-30499-9_128"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Ringdahl, O., Kurtser, P., and Edan, Y. (2019, January 4\u20136). Performance of RGB-D camera for different object types in greenhouse conditions. Proceedings of the 2019 European Conference on Mobile Robots (ECMR), Prague, Czech Republic.","DOI":"10.1109\/ECMR.2019.8870935"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Nunes, J., Moreira, P., and Tavares, J. (2015). Human Motion Analysis and Simulation Tools: A Survey, IGI Global.","DOI":"10.4018\/978-1-4666-8823-0.ch012"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"193","DOI":"10.1016\/S0263-2241(96)00065-6","article-title":"Stereo vision for 3D measurement: Accuracy analysis, calibration and industrial applications","volume":"18","author":"Aguilar","year":"1996","journal-title":"Measurement"},{"key":"ref_45","unstructured":"Gokturk, S.B., Yalcin, H., and Bamji, C. (July, January 27). A Time-Of-Flight Depth Sensor\u2014System Description, Issues and Solutions. Proceedings of the 2004 Conference on Computer Vision and Pattern Recognition Workshop, Washington, DC, USA."},{"key":"ref_46","unstructured":"Scharstein, D., and Szeliski, R. (2003, January 18\u201320). High-accuracy stereo depth maps using structured light. Proceedings of the 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Madison, WI, USA."},{"key":"ref_47","unstructured":"(2021, February 01). Kuka KR 3 AGILUS Specification. Available online: http:\/\/www.wtech.com.tw\/public\/download\/manual\/kuka\/KUKA%20KR%203.pdf."},{"key":"ref_48","unstructured":"(2021, February 01). Kuka KR 3 AGILUS Datasheet. Available online: https:\/\/www.kuka.com\/-\/media\/kuka-downloads\/imported\/6b77eecacfe542d3b736af377562ecaa\/0000270971_en.pdf."},{"key":"ref_49","unstructured":"(2021, February 01). Stereolabs\u2014ZED Camera. Available online: https:\/\/cdn.stereolabs.com\/assets\/datasheets\/zed-camera-datasheet.pdf."},{"key":"ref_50","unstructured":"(2021, February 01). Pozyx\u2014Creator RTLS System. Available online: https:\/\/pozyx.io\/products-and-services\/creator\/."},{"key":"ref_51","unstructured":"(2021, February 01). Photoneo PhoXi 3D Scanner Specification. Available online: https:\/\/photoneo.com\/wp-content\/uploads\/datasheets\/PhoXi3DScannerL-Datasheet-08_2020.pdf."},{"key":"ref_52","unstructured":"(2021, March 01). Pozyx\u2014Anchor Location Best Practice. Available online: https:\/\/pozyx.io\/uwb-technology\/where-to-place-uwb-anchors\/."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"344","DOI":"10.1109\/HIS.2009.74","article-title":"Otsu Method and K-means","volume":"Volume 1","author":"Liu","year":"2009","journal-title":"Proceedings of the 2009 Ninth International Conference on Hybrid Intelligent Systems"},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"21777","DOI":"10.37622\/IJAER\/10.9.2015.21777-21783","article-title":"Reviewing Otsu\u2019s Method For Image Thresholding","volume":"10","author":"Bangare","year":"2015","journal-title":"Int. J. Appl. Eng. Res."},{"key":"ref_55","unstructured":"Dalal, N., and Triggs, B. (2005, January 20\u201325). Histograms of oriented gradients for human detection. Proceedings of the 2005 IEEE Conference on Computer Vision and Pattern Recognition, San Diego, CA, USA."},{"key":"ref_56","unstructured":"(2021, February 01). Accuracy Considerations for UWB Indoor Tracking in an Industrial Environment. Available online: https:\/\/www.sewio.net\/accuracy-considerations-for-uwb-indoor-tracking-in-an-industrial-environment\/."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/7\/2419\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,13]],"date-time":"2025-10-13T13:55:55Z","timestamp":1760363755000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/7\/2419"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,4,1]]},"references-count":56,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2021,4]]}},"alternative-id":["s21072419"],"URL":"https:\/\/doi.org\/10.3390\/s21072419","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,4,1]]}}}