{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,10]],"date-time":"2026-03-10T03:58:16Z","timestamp":1773115096060,"version":"3.50.1"},"reference-count":58,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2021,2,4]],"date-time":"2021-02-04T00:00:00Z","timestamp":1612396800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Over time, the field of robotics has provided solutions to automate routine tasks in different scenarios. In particular, libraries are awakening great interest in automated tasks since they are semi-structured environments where machines coexist with humans and several repetitive operations could be automatically performed. In addition, multirotor aerial vehicles have become very popular in many applications over the past decade, however autonomous flight in confined spaces still presents a number of challenges and the use of small drones has not been reported as an automated inventory device within libraries. This paper presents the UJI aerial librarian robot that leverages computer vision techniques to autonomously self-localize and navigate in a library for automated inventory and book localization. A control strategy to navigate along the library bookcases is presented by using visual markers for self-localization during a visual inspection of bookshelves. An image-based book recognition technique is described that combines computer vision techniques to detect the tags on the book spines, followed by an optical character recognizer (OCR) to convert the book code on the tags into text. These data can be used for library inventory. Misplaced books can be automatically detected, and a particular book can be located within the library. Our quadrotor robot was tested in a real library with promising results. The problems encountered and limitation of the system are discussed, along with its relation to similar applications, such as automated inventory in warehouses.<\/jats:p>","DOI":"10.3390\/s21041079","type":"journal-article","created":{"date-parts":[[2021,2,4]],"date-time":"2021-02-04T21:29:27Z","timestamp":1612474167000},"page":"1079","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":15,"title":["The UJI Aerial Librarian Robot: A Quadcopter for Visual Library Inventory and Book Localisation"],"prefix":"10.3390","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4495-6912","authenticated-orcid":false,"given":"Ester","family":"Martinez-Martin","sequence":"first","affiliation":[{"name":"RoViT, Department of Computer Science and Artificial Intelligence, University of Alicante, 03690 Alicante, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Eric","family":"Ferrer","sequence":"additional","affiliation":[{"name":"Robotic Intelligence Lab (RobInLab), Department of Engineering and Computer Science, Universitat Jaume I, 12071 Castell\u00f3n, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ilia","family":"Vasilev","sequence":"additional","affiliation":[{"name":"Robotic Intelligence Lab (RobInLab), Department of Engineering and Computer Science, Universitat Jaume I, 12071 Castell\u00f3n, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6227-3758","authenticated-orcid":false,"given":"Angel P.","family":"del Pobil","sequence":"additional","affiliation":[{"name":"Robotic Intelligence Lab (RobInLab), Department of Engineering and Computer Science, Universitat Jaume I, 12071 Castell\u00f3n, Spain"},{"name":"Department of Interaction Science, Sungkyunkwan University, Seoul 110-745, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,2,4]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"042049","DOI":"10.1088\/1757-899X\/263\/4\/042049","article-title":"A survey on barcode RFID and NFC","volume":"263","author":"Thanapal","year":"2017","journal-title":"IOP Conf. Ser. Mater. Sci. Eng."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Morenza-Cinos, M., Casamayor-Pujol, V., Soler-Busquets, J., Sanz, J.L., Guzm\u00e1n, R., and Pous, R. (2017). Development of an RFID Inventory Robot (AdvanRobot). Studies in Computational Intelligence, Springer International Publishing.","DOI":"10.1007\/978-3-319-54927-9_12"},{"key":"ref_3","unstructured":"Li, R., Huang, Z., Kurniawan, E., and Ho, C.K. (October, January 28). AuRoSS: An Autonomous Robotic Shelf Scanning system. Proceedings of the 2015 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Hamburg, Germany."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Ehrenberg, I., Floerkemeier, C., and Sarma, S. (2007, January 22\u201325). Inventory Management with an RFID-equipped Mobile Robot. Proceedings of the 2007 IEEE International Conference on Automation Science and Engineering, Scottsdale, AZ, USA.","DOI":"10.1109\/COASE.2007.4341838"},{"key":"ref_5","unstructured":"MetraLabs (2021, February 03). TORY\u2014Efficient Automated RFID Inventory. Available online: https:\/\/www.metralabs.com\/en\/rfid-robot-tory\/."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Quoc, N.H., and Choi, W.H. (2009). A Framework for Recognition Books on Bookshelves. Emerging Intelligent Computing Technology and Applications, Springer.","DOI":"10.1007\/978-3-642-04070-2_44"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Agaian, S.S., and Jassim, S.A. (2016). A hybrid algorithm for the segmentation of books in libraries. Mobile Multimedia\/Image Processing, Security, and Applications, SPIE.","DOI":"10.1117\/12.2223338"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Tabassum, N., Chowdhury, S., Hossen, M.K., and Mondal, S.U. (2017, January 13\u201314). An approach to recognize book title from multi-cell bookshelf images. Proceedings of the 2017 IEEE International Conference on Imaging, Vision & Pattern Recognition (icIVPR), Dhaka, Bangladesh.","DOI":"10.1109\/ICIVPR.2017.7890886"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Jubair, M.I., and Banik, P. (2013, January 8\u201310). A technique to detect books from library bookshelf image. Proceedings of the 2013 IEEE 9th International Conference on Computational Cybernetics (ICCC), Tihany, Hungary.","DOI":"10.1109\/ICCCyb.2013.6617619"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Prashanth, P., Vivek, K.S., Reddy, D.R., and Aruna, K. (2019, January 27\u201329). Book Detection Using Deep Learning. Proceedings of the 2019 3rd International Conference on Computing Methodologies and Communication (ICCMC), Erode, India.","DOI":"10.1109\/ICCMC.2019.8819725"},{"key":"ref_11","unstructured":"Zhu, B., Wu, X., Yang, L., Shen, Y., and Wu, L. (2016, January 6\u20138). Automatic detection of books based on Faster R-CNN. Proceedings of the 2016 Third International Conference on Digital Information Processing, Data Mining, and Wireless Communications (DIPDMWC), Moscow, Russia."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Yang, X., He, D., Huang, W., Zhou, Z., Ororbia, A., Kifer, D., and Giles, C.L. (2016). Smart Library: Identifying Books in a Library using Richly Supervised Deep Scene Text Reading. arXiv.","DOI":"10.1109\/JCDL.2017.7991581"},{"key":"ref_13","unstructured":"Martinez-Martin, E., Recatala, G., and del Pobil, A.P. (2019). Transforming library operation with robotics. Information Technology Satellite Meeting \u201cRobots in Libraries: Challenge or Opportunity?\u201d, IFLA WLIC."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"321","DOI":"10.1007\/s11370-008-0028-1","article-title":"The UJI librarian robot","volume":"1","author":"Prats","year":"2008","journal-title":"J. Intell. Serv. Robot."},{"key":"ref_15","first-page":"358","article-title":"Library Assistant Robot","volume":"8","author":"Apoorva","year":"2019","journal-title":"Int. J. Eng. Res. Technol. IJERT"},{"key":"ref_16","unstructured":"Tomizawa, T., Ohya, A., and Yuta, S. (2003, January 14\u201319). Remote book browsing system using a mobile manipulator. Proceedings of the 2003 IEEE International Conference on Robotics and Automation (ICRA), Taipei, Taiwan."},{"key":"ref_17","first-page":"139","article-title":"Library Assistant Robot. Robots in Library Management System","volume":"6","author":"Unnikrishnan","year":"2017","journal-title":"Int. J. Eng. Res. Technol. IJERT"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"20","DOI":"10.1109\/MRA.2012.2206474","article-title":"Multirotor Aerial Vehicles: Modeling, Estimation, and Control of Quadrotor","volume":"19","author":"Mahony","year":"2012","journal-title":"IEEE Robot. Autom. Mag."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Benjdira, B., Khursheed, T., Koubaa, A., Ammar, A., and Ouni, K. (2019, January 20). Car Detection using Unmanned Aerial Vehicles: Comparison between Faster R-CNN and YOLOv3. Proceedings of the 2019 1st International Conference on Unmanned Vehicle Systems-Oman (UVS), Muscat, Oman.","DOI":"10.1109\/UVS.2019.8658300"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"13810","DOI":"10.1109\/ACCESS.2018.2811762","article-title":"DroneTrack: Cloud-Based Real-Time Object Tracking Using Unmanned Aerial Vehicles Over the Internet","volume":"6","author":"Koubaa","year":"2018","journal-title":"IEEE Access"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"3485","DOI":"10.1109\/JSYST.2017.2777866","article-title":"Mobile Target Coverage and Tracking on Drone-Be-Gone UAV Cyber-Physical Testbed","volume":"12","author":"Khan","year":"2018","journal-title":"IEEE Syst. J."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1109\/MCOM.2017.1700452","article-title":"An Amateur Drone Surveillance System Based on the Cognitive Internet of Things","volume":"56","author":"Ding","year":"2018","journal-title":"IEEE Commun. Mag."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"129","DOI":"10.1016\/j.future.2018.07.048","article-title":"A distributed PSO-based exploration algorithm for a UAV network assisting a disaster scenario","volume":"90","author":"Reina","year":"2019","journal-title":"Future Gener. Comput. Syst."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Liu, Y., Liu, Z., Shi, J., Wu, G., and Chen, C. (2019). Optimization of Base Location and Patrol Routes for Unmanned Aerial Vehicles in Border Intelligence, Surveillance, and Reconnaissance. J. Adv. Transp., 2019.","DOI":"10.20944\/preprints201809.0487.v2"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"168","DOI":"10.1016\/j.jsg.2016.02.012","article-title":"Mapping folds and fractures in basement and cover rocks using UAV photogrammetry, Cape Liptrap and Cape Paterson, Victoria, Australia","volume":"85","author":"Vollgger","year":"2016","journal-title":"J. Struct. Geol."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Lottes, P., Khanna, R., Pfeifer, J., Siegwart, R., and Stachniss, C. (June, January 29). UAV-based crop and weed classification for smart farming. Proceedings of the 2017 IEEE International Conference on Robotics and Automation (ICRA), Singapore.","DOI":"10.1109\/ICRA.2017.7989347"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Park, S., and Choi, Y. (2020). Applications of Unmanned Aerial Vehicles in Mining from Exploration to Reclamation: A Review. Minerals, 10.","DOI":"10.3390\/min10080663"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Belmonte, L.M., Morales, R., and Fern\u00e1ndez-Caballero, A. (2019). Computer Vision in Autonomous Unmanned Aerial Vehicles\u2014A Systematic Mapping Study. Appl. Sci., 9.","DOI":"10.3390\/app9153196"},{"key":"ref_29","unstructured":"Fleye (2021, February 03). Fleye\u2014Your Personal Flying Robot. Available online: https:\/\/www.kickstarter.com\/projects\/gofleye\/fleye-your-personal-flying-robot."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1016\/j.techfore.2018.05.004","article-title":"Unmanned aerial vehicles applications in future smart cities","volume":"153","author":"Mohamed","year":"2020","journal-title":"Technol. Forecast. Soc. Chang."},{"key":"ref_31","unstructured":"Amazon (2021, February 03). Amazon Prime Air. Available online: https:\/\/www.amazon.com\/Amazon-Prime-Air\/b?ie=UTF8&node=8037720011."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"460","DOI":"10.1038\/nature14542","article-title":"Science, technology and the future of small autonomous drones","volume":"521","author":"Floreano","year":"2015","journal-title":"Nature"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Harik, E.H.C., Guerin, F., Guinand, F., Brethe, J.F., and Pelvillain, H. (2016, January 6\u20139). Towards An Autonomous Warehouse Inventory Scheme. Proceedings of the 2016 IEEE Symposium Series on Computational Intelligence (SSCI), Honolulu, HI, USA.","DOI":"10.1109\/SSCI.2016.7850056"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"63504","DOI":"10.1109\/ACCESS.2019.2914352","article-title":"Cooperative Routing Problem for Ground Vehicle and Unmanned Aerial Vehicle: The Application on Intelligence, Surveillance, and Reconnaissance Missions","volume":"7","author":"Liu","year":"2019","journal-title":"IEEE Access"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Manyam, S.G., Casbeer, D.W., and Sundar, K. (2016, January 6\u20138). Path planning for cooperative routing of air-ground vehicles. Proceedings of the 2016 American Control Conference (ACC), Boston, MA, USA.","DOI":"10.1109\/ACC.2016.7526082"},{"key":"ref_36","first-page":"100106","article-title":"Swarms of Unmanned Aerial Vehicles\u2014A Survey","volume":"16","author":"Tahir","year":"2019","journal-title":"J. Ind. Inf. Integr."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"141","DOI":"10.1007\/s10846-017-0483-z","article-title":"Survey on Computer Vision for UAVs: Current Developments and Trends","volume":"87","author":"Kanellakis","year":"2017","journal-title":"J. Intell. Robot. Syst."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"373","DOI":"10.1007\/s10846-011-9571-7","article-title":"Combining Stereo Vision and Inertial Navigation System for a Quad-Rotor UAV","volume":"65","author":"Carrillo","year":"2011","journal-title":"J. Intell. Robot. Syst."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Blosch, M., Weiss, S., Scaramuzza, D., and Siegwart, R. (2010, January 3\u20137). Vision based MAV navigation in unknown and unstructured environments. Proceedings of the 2010 IEEE International Conference on Robotics and Automation, Anchorage, AK, USA.","DOI":"10.1109\/ROBOT.2010.5509920"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"696","DOI":"10.1016\/j.comcom.2019.12.026","article-title":"An effective approach to unmanned aerial vehicle navigation using visual topological map in outdoor and indoor environments","volume":"150","author":"Han","year":"2020","journal-title":"Comput. Commun."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"243","DOI":"10.1109\/LRA.2019.2955003","article-title":"Robust Autonomous Navigation of Unmanned Aerial Vehicles (UAVs) for Warehouses\u2019 Inventory Application","volume":"5","author":"Kwon","year":"2020","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Ibarra, R.R., M\u00e1rquez, M.V., Mart\u00ednez, G., and Hern\u00e1ndez, V. (2020). Computer Vision Navigation System for an Indoors Unmanned Aerial Vehicle. Communications in Computer and Information Science, Springer International Publishing.","DOI":"10.1007\/978-3-030-62554-2_3"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Hummel, K.A., Pollak, M., and Krahofer, J. (2019). A Distributed Architecture for Human-Drone Teaming: Timing Challenges and Interaction Opportunities. Sensors, 19.","DOI":"10.3390\/s19061379"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"56","DOI":"10.1016\/j.vrih.2019.12.004","article-title":"Survey on path and view planning for UAVs","volume":"2","author":"Zhou","year":"2020","journal-title":"Virtual Real. Intell. Hardw."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"270","DOI":"10.1016\/j.comcom.2019.10.014","article-title":"Path planning techniques for unmanned aerial vehicles: A review, solutions, and challenges","volume":"149","author":"Aggarwal","year":"2020","journal-title":"Comput. Commun."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Cabreira, T., Brisolara, L., and Ferreira, P.R.F. (2019). Survey on Coverage Path Planning with Unmanned Aerial Vehicles. Drones, 3.","DOI":"10.3390\/drones3010004"},{"key":"ref_47","unstructured":"Parrot Drone SAS (2021, February 03). Parrot Bebop 2 Quadcopter. Available online: https:\/\/www.parrot.com\/en."},{"key":"ref_48","unstructured":"Moshe, B.B., Shvalb, N., Baadani, J., Nagar, I., and Levy, H. (2012, January 14\u201317). Indoor positioning and navigation for micro UAV drones. Proceedings of the 2012 IEEE 27th Convention of Electrical and Electronics Engineers, Eilat, Israel. Work in progress."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"2280","DOI":"10.1016\/j.patcog.2014.01.005","article-title":"Automatic generation and detection of highly reliable fiducial markers under occlusion","volume":"47","year":"2014","journal-title":"Pattern Recognit."},{"key":"ref_50","unstructured":"OpenCV Team (2021, February 03). OpenCV. Available online: https:\/\/opencv.org\/."},{"key":"ref_51","unstructured":"van Waveren, J.M.P. (2005). From Quaternion to Matrix and Back, Id Software, Inc.. Technical Report."},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Corke, P. (2017). Robotics, Vision and Control, Springer International Publishing.","DOI":"10.1007\/978-3-319-54413-7"},{"key":"ref_53","unstructured":"Luukkonen, T. (2011). Modelling and Control of Quadcopter, Aalto University, School of Science. Technical Report."},{"key":"ref_54","doi-asserted-by":"crossref","unstructured":"Quan, Q. (2017). Introduction to Multicopter Design and Control, Springer International Publishing.","DOI":"10.1007\/978-981-10-3382-7"},{"key":"ref_55","unstructured":"Islam, N., Islam, Z., and Noor, N. (2017). A Survey on Optical Character Recognition System. arXiv."},{"key":"ref_56","first-page":"34","article-title":"Review of Text Recognition Works","volume":"137","author":"Agarwal","year":"2016","journal-title":"Int. J. Comput. Appl."},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"991","DOI":"10.22214\/ijraset.2020.5157","article-title":"OCR Text Detector and Audio Convertor","volume":"8","author":"Dave","year":"2020","journal-title":"Int. J. Res. Appl. Sci. Eng. Technol."},{"key":"ref_58","unstructured":"Rice, S.V., Jenkins, F.R., and Nartker, T.A. (1995). The Fourth Annual Test of OCR Accuracy, Information Science Research Institute. Technical Report."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/4\/1079\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T05:20:18Z","timestamp":1760160018000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/4\/1079"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,2,4]]},"references-count":58,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2021,2]]}},"alternative-id":["s21041079"],"URL":"https:\/\/doi.org\/10.3390\/s21041079","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,2,4]]}}}