{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,7]],"date-time":"2026-05-07T23:26:54Z","timestamp":1778196414672,"version":"3.51.4"},"reference-count":30,"publisher":"Springer Science and Business Media LLC","issue":"9","license":[{"start":{"date-parts":[[2023,8,31]],"date-time":"2023-08-31T00:00:00Z","timestamp":1693440000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,8,31]],"date-time":"2023-08-31T00:00:00Z","timestamp":1693440000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100003086","name":"Eusko Jaurlaritza","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100003086","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Multimed Tools Appl"],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Annotated datasets have become crucial for training Machine Learning (ML) models for developing Autonomous Vehicles (AVs) and their functions. Generating these datasets usually involves a complex coordination of automation and manual effort. Moreover, most available labelling tools focus on specific media types (e.g., images or video). Consequently, they cannot perform complex labelling tasks for multi-sensor setups. Recently, ASAM published OpenLABEL, a standard designed to specify an annotation format flexible enough to support the development of automated driving features and to guarantee interoperability among different systems and providers. In this work, we present WebLabel, the first multipurpose web application tool for labelling complex multi-sensor data that is fully compliant with OpenLABEL 1.0. The proposed work analyses several labelling use cases demonstrating the standard's benefits and the application's flexibility to cover various heterogeneous requirements: image labelling, multi-view video object annotation, point-cloud view-based labelling for 3D geometries and action recognition.<\/jats:p>","DOI":"10.1007\/s11042-023-16664-4","type":"journal-article","created":{"date-parts":[[2023,8,31]],"date-time":"2023-08-31T03:24:43Z","timestamp":1693452283000},"page":"26505-26524","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["WebLabel: OpenLABEL-compliant multi-sensor labelling"],"prefix":"10.1007","volume":"83","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7983-3651","authenticated-orcid":false,"given":"Itziar","family":"Urbieta","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Andoni","family":"Mujika","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Gonzalo","family":"Pi\u00e9rola","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Eider","family":"Irigoyen","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Marcos","family":"Nieto","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Estibaliz","family":"Loyo","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Naiara","family":"Aginako","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2023,8,31]]},"reference":[{"key":"16664_CR1","doi-asserted-by":"publisher","unstructured":"Lin T-Y et al (2014) Microsoft COCO: Common Objects in Context. https:\/\/doi.org\/10.48550\/arxiv.1405.0312","DOI":"10.48550\/arxiv.1405.0312"},{"key":"16664_CR2","unstructured":"ASAM e.V. (2021) ASAM OpenODD Concept Project, ASAM OpenODD Concept Project. https:\/\/www.asam.net\/project-detail\/asam-openodd. Accessed 11 Sep 2022"},{"key":"16664_CR3","unstructured":"ASAM e.V. (2022) ASAM OpenSCENARIO: User Guide. https:\/\/www.asam.net\/index.php?eID=dumpFile&t=f&f=4908&token=ae9d9b44ab9257e817072a653b5d5e98ee0babf8. Accessed 21 Aug 2022"},{"key":"16664_CR4","unstructured":"ASAM e.V. (2020) ASAM OpenLABEL Concept Paper. https:\/\/www.asam.net\/index.php?eID=dumpFile&t=f&f=3876&token=413e8c85031ae64cc35cf42d0768627514868b2f. Accessed 25 Sep 2022"},{"issue":"1","key":"16664_CR5","doi-asserted-by":"publisher","first-page":"98","DOI":"10.1007\/s11263-014-0733-5","volume":"111","author":"M Everingham","year":"2015","unstructured":"Everingham M, Eslami SMA, van Gool L, Williams CKI, Winn J, Zisserman A (2015) The Pascal Visual Object Classes Challenge: A Retrospective. Int J Comput Vis 111(1):98\u2013136. https:\/\/doi.org\/10.1007\/s11263-014-0733-5","journal-title":"Int J Comput Vis"},{"key":"16664_CR6","doi-asserted-by":"publisher","DOI":"10.1007\/s11042-022-13153-y","author":"J Kaur","year":"2022","unstructured":"Kaur J, Singh W (2022) Tools, techniques, datasets and application areas for object detection in an image: a review. Multimed Tools Appl. https:\/\/doi.org\/10.1007\/s11042-022-13153-y","journal-title":"Multimed Tools Appl"},{"key":"16664_CR7","unstructured":"Lin Q, Ye G, Wang J, Liu H (2022) RoboFlow: a Data-centric Workflow Management System for Developing AI-enhanced Robots, in Proceedings of the 5th Conference on Robot Learning, A. Faust, D. Hsu, and G. Neumann, Eds., in Proceedings of Machine Learning Research, vol. 164. PMLR, pp. 1789\u20131794. [Online]. Available: https:\/\/proceedings.mlr.press\/v164\/lin22c.html"},{"key":"16664_CR8","unstructured":"Kar A et al (2021) Toronto Annotation Suite (TORAS). https:\/\/aidemos.cs.toronto.edu\/toras. Accessed 05 Oct 2022"},{"issue":"8","key":"16664_CR9","doi-asserted-by":"publisher","first-page":"1467","DOI":"10.1109\/JPROC.2010.2050290","volume":"98","author":"A Torralba","year":"2010","unstructured":"Torralba A, Russell BC, Yuen J (2010) LabelMe: Online Image Annotation and Applications. Proc IEEE 98(8):1467\u20131484. https:\/\/doi.org\/10.1109\/JPROC.2010.2050290","journal-title":"Proc IEEE"},{"key":"16664_CR10","doi-asserted-by":"crossref","unstructured":"Vondrick C, Ramanan D, Patterson D (2010) Efficiently Scaling Up Video Annotation with Crowdsourced Marketplaces, in Computer Vision \u2013 ECCV 2010, K. Daniilidis, P. Maragos, and N. Paragios, Eds., Berlin, Heidelberg: Springer Berlin Heidelberg, pp. 610\u2013623","DOI":"10.1007\/978-3-642-15561-1_44"},{"key":"16664_CR11","doi-asserted-by":"crossref","unstructured":"Zimmer W, Rangesh A, Trivedi MM (2019) 3D BAT: A Semi-Automatic, Web-based 3D Annotation Toolbox for Full-Surround, Multi-Modal Data Streams, CoRR, vol. abs\/1905.00525, [Online]. Available: http:\/\/arxiv.org\/abs\/1905.00525","DOI":"10.1109\/IVS.2019.8814071"},{"key":"16664_CR12","doi-asserted-by":"publisher","unstructured":"Sekachev B et al (2020) opencv\/cvat: v1.1.0. Zenodo. https:\/\/doi.org\/10.5281\/zenodo.4009388","DOI":"10.5281\/zenodo.4009388"},{"key":"16664_CR13","doi-asserted-by":"publisher","unstructured":"Redmon J, Divvala S, Girshick R, Farhadi A (2015) You Only Look Once: Unified, Real-Time Object Detection. arXiv. https:\/\/doi.org\/10.48550\/ARXIV.1506.02640","DOI":"10.48550\/ARXIV.1506.02640"},{"key":"16664_CR14","unstructured":"Pokhrel S (2020) Image Data Labelling and Annotation - Everything you need to know. https:\/\/towardsdatascience.com\/image-data-labelling-and-annotation-everything-you-need-to-know-86ede6c684b1. Accessed 27 Aug 2022"},{"key":"16664_CR15","unstructured":"Tkachenko M, Malyuk M, Holmanyuk A, Liubimov N (2022) Label Studio: Data labeling software, Open source software available from https:\/\/github.com\/heartexlabs\/label-studio, https:\/\/github.com\/heartexlabs\/label-studio. Accessed 12 Aug 2022"},{"key":"16664_CR16","doi-asserted-by":"publisher","unstructured":"Buechel M, Hinz G, Ruehl F, Schroth H, Gy\u00f6ri C, Knoll A (2017) Ontology-Based Traffic Scene Modeling, Traffic Regulations Dependent Situational Awareness and Decision-Making for Automated Vehicles. https:\/\/doi.org\/10.1109\/IVS.2017.7995917","DOI":"10.1109\/IVS.2017.7995917"},{"issue":"1","key":"16664_CR17","doi-asserted-by":"publisher","first-page":"173","DOI":"10.1007\/s11042-009-0370-0","volume":"50","author":"ND Doulamis","year":"2010","unstructured":"Doulamis ND (2010) Coupled multi-object tracking and labeling for vehicle trajectory estimation and matching. Multimed Tools Appl 50(1):173\u2013198. https:\/\/doi.org\/10.1007\/s11042-009-0370-0","journal-title":"Multimed Tools Appl"},{"key":"16664_CR18","doi-asserted-by":"publisher","unstructured":"Mujika A et al (2019) Web-based Video-Assisted Point Cloud Annotation for ADAS validation. https:\/\/doi.org\/10.1145\/3329714.3338128","DOI":"10.1145\/3329714.3338128"},{"key":"16664_CR19","unstructured":"Three.js - JavaScript 3D Library. https:\/\/threejs.org\/"},{"key":"16664_CR20","unstructured":"The Khronos Group Inc., WebGL. https:\/\/www.khronos.org\/api\/webgl"},{"key":"16664_CR21","unstructured":"Jain N, Bhansali A, Mehta D (2014) AngularJS: A modern MVC framework in JavaScript. J Global Res Comput Sci 5(12): 17\u201323. Accessed 3 May 2023. [Online]. Available: http:\/\/www.rroij.com\/open-access\/angularjs-a-modern-mvc-framework-in-javascript.pdf"},{"key":"16664_CR22","unstructured":"(2020) Euro NCAP Assisted Driving Test and Assessment. Highway Assist Systems. Protocol v1.0. Accessed 04 Oct 2022. [Online]. Available: https:\/\/cdn.euroncap.com\/media\/58813\/euro-ncap-ad-test-and-assessment-protocol-v10.pdf"},{"key":"16664_CR23","doi-asserted-by":"publisher","first-page":"100653","DOI":"10.1016\/j.softx.2020.100653","volume":"13","author":"M Nieto","year":"2021","unstructured":"Nieto M, Senderos O, Otaegui O (2021) Boosting AI applications: Labeling format for complex datasets. SoftwareX 13:100653. https:\/\/doi.org\/10.1016\/j.softx.2020.100653","journal-title":"SoftwareX"},{"key":"16664_CR24","unstructured":"(2021) labelGo, Github. https:\/\/github.com\/cnyvfang\/labelGo-Yolov5AutoLabelImg. Accessed 01 Oct 2022"},{"key":"16664_CR25","doi-asserted-by":"publisher","unstructured":"Urbieta I, Nieto M, Garc\u00eda M, Otaegui O (2021) Design and Implementation of an Ontology for Semantic Labeling and Testing: Automotive Global Ontology (AGO). Appl Sci 11(17). https:\/\/doi.org\/10.3390\/app11177782","DOI":"10.3390\/app11177782"},{"key":"16664_CR26","doi-asserted-by":"crossref","unstructured":"Apell\u00e1niz JL, Garc\u00eda M, Aranjuelo N, Barandiaran J, Nieto M (2023) LiDAR-based curb detection for ground truth annotation in AD validation, in Proc. of IEEE Intelligent Transport Systems Conference, Bilbao. Just Accepted","DOI":"10.1109\/ITSC57777.2023.10422558"},{"key":"16664_CR27","doi-asserted-by":"crossref","unstructured":"Ortega JD et al (2020) DMD: A Large-Scale Multi-Modal Driver Monitoring Dataset for Attention and Alertness Analysis, CoRR, vol. abs\/2008.12085, [Online]. Available: https:\/\/arxiv.org\/abs\/2008.12085","DOI":"10.1007\/978-3-030-66823-5_23"},{"key":"16664_CR28","unstructured":"Vicomtech (2023) WebLabel, Github. https:\/\/github.com\/Vicomtech\/weblabel#use-case. Accessed 19 Jul 2023"},{"key":"16664_CR29","unstructured":"Deutsches Zentrum f\u00fcr Schienenverkehrsforschung (DZSF) (2023) Open Sensor Data for Rail 2023. https:\/\/data.fid-move.de\/dataset\/osdar23#. Accessed 20 Jul 2023"},{"key":"16664_CR30","doi-asserted-by":"crossref","unstructured":"R. Tagiew et al (2023) OSDaR23: Open Sensor Data for Rail 2023, [Online]. Available: http:\/\/arxiv.org\/abs\/2305.03001","DOI":"10.1109\/ICRAE59816.2023.10458449"}],"updated-by":[{"DOI":"10.1007\/s11042-023-17602-0","type":"correction","label":"Correction","source":"publisher","updated":{"date-parts":[[2023,11,1]],"date-time":"2023-11-01T00:00:00Z","timestamp":1698796800000}}],"container-title":["Multimedia Tools and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11042-023-16664-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11042-023-16664-4\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11042-023-16664-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,10,27]],"date-time":"2024-10-27T06:20:00Z","timestamp":1730010000000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11042-023-16664-4"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,8,31]]},"references-count":30,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2024,3]]}},"alternative-id":["16664"],"URL":"https:\/\/doi.org\/10.1007\/s11042-023-16664-4","relation":{"correction":[{"id-type":"doi","id":"10.1007\/s11042-023-17602-0","asserted-by":"object"}]},"ISSN":["1573-7721"],"issn-type":[{"value":"1573-7721","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,8,31]]},"assertion":[{"value":"5 December 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"20 July 2023","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"23 August 2023","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"31 August 2023","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"1 November 2023","order":5,"name":"change_date","label":"Change Date","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"Correction","order":6,"name":"change_type","label":"Change Type","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"A Correction to this paper has been published:","order":7,"name":"change_details","label":"Change Details","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"https:\/\/doi.org\/10.1007\/s11042-023-17602-0","URL":"https:\/\/doi.org\/10.1007\/s11042-023-17602-0","order":8,"name":"change_details","label":"Change Details","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare they have no financial interests.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Financial interests"}},{"value":"The authors have no competing interests to declare that are relevant to the content of this article.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}]}}