{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,10]],"date-time":"2026-04-10T23:14:23Z","timestamp":1775862863590,"version":"3.50.1"},"reference-count":45,"publisher":"Springer Science and Business Media LLC","issue":"6","license":[{"start":{"date-parts":[[2023,10,24]],"date-time":"2023-10-24T00:00:00Z","timestamp":1698105600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,10,24]],"date-time":"2023-10-24T00:00:00Z","timestamp":1698105600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100014013","name":"UK Research and Innovation","doi-asserted-by":"publisher","award":["10038942"],"award-info":[{"award-number":["10038942"]}],"id":[{"id":"10.13039\/100014013","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100014013","name":"UK Research and Innovation","doi-asserted-by":"publisher","award":["10038942"],"award-info":[{"award-number":["10038942"]}],"id":[{"id":"10.13039\/100014013","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100018703","name":"HORIZON EUROPE European Innovation Council","doi-asserted-by":"publisher","award":["101070918"],"award-info":[{"award-number":["101070918"]}],"id":[{"id":"10.13039\/100018703","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100018703","name":"HORIZON EUROPE European Innovation Council","doi-asserted-by":"publisher","award":["101070918"],"award-info":[{"award-number":["101070918"]}],"id":[{"id":"10.13039\/100018703","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Real-Time Image Proc"],"published-print":{"date-parts":[[2023,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Square fiducial markers are widely used in robotics to easily obtain pose and other information about the world from camera images. Processing the images to extract the markers is usually performed centrally with standard libraries but the code is typically aimed at PC-level hardware. Platforms with constrained processing power have difficulty handling multiple camera streams at real-time refresh rates. We introduce the<jats:bold>Frappe<\/jats:bold>(Fiducial Recognition Accelerated with Parallel Processing Elements) algorithm for detecting and decoding the popular ArUco tags. Designed to be implemented on the low cost hardware of the Raspberry Pi Zero, we show tag detection and decoding on images of 640\u00a0\u00d7\u00a0480 resolution exceeding 60\u00a0Hz, five times faster than the standard ArUco library, while maintaining similar detection performance and using much less energy. Using Frappe, we demonstrate improved real-world performance on a visual navigation task with our DOTS robot.<\/jats:p>","DOI":"10.1007\/s11554-023-01373-w","type":"journal-article","created":{"date-parts":[[2023,10,24]],"date-time":"2023-10-24T13:03:22Z","timestamp":1698152602000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":8,"title":["Frappe: fast fiducial detection on low cost hardware"],"prefix":"10.1007","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7184-8477","authenticated-orcid":false,"given":"Simon","family":"Jones","sequence":"first","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0341-7306","authenticated-orcid":false,"given":"Sabine","family":"Hauert","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2023,10,24]]},"reference":[{"key":"1373_CR1","unstructured":"Jones, S., Milner, E., Sooriyabandara, M. and Hauert, S.: DOTS: An Open Testbed for Industrial Swarm Robotic Solutions. 2022. https:\/\/arxiv.org\/abs\/2203.13809"},{"key":"1373_CR2","doi-asserted-by":"crossref","unstructured":"Kato, H. and Billinghurst, M.: Marker tracking and HMD calibration for a video-based augmented reality conferencing system. In: Proceedings 2nd IEEE and ACM International Workshop on Augmented Reality (IWAR\u201999). IEEE, pp. 85\u201394 (1999)","DOI":"10.1109\/IWAR.1999.803809"},{"key":"1373_CR3","doi-asserted-by":"publisher","first-page":"3400","DOI":"10.1109\/ICRA.2011.5979561","volume":"2011","author":"E Olson","year":"2011","unstructured":"Olson, E.: AprilTag: a robust and flexible visual fiducial system. IEEE Int. Conf. Robot. Autom. 2011, 3400\u20133407 (2011)","journal-title":"IEEE Int. Conf. Robot. Autom."},{"key":"1373_CR4","doi-asserted-by":"crossref","unstructured":"Wang, J. and Olson, E.: AprilTag 2: efficient and robust fiducial detection. In: 2016 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, pp. 4193\u20134198 (2016)","DOI":"10.1109\/IROS.2016.7759617"},{"key":"1373_CR5","doi-asserted-by":"crossref","unstructured":"Fiala, M.: ARTag, a fiducial marker system using digital techniques. In: 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR\u201905), vol.\u00a02. IEEE, pp. 590\u2013596 (2005)","DOI":"10.1109\/CVPR.2005.74"},{"issue":"6","key":"1373_CR6","doi-asserted-by":"publisher","first-page":"2280","DOI":"10.1016\/j.patcog.2014.01.005","volume":"47","author":"S Garrido-Jurado","year":"2014","unstructured":"Garrido-Jurado, S., Munoz-Salinas, R., Madrid-Cuevas, F.J., Marin-Jimenez, M.J.: Automatic generation and detection of highly reliable fiducial markers under occlusion. Pattern Recogn. 47(6), 2280\u20132292 (2014)","journal-title":"Pattern Recogn."},{"key":"1373_CR7","doi-asserted-by":"publisher","first-page":"38","DOI":"10.1016\/j.imavis.2018.05.004","volume":"76","author":"FJ Romero-Ramirez","year":"2018","unstructured":"Romero-Ramirez, F.J., Mu\u00f1oz-Salinas, R., Medina-Carnicer, R.: Speeded up detection of squared fiducial markers. Image Vis. Comput. 76, 38\u201347 (2018)","journal-title":"Image Vis. Comput."},{"key":"1373_CR8","doi-asserted-by":"crossref","unstructured":"Naimark, L. and Foxlin, E.: Circular data matrix fiducial system and robust image processing for a wearable vision-inertial self-tracker. In: Proceedings. International Symposium on Mixed and Augmented Reality. IEEE, pp. 27\u201336 (2002)","DOI":"10.1109\/ISMAR.2002.1115065"},{"key":"1373_CR9","doi-asserted-by":"publisher","first-page":"158","DOI":"10.1016\/j.imavis.2019.06.007","volume":"89","author":"B Benligiray","year":"2019","unstructured":"Benligiray, B., Topal, C., Akinlar, C.: STag: a stable fiducial marker system. Image Vis. Comput. 89, 158\u2013169 (2019)","journal-title":"Image Vis. Comput."},{"key":"1373_CR10","doi-asserted-by":"crossref","unstructured":"Calvet, L., Gurdjos, P., Griwodz, C. and Gasparini, S.: Detection and accurate localization of circular fiducials under highly challenging conditions. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 562\u2013570 (2016)","DOI":"10.1109\/CVPR.2016.67"},{"key":"1373_CR11","doi-asserted-by":"publisher","DOI":"10.1016\/j.imavis.2020.104094","volume":"107","author":"FJ Romero-Ramirez","year":"2021","unstructured":"Romero-Ramirez, F.J., Mu\u00f1oz-Salinas, R., Medina-Carnicer, R.: Tracking fiducial markers with discriminative correlation filters. Image Vis. Comput. 107, 104094 (2021)","journal-title":"Image Vis. Comput."},{"key":"1373_CR12","doi-asserted-by":"crossref","unstructured":"Li, B., Wu, J., Tan, X., and Wang, B.: Aruco marker detection under occlusion using convolutional neural network. In: 2020 5th International Conference on Automation, Control and Robotics Engineering (CACRE). IEEE, pp. 706\u2013711 (2020)","DOI":"10.1109\/CACRE50138.2020.9230250"},{"key":"1373_CR13","doi-asserted-by":"publisher","first-page":"336","DOI":"10.1016\/j.eswa.2017.10.032","volume":"93","author":"V Mond\u00e9jar-Guerra","year":"2018","unstructured":"Mond\u00e9jar-Guerra, V., Garrido-Jurado, S., Mu\u00f1oz-Salinas, R., Mar\u00edn-Jim\u00e9nez, M.J., Medina-Carnicer, R.: Robust identification of fiducial markers in challenging conditions. Expert Syst. Appl. 93, 336\u2013345 (2018)","journal-title":"Expert Syst. Appl."},{"issue":"4","key":"1373_CR14","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s10846-020-01307-9","volume":"101","author":"M Kalaitzakis","year":"2021","unstructured":"Kalaitzakis, M., Cain, B., Carroll, S., Ambrosi, A., Whitehead, C., Vitzilaios, N.: Fiducial markers for pose estimation. J. Intell. Robot. Syst. 101(4), 1\u201326 (2021)","journal-title":"J. Intell. Robot. Syst."},{"issue":"1","key":"1373_CR15","doi-asserted-by":"publisher","first-page":"154","DOI":"10.1109\/TPAMI.2020.3008413","volume":"44","author":"G Gallego","year":"2020","unstructured":"Gallego, G., Delbr\u00fcck, T., Orchard, G., Bartolozzi, C., Taba, B., Censi, A., Leutenegger, S., Davison, A.J., Conradt, J., Daniilidis, K., et al.: Event-based vision: a survey. IEEE Trans. Pattern Anal. Mach. Intell. 44(1), 154\u2013180 (2020)","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"issue":"5","key":"1373_CR16","doi-asserted-by":"publisher","first-page":"1147","DOI":"10.1109\/TRO.2015.2463671","volume":"31","author":"R Mur-Artal","year":"2015","unstructured":"Mur-Artal, R., Montiel, J.M.M., Tardos, J.D.: ORB-SLAM: a versatile and accurate monocular SLAM system. IEEE Trans. Robot. 31(5), 1147\u20131163 (2015)","journal-title":"IEEE Trans. Robot."},{"key":"1373_CR17","doi-asserted-by":"crossref","unstructured":"Engel, J., Sch\u00f6ps, T. and Cremers, D.: LSD-SLAM: large-scale direct monocular SLAM. In: European conference on computer vision. Springer, pp. 834\u2013849 (2014)","DOI":"10.1007\/978-3-319-10605-2_54"},{"issue":"10","key":"1373_CR18","doi-asserted-by":"publisher","first-page":"14","DOI":"10.1109\/MC.2013.349","volume":"46","author":"C Severance","year":"2013","unstructured":"Severance, C.: Eben upton: raspberry Pi. Computer 46(10), 14\u201316 (2013)","journal-title":"Computer"},{"issue":"1","key":"1373_CR19","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1002\/meet.2014.14505101110","volume":"51","author":"KE Parham","year":"2014","unstructured":"Parham, K.E., Ferri, A.M., Fan, S., Murray, M.P., Lahr, R.A., Grguric, E., Swamiraj, M., Meyers, E.: Critical making with a raspberry Pi\u2014towards a conceptualization of librarians as makers. Proc. Am. Soc. Inf. Sci. Technol. 51(1), 1\u20134 (2014)","journal-title":"Proc. Am. Soc. Inf. Sci. Technol."},{"issue":"9","key":"1373_CR20","doi-asserted-by":"publisher","first-page":"1562","DOI":"10.1111\/2041-210X.13652","volume":"12","author":"JW Jolles","year":"2021","unstructured":"Jolles, J.W.: Broad-scale applications of the Raspberry Pi: a review and guide for biologists. Methods Ecol. Evolut. 12(9), 1562\u20131579 (2021)","journal-title":"Methods Ecol. Evolut."},{"issue":"6","key":"1373_CR21","doi-asserted-by":"publisher","first-page":"2389","DOI":"10.1007\/s11554-021-01131-w","volume":"18","author":"A Taheri Tajar","year":"2021","unstructured":"Taheri Tajar, A., Ramazani, A., Mansoorizadeh, M.: A lightweight Tiny-YOLOv3 vehicle detection approach. J. Real-Time Image Process. 18(6), 2389\u20132401 (2021)","journal-title":"J. Real-Time Image Process."},{"key":"1373_CR22","doi-asserted-by":"publisher","first-page":"193","DOI":"10.1007\/s11554-018-0833-5","volume":"16","author":"EM Rubino","year":"2019","unstructured":"Rubino, E.M., \u00c1lvares, A.J., Mar\u00edn, R., Sanz, P.J.: Real-time rate distortion-optimized image compression with region of interest on the arm architecture for underwater robotics applications. J. Real-Time Image Process. 16, 193\u2013225 (2019)","journal-title":"J. Real-Time Image Process."},{"key":"1373_CR23","doi-asserted-by":"crossref","unstructured":"Paull, L., Tani, J., Ahn, H., Alonso-Mora, J., Carlone, L., Cap, M., Chen, Y.F., Choi, C., Dusek, J., Fang, Y. et\u00a0al.: Duckietown: an open, inexpensive and flexible platform for autonomy education and research. In: 2017 IEEE International Conference on Robotics and Automation (ICRA). IEEE, pp. 1497\u20131504 (2017)","DOI":"10.1109\/ICRA.2017.7989179"},{"key":"1373_CR24","doi-asserted-by":"crossref","unstructured":"Millard, A.G., Joyce, R.A., Hilder, J.A., Fleseriu, C., Newbrook, L., Li, W., McDaid, L. and Halliday, D.M.: The Pi-puck extension board: a Raspberry Pi interface for the e-puck robot platform. In: Maciejewski, T., (ed.) IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS 2017), Vancouver, Canada: IEEE (2017)","DOI":"10.1109\/IROS.2017.8202233"},{"key":"1373_CR25","doi-asserted-by":"crossref","unstructured":"Alhafnawi, M., Hunt, E.R., Lemaignan, S., O\u2019Dowd, P. and Hauert, S.: MOSAIX: a swarm of robot tiles for social human-Swarm interaction. In: 2022 International Conference on Robotics and Automation (ICRA). IEEE, pp. 6882\u20136888 (2022)","DOI":"10.1109\/ICRA46639.2022.9811723"},{"key":"1373_CR26","unstructured":"Broadcom, VideoCore IV 3D Architecture Reference Manual, Broadcom, 2013. [Online]. Available: https:\/\/docs.broadcom.com\/doc\/12358545"},{"key":"1373_CR27","unstructured":"Hermitage; H., et al.: VideoCore IV Programmers Manual, 2012. Available: https:\/\/github.com\/hermanhermitage\/videocoreiv\/wiki\/ VideoCore-IV-Programmers-Manual"},{"key":"1373_CR28","unstructured":"M\u00fcller, M.: vc4asm - Macro assembler for Broadcom VideoCore IV. 2014. . Available: https:\/\/github.com\/maazl\/vc4asm"},{"key":"1373_CR29","unstructured":"Brooks, K.: Minimal Raspberry Pi VPU firmware. 2016. Available: https:\/\/github.com\/christinaa\/rpi-open-firmware"},{"key":"1373_CR30","unstructured":"Brown, J.: VC4 GCC toolchain. 2016. Available: https:\/\/github.com\/itszor\/vc4-toolchain"},{"key":"1373_CR31","unstructured":"Holme, A.: GPU FFT. 2014. Available: http:\/\/www.aholme.co.uk\/GPU_FFT\/Main.htm"},{"key":"1373_CR32","unstructured":"\u2018mn416\u2019 and Rijnders, V.: QPULib. 2016. Available: https:\/\/github.com\/mn416\/QPULib"},{"key":"1373_CR33","unstructured":"Seneral. VideoCore IV Computer Vision framework. 2020. Available: https:\/\/github.com\/Seneral\/VC4CV"},{"key":"1373_CR34","unstructured":"\u201cVC4 caches,\u201d 2019. Available: https:\/\/forums.raspberrypi.com\/viewtopic.php? t=234167#p1432851"},{"key":"1373_CR35","unstructured":"\u201cVPU information,\u201d 2020. Available: https:\/\/forums.raspberrypi.com\/viewtopic.php? t=287399#p1738410"},{"issue":"2","key":"1373_CR36","doi-asserted-by":"publisher","first-page":"322","DOI":"10.36222\/ejt.708805","volume":"10","author":"A Polat","year":"2020","unstructured":"Polat, A., Bayar, S.: A fast and energy efficient parallel image filtering implementation on Raspberry Pi\u2019s GPU. Eur. J. Tech. (EJT) 10(2), 322\u2013330 (2020)","journal-title":"Eur. J. Tech. (EJT)"},{"key":"1373_CR37","doi-asserted-by":"crossref","unstructured":"Li, Y., Huang, D., Huang, S., Huang, S., Li, Y., Zhou, X., et\u00a0al.: Sub-pixel gear parameter measurement based on Zemike moment. In: 2019 IEEE International Conference on Mechatronics and Automation (ICMA). IEEE, pp. 2336\u20132341 (2019)","DOI":"10.1109\/ICMA.2019.8816252"},{"key":"1373_CR38","doi-asserted-by":"crossref","unstructured":"Faerman, V., Shvetsov, M., and Tsavnin, A.: Computations of cross-correlation functions on a single board Raspberry Pi computer. In: Journal of Physics: Conference Series, vol. 1615, no.\u00a01. IOP Publishing, p. 012004 (2020)","DOI":"10.1088\/1742-6596\/1615\/1\/012004"},{"key":"1373_CR39","doi-asserted-by":"publisher","first-page":"679","DOI":"10.1109\/TPAMI.1986.4767851","volume":"6","author":"J Canny","year":"1986","unstructured":"Canny, J.: A computational approach to edge detection. IEEE Trans. Pattern Anal. Mach. Intell. 6, 679\u2013698 (1986)","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"1373_CR40","doi-asserted-by":"crossref","unstructured":"Shi, C., Jianbo;\u00a0Tomasi. Good Features to Track. In: 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition. IEEE, pp. 593\u2013600 (1994)","DOI":"10.1109\/CVPR.1994.323794"},{"key":"1373_CR41","unstructured":"Sobel, I. and Feldman, G.: An Isotropic 3x3 Image Gradient Operator,\u201d Stanford AI Project (1968)"},{"issue":"1","key":"1373_CR42","doi-asserted-by":"publisher","first-page":"32","DOI":"10.1016\/0734-189X(85)90016-7","volume":"30","author":"S Suzuki","year":"1985","unstructured":"Suzuki, S., et al.: Topological structural analysis of digitized binary images by border following. Comput. Vis. Graph. Image Process. 30(1), 32\u201346 (1985)","journal-title":"Comput. Vis. Graph. Image Process."},{"key":"1373_CR43","doi-asserted-by":"crossref","unstructured":"Kallwies, J., Forkel, B., and Wuensche, H.-J.: Determining and improving the localization accuracy of AprilTag detection. In: 2020 IEEE International Conference on Robotics and Automation (ICRA). IEEE, pp. 8288\u20138294 (2020)","DOI":"10.1109\/ICRA40945.2020.9197427"},{"issue":"1","key":"1373_CR44","doi-asserted-by":"publisher","first-page":"62","DOI":"10.1109\/TSMC.1979.4310076","volume":"9","author":"N Otsu","year":"1979","unstructured":"Otsu, N.: A threshold selection method from Gray-level histograms. IEEE Trans. Syst. Man Cybern. 9(1), 62\u201366 (1979)","journal-title":"IEEE Trans. Syst. Man Cybern."},{"key":"1373_CR45","doi-asserted-by":"publisher","first-page":"25","DOI":"10.1016\/j.patcog.2017.04.018","volume":"70","author":"L He","year":"2017","unstructured":"He, L., Ren, X., Gao, Q., Zhao, X., Yao, B., Chao, Y.: The connected-component labeling problem: a review of state-of-the-art algorithms. Pattern Recogn. 70, 25\u201343 (2017)","journal-title":"Pattern Recogn."}],"container-title":["Journal of Real-Time Image Processing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11554-023-01373-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11554-023-01373-w\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11554-023-01373-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,10,31]],"date-time":"2024-10-31T18:44:06Z","timestamp":1730400246000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11554-023-01373-w"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,10,24]]},"references-count":45,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2023,12]]}},"alternative-id":["1373"],"URL":"https:\/\/doi.org\/10.1007\/s11554-023-01373-w","relation":{},"ISSN":["1861-8200","1861-8219"],"issn-type":[{"value":"1861-8200","type":"print"},{"value":"1861-8219","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,10,24]]},"assertion":[{"value":"26 July 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"27 September 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"24 October 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}],"article-number":"119"}}