{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,26]],"date-time":"2025-11-26T16:43:10Z","timestamp":1764175390255,"version":"3.37.3"},"reference-count":27,"publisher":"Springer Science and Business Media LLC","issue":"7","license":[{"start":{"date-parts":[[2023,1,30]],"date-time":"2023-01-30T00:00:00Z","timestamp":1675036800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,1,30]],"date-time":"2023-01-30T00:00:00Z","timestamp":1675036800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100007863","name":"Lunds Tekniska H\u00f6gskola, Lunds universitet","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100007863","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003252","name":"Lund University","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100003252","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Sign Process Syst"],"published-print":{"date-parts":[[2023,7]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>In computer-vision feature extraction algorithms, compressing the image into a sparse set of trackable keypoints, empowers navigation-critical systems such as Simultaneous Localization And Mapping (SLAM) in autonomous robots, and also other applications such as augmented reality and 3D reconstruction. Most of those applications are performed in battery-powered gadgets featuring in common a very stringent power-budget. Near-to-sensor computing of feature extraction algorithms allows for several design optimizations. First, the overall on-chip memory requirements can be lessened, and second, the internal data movement can be minimized. This work explores the usage of an Application Specific Instruction Set Processor (ASIP) dedicated to perform feature extraction in a real-time and energy-efficient manner. The ASIP features a Very Long Instruction Word (VLIW) architecture comprising one RV32I RISC-V and three vector slots. The on-chip memory sub-system implements parallel multi-bank memories with near-memory data shuffling to enable single-cycle multi-pattern vector access. Oriented FAST and Rotated BRIEF (ORB) are thoroughly explored to validate the proposed architecture, achieving a throughput of 140 Frames-Per-Second (FPS) for VGA images for one scale, while reducing the number of memory accesses by 2 orders of magnitude as compared to other embedded general-purpose architectures.<\/jats:p>","DOI":"10.1007\/s11265-022-01833-9","type":"journal-article","created":{"date-parts":[[2023,1,30]],"date-time":"2023-01-30T15:15:46Z","timestamp":1675091746000},"page":"863-875","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Design of an Application-specific VLIW Vector Processor for ORB Feature Extraction"],"prefix":"10.1007","volume":"95","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4620-2228","authenticated-orcid":false,"given":"Lucas","family":"Ferreira","sequence":"first","affiliation":[]},{"given":"Steffen","family":"Malkowsky","sequence":"additional","affiliation":[]},{"given":"Patrik","family":"Persson","sequence":"additional","affiliation":[]},{"given":"Sven","family":"Karlsson","sequence":"additional","affiliation":[]},{"given":"Kalle","family":"\u00c5str\u00f6m","sequence":"additional","affiliation":[]},{"given":"Liang","family":"Liu","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2023,1,30]]},"reference":[{"key":"1833_CR1","doi-asserted-by":"publisher","first-page":"1164","DOI":"10.1016\/j.apenergy.2019.03.117","volume":"242","author":"W-C Chiang","year":"2019","unstructured":"Chiang, W. -C., Li, Y., Shang, J., & Urban, T. L. (2019). Impact of drone delivery on sustainability and cost: Realizing the UAV potential through vehicle routing optimization. Applied Energy, 242, 1164\u20131175. https:\/\/doi.org\/10.1016\/j.apenergy.2019.03.117","journal-title":"Applied Energy"},{"key":"1833_CR2","doi-asserted-by":"publisher","unstructured":"Kanistras, K., et al. (2013). A survey of unmanned aerial vehicles (UAVs) for traffic monitoring. In: 2013 International Conference on Unmanned Aircraft Systems (ICUAS), pp. 221\u2013234. https:\/\/doi.org\/10.1109\/ICUAS.2013.6564694","DOI":"10.1109\/ICUAS.2013.6564694"},{"key":"1833_CR3","doi-asserted-by":"publisher","unstructured":"Liu, Y., Liu, H., Tian, Y., & Sun, C. (2020). Reinforcement learning based two-level control framework of UAV swarm for cooperative persistent surveillance in an unknown urban area. Aerospace Science and Technology,\u00a098, 105671. https:\/\/doi.org\/10.1016\/j.ast.2019.105671","DOI":"10.1016\/j.ast.2019.105671"},{"issue":"5","key":"1833_CR4","doi-asserted-by":"publisher","first-page":"32","DOI":"10.1109\/MAES.2013.6516147","volume":"28","author":"D Erdos","year":"2013","unstructured":"Erdos, D., Erdos, A., & Watkins, S. E. (2013). An experimental UAV system for search and rescue challenge. IEEE Aerospace and Electronic Systems Magazine, 28(5), 32\u201337. https:\/\/doi.org\/10.1109\/MAES.2013.6516147","journal-title":"IEEE Aerospace and Electronic Systems Magazine"},{"issue":"4","key":"1833_CR5","doi-asserted-by":"publisher","first-page":"4026","DOI":"10.3390\/rs70404026","volume":"7","author":"S Candiago","year":"2015","unstructured":"Candiago, S., et al. (2015). Evaluating multispectral images and vegetation indices for precision farming applications from UAV images. Remote Sensing, 7(4), 4026\u20134047. https:\/\/doi.org\/10.3390\/rs70404026","journal-title":"Remote Sensing"},{"issue":"9","key":"1833_CR6","doi-asserted-by":"publisher","first-page":"699","DOI":"10.1049\/el.2015.4551","volume":"52","author":"D Li","year":"2016","unstructured":"Li, D., Wang, X., & Sun, T. (2016). Energy-optimal coverage path planning on topographic map for environment survey with unmanned aerial vehicles. Electronics Letters, 52(9), 699\u2013701. https:\/\/doi.org\/10.1049\/el.2015.4551","journal-title":"Electronics Letters"},{"issue":"15\u201316","key":"1833_CR7","doi-asserted-by":"publisher","first-page":"5236","DOI":"10.1080\/01431161.2017.1363442","volume":"39","author":"SE Franklin","year":"2018","unstructured":"Franklin, S. E., & Ahmed, O. S. (2018). Deciduous tree species classification using object-based analysis and machine learning with unmanned aerial vehicle multispectral data. International Journal of Remote Sensing, 39(15\u201316), 5236\u20135245. https:\/\/doi.org\/10.1080\/01431161.2017.1363442","journal-title":"International Journal of Remote Sensing"},{"issue":"8","key":"1833_CR8","doi-asserted-by":"publisher","first-page":"18","DOI":"10.1109\/MC.2017.3001256","volume":"50","author":"S Liu","year":"2017","unstructured":"Liu, S., et al. (2017). Computer architectures for autonomous driving. Computer, 50(8), 18\u201325. https:\/\/doi.org\/10.1109\/MC.2017.3001256","journal-title":"Computer"},{"key":"1833_CR9","unstructured":"European Union Energy label. Tesla Support. (2021). https:\/\/www.tesla.com\/en_EU\/support\/european-union-energy-label"},{"issue":"4","key":"1833_CR10","doi-asserted-by":"publisher","first-page":"1106","DOI":"10.1109\/JSSC.2018.2886342","volume":"54","author":"A Suleiman","year":"2019","unstructured":"Suleiman, A., et al. (2019). Navion: A 2-mw fully integrated real-time visual-inertial odometry accelerator for autonomous navigation of nano drones. IEEE Journal of Solid-State Circuits, 54(4), 1106\u20131119. https:\/\/doi.org\/10.1109\/JSSC.2018.2886342","journal-title":"IEEE Journal of Solid-State Circuits"},{"issue":"3","key":"1833_CR11","doi-asserted-by":"publisher","first-page":"611","DOI":"10.1109\/TPAMI.2017.2658577","volume":"40","author":"J Engel","year":"2018","unstructured":"Engel, J., Koltun, V., & Cremers, D. (2018). Direct sparse odometry. IEEE Transactions on Pattern Analysis and Machine Intelligence, 40(3), 611\u2013625. https:\/\/doi.org\/10.1109\/TPAMI.2017.2658577","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"issue":"5","key":"1833_CR12","doi-asserted-by":"publisher","first-page":"1147","DOI":"10.1109\/TRO.2015.2463671","volume":"31","author":"R Mur-Artal","year":"2015","unstructured":"Mur-Artal, R., Montiel, J. M. M., & Tard\u00f3s, J. D. (2015). ORB-SLAM: a versatile and accurate monocular SLAM system. IEEE Transactions on Robotics, 31(5), 1147\u20131163. https:\/\/doi.org\/10.1109\/TRO.2015.2463671","journal-title":"IEEE Transactions on Robotics"},{"key":"1833_CR13","doi-asserted-by":"publisher","unstructured":"Klein, G., & Murray, D. (2007). Parallel tracking and mapping for small AR workspaces. In: 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality, pp. 225\u2013234. https:\/\/doi.org\/10.1109\/ISMAR.2007.4538852","DOI":"10.1109\/ISMAR.2007.4538852"},{"key":"1833_CR14","doi-asserted-by":"publisher","unstructured":"Newcombe, R. A., Lovegrove, S. J., & Davison, A. J. (2011). DTAM: Dense tracking and mapping in real-time. In: 2011 International Conference on Computer Vision, pp. 2320\u20132327. https:\/\/doi.org\/10.1109\/ICCV.2011.6126513","DOI":"10.1109\/ICCV.2011.6126513"},{"key":"1833_CR15","doi-asserted-by":"crossref","unstructured":"Engel, J., Sch\u00f6ps, T., & Cremers, D. (2014). LSD-SLAM: Large-scale direct monocular SLAM. In: ECCV.","DOI":"10.1007\/978-3-319-10605-2_54"},{"key":"1833_CR16","doi-asserted-by":"crossref","unstructured":"Hartley, R., & Zisserman, A. (2003). Multiple wiew geometry in computer vision, 2nd Edn. Cambridge University Press, New York, NY, USA.","DOI":"10.1017\/CBO9780511811685"},{"key":"1833_CR17","doi-asserted-by":"publisher","unstructured":"Park, S., Sch\u00f6ps, T., & Pollefeys, M. (2017). Illumination change robustness in direct visual SLAM. In: 2017 IEEE International Conference on Robotics and Automation (ICRA), pp. 4523\u20134530. https:\/\/doi.org\/10.1109\/ICRA.2017.7989525","DOI":"10.1109\/ICRA.2017.7989525"},{"issue":"2","key":"1833_CR18","doi-asserted-by":"publisher","first-page":"91","DOI":"10.1023\/B:VISI.0000029664.99615.94","volume":"60","author":"DG Lowe","year":"2004","unstructured":"Lowe, D. G. (2004). Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision, 60(2), 91\u2013110. https:\/\/doi.org\/10.1023\/B:VISI.0000029664.99615.94","journal-title":"International Journal of Computer Vision"},{"issue":"3","key":"1833_CR19","doi-asserted-by":"publisher","first-page":"346","DOI":"10.1016\/j.cviu.2007.09.014","volume":"110","author":"H Bay","year":"2008","unstructured":"Bay, H., et al. (2008). Speeded-up robust features (SURF). Computer Vision and Image Understanding, 110(3), 346\u2013359. https:\/\/doi.org\/10.1016\/j.cviu.2007.09.014","journal-title":"Computer Vision and Image Understanding"},{"key":"1833_CR20","doi-asserted-by":"publisher","unstructured":"Rublee, E., Rabaud, V., Konolige, K., & Bradski, G. (2011). ORB: an efficient alternative to SIFT or SURF. In: 2011 International Conference on Computer Vision, pp. 2564\u20132571. https:\/\/doi.org\/10.1109\/ICCV.2011.6126544","DOI":"10.1109\/ICCV.2011.6126544"},{"key":"1833_CR21","doi-asserted-by":"crossref","unstructured":"Viswanath, P., Swami, P., Desappan, K., Jain, A., & Pathayapurakkal, A. (2015). ORB in 5 ms: an efficient SIMD friendly implementation. In: Jawahar, C. V., Shan, S. (eds.) Computer Vision - ACCV 2014 Workshops, pp. 675\u2013686. Springer, Cham.","DOI":"10.1007\/978-3-319-16628-5_48"},{"key":"1833_CR22","doi-asserted-by":"publisher","unstructured":"Fang, W., Zhang, Y., Yu, B., & Liu, S. (2017).\u00a0FPGA-based orb feature extraction for real-time visual slam. In: 2017 International Conference on Field Programmable Technology (ICFPT), pp. 275\u2013278. https:\/\/doi.org\/10.1109\/FPT.2017.8280159","DOI":"10.1109\/FPT.2017.8280159"},{"key":"1833_CR23","doi-asserted-by":"publisher","unstructured":"Taranco, R., Arnau, J. -M., Gonz\u00e1lez, A. (2021). A low-power hardware accelerator for ORB feature extraction in self-driving cars. In: 2021 IEEE 33rd International Symposium on Computer Architecture and High Performance Computing (SBAC-PAD), pp. 11\u201321. https:\/\/doi.org\/10.1109\/SBAC-PAD53543.2021.00013","DOI":"10.1109\/SBAC-PAD53543.2021.00013"},{"key":"1833_CR24","doi-asserted-by":"publisher","unstructured":"Ferreira, L., et al. (2021).\u00a0Energy-efficient application-specific instruction-set processor for feature extraction in smart vision systems. In: 2021 55th Asilomar Conference on Signals, Systems, and Computers, pp. 324\u2013328. https:\/\/doi.org\/10.1109\/IEEECONF53345.2021.9723114","DOI":"10.1109\/IEEECONF53345.2021.9723114"},{"key":"1833_CR25","doi-asserted-by":"publisher","unstructured":"Bailo, O., Rameau, F., Joo, K., Park, J., Bogdan, O., & Kweon, I. (2018). Efficient adaptive non-maximal suppression algorithms for homogeneous spatial keypoint distribution. Pattern Recognition Letters,\u00a0106. https:\/\/doi.org\/10.1016\/j.patrec.2018.02.020","DOI":"10.1016\/j.patrec.2018.02.020"},{"key":"1833_CR26","doi-asserted-by":"publisher","unstructured":"Ferreira, L., et al. (2021).\u00a0Reconfigurable multi-access pattern vector memory for real-time ORB feature extraction. In: 2021 IEEE International Symposium on Circuits and Systems (ISCAS), pp. 1\u20135. https:\/\/doi.org\/10.1109\/ISCAS51556.2021.9401698","DOI":"10.1109\/ISCAS51556.2021.9401698"},{"key":"1833_CR27","doi-asserted-by":"publisher","unstructured":"Sun, R., et al. (2017).\u00a0A 42fps full-HD ORB feature extraction accelerator with reduced memory overhead. In: 2017 International Conference on Field Programmable Technology (ICFPT), pp. 183\u2013190. https:\/\/doi.org\/10.1109\/FPT.2017.8280137","DOI":"10.1109\/FPT.2017.8280137"}],"container-title":["Journal of Signal Processing Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11265-022-01833-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11265-022-01833-9\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11265-022-01833-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,9,29]],"date-time":"2023-09-29T08:06:51Z","timestamp":1695974811000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11265-022-01833-9"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,1,30]]},"references-count":27,"journal-issue":{"issue":"7","published-print":{"date-parts":[[2023,7]]}},"alternative-id":["1833"],"URL":"https:\/\/doi.org\/10.1007\/s11265-022-01833-9","relation":{},"ISSN":["1939-8018","1939-8115"],"issn-type":[{"type":"print","value":"1939-8018"},{"type":"electronic","value":"1939-8115"}],"subject":[],"published":{"date-parts":[[2023,1,30]]},"assertion":[{"value":"24 May 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"21 October 2022","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"27 December 2022","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"30 January 2023","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Not applicable.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics Approval"}},{"value":"The authors have no relevant financial or non-financial interests to disclose.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing Interest"}}]}}