{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,29]],"date-time":"2026-07-29T15:15:03Z","timestamp":1785338103490,"version":"3.55.0"},"reference-count":108,"publisher":"American Association for the Advancement of Science (AAAS)","content-domain":{"domain":["spj.science.org"],"crossmark-restriction":true},"short-container-title":["Intell Comput"],"published-print":{"date-parts":[[2023,1]]},"abstract":"<jats:p>Conventional machine vision systems have separate perception, memory, and processing architectures, which may exacerbate the increasing need for ultrahigh image processing rates and ultralow power consumption. In contrast, in-sensor visual computing performs signal processing at the pixel level using the collected analog signals directly, without sending data to other processors. Therefore, the in-sensor computing paradigm may hold the key to realizing extremely efficient and low power visual signal processing by integrating sensing, storage, and computation onto focal planes using either novel circuit designs or new materials. The focal-plane sensor-processor (FPSP), which is a typical in-sensor visual computing device, is a vision chip that has been developed for nearly 2 decades in domains such as image processing, computer vision, robotics, and neural networks. In contrast to conventional computer vision systems, the FPSP gives vision systems in-sensor image processing capabilities, thus decreasing system complexity, reducing power consumption, and enhancing information processing efficiency and security. Although many studies on in-sensor computing using the FPSP have been conducted since its invention, no thorough and systematic summary of these studies exists. This review explains the use of image processing algorithms, neural networks, and applications of in-sensor computing in the fields of machine vision and robotics. The objective is to assist future developers, researchers, and users of unconventional visual sensors in understanding in-sensor computing and associated applications.<\/jats:p>","DOI":"10.34133\/icomputing.0043","type":"journal-article","created":{"date-parts":[[2023,7,26]],"date-time":"2023-07-26T13:51:23Z","timestamp":1690379483000},"update-policy":"https:\/\/doi.org\/10.34133\/aaas_crossmark_01","source":"Crossref","is-referenced-by-count":34,"title":["In-Sensor Visual Perception and Inference"],"prefix":"10.34133","volume":"2","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9625-5806","authenticated-orcid":false,"given":"Yanan","family":"Liu","sequence":"first","affiliation":[{"name":"School of Microelectronics, Shanghai University, Shanghai,China."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Rui","family":"Fan","sequence":"additional","affiliation":[{"name":"The College of Electronics and Information Engineering, the State Key Laboratory of Intelligent Autonomous Systems, and Frontiers Science Center for Intelligent Autonomous Systems, Tongji University, Shanghai, China."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jianglong","family":"Guo","sequence":"additional","affiliation":[{"name":"School of Science, Harbin Institute of Technology, Shenzhen, China."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hepeng","family":"Ni","sequence":"additional","affiliation":[{"name":"School of Mechanical and Electrical Engineering, Shandong Jianzhu University, Jinan, China."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Muhammad Usman Maqboo","family":"Bhutta","sequence":"additional","affiliation":[{"name":"Robotics Lab, The Chinese University of Hong Kong, Hong Kong, China."}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"221","published-online":{"date-parts":[[2023,9,26]]},"reference":[{"key":"e_1_3_4_2_2","unstructured":"Frisby JP Stone JV. Seeing: The computational approach to biological vision. Cambridge (MA): MIT Press; 2010."},{"issue":"15","key":"e_1_3_4_3_2","doi-asserted-by":"crossref","DOI":"10.1002\/advs.202106092","article-title":"Ultralow-power machine vision with self-powered sensor reservoir","volume":"9","author":"Lao J","year":"2022","unstructured":"Lao J, Yan M, Tian B, Jiang C, Luo C, Xie Z, Zhu Q, Bao Z, Zhong N, Tang X, et al. Ultralow-power machine vision with self-powered sensor reservoir. Adv Sci. 2022;9(15): Article e2106092.","journal-title":"Adv Sci"},{"key":"e_1_3_4_4_2","article-title":"In-sensor computing: Materials, devices, and integration technologies","author":"Wan T","year":"2022","unstructured":"Wan T, Shao B, Ma S, Zhou Y, Li Q, Chai Y. In-sensor computing: Materials, devices, and integration technologies. Adv Mater. 2022; Article e2203830.","journal-title":"Adv Mater"},{"key":"e_1_3_4_5_2","unstructured":"Semiconductor Research Corporation and Semiconductor Industry Association Interim report for the decadal plan for semiconductors; 2020. p. 1\u201321."},{"key":"e_1_3_4_6_2","doi-asserted-by":"crossref","DOI":"10.1016\/j.eng.2022.01.009","article-title":"A future perspective on in-sensor computing","author":"Pan W","year":"2022","unstructured":"Pan W, Zheng J, Wang L, Luo Y. A future perspective on in-sensor computing. Engineering. 2022.","journal-title":"Engineering"},{"key":"e_1_3_4_7_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41928-020-00501-9"},{"key":"e_1_3_4_8_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41928-018-0092-2"},{"key":"e_1_3_4_9_2","doi-asserted-by":"publisher","DOI":"10.1038\/d41586-020-00592-6"},{"key":"e_1_3_4_10_2","unstructured":"Hubel DH. Eye brain and vision . New York City: Scientific American Library\/Scientific American Books; 1995."},{"key":"e_1_3_4_11_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41586-020-2038-x"},{"key":"e_1_3_4_12_2","unstructured":"Song R Huang K Wang Z Shen H. A reconfigurable convolution-in-pixel CMOS image sensor architecture. arXiv 2021. arXiv.2101.03308."},{"key":"e_1_3_4_13_2","unstructured":"inivation Dynamic vision platform. 2021. https:\/\/inivation.com\/dvp\/."},{"key":"e_1_3_4_14_2","doi-asserted-by":"crossref","DOI":"10.1016\/j.nanoen.2021.106291","article-title":"Reconfigurable optoelectronic memristor for in-sensor computing applications","volume":"89","author":"Wang T-Y","year":"2021","unstructured":"Wang T-Y, Meng JL, Li QX, He ZY, Zhu H, Ji L, Sun QQ, Chen L, Zhang DW. Reconfigurable optoelectronic memristor for in-sensor computing applications. Nano Energy. 2021;89: Article 106291.","journal-title":"Nano Energy"},{"key":"e_1_3_4_15_2","doi-asserted-by":"publisher","DOI":"10.1002\/adfm.202100144"},{"key":"e_1_3_4_16_2","doi-asserted-by":"publisher","DOI":"10.1126\/sciadv.abg1455"},{"key":"e_1_3_4_17_2","doi-asserted-by":"crossref","DOI":"10.1007\/978-1-4419-6475-5","volume-title":"Focal-plane sensor-processor chips","author":"Zar\u00e1ndy \u00c1","year":"2011","unstructured":"Zar\u00e1ndy \u00c1. Focal-plane sensor-processor chipsNew York City: Springer Science & Business Media; 2011."},{"key":"e_1_3_4_18_2","first-page":"15","volume-title":"The eye-ris cmos vision system, Analog circuit design","author":"Rodr\u00edguez-V\u00e1zquez \u00c1","year":"2008","unstructured":"Rodr\u00edguez-V\u00e1zquez \u00c1, Dom\u00ednguez-Castro R, Jim\u00e9nez-Garrido F, Morillas S, List\u00e1n J, Alba L, Utrera C, Espejo S, Romay R. The eye-ris cmos vision system, Analog circuit designNew York City: Springer; 2008. p. 15\u201332."},{"key":"e_1_3_4_19_2","unstructured":"Kovilta. https:\/\/kovilta.fi\/technology\/."},{"key":"e_1_3_4_20_2","unstructured":"Aistorm Ai in sensor. [accessed 22 Nov 2021] https:\/\/aistorm.ai\/."},{"key":"e_1_3_4_21_2","doi-asserted-by":"publisher","DOI":"10.1002\/aisy.201900136"},{"key":"e_1_3_4_22_2","unstructured":"Dudek P. A programmable focal-plane analogue processor array [thesis]. The University of Manchester; 2000."},{"key":"e_1_3_4_23_2","doi-asserted-by":"crossref","unstructured":"Carey S Dudek P. Vision chip with high accuracy analog S 2 I cells. Paper presented at: 2014 14th International Workshop on Cellular Nanoscale Networks and their Applications (CNNA); 2014 Jul 29\u201331; Notre Dame Indiana USA. p. 1\u20132.","DOI":"10.1109\/CNNA.2014.6888642"},{"key":"e_1_3_4_24_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10470-013-0192-x"},{"key":"e_1_3_4_25_2","doi-asserted-by":"crossref","unstructured":"Lopich A Dudek P A general-purpose vision processor with 160 \u00d7 80 pixel-parallel simd processor array. Paper presented at: Proceedings of the IEEE 2013 Custom Integrated Circuits Conference; 2013 Sep 22\u201325; San Jose CA USA. p. 1\u20134.","DOI":"10.1109\/CICC.2013.6658542"},{"key":"e_1_3_4_26_2","unstructured":"J. N. Martel and P. Dudek \u201cVision chips with in-pixel processors for high-performance low power embedded vision systems \u201d in ASR-MOV Workshop CGO vol. 6 2016 p. 14."},{"key":"e_1_3_4_27_2","unstructured":"Dudek P Hicks PJ An simd array of analogue microprocessors for early vision. Paper presented at: PREP\u201999: Postgraduate Research in Electronics Photonics and Related Fields; 1999 Jan 05\u201307; UMIST Manchester. p. 359\u2013362."},{"key":"e_1_3_4_28_2","doi-asserted-by":"publisher","DOI":"10.1109\/82.842115"},{"key":"e_1_3_4_29_2","article-title":"Pixel processor array for sensor-level computer vision on agile robots","author":"Dudek P","year":"2022","unstructured":"Dudek P, Richardson T, Bose L, Carey S, Chen J, Greatwood C, Liu Y, Mayol-Cuevas W. Pixel processor array for sensor-level computer vision on agile robots. Sci Robot. 2022.","journal-title":"Sci Robot"},{"key":"e_1_3_4_30_2","unstructured":"Carey SJ Lopich A Barr DR Wang B Dudek P. A 100 000 fps vision sensor with embedded 535GOPS\/W 256\u00d7256 SIMD processor array. Paper presented at: 2013 Symposium on VLSI Circuits; 2013 Jun 12\u201314; Kyoto Japan. p. C182\u2013C183."},{"issue":"7","key":"e_1_3_4_31_2","doi-asserted-by":"crossref","first-page":"1642","DOI":"10.1109\/TPAMI.2020.2986944","article-title":"Neural sensors: Learning pixel exposures for HDR imaging and video compressive sensing with programmable sensors","volume":"42","author":"Martel JN","year":"2020","unstructured":"Martel JN, Mueller LK, Carey SJ, Dudek P, Wetzstein G. Neural sensors: Learning pixel exposures for HDR imaging and video compressive sensing with programmable sensors. IEEE Trans Pattern Anal Mach Intell. 2020;42(7):1642\u20131653.","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"key":"e_1_3_4_32_2","doi-asserted-by":"crossref","unstructured":"Bose L Chen J Carey SJ Dudek P Mayol-Cuevas W. Visual odometry for pixel processor arrays. Paper presented at: 2017 IEEE International Conference on Computer Vision (ICCV); 2017 Oct 22\u201329; Venice Italy. p. 4604\u20134612.","DOI":"10.1109\/ICCV.2017.493"},{"key":"e_1_3_4_33_2","unstructured":"Chen J Carey SJ Dudek P Feature extraction using a portable vision system. In: IEEE\/RSJ International Conference on Intelligent Robots and Systems Workshop Vision-Based Agile Autonomous Navigation; 2017."},{"key":"e_1_3_4_34_2","doi-asserted-by":"crossref","first-page":"1257","DOI":"10.1109\/31.7600","article-title":"Cellular neural networks: Theory","volume":"35","author":"Chua LO","year":"1988","unstructured":"Chua LO, Yang L. Cellular neural networks: Theory. IEEE Trans Circuits Syst. 1988;35:1257.","journal-title":"IEEE Trans Circuits Syst"},{"key":"e_1_3_4_35_2","doi-asserted-by":"crossref","first-page":"163","DOI":"10.1109\/82.222815","article-title":"The cnn universal machine: An analogic array computer","volume":"40","author":"Roska T","year":"1993","unstructured":"Roska T, Chua LO. The cnn universal machine: An analogic array computer. IEEE Trans Circuits Syst II Analog Digit Signal Process. 1993;40:163.","journal-title":"IEEE Trans Circuits Syst II Analog Digit Signal Process"},{"key":"e_1_3_4_36_2","unstructured":"Orovas C Cellular associative neural networks for pattern recognition [thesis]. University of York; 2000."},{"key":"e_1_3_4_37_2","doi-asserted-by":"crossref","first-page":"2076","DOI":"10.1109\/TIP.2006.877040","article-title":"Training cellular automata for image processing","volume":"15","author":"Rosin PL","year":"2006","unstructured":"Rosin PL. Training cellular automata for image processing. IEEE Trans Image Process. 2006;15:2076.","journal-title":"IEEE Trans Image Process"},{"key":"e_1_3_4_38_2","unstructured":"Torralba AB Analogue architectures for vision: Cellular neural networks and neuromorphic circuits [thesis]. Institute national Polytechnique Grenoble Laboratory of Images and Signals; 1999."},{"key":"e_1_3_4_39_2","unstructured":"Liu Y Bose L Chen J Carey SJ Dudek P Mayol-Cuevas W. High-speed lightweight cnn inference via strided convolutions on a pixel processor array. Paper presented at: The 31st British Machine Vision Conference (BMVC 2020); 2020 Sep 07\u201310; Virtual Conference."},{"issue":"9","key":"e_1_3_4_40_2","doi-asserted-by":"crossref","first-page":"1883","DOI":"10.1049\/ipr2.12158","article-title":"Agile reactive navigation for a non-holonomic mobile robot using a pixel processor array","volume":"15","author":"Liu Y","year":"2021","unstructured":"Liu Y, Bose L, Greatwood C, Chen J, Fan R, Richardson T, Carey SJ, Dudek P, Mayol-Cuevas W. Agile reactive navigation for a non-holonomic mobile robot using a pixel processor array. IET Image Process. 2021;15(9):1883\u20131892.","journal-title":"IET Image Process"},{"key":"e_1_3_4_41_2","doi-asserted-by":"crossref","unstructured":"Greatwood C Bose L Richardson T Mayol-Cuevas W Chen J Carey SJ Dudek P. Tracking control of a UAV with a parallel visual processor. Paper presented at: 2017 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS); 2017 Sep 24\u201328; Vancouver British Columbia Canada. p. 4248\u20134254.","DOI":"10.1109\/IROS.2017.8206286"},{"key":"e_1_3_4_42_2","doi-asserted-by":"crossref","unstructured":"C. Greatwood Bose L Richardson T Mayol-Cuevas W Chen J Carey SJ Dudek P. Perspective correcting visual odometry for agile mavs using a pixel processor array. Paper presented at: 2018 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS); 2018 Oct 01\u201305; Madrid Spain. p. 987\u2013994.","DOI":"10.1109\/IROS.2018.8594500"},{"key":"e_1_3_4_43_2","doi-asserted-by":"publisher","DOI":"10.3389\/frobt.2020.00126"},{"issue":"10","key":"e_1_3_4_44_2","doi-asserted-by":"crossref","first-page":"889","DOI":"10.1016\/j.sysarc.2013.03.016","article-title":"Low power high-performance smart camera system based on SCAMP vision sensor","volume":"59","author":"Carey SJ","year":"2013","unstructured":"Carey SJ, Barr DR, Dudek P. Low power high-performance smart camera system based on SCAMP vision sensor. J Syst Archit. 2013;59(10):889\u2013899.","journal-title":"J Syst Archit"},{"key":"e_1_3_4_45_2","doi-asserted-by":"crossref","unstructured":"Bose L Chen J Carey SJ Dudek P Mayol-Cuevas W. A camera that CNNs: Towards embedded neural networks on pixel processor arrays. Paper presented at: Proceedings of the IEEE\/CVF International Conference on Computer Vision; 2019 Oct 27\u2013Nov 02; Seoul Korea (South). p. 1335\u20131344.","DOI":"10.1109\/ICCV.2019.00142"},{"issue":"4","key":"e_1_3_4_46_2","article-title":"Auke: Automatic kernel code generation for an analogue simd focal-plane sensor-processor array","volume":"15","author":"Debrunner T","year":"2019","unstructured":"Debrunner T, Saeedi S, Kelly PH. Auke: Automatic kernel code generation for an analogue simd focal-plane sensor-processor array. ACM Trans Archit Code Optim. 2019;15(4): Article 59.","journal-title":"ACM Trans Archit Code Optim"},{"key":"e_1_3_4_47_2","doi-asserted-by":"crossref","DOI":"10.1016\/j.pmcj.2020.101132","article-title":"Privacy and utility preserving sensor-data transformations","volume":"63","author":"Malekzadeh M","year":"2020","unstructured":"Malekzadeh M, Clegg RG, Cavallaro A, Haddadi H. Privacy and utility preserving sensor-data transformations. Pervasive Mob Comput. 2020;63: Article 101132.","journal-title":"Pervasive Mob Comput"},{"key":"e_1_3_4_48_2","doi-asserted-by":"crossref","first-page":"663","DOI":"10.1109\/JETCAS.2021.3121259","article-title":"Near-sensor distributed dnn processing for augmented and virtual reality","volume":"11","author":"Pinkham R","year":"2021","unstructured":"Pinkham R, Berkovich A, Zhang Z. Near-sensor distributed dnn processing for augmented and virtual reality. IEEE J Emerg Sel Top Circuits Syst. 2021;11:663.","journal-title":"IEEE J Emerg Sel Top Circuits Syst"},{"key":"e_1_3_4_49_2","unstructured":"Sony Intelligent vision sensors with AI processing functionality [accessed 14 May 2020] https:\/\/www.sony.com\/en\/SonyInfo\/News\/Press\/202005\/20-037E\/."},{"key":"e_1_3_4_50_2","unstructured":"Eye-RIS Eye-ris v1.3 hardware description [accessed 16 Sep 2022] https:\/\/imaging.teledyne-e2v.com\/products\/2d-cmos-image-sensors\/eye-ris\/."},{"key":"e_1_3_4_51_2","first-page":"821634","article-title":"Embedding the anafocus\u2019 eye-ris vision system in roving robots to enhance the action-oriented perception","volume":"7365","author":"Sotoa LA","year":"2009","unstructured":"Sotoa LA, Morillas S, List\u00e1n J, Jim\u00e9nez A, Arena P, Patan\u00e9 L, De Fiore S. Embedding the anafocus\u2019 eye-ris vision system in roving robots to enhance the action-oriented perception. Neurophysiology. 2009;7365:821634.","journal-title":"Neurophysiology"},{"key":"e_1_3_4_52_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41586-020-1942-4"},{"key":"e_1_3_4_53_2","doi-asserted-by":"crossref","DOI":"10.1088\/0022-3727\/46\/9\/093001","article-title":"Memristor-based neural networks","volume":"46","author":"Thomas A","year":"2013","unstructured":"Thomas A. Memristor-based neural networks. J Phys D Appl Phys. 2013;46: Article 093001.","journal-title":"J Phys D Appl Phys"},{"key":"e_1_3_4_54_2","doi-asserted-by":"crossref","unstructured":"Lungu IA Liu S-C Delbruck T. Fast event-driven incremental learning of hand symbols. Paper presented at: 2019 IEEE International Conference on Artificial Intelligence Circuits and Systems (AICAS) (IEEE 2019); 2019 May 18\u201320; Hsinchu Taiwan.","DOI":"10.1109\/AICAS.2019.8771472"},{"key":"e_1_3_4_55_2","doi-asserted-by":"crossref","unstructured":"Lungu IA Corradi F Delbr\u00fcck T. Live demonstration: Convolutional neural network driven by dynamic vision sensor playing roshambo. Paper presented at: 2017 IEEE International Symposium on Circuits and Systems (ISCAS) (IEEE 2017); 2017 May 28\u201331; Baltimore MD USA.","DOI":"10.1109\/ISCAS.2017.8050403"},{"key":"e_1_3_4_56_2","unstructured":"Linares-Barranco A Rios-Navarro A Tapiador-Morales R Delbruck T. Dynamic vision sensor integration on fpga-based cnn accelerators for high-speed visual classification. arXiv 2019. arXiv:1905.07419."},{"key":"e_1_3_4_57_2","unstructured":"Gallego G Delbruck T Orchard G Bartolozzi C Taba G Censi A Leutenegger S Davison A Conradt J Daniilidis K Scaramuzza D. Event-based vision: A survey. arXiv 2019. arXiv:1904.08405."},{"key":"e_1_3_4_58_2","doi-asserted-by":"crossref","unstructured":"Datta G Kundu S Yin Z Teja Lakkireddy R Mathai J Jacob A Beerel PA Jaiswal AR. P2m: A processing-in-pixel-in-memory paradigm for resource-constrained tinyml applications. arXiv 2022. arXiv:abs\/2203.04737.","DOI":"10.21203\/rs.3.rs-1459821\/v1"},{"key":"e_1_3_4_59_2","doi-asserted-by":"crossref","unstructured":"Chen J Carey SJ Dudek P. Scamp5d vision system and development framework. Paper presented at: Proceedings of the 12th International Conference on Distributed Smart Cameras; 2018.","DOI":"10.1145\/3243394.3243698"},{"key":"e_1_3_4_60_2","unstructured":"Liu Y Chen J Bose L Dudek P Mayol-Cuevas W. Bringing a robot simulator to the scamp vision system. Paper presented at: 2021 IEEE International Conference on Robotics and Automation (ICRA) Workshop: On and Near-sensor Vision Processing from Photons to Applications (IEEE 2021); 2021."},{"key":"e_1_3_4_61_2","unstructured":"Fan W Liu Y Xing Y. Fully-simulated integration of scamp5d vision system and robot simulator. arXiv 2021. arXiv:2110.06386."},{"key":"e_1_3_4_62_2","doi-asserted-by":"crossref","unstructured":"Stow E Murai R Saeedi S Kelly PH. Cain: Automatic code generation for simultaneous convolutional kernels on focal-plane sensor-processors. arXiv 2021. arXiv:2101.08715.","DOI":"10.1007\/978-3-030-95953-1_13"},{"key":"e_1_3_4_63_2","unstructured":"Stow EJ Murai R Saeedi S Kelly PHJ. Automatic code generation for simultaneous convolutional kernels on cellular processor arrays. arXiv 2020. arXiv.2101.08715."},{"key":"e_1_3_4_64_2","unstructured":"Stow E Kelly PHJ. Super-pixel compilation for pixel processor arrays. Paper presented at: 2021 IEEE International Conference on Robotics and Automation (ICRA) workshop: On and Near-sensor Vision Processing from Photons to Applications (IEEE 2021); 2021."},{"key":"e_1_3_4_65_2","unstructured":"Wang B. Pixel-parallel image processing techniques and algorithms [thesis]. University of Manchester; 2014."},{"key":"e_1_3_4_66_2","doi-asserted-by":"crossref","unstructured":"Barr DR Carey SJ Dudek P. Low power multiple object tracking and counting using a scamp cellular processor array. Paper presented at: 2012 13th International Workshop on Cellular Nanoscale Networks and their Applications (IEEE 2012); 2012 Aug 29\u201331; Turin Italy.","DOI":"10.1109\/CNNA.2012.6331467"},{"key":"e_1_3_4_67_2","doi-asserted-by":"crossref","unstructured":"Carey SJ Barr DR Wang B Lopich A Dudek P. Locating high speed multiple objects using a scamp-5 vision-chip. Paper presented at: 2012 13th International Workshop on Cellular Nanoscale Networks and their Applications (IEEE 2012); 2012 Aug 29\u201331; Turin Italy.","DOI":"10.1109\/CNNA.2012.6331468"},{"key":"e_1_3_4_68_2","doi-asserted-by":"crossref","unstructured":"Martel JN Sandamirskaya Y Dudek P. A demonstration of tracking using dynamic neural fields on a programmable vision chip. Paper presented at: Proceedings of the 10th International Conference on Distributed Smart Camera (2016); 2016 Sep 12; New York USA.","DOI":"10.1145\/2967413.2974037"},{"key":"e_1_3_4_69_2","unstructured":"Martel JN. Unconventional processing with unconventional visual sensing: Parallel distributed and event based vision algorithms & systems [thesis]. ETH Zurich; 2019."},{"key":"e_1_3_4_70_2","unstructured":"Dudek P 2006 International Workshop on Computer Architecture for Machine Perception and Sensing (IEEE 2006); 2006 Aug 18\u201320."},{"key":"e_1_3_4_71_2","doi-asserted-by":"publisher","DOI":"10.1049\/el:20060352"},{"key":"e_1_3_4_72_2","doi-asserted-by":"crossref","unstructured":"Martel JN M\u00fcller LK Carey SJ Dudek P. Parallel hdr tone mapping and autofocus on a cellular processor array vision chip. Paper presented at: 2016 IEEE International Symposium on Circuits and Systems (ISCAS) (IEEE 2016); 2016 May 22\u201325; Montreal QC Canada.","DOI":"10.1109\/ISCAS.2016.7527519"},{"key":"e_1_3_4_73_2","unstructured":"Martel JN M\u00fcller LK Carey SJ Dudek P A real-time high dynamic range vision. Paper presented at: 15th International Workshop on Cellular Nanoscale Networks and their Applications (VDE 2016); 2016 Jun 7\u201312; Boston MA USA."},{"key":"e_1_3_4_74_2","doi-asserted-by":"crossref","unstructured":"So HM Martel JN Dudek P Wetzstein G. Mantissacam: Learning snapshot high-dynamic-range imaging with perceptually-based in-pixel irradiance encoding. arXiv 2021. arXiv:2112.05221.","DOI":"10.1109\/ICCP54855.2022.9887659"},{"key":"e_1_3_4_75_2","doi-asserted-by":"crossref","unstructured":"Dudek P Vilari\u00f1o DL. A cellular active contours algorithm based on region evolution. Paper presented at: 2006 10th International Workshop on Cellular Neural Networks and Their Applications (IEEE 2006); 2006 Jul 1.","DOI":"10.1109\/CNNA.2006.341643"},{"key":"e_1_3_4_76_2","unstructured":"Alonso-Montes C Vilarino D Penedo M. Cnn-based automatic retinal vascular tree extraction Paper presented at: 2005 9th International Workshop on Cellular Neural Networks and Their Applications (IEEE 2005); 2005."},{"key":"e_1_3_4_77_2","unstructured":"Dudek P H\u00fclse M Barr DR. Cellular automata and non-static image processing for embodied robot systems on a massively parallel processor array Automata-2008: Theory and Applications of Cellular Automata Luniver Press; 2008. p. 504\u2013510."},{"key":"e_1_3_4_78_2","doi-asserted-by":"crossref","unstructured":"Wang B Mroszczyk P Dudek P. A new method for fast skeletonization of binary images on cellular processor arrays. Paper presented at: 2014 14th International Workshop on Cellular Nanoscale Networks and their Applications (CNNA) IEEE; 2014 Jul 29\u201331; Notre Dame IN USA.","DOI":"10.1109\/CNNA.2014.6888649"},{"key":"e_1_3_4_79_2","doi-asserted-by":"crossref","unstructured":"Mroszczyk P Dudek P. Trigger-wave collision detecting asynchronous cellular logic array for fast image skeletonization. Paper presented at: 2012 IEEE International Symposium on Circuits and Systems (ISCAS) (IEEE 2012); 2012 May 20\u201323; Seoul Korea (South).","DOI":"10.1109\/ISCAS.2012.6271852"},{"key":"e_1_3_4_80_2","doi-asserted-by":"crossref","unstructured":"Razmjooei S Dudek P. Approximating euclidean distance transform with simple operations in cellular processor arrays. Paper presented at: 2010 12th International Workshop on Cellular Nanoscale Networks and their Applications (CNNA 2010) (IEEE 2010); 2010 Feb 3\u20135; Berkeley CA USA.","DOI":"10.1109\/CNNA.2010.5430299"},{"key":"e_1_3_4_81_2","doi-asserted-by":"crossref","unstructured":"Wang B Dudek P. Amber: Adapting multi-resolution background extractor. Paper presented at: 2013 IEEE International Conference on Image Processing (IEEE 2013); 2013 Sep 15\u201318; Melbourne VIC Australia.","DOI":"10.1109\/ICIP.2013.6738705"},{"key":"e_1_3_4_82_2","doi-asserted-by":"crossref","unstructured":"Wang B Dudek P. A fast self-tuning background subtraction algorithm. Paper presented at: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops. 2014.","DOI":"10.1109\/CVPRW.2014.64"},{"key":"e_1_3_4_83_2","doi-asserted-by":"crossref","unstructured":"Chen J Liu Y Carey SJ Dudek P. Proximity estimation using vision features computed on sensor. Paper presented at: 2020 IEEE International Conference on Robotics and Automation (ICRA) (IEEE 2020); 2020 May\u2013Aug 31; Paris France.","DOI":"10.1109\/ICRA40945.2020.9197370"},{"key":"e_1_3_4_84_2","doi-asserted-by":"crossref","unstructured":"Murai R Saeedi S Kelly PH. Bit-vo: Visual odometry at 300 fps using binary features from the focal plane. arXiv 2020. arXiv:2004.11186.","DOI":"10.1109\/IROS45743.2020.9341151"},{"key":"e_1_3_4_85_2","doi-asserted-by":"crossref","unstructured":"Wang B Dudek P. Coarse grain mapping method for image processing on fine grain cellular processor arrays. Paper presented at: 2012 13th International Workshop on Cellular Nanoscale Networks and their Applications (IEEE 2012); 2012 Aug 29\u201331; Turin Italy.","DOI":"10.1109\/CNNA.2012.6331421"},{"key":"e_1_3_4_86_2","doi-asserted-by":"crossref","unstructured":"Martel JN Chau M Cook M Dudek P. Pixel interlacing to trade off the resolution of a cellular processor array against more registers. Paper presented at: 2015 European Conference on Circuit Theory and Design (ECCTD) (IEEE 2015); 2015 Aug 24\u201326; Trondheim Norway.","DOI":"10.1109\/ECCTD.2015.7300011"},{"key":"e_1_3_4_87_2","doi-asserted-by":"crossref","unstructured":"Bose L Chen J Carey SJ Dudek P Mayol-Cuevas W. Live demonstration: Digit recognition on pixel processor arrays. Paper presented at: Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition Workshops (2019); 2019 Jun 16\u201317; Long Beach CA USA.","DOI":"10.1109\/CVPRW.2019.00218"},{"key":"e_1_3_4_88_2","doi-asserted-by":"crossref","unstructured":"Bose L Dudek P Chen J Carey SJ Mayol-Cuevas WW. Fully embedding fast convolutional networks on pixel processor arrays European Conference on Computer Vision (Springer 2020); 2020 Aug 23\u201328; Berlin Heidelberg.","DOI":"10.1007\/978-3-030-58526-6_29"},{"key":"e_1_3_4_89_2","unstructured":"Courbariaux M Bengio Y David J-P. Binaryconnect: Training deep neural networks with binary weights during propagations. Paper presented at: NIPS'15: Proceedings of the 28th International Conference on Neural Information Processing Systems; 2015 Dec 7; Cambridge MA USA."},{"key":"e_1_3_4_90_2","unstructured":"Liu Y Chen J Bose L Dudek P Mayol-Cuevas W. Direct servo control from in-sensor cnn inference with a pixel processor array. Paper presented at: 2021 IEEE International Conference on Robotics and Automation (ICRA) workshop: On and Near-sensor Vision Processing from Photons to Applications (IEEE 2021); 2021."},{"key":"e_1_3_4_91_2","unstructured":"Guillard B. Optimising convolutional neural networks for super fast inference on focal-plane sensor-processor arrays [thesis]. Imperial College London; 2019."},{"key":"e_1_3_4_92_2","unstructured":"Wong MZ Guillard B Murai R Saeedi S Kelly PH. Analognet: Convolutional neural network inference on analog focal plane sensor processors. arXiv 2020. arXiv:2006.01765."},{"key":"e_1_3_4_93_2","unstructured":"Wong M Saeedi S Kelly PH. Analog vision-neural network inference acceleration using analog simd computation in the focal plane [thesis]. Imperial College London; 2018."},{"key":"e_1_3_4_94_2","doi-asserted-by":"crossref","DOI":"10.3389\/fnins.2022.909448","article-title":"On-sensor binarized cnn inference with dynamic model swapping in pixel processor arrays","volume":"16","author":"Liu Y","year":"2022","unstructured":"Liu Y, Bose L, Fan R, Dudek P, Mayol-Cuevas W. On-sensor binarized cnn inference with dynamic model swapping in pixel processor arrays. Front Neurosci. 2022;16: Article 909448.","journal-title":"Front Neurosci"},{"key":"e_1_3_4_95_2","unstructured":"Liu Y Bose L Lu Y Dudek P Mayol-Cuevas W. On-sensor binarized fully convolutional neural network with a pixel processor array. arXiv 2022. arXiv:2202.00836."},{"key":"e_1_3_4_96_2","doi-asserted-by":"crossref","unstructured":"Klein G Murray D. Parallel tracking and mapping for small ar workspaces. Paper presented at: 2007 6th IEEE and ACM international symposium on mixed and augmented reality (IEEE 2007); 2007 Nov 13\u201316; Nara Japan.","DOI":"10.1109\/ISMAR.2007.4538852"},{"issue":"3","key":"e_1_3_4_97_2","doi-asserted-by":"crossref","first-page":"925","DOI":"10.1109\/TCSI.2017.2753878","article-title":"Real-time depth from focus on a programmable focal plane processor","volume":"65","author":"Martel JN","year":"2017","unstructured":"Martel JN, Muller LK, Carey SJ, Muller J, Sandamirskaya Y, Dudek P. Real-time depth from focus on a programmable focal plane processor. IEEE Trans Circuits Syst I: Regular Papers. 2017;65(3):925\u2013934.","journal-title":"IEEE Trans Circuits Syst I: Regular Papers"},{"key":"e_1_3_4_98_2","doi-asserted-by":"crossref","unstructured":"Martel JN M\u00fcller LK Carey SJ Dudek P. High-speed depth from focus on a programmable vision chip using a focus tunable lens. Paper presented at: 2017 IEEE International Symposium on Circuits and Systems (ISCAS) (IEEE 2017); 2017 May 29\u201331; Baltimore MD USA.","DOI":"10.1109\/ISCAS.2017.8050548"},{"key":"e_1_3_4_99_2","doi-asserted-by":"crossref","unstructured":"Martel JN M\u00fcller LK Carey SJ Dudek P. Paper presented at: 2017 IEEE International Symposium on Circuits and Systems (ISCAS) (IEEE 2017). p. 1\u20131.","DOI":"10.1109\/ISCAS.2017.8050715"},{"key":"e_1_3_4_100_2","doi-asserted-by":"crossref","unstructured":"L. Bose J. Chen S. J. Carey P. Dudek Pixel processor arrays for low latency gaze estimation. Paper presented at: 2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW) (IEEE 2022); 2022.","DOI":"10.1109\/VRW55335.2022.00336"},{"key":"e_1_3_4_101_2","unstructured":"Davison AJ. Futuremapping: The computational structure of spatial ai systems. arXiv 2018. arXiv:1803.11288."},{"key":"e_1_3_4_102_2","unstructured":"Greatwood C Bose L Richardson T Mayol-Cuevas W Clarke R Chn J Carey S. Towards drone racing with a pixel processor array 11th International Micro Air Vehicles. Paper presented at: Conferences and Competitions (2019); 2019."},{"key":"e_1_3_4_103_2","doi-asserted-by":"crossref","unstructured":"Castillo-Elizalde H Liu Y Bose L Mayol-Cuevas W. Weighted node mapping and localisation on a pixel processor array. Paper presented at: 2021 IEEE International Conference on Robotics and Automation (ICRA) (IEEE 2021); 2021 May 30\u2013Jun 5; Xi'an China.","DOI":"10.1109\/ICRA48506.2021.9561524"},{"key":"e_1_3_4_104_2","doi-asserted-by":"crossref","DOI":"10.23915\/distill.00023","article-title":"Growing neural cellular automata","volume":"5","author":"Mordvintsev A","year":"2020","unstructured":"Mordvintsev A, Randazzo E, Niklasson E, Levin M. Growing neural cellular automata. Distill. 2020;5: Article e23.","journal-title":"Distill"},{"key":"e_1_3_4_105_2","first-page":"5998","article-title":"Attention is all you need","author":"Vaswani A","year":"2017","unstructured":"Vaswani A et al. Attention is all you need. Adv Neural Inf Proces Syst. 2017;5998\u20136008.","journal-title":"Adv Neural Inf Proces Syst"},{"issue":"1","key":"e_1_3_4_106_2","doi-asserted-by":"crossref","first-page":"61","DOI":"10.1109\/TNN.2008.2005605","article-title":"The graph neural network model","volume":"20","author":"Scarselli F","year":"2008","unstructured":"Scarselli F, Gori M, Tsoi AC, Hagenbuchner M, Monfardini G. The graph neural network model. IEEE Trans Neural Netw. 2008;20(1):61.","journal-title":"IEEE Trans Neural Netw"},{"key":"e_1_3_4_107_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neunet.2019.03.005"},{"key":"e_1_3_4_108_2","unstructured":"Yilmaz O. Reservoir computing using cellular automata. arXiv 2014. arXiv:1410.0162."},{"issue":"1","key":"e_1_3_4_109_2","doi-asserted-by":"crossref","first-page":"16","DOI":"10.1272\/jnms.80.16","article-title":"Signal processing in the mammalian retina","volume":"80","author":"Kaneda M","year":"2013","unstructured":"Kaneda M. Signal processing in the mammalian retina. J Nippon Med Sch. 2013;80(1):16\u201324.","journal-title":"J Nippon Med Sch"}],"container-title":["Intelligent Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/spj.science.org\/doi\/pdf\/10.34133\/icomputing.0043","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,10,25]],"date-time":"2024-10-25T02:50:54Z","timestamp":1729824654000},"score":1,"resource":{"primary":{"URL":"https:\/\/spj.science.org\/doi\/10.34133\/icomputing.0043"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,1]]},"references-count":108,"alternative-id":["10.34133\/icomputing.0043"],"URL":"https:\/\/doi.org\/10.34133\/icomputing.0043","relation":{},"ISSN":["2771-5892"],"issn-type":[{"value":"2771-5892","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,1]]},"assertion":[{"value":"2022-09-16","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-06-03","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-09-26","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}],"article-number":"0043"}}