{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,18]],"date-time":"2025-11-18T12:16:46Z","timestamp":1763468206576,"version":"build-2065373602"},"reference-count":54,"publisher":"MDPI AG","issue":"8","license":[{"start":{"date-parts":[[2014,8,19]],"date-time":"2014-08-19T00:00:00Z","timestamp":1408406400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/3.0\/"}],"funder":[{"DOI":"10.13039\/501100010198","name":"MINECO","doi-asserted-by":"publisher","award":["TEC2012-38921-C02","IPT-2011-1625-430000"],"award-info":[{"award-number":["TEC2012-38921-C02","IPT-2011-1625-430000"]}],"id":[{"id":"10.13039\/501100010198","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001872","name":"CDTI","doi-asserted-by":"publisher","award":["IPC-20111009"],"award-info":[{"award-number":["IPC-20111009"]}],"id":[{"id":"10.13039\/501100001872","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100011011","name":"Junta de Andaluc\u00eda","doi-asserted-by":"publisher","award":["TIC 2338-2013 CEICE"],"award-info":[{"award-number":["TIC 2338-2013 CEICE"]}],"id":[{"id":"10.13039\/501100011011","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000006","name":"Office of Naval Research","doi-asserted-by":"publisher","award":["N000141410355"],"award-info":[{"award-number":["N000141410355"]}],"id":[{"id":"10.13039\/100000006","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Faculty of Engineering of Ghent University","award":["Grant for Visiting Foreign Researchers"],"award-info":[{"award-number":["Grant for Visiting Foreign Researchers"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>The capture, processing and distribution of visual information is one of the major challenges for the paradigm of the Internet of Things. Privacy emerges as a fundamental barrier to overcome. The idea of networked image sensors pervasively collecting data generates social rejection in the face of sensitive information being tampered by hackers or misused by legitimate users. Power consumption also constitutes a crucial aspect. Images contain a massive amount of data to be processed under strict timing requirements, demanding high-performance vision systems. In this paper, we describe a hardware-based strategy to concurrently address these two key issues. By conveying processing capabilities to the focal plane in addition to sensing, we can implement privacy protection measures just at the point where sensitive data are generated. Furthermore, such measures can be tailored for efficiently reducing the computational load of subsequent processing stages. As a proof of concept, a full-custom QVGA vision sensor chip is presented. It incorporates a mixed-signal focal-plane sensing-processing array providing programmable pixelation of multiple image regions in parallel. In addition to this functionality, the sensor exploits reconfigurability to implement other processing primitives, namely block-wise dynamic range adaptation, integral image computation and multi-resolution filtering. The proposed circuitry is also suitable to build a granular space, becoming the raw material for subsequent feature extraction and recognition of categorized objects.<\/jats:p>","DOI":"10.3390\/s140815203","type":"journal-article","created":{"date-parts":[[2014,8,19]],"date-time":"2014-08-19T10:40:39Z","timestamp":1408444839000},"page":"15203-15226","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":17,"title":["Focal-Plane Sensing-Processing: A Power-Efficient Approach for the Implementation of Privacy-Aware Networked Visual Sensors"],"prefix":"10.3390","volume":"14","author":[{"given":"Jorge","family":"Fern\u00e1ndez-Berni","sequence":"first","affiliation":[{"name":"Institute of Microelectronics of Seville (IMSE-CNM), CSIC-Univ. Sevilla, calle Am\u00e9rico Vespucio s\/n, Seville 41092, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4230-3988","authenticated-orcid":false,"given":"Ricardo","family":"Carmona-Gal\u00e1n","sequence":"additional","affiliation":[{"name":"Institute of Microelectronics of Seville (IMSE-CNM), CSIC-Univ. Sevilla, calle Am\u00e9rico Vespucio s\/n, Seville 41092, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Roc\u00edo","family":"Del R\u00edo","sequence":"additional","affiliation":[{"name":"Institute of Microelectronics of Seville (IMSE-CNM), CSIC-Univ. Sevilla, calle Am\u00e9rico Vespucio s\/n, Seville 41092, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Richard","family":"Kleihorst","sequence":"additional","affiliation":[{"name":"Ghent University\/iMinds\/TELIN-IPI, St-Pietersnieuwstraat 41, Ghent B-9000, Belgium"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Wilfried","family":"Philips","sequence":"additional","affiliation":[{"name":"Ghent University\/iMinds\/TELIN-IPI, St-Pietersnieuwstraat 41, Ghent B-9000, Belgium"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"\u00c1ngel","family":"Rodr\u00edguez-V\u00e1zquez","sequence":"additional","affiliation":[{"name":"Institute of Microelectronics of Seville (IMSE-CNM), CSIC-Univ. Sevilla, calle Am\u00e9rico Vespucio s\/n, Seville 41092, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2014,8,19]]},"reference":[{"key":"ref_1","unstructured":"European Commision Internet of Things in 2020, a Roadmap for the Future. RFID Working Group of the European Technology Platform on Smart Systems Integration, 2008. Available online: http:\/\/www.smart-systems-integration.org\/public\/internet-of-things."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Dohr, A., Modre-Osprian, R., Drobics, M., Hayn, D., and Schreier, G. (2010, January 12\u201314). The Internet of Things for ambient assisted living. Las Vegas, NE, USA.","DOI":"10.1109\/ITNG.2010.104"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"414","DOI":"10.1109\/SURV.2013.042313.00197","article-title":"Context aware computing for the Internet of Things: A survey","volume":"16","author":"Perera","year":"2014","journal-title":"IEEE Commun. Surv. Tutor."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"McCulloch, J., McCarthy, P., Guru, S., Peng, W., Hugo, D., and Terhorst, A. (2008, January 1\u20134). Wireless sensor network deployment for water use efficiency in irrigation. Glasgow, Scotland.","DOI":"10.1145\/1435473.1435487"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Kim, S., Pakzad, S., Culler, D., and Demmel, J. (2007, January 25\u201327). Health Monitoring of Civil Infrastructures Using Wireless Sensor Networks. Cambridge, MA, USA.","DOI":"10.1109\/IPSN.2007.4379685"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Barrenetxea, G., Ingelrest, F., Schaefer, G., and Vetterli, M. (2008, January 4\u20137). The hitchhiker's guide to successful wireless sensor network deployments. Raleigh, NC, USA.","DOI":"10.1145\/1460412.1460418"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"689","DOI":"10.1007\/s11042-011-0840-z","article-title":"A survey of visual sensor network platforms","volume":"60","author":"Bulent","year":"2012","journal-title":"Multimed. Tools Appl."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Winkler, T., and Rinner, B. (2013, January 1\u20133). Sensor-level security and privacy protection by embedding video content analysis. Santorini, Greece.","DOI":"10.1109\/ICDSP.2013.6622726"},{"key":"ref_9","unstructured":"OpenSSL Project. Heartbeat Overflow Issue, 2014. Available online: https:\/\/www.openssl.org\/news\/secadv_20140407.txt."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Winkler, T., Erd\u00e9lyi, \u00c1., and Rinner, B. (2014, January 26\u201329). TrustEYE.M4: Protecting the sensor\u2014Not the camera. Seoul, Korea.","DOI":"10.1109\/AVSS.2014.6918661"},{"key":"ref_11","first-page":"1141","article-title":"Ultra-low power motion-triggered image sensor for distributed wireless sensor network","volume":"2","author":"Zhang","year":"2003","journal-title":"IEEE Sens."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"720","DOI":"10.1109\/JSEN.2011.2138128","article-title":"An 84 pW\/Frame Per Pixel Current-Mode CMOS Image Sensor with Energy Harvesting Capability","volume":"12","author":"Fang","year":"2012","journal-title":"IEEE Sens."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Choi, J., Park, S., Cho, J., and Yoon, E. (2012, January 19\u201323). A 1.36 \u03bcW adaptive CMOS image sensor with reconfigurable modes of operation from available energy\/illumination for distributed wireless sensor network. San Francisco, CA, USA.","DOI":"10.1109\/ISSCC.2012.6176897"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"289","DOI":"10.1109\/JSSC.2013.2284350","article-title":"A 3.4 \u03bcW Object-Adaptive CMOS Image Sensor with Embedded Feature Extraction Algorithm for Motion-Triggered Object-of-Interest Imaging","volume":"49","author":"Choi","year":"2014","journal-title":"IEEE J. Solid-State Circuits"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"127","DOI":"10.1109\/JSSC.2008.2007158","article-title":"iVisual: An Intelligent Visual Sensor SoC With 2790 fps CMOS Image Sensor and 205 GOPS\/W Vision Processor","volume":"44","author":"Cheng","year":"2009","journal-title":"IEEE J. Solid-State Circuits"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Teixeira, T., Culurciello, E., Park, J., Lymberopoulos, D., Barton-Sweeney, A., and Savvides, A. (2006, January 19\u201321). Address-event imagers for sensor networks: Evaluation and modeling. Nashville, TN, USA.","DOI":"10.1145\/1127777.1127847"},{"key":"ref_17","unstructured":"Huang, C., Ai, H., Li, Y., and Lao, S. (2006, January 10\u201312). Learning sparse features in granular space for multi-view face detection. Southampton, UK."},{"key":"ref_18","unstructured":"Gonzalez, R., and Woods, R. (2002). Digital Image Processing;, Prentice Hall."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Zar\u00e1ndy, \u00c1. (2011). Focal-Plane Sensor-Processor Chips, Springer.","DOI":"10.1007\/978-1-4419-6475-5"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"583","DOI":"10.1038\/35069068","article-title":"Vertical interactions across ten parallel, stacked representations in the mammalian retina","volume":"410","author":"Roska","year":"2001","journal-title":"Nature"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1829","DOI":"10.1109\/JSSC.2009.2016693","article-title":"Focal-plane algorithmically-multiplying CMOS computational image sensor","volume":"44","author":"Nilchi","year":"2009","journal-title":"IEEE J. Solid-State Circuits"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"279","DOI":"10.1109\/TCSI.2012.2215803","article-title":"An analog sub-miliwatt CMOS image sensor with pixel-level convolution processing","volume":"60","author":"Jendernalik","year":"2013","journal-title":"IEEE Trans. Circuits Syst. I"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"859","DOI":"10.1002\/cta.759","article-title":"All-MOS implementation of RC networks for time-controlled Gaussian spatial filtering","volume":"40","year":"2012","journal-title":"Int. J. Circuit Theory Appl."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1582","DOI":"10.1109\/JSSC.2009.2017000","article-title":"A 100 \u03bcW 128 \u00d7 64 pixels contrast-based asynchronous binary vision sensor for sensor networks applications","volume":"44","author":"Gottardi","year":"2009","journal-title":"IEEE J. Solid-State Circuits"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1443","DOI":"10.1109\/JSSC.2011.2118490","article-title":"A 3.6 \u03bcs Latency asynchronous frame-free event-driven dynamic-vision-sensor","volume":"46","year":"2011","journal-title":"IEEE J. Solid-State Circuits"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"850","DOI":"10.1109\/JSSC.2012.2235031","article-title":"A 33 \u03bcW 64 \u00d7 64 pixel vision sensor embedding robust dynamic background subtraction for event detection and scene interpretation","volume":"48","author":"Cottini","year":"2013","journal-title":"IEEE J. Solid-State Circuits"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1331","DOI":"10.1109\/TCSI.2012.2226505","article-title":"CMOS imager with focal-plane analog image compression combining DPCM and VQ","volume":"60","author":"Oliveira","year":"2013","journal-title":"IEEE Trans. Circuits Syst. I"},{"key":"ref_28","unstructured":"Messaoud, F., Peizerat, A., Dupret, A., and Blanchard, Y. (2010, January 8\u201310). On-chip compression for HDR image sensors. Madrid, Spain."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"963","DOI":"10.1002\/cta.679","article-title":"Asynchronous cellular logic network as a co-processor for a general-purpose massively parallel array","volume":"39","author":"Lopich","year":"2011","journal-title":"Int. J. Circuit Theory Appl."},{"key":"ref_30","unstructured":"Casier, H., Steyaert, M., and Van Roermund, A. (2011). Sensors, Actuators and Power Drivers; Integrated Power Amplifiers from Wireline to RF; Very High Frequency Front Ends, Springer."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Fern\u00e1ndez-Berni, J., Carmona-Gal\u00e1n, R., del R\u00edo, R., and Rodr\u00edguez-V\u00e1zquez, A. (2014). Bottom-up performance analysis of focal-plane mixed-signal hardware for Viola-Jones early vision tasks. Int. J. Circuit Theory Appl.","DOI":"10.1002\/cta.1996"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Yin, C., and Hsieh, C. (2013, January 11\u201313). A 0.5V 34.4 \u03bcW 14.28 kfps 105 dB smart image sensor with array-level analog signal processing. Singapore.","DOI":"10.1109\/ASSCC.2013.6690991"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Su\u00e1rez, M., Brea, V., Fern\u00e1ndez-Berni, J., Carmona-Gal\u00e1n, R., Cabello, D., and Rodr\u00edguez-V\u00e1zquez, A. (2014, January 22\u201326). A 26.5 nJ\/px 2.64 Mpx\/s CMOS Vision Sensor for Gaussian Pyramid Extraction. Venice, Italy.","DOI":"10.1109\/ESSCIRC.2014.6942084"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Park, S., Cho, J., Lee, K., and Yoon, E. (2014, January 9\u201313). 243.3 pJ\/pixel Bio-Inspired Time-Stamp-Based 2D Optic Flow Sensor for Artificial Compound Eyes. San Francisco, CA, USA.","DOI":"10.1109\/ISSCC.2014.6757366"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"1438","DOI":"10.1109\/TCSVT.2011.2162762","article-title":"Adaptive Methodologies for Energy-Efficient Object Detection and Tracking with Battery-Powered Embedded Smart Cameras","volume":"21","author":"Casares","year":"2011","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Dieber, B., and Rinner, B. (2013, January 9\u201313). Distributed online visual sensor network reconfiguration for resource-aware coverage and task assignment. Atlanta, GA, USA.","DOI":"10.1109\/GLOCOM.2013.6831086"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Cheung, S., Zhao, J., and Vijay, M. (2006, January 8\u201311). Efficient Object-Based Video Inpainting. Atlanta, GA, USA.","DOI":"10.1109\/ICIP.2006.312432"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"1168","DOI":"10.1109\/TCSVT.2008.928225","article-title":"Scrambling for Privacy Protection in Video Surveillance Systems","volume":"18","author":"Dufaux","year":"2008","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Korshunov, P., Araimo, C., de Simone, F., Velardo, C., Dugelay, J., and Ebrahimi, T. (2012, January 17\u201319). Subjective Study of Privacy Filters in Video Surveillance. Banff, AB, Canada.","DOI":"10.1109\/MMSP.2012.6343472"},{"key":"ref_40","unstructured":"Korshunov, P., Cai, S., and Ebrahimi, T. (November, January 29). Crowdsourcing Approach for Evaluation of Privacy Filters in Video Surveillance. Nara, Japan."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Korshunov, P., and Ebrahimi, T. (2013, January 1\u20133). Using Warping for Privacy Protection in Video Surveillance. Santorini, Greece.","DOI":"10.1109\/ICDSP.2013.6622791"},{"key":"ref_42","unstructured":"Erd\u00e9lyi, \u00c1., Winkler, T., and Rinner, B. (2013, January 18\u201319). Serious Fun: Cartooning for Privacy Protection. Barcelona, Spain."},{"key":"ref_43","unstructured":"MONDEGO project. Available online: www.imse-cnm.csic.es\/mondego\/Sensors\/."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"1266","DOI":"10.1109\/TIP.2009.2015158","article-title":"High-Dimensional Statistical Measure for Region-of-Interest Tracking","volume":"18","author":"Boltz","year":"2009","journal-title":"IEEE Trans. Image Process."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"1231","DOI":"10.1109\/TIP.2011.2167343","article-title":"Automatic Bootstrapping and Tracking of Object Contours","volume":"21","author":"Chiverton","year":"2012","journal-title":"IEEE Trans. Image Process."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Dom\u00ednguez-Matas, C., S\u00e1nchez-Fern\u00e1ndez, F., Carmona-Gal\u00e1n, R., and Roca-Moreno, E. (2006, January 28\u201330). Experiments on Global and Local Adaptation to Illumination Conditions based on Focal-Plane Average Compuutation. Istanbul, Turkey.","DOI":"10.1109\/CNNA.2006.341639"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1023\/B:VISI.0000013087.49260.fb","article-title":"Robust Real-time Face Detection","volume":"57","author":"Viola","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"669","DOI":"10.1109\/JSSC.2010.2102591","article-title":"FLIP-Q: A QCIF resolution focal-plane array for low-power image processing","volume":"46","year":"2011","journal-title":"IEEE J. Solid-State Circuits"},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Fern\u00e1ndez-Berni, J., Carmona-Gal\u00e1n, R., and Rodr\u00edguez-V\u00e1zquez, \u00c1. (2011, January 29\u201331). Image filtering by reduced kernels exploiting kernel structure and focal-plane averaging. Link\u00d6ping, Sweden.","DOI":"10.1109\/ECCTD.2011.6043324"},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Grauman, K., and Leibe, B. (2010). Visual Object Recognition, Morgan and Claypool.","DOI":"10.1007\/978-3-031-01553-3"},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Su, Y., Ai, H., and Lao, S. (2008, January 12\u201315). Real-time face alignment with tracking in video. San Diego, CA, USA.","DOI":"10.1109\/ICIP.2008.4712084"},{"key":"ref_52","unstructured":"Gao, W., Ai, H., and Lao, S. (2009, January 20\u201325). Adaptive contour features in oriented granular space for human detection and segmentation. Miami, FL, USA."},{"key":"ref_53","unstructured":"Duan, G., Huang, C., Ai, H., and Lao, S. (October, January 27). Boosting associated pairing comparison features for pedestrian detection. Kyoto, Japan."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"133","DOI":"10.1007\/s00138-013-0516-y","article-title":"Hierarchical abnormal event detection by real time and semi-real time multi-tasking video surveillance system","volume":"25","author":"Lee","year":"2014","journal-title":"Mach. Vis. Appl."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/14\/8\/15203\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T21:14:57Z","timestamp":1760217297000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/14\/8\/15203"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2014,8,19]]},"references-count":54,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2014,8]]}},"alternative-id":["s140815203"],"URL":"https:\/\/doi.org\/10.3390\/s140815203","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2014,8,19]]}}}