{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,3]],"date-time":"2026-04-03T02:55:45Z","timestamp":1775184945728,"version":"3.50.1"},"reference-count":41,"publisher":"IOP Publishing","issue":"3","license":[{"start":{"date-parts":[[2024,8,14]],"date-time":"2024-08-14T00:00:00Z","timestamp":1723593600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2024,8,14]],"date-time":"2024-08-14T00:00:00Z","timestamp":1723593600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/iopscience.iop.org\/info\/page\/text-and-data-mining"}],"funder":[{"DOI":"10.13039\/100006208","name":"High Energy Physics","doi-asserted-by":"crossref","award":["DE-SC0023365"],"award-info":[{"award-number":["DE-SC0023365"]}],"id":[{"id":"10.13039\/100006208","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/100006230","name":"Fermilab","doi-asserted-by":"crossref","award":["Contract No. DE-AC02-07CH1135"],"award-info":[{"award-number":["Contract No. DE-AC02-07CH1135"]}],"id":[{"id":"10.13039\/100006230","id-type":"DOI","asserted-by":"crossref"}]},{"name":"DOE Office of Science Research Program for Microelectronics Codesign"},{"DOI":"10.13039\/100000166","name":"Division of Physics","doi-asserted-by":"crossref","award":["2012584"],"award-info":[{"award-number":["2012584"]}],"id":[{"id":"10.13039\/100000166","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/100006192","name":"Advanced Scientific Computing Research","doi-asserted-by":"crossref","id":[{"id":"10.13039\/100006192","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["iopscience.iop.org"],"crossmark-restriction":false},"short-container-title":["Mach. Learn.: Sci. Technol."],"published-print":{"date-parts":[[2024,9,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>Highly granular pixel detectors allow for increasingly precise measurements of charged particle tracks. Next-generation detectors require that pixel sizes will be further reduced, leading to unprecedented data rates exceeding those foreseen at the High- Luminosity Large Hadron Collider. Signal processing that handles data incoming at a rate of <jats:inline-formula>\n                     <jats:tex-math\/>\n                     <mml:math xmlns:mml=\"http:\/\/www.w3.org\/1998\/Math\/MathML\" overflow=\"scroll\">\n                        <mml:mrow>\n                           <mml:mrow>\n                              <mml:mi class=\"MJX-tex-calligraphic\">O<\/mml:mi>\n                           <\/mml:mrow>\n                        <\/mml:mrow>\n                     <\/mml:math>\n                  <\/jats:inline-formula>(40 MHz) and intelligently reduces the data within the pixelated region of the detector <jats:italic>at rate<\/jats:italic> will enhance physics performance at high luminosity and enable physics analyses that are not currently possible. Using the shape of charge clusters deposited in an array of small pixels, the physical properties of the traversing particle can be extracted with locally customized neural networks. In this first demonstration, we present a neural network that can be embedded into the on-sensor readout and filter out hits from low momentum tracks, reducing the detector\u2019s data volume by 57.1%\u201375.7%. The network is designed and simulated as a custom readout integrated circuit with 28 nm CMOS technology and is expected to operate at less than 300\u2009<jats:inline-formula>\n                     <jats:tex-math\/>\n                     <mml:math xmlns:mml=\"http:\/\/www.w3.org\/1998\/Math\/MathML\" overflow=\"scroll\">\n                        <mml:mrow>\n                           <mml:mi>\u03bc<\/mml:mi>\n                           <mml:mi>W<\/mml:mi>\n                        <\/mml:mrow>\n                     <\/mml:math>\n                  <\/jats:inline-formula> with an area of less than 0.2 mm<jats:sup>2<\/jats:sup>. The temporal development of charge clusters is investigated to demonstrate possible future performance gains, and there is also a discussion of future algorithmic and technological improvements that could enhance efficiency, data reduction, and power per area.<\/jats:p>","DOI":"10.1088\/2632-2153\/ad6a00","type":"journal-article","created":{"date-parts":[[2024,8,1]],"date-time":"2024-08-01T00:48:07Z","timestamp":1722473287000},"page":"035047","update-policy":"https:\/\/doi.org\/10.1088\/crossmark-policy","source":"Crossref","is-referenced-by-count":7,"title":["Smart pixel sensors: towards on-sensor filtering of pixel clusters with deep learning"],"prefix":"10.1088","volume":"5","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3826-1332","authenticated-orcid":true,"given":"Jieun","family":"Yoo","sequence":"first","affiliation":[]},{"given":"Jennet","family":"Dickinson","sequence":"additional","affiliation":[]},{"given":"Morris","family":"Swartz","sequence":"additional","affiliation":[]},{"given":"Giuseppe","family":"Di Guglielmo","sequence":"additional","affiliation":[]},{"given":"Alice","family":"Bean","sequence":"additional","affiliation":[]},{"given":"Douglas","family":"Berry","sequence":"additional","affiliation":[]},{"given":"Manuel","family":"Blanco Valentin","sequence":"additional","affiliation":[]},{"given":"Karri","family":"DiPetrillo","sequence":"additional","affiliation":[]},{"given":"Farah","family":"Fahim","sequence":"additional","affiliation":[]},{"given":"Lindsey","family":"Gray","sequence":"additional","affiliation":[]},{"given":"James","family":"Hirschauer","sequence":"additional","affiliation":[]},{"given":"Shruti R","family":"Kulkarni","sequence":"additional","affiliation":[]},{"given":"Ron","family":"Lipton","sequence":"additional","affiliation":[]},{"given":"Petar","family":"Maksimovic","sequence":"additional","affiliation":[]},{"given":"Corrinne","family":"Mills","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8434-9274","authenticated-orcid":true,"given":"Mark S","family":"Neubauer","sequence":"additional","affiliation":[]},{"given":"Benjamin","family":"Parpillon","sequence":"additional","affiliation":[]},{"given":"Gauri","family":"Pradhan","sequence":"additional","affiliation":[]},{"given":"Chinar","family":"Syal","sequence":"additional","affiliation":[]},{"given":"Nhan","family":"Tran","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0009-0009-0509-0387","authenticated-orcid":true,"given":"Dahai","family":"Wen","sequence":"additional","affiliation":[]},{"given":"Aaron","family":"Young","sequence":"additional","affiliation":[]}],"member":"266","published-online":{"date-parts":[[2024,8,14]]},"reference":[{"key":"mlstad6a00bib1","doi-asserted-by":"publisher","DOI":"10.1088\/1748-0221\/3\/08\/S08003","article-title":"The ATLAS experiment at the CERN Large Hadron Collider","volume":"3","author":"ATLAS Collaboration","year":"2008","journal-title":"J. Instrum."},{"key":"mlstad6a00bib2","doi-asserted-by":"publisher","DOI":"10.1088\/1748-0221\/3\/08\/S08004","article-title":"The CMS experiment at the CERN LHC","volume":"3","author":"CMS Collaboration","year":"2008","journal-title":"J. Instrum."},{"key":"mlstad6a00bib3","article-title":"Technical design report for the ATLAS inner tracker pixel detector","year":"2017"},{"key":"mlstad6a00bib4","doi-asserted-by":"crossref","DOI":"10.2172\/1151650","article-title":"CMS technical design report for the pixel detector upgrade","author":"Dominguez","year":"2012"},{"key":"mlstad6a00bib5","doi-asserted-by":"publisher","first-page":"374","DOI":"10.1016\/j.physletb.2007.06.055","article-title":"Echoes of a hidden valley at hadron colliders","volume":"651","author":"Strassler","year":"2007","journal-title":"Phys. Lett. B"},{"key":"mlstad6a00bib6","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevD.103.115013","article-title":"Perturbative benchmark models for a dark shower search program","volume":"103","author":"Knapen","year":"2021","journal-title":"Phys. Rev. D"},{"key":"mlstad6a00bib7","doi-asserted-by":"publisher","first-page":"JHEP08(2017)076","DOI":"10.1007\/JHEP08(2017)076","article-title":"Triggering soft bombs at the LHC","author":"Knapen","year":"2017","journal-title":"J. High Energy Phys."},{"key":"mlstad6a00bib8","doi-asserted-by":"publisher","DOI":"10.1088\/1748-0221\/9\/10\/C10011","article-title":"Data compression considerations for detectors with local intelligence","volume":"9","author":"Garcia-Sciveres","year":"2014","journal-title":"J. Instrum."},{"key":"mlstad6a00bib9","doi-asserted-by":"publisher","DOI":"10.1088\/1748-0221\/9\/04\/P04021","article-title":"Data encoding efficiency in binary strip detector readout","volume":"9","author":"Garcia-Sciveres","year":"2014","journal-title":"J. Instrum."},{"key":"mlstad6a00bib10","doi-asserted-by":"publisher","first-page":"18","DOI":"10.1016\/j.nima.2016.01.014","article-title":"Data encoding efficiency in pixel detector readout with charge information","volume":"815","author":"Garcia-Sciveres","year":"2016","journal-title":"Nuclear Instrum. Methods Phys. Res. A"},{"key":"mlstad6a00bib11","doi-asserted-by":"publisher","DOI":"10.1088\/1748-0221\/16\/05\/P05001","article-title":"Beyond 4d tracking: using cluster shapes for track seeding","volume":"16","author":"Fox","year":"2021","journal-title":"J. Instrum."},{"key":"mlstad6a00bib12","doi-asserted-by":"publisher","DOI":"10.1088\/1748-0221\/13\/07\/P07027","article-title":"Fast inference of deep neural networks in FPGAs for particle physics","volume":"13","author":"Duarte","year":"2018","journal-title":"J. Instrum."},{"key":"mlstad6a00bib13","article-title":"fastmachinelearning\/HLS4ML","author":"","year":"2023"},{"key":"mlstad6a00bib14","doi-asserted-by":"publisher","first-page":"2179","DOI":"10.1109\/TNS.2021.3087100","article-title":"A reconfigurable neural network ASIC for detector front-end data compression at the HL-LHC","volume":"68","author":"Di Guglielmo","year":"2021","journal-title":"IEEE Trans. Nucl. Sci."},{"key":"mlstad6a00bib15","author":"CMS Collaboration The Tracker Group","year":"2020"},{"key":"mlstad6a00bib16","doi-asserted-by":"publisher","author":"Swartz","year":"2022","DOI":"10.5281\/zenodo.7331128)"},{"key":"mlstad6a00bib17","author":"Swartz","year":"2002"},{"key":"mlstad6a00bib18","article-title":"Privately produced dataset","author":"Swartz","year":"2023"},{"key":"mlstad6a00bib19","doi-asserted-by":"publisher","first-page":"1513","DOI":"10.1007\/s10462-023-10562-9","article-title":"A survey of uncertainty in deep neural networks","volume":"56","author":"Gawlikowski","year":"2023","journal-title":"Artif. Intell. Rev."},{"key":"mlstad6a00bib20","article-title":"TensorFlow: large-scale machine learning on heterogeneous systems","author":"Abadi","year":"2015"},{"key":"mlstad6a00bib21","author":"Chollet","year":"2015"},{"key":"mlstad6a00bib22","article-title":"Adam: a method for stochastic optimization","author":"Kingma","year":"2014"},{"key":"mlstad6a00bib23","article-title":"Deep learning using rectified linear units (relu)","author":"Agarap","year":"2018"},{"key":"mlstad6a00bib24","doi-asserted-by":"crossref","DOI":"10.1109\/ISCAS46773.2023.10182087","article-title":"A Cryogenic Readout IC with 100 KSPS in-Pixel ADC for Skipper CCD-in-CMOS Sensors","author":"Quinn","year":"2023"},{"key":"mlstad6a00bib25","author":"RD53 Collaboration","year":"2020"},{"key":"mlstad6a00bib26","article-title":"Readout IC with 40 MSPS in-pixel ADC for future vertex detector upgrades of Large Hadron Collider","author":"Parpillon","year":"2023"},{"key":"mlstad6a00bib27","doi-asserted-by":"publisher","first-page":"675","DOI":"10.1038\/s42256-021-00356-5","article-title":"Automatic heterogeneous quantization of deep neural networks for low-latency inference on the edge for particle detectors","volume":"3","author":"Coelho","year":"2021","journal-title":"Nat. Mach. Intell."},{"key":"mlstad6a00bib28","doi-asserted-by":"crossref","DOI":"10.1145\/3469116.3470015","article-title":"Enabling binary neural network training on the edge","author":"Wang","year":"2021"},{"key":"mlstad6a00bib29","article-title":"fastmachinelearning\/HLS4ML","author":"","year":"2021"},{"key":"mlstad6a00bib30","article-title":"HLS4ML: An open-source codesign workflow to empower scientific low-power machine learning devices","author":"Fahim","year":"2021"},{"key":"mlstad6a00bib31","article-title":"Catapult HLS","author":"Siemens"},{"key":"mlstad6a00bib32","article-title":"High-luminosity LHC","year":"2024"},{"key":"mlstad6a00bib33","first-page":"pp 1","article-title":"Neuromorphic computing for temporal scientific data classification","author":"Schuman","year":"2017"},{"key":"mlstad6a00bib34","doi-asserted-by":"publisher","first-page":"154","DOI":"10.1109\/TPAMI.2020.3008413","article-title":"Event-Based Vision: A Survey","volume":"44","author":"Gallego","year":"2022","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"mlstad6a00bib35","doi-asserted-by":"publisher","first-page":"10","DOI":"10.1038\/s43588-021-00184-y","article-title":"Opportunities for neuromorphic computing algorithms and applications","volume":"2","author":"Schuman","year":"2022","journal-title":"Nat. Comput. Sci."},{"key":"mlstad6a00bib36","first-page":"pp 22","article-title":"Neuromorphic computing for scientific applications","author":"Patton","year":"2022"},{"key":"mlstad6a00bib37","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-020-74219-1","article-title":"A spiking and adapting tactile sensor for neuromorphic applications","volume":"10","author":"Birkoben","year":"2020","journal-title":"Sci. Rep."},{"key":"mlstad6a00bib38","doi-asserted-by":"publisher","DOI":"10.1063\/5.0116699","article-title":"Benchmarking energy consumption and latency for neuromorphic computing in condensed matter and particle physics","volume":"1","author":"K\u00f6sters","year":"2023","journal-title":"APL Mach. Learn."},{"key":"mlstad6a00bib39","doi-asserted-by":"crossref","DOI":"10.1145\/3589737.3605976","article-title":"On-sensor data filtering using neuromorphic computing for high energy physics experiments","author":"Kulkarni","year":"2023"},{"key":"mlstad6a00bib40","doi-asserted-by":"publisher","DOI":"10.3389\/fdata.2023.1301942","article-title":"Applications and techniques for fast machine learning in science","volume":"5","author":"Deiana","year":"2022","journal-title":"Front. Big Data"},{"key":"mlstad6a00bib41","author":"Hoch","year":"2017"}],"container-title":["Machine Learning: Science and Technology"],"original-title":[],"link":[{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/ad6a00","content-type":"text\/html","content-version":"am","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/ad6a00\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/ad6a00","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/ad6a00\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/ad6a00\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/ad6a00\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/ad6a00\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"similarity-checking"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/ad6a00\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,8,14]],"date-time":"2024-08-14T08:49:34Z","timestamp":1723625374000},"score":1,"resource":{"primary":{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/ad6a00"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,8,14]]},"references-count":41,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2024,8,14]]},"published-print":{"date-parts":[[2024,9,1]]}},"URL":"https:\/\/doi.org\/10.1088\/2632-2153\/ad6a00","relation":{},"ISSN":["2632-2153"],"issn-type":[{"value":"2632-2153","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,8,14]]},"assertion":[{"value":"Smart pixel sensors: towards on-sensor filtering of pixel clusters with deep learning","name":"article_title","label":"Article Title"},{"value":"Machine Learning: Science and Technology","name":"journal_title","label":"Journal Title"},{"value":"paper","name":"article_type","label":"Article Type"},{"value":"\u00a9 2024 The Author(s). Published by IOP Publishing Ltd","name":"copyright_information","label":"Copyright Information"},{"value":"2024-02-08","name":"date_received","label":"Date Received","group":{"name":"publication_dates","label":"Publication dates"}},{"value":"2024-07-31","name":"date_accepted","label":"Date Accepted","group":{"name":"publication_dates","label":"Publication dates"}},{"value":"2024-08-14","name":"date_epub","label":"Online publication date","group":{"name":"publication_dates","label":"Publication dates"}}]}}