{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,6]],"date-time":"2025-11-06T12:30:25Z","timestamp":1762432225151,"version":"build-2065373602"},"reference-count":20,"publisher":"MDPI AG","issue":"9","license":[{"start":{"date-parts":[[2022,5,4]],"date-time":"2022-05-04T00:00:00Z","timestamp":1651622400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Ministry of Science and Technology of Taiwan","award":["MOST 110-2218-E-002-028","111HZA38001"],"award-info":[{"award-number":["MOST 110-2218-E-002-028","111HZA38001"]}]},{"name":"MediaTek","award":["MOST 110-2218-E-002-028","111HZA38001"],"award-info":[{"award-number":["MOST 110-2218-E-002-028","111HZA38001"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>The majority of digital sensors rely on von Neumann architecture microprocessors to process sampled data. When the sampled data require complex computation for 24\u00d77, the processing element will a consume significant amount of energy and computation resources. Several new sensing algorithms use deep neural network algorithms and consume even more computation resources. High resource consumption prevents such systems for 24\u00d77 deployment although they can deliver impressive results. This work adopts a Computing-In-Memory (CIM) device, which integrates a storage and analog processing unit to eliminate data movement, to process sampled data. This work designs and evaluates the CIM-based sensing framework for human pose recognition. The framework consists of uncertainty-aware training, activation function design, and CIM error model collection. The evaluation results show that the framework can improve the detection accuracy of three poses classification on CIM devices using binary weights from 33.3% to 91.5% while that on ideal CIM is 92.1%. Although on digital systems the accuracy is 98.7% with binary weight and 99.5% with floating weight, the energy consumption of executing 1 convolution layer on a CIM device is only 30,000 to 50,000 times less than the digital sensing system. Such a design can significantly reduce power consumption and enables battery-powered always-on sensors.<\/jats:p>","DOI":"10.3390\/s22093491","type":"journal-article","created":{"date-parts":[[2022,5,4]],"date-time":"2022-05-04T08:21:25Z","timestamp":1651652485000},"page":"3491","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["CIM-Based Smart Pose Detection Sensors"],"prefix":"10.3390","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5845-4214","authenticated-orcid":false,"given":"Jyun-Jhe","family":"Chou","sequence":"first","affiliation":[{"name":"Department of Computer Science and Information Engineering, National Taiwan University, Taipei 10617, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ting-Wei","family":"Chang","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Information Engineering, National Taiwan University, Taipei 10617, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xin-You","family":"Liu","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Information Engineering, National Taiwan University, Taipei 10617, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5429-1729","authenticated-orcid":false,"given":"Tsung-Yen","family":"Wu","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering, National Taiwan University, Taipei 10617, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yu-Kai","family":"Chen","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering, National Taiwan University, Taipei 10617, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2290-3695","authenticated-orcid":false,"given":"Ying-Tuan","family":"Hsu","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering, National Taiwan University, Taipei 10617, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chih-Wei","family":"Chen","sequence":"additional","affiliation":[{"name":"Center of High Performance and Scientific Computing Technology, National Taiwan University, Taipei 10617, Taiwan"},{"name":"MediaTek Inc., Hsinchu 30078, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tsung-Te","family":"Liu","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering, National Taiwan University, Taipei 10617, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8936-8255","authenticated-orcid":false,"given":"Chi-Sheng","family":"Shih","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Information Engineering, National Taiwan University, Taipei 10617, Taiwan"},{"name":"Center of High Performance and Scientific Computing Technology, National Taiwan University, Taipei 10617, Taiwan"},{"name":"Graduate Institute of Networking and Multimedia, National Taiwan University, Taipei 10617, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2022,5,4]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"50","DOI":"10.1001\/jama.2010.1923","article-title":"Gait speed and survival in older adults","volume":"305","author":"Studenski","year":"2011","journal-title":"JAMA"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"e11335","DOI":"10.2196\/11335","article-title":"Impact of a wearable device-based walking programs in rural older adults on physical activity and health outcomes: Cohort study","volume":"6","author":"Jang","year":"2018","journal-title":"JMIR mHealth uHealth"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"915","DOI":"10.1109\/JSSC.2016.2642198","article-title":"In-memory computation of a machine-learning classifier in a standard 6T SRAM array","volume":"52","author":"Zhang","year":"2017","journal-title":"IEEE J. Solid-State Circuits"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Chen, Z., Chen, X., and Gu, J. (2021, January 13\u201322). 15.3 A 65nm 3T Dynamic Analog RAM-Based Computing-in-Memory Macro and CNN Accelerator with Retention Enhancement, Adaptive Analog Sparsity and 44TOPS\/W System Energy Efficiency. Proceedings of the 2021 IEEE International Solid-State Circuits Conference (ISSCC), San Francisco, CA, USA.","DOI":"10.1109\/ISSCC42613.2021.9366045"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"189","DOI":"10.1109\/JSSC.2019.2952773","article-title":"A twin-8T SRAM computation-in-memory unit-macro for multibit CNN-based AI edge processors","volume":"55","author":"Si","year":"2019","journal-title":"IEEE J. Solid-State Circuits"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"146","DOI":"10.1109\/LSSC.2021.3103759","article-title":"A High-Throughput Energy\u2013Area-Efficient Computing-in-Memory SRAM Using Unified Charge-Processing Network","volume":"4","author":"Hsu","year":"2021","journal-title":"IEEE Solid-State Circuits Lett."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"245","DOI":"10.2478\/amcs-2019-0018","article-title":"IoT Sensing Networks for Gait Velocity Measurement","volume":"29","author":"Chou","year":"2019","journal-title":"Int. J. Appl. Math. Comput. Sci. (AMCS)"},{"key":"ref_8","unstructured":"(2022, January 10). Infrared Array Sensor Grid-EYE (AMG88) Datasheet. Available online: https:\/\/datasheet.octopart.com\/AMG8833-Panasonic-datasheet-62338626.pdf."},{"key":"ref_9","unstructured":"(2022, January 10). FLIR LEPTON 3 Long Wave Infrared (LWIR) Datasheet. Available online: https:\/\/media.digikey.com\/pdf\/Data%20Sheets\/FLIR%20PDFs\/Lepton3_LWIR_DS_Rev100_4-4-17.pdf."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"217","DOI":"10.1109\/JSSC.2018.2880918","article-title":"CONV-SRAM: An energy-efficient SRAM with in-memory dot-product computation for low-power convolutional neural networks","volume":"54","author":"Biswas","year":"2018","journal-title":"IEEE J. Solid-State Circuits"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"2790","DOI":"10.1109\/JSSC.2020.3005754","article-title":"A 4-Kb 1-to-8-bit configurable 6T SRAM-based computation-in-memory unit-macro for CNN-based AI edge processors","volume":"55","author":"Chiu","year":"2020","journal-title":"IEEE J. Solid-State Circuits"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"642","DOI":"10.1109\/JSSC.2017.2782087","article-title":"A multi-functional in-memory inference processor using a standard 6T SRAM array","volume":"53","author":"Kang","year":"2018","journal-title":"IEEE J. Solid-State Circuits"},{"key":"ref_13","unstructured":"Olleta, B., Chen, D., and Geiger, R. (2002, January 4\u20137). A dynamic element matching approach to ADC testing. Proceedings of the The 2002 45th Midwest Symposium on Circuits and Systems, Tulsa, OK, USA. MWSCAS-2002."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"96963","DOI":"10.1109\/ACCESS.2020.2996936","article-title":"Learning sparse low-precision neural networks with learnable regularization","volume":"8","author":"Choi","year":"2020","journal-title":"IEEE Access"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3414685.3417786","article-title":"A reduced-precision network for image reconstruction","volume":"39","author":"Thomas","year":"2020","journal-title":"ACM Trans. Graph. (TOG)"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Xin, J., Wang, N., Jiang, X., Li, J., Huang, H., and Gao, X. (2020). Binarized neural network for single image super resolution. European Conference on Computer Vision, Springer.","DOI":"10.1007\/978-3-030-58548-8_6"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Shermeyer, J., and Van Etten, A. (2019, January 16\u201317). The effects of super-resolution on object detection performance in satellite imagery. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition Workshops, Long Beach, CA, USA.","DOI":"10.1109\/CVPRW.2019.00184"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Shih, C.S., Wang, Y.T., and Chou, J.J. (2020, January 21). Multiple-Image Super-Resolution for Networked Extremely Low-Resolution Thermal Sensor Array. Proceedings of the 2020 IEEE Second Workshop on Machine Learning on Edge in Sensor Systems (SenSys-ML), Sydney, Australia.","DOI":"10.1109\/SenSysML50931.2020.00004"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Chou, J.J., and Shih, C.S. (2020, January 19\u201321). Turning Over Detecting Using Super-Resolution Thermal Image. Proceedings of the the 26th IEEE International Conference on Embedded and Real-Time Computing Systems and Applications, Gangnueng, Korea.","DOI":"10.1109\/RTCSA50079.2020.9203746"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Almasri, F., and Debeir, O. (2018, January 26\u201328). Rgb guided thermal super-resolution enhancement. Proceedings of the 2018 4th International Conference on Cloud Computing Technologies and Applications (Cloudtech), Brussels, Belgium.","DOI":"10.1109\/CloudTech.2018.8713356"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/9\/3491\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T23:05:55Z","timestamp":1760137555000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/9\/3491"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,5,4]]},"references-count":20,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2022,5]]}},"alternative-id":["s22093491"],"URL":"https:\/\/doi.org\/10.3390\/s22093491","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2022,5,4]]}}}