{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,30]],"date-time":"2026-06-30T03:48:36Z","timestamp":1782791316223,"version":"3.54.5"},"reference-count":90,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2019,3,19]],"date-time":"2019-03-19T00:00:00Z","timestamp":1552953600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc-sa\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["OAC:1835712,IIS-1652515"],"award-info":[{"award-number":["OAC:1835712,IIS-1652515"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001711","name":"Schweizerischer Nationalfonds zur F\u00f6rderung der Wissenschaftlichen Forschung","doi-asserted-by":"publisher","award":["200021_162958"],"award-info":[{"award-number":["200021_162958"]}],"id":[{"id":"10.13039\/501100001711","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2019,4,30]]},"abstract":"<jats:p>We propose a hardware and software pipeline to fabricate flexible wearable sensors and use them to capture deformations without line-of-sight. Our first contribution is a low-cost fabrication pipeline to embed multiple aligned conductive layers with complex geometries into silicone compounds. Overlapping conductive areas from separate layers form local capacitors that measure dense area changes. Contrary to existing fabrication methods, the proposed technique only requires hardware that is readily available in modern fablabs. While area measurements alone are not enough to reconstruct the full 3D deformation of a surface, they become sufficient when paired with a data-driven prior. A novel semi-automatic tracking algorithm, based on an elastic surface geometry deformation, allows us to capture ground-truth data with an optical mocap system, even under heavy occlusions or partially unobservable markers. The resulting dataset is used to train a regressor based on deep neural networks, directly mapping the area readings to global positions of surface vertices. We demonstrate the flexibility and accuracy of the proposed hardware and software in a series of controlled experiments and design a prototype of wearable wrist, elbow, and biceps sensors, which do not require line-of-sight and can be worn below regular clothing.<\/jats:p>","DOI":"10.1145\/3311972","type":"journal-article","created":{"date-parts":[[2019,3,20]],"date-time":"2019-03-20T11:51:18Z","timestamp":1553082678000},"page":"1-16","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":50,"title":["Deformation Capture via Soft and Stretchable Sensor Arrays"],"prefix":"10.1145","volume":"38","author":[{"given":"Oliver","family":"Glauser","sequence":"first","affiliation":[{"name":"ETH Zurich, Z\u00fcrich, Switzerland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Daniele","family":"Panozzo","sequence":"additional","affiliation":[{"name":"New York University, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5068-3474","authenticated-orcid":false,"given":"Otmar","family":"Hilliges","sequence":"additional","affiliation":[{"name":"ETH Zurich, Z\u00fcrich, Switzerland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Olga","family":"Sorkine-Hornung","sequence":"additional","affiliation":[{"name":"ETH Zurich, Z\u00fcrich, Switzerland"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2019,3,19]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1021\/acsami.5b04975"},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1002\/admt.201700136"},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858354"},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/300523.300536"},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-33783-3_46"},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.polymertesting.2017.03.018"},{"key":"e_1_2_2_8_1","volume-title":"Proceedings of the IEEE Sensors Council Conference (SENSORS\u201913)","author":"Block P. D."},{"key":"e_1_2_2_9_1","volume-title":"Black","author":"Bogo Federica","year":"2016"},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.5555\/794191.794776"},{"key":"e_1_2_2_11_1","volume-title":"Proc. SPIE 10","author":"Brunne Jens","year":"2011"},{"key":"e_1_2_2_12_1","volume-title":"Proceedings of the Annual Conference on Neural Information Processing Systems (NIPS\u201914)","author":"Chen Xianjie","year":"2014"},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/2807442.2807456"},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1117\/12.339112"},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/1399504.1360697"},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/2897824.2925969"},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2016.2557779"},{"key":"e_1_2_2_18_1","volume-title":"Saunvit Dinesh Pandya, Craig Tucker, Yingchen Yang, and Chang Liu.","author":"Engel Jonathan M.","year":"2006"},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-33783-3_53"},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/2984751.2985696"},{"key":"e_1_2_2_21_1","volume-title":"Theremin: Ether Music and Espionage","author":"Glinsky Albert","year":"2000"},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/2851581.2890258"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3025808"},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/2642918.2647381"},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jmbbm.2016.02.022"},{"key":"e_1_2_2_26_1","volume-title":"Wearable stretch sensors for motion measurement of the wrist joint based on dielectric elastomers. Sensors 17, 12","author":"Huang Bo","year":"2017"},{"key":"e_1_2_2_27_1","unstructured":"Imerys ENSACO 250G. 2018. Retrieved from http:\/\/www.imerys-graphite-and-carbon.com\/wordpress\/wp-app\/uploads\/2014\/04\/Polymer_compounds1.pdf.  Imerys ENSACO 250G. 2018. Retrieved from http:\/\/www.imerys-graphite-and-carbon.com\/wordpress\/wp-app\/uploads\/2014\/04\/Polymer_compounds1.pdf."},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/2601097.2601112"},{"key":"e_1_2_2_29_1","volume-title":"A stretchable radio-frequency strain sensor using screen printing technology. Sensors 16, 11","author":"Jeong Heijun","year":"2016"},{"key":"e_1_2_2_30_1","first-page":"1","article-title":"Stretchable dual-capacitor multi-sensor for touch-curvature-pressure-strain sensing. Sci","volume":"7","author":"Jin H.","year":"2017","journal-title":"Rep."},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/2971763.2971777"},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/212430.212431"},{"key":"e_1_2_2_33_1","volume-title":"Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980","author":"Kingma Diederik","year":"2014"},{"key":"e_1_2_2_34_1","volume-title":"Proceedings of the IEEE International Conference on Robotics and Automation (ICRA\u201916)","author":"Lee H."},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/317456.317461"},{"key":"e_1_2_2_36_1","volume-title":"Skin-like pressure and strain sensors based on transparent elastic films of carbon nanotubes. Nature Nanotechnology 6 (10","author":"Lipomi Darren","year":"2011"},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/1944745.1944768"},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/JSEN.2004.837498"},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1002\/adfm.201303732"},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.5555\/2670639.2670713"},{"key":"e_1_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.3390\/s8063719"},{"key":"e_1_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/3072959.3073596"},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cviu.2006.08.002"},{"key":"e_1_2_2_44_1","volume-title":"Comput. Graph. Forum 32","author":"Neumann T.","year":"2013"},{"key":"e_1_2_2_45_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 343--352","author":"Newcombe Richard A."},{"key":"e_1_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-46484-8_29"},{"key":"e_1_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173607"},{"key":"e_1_2_2_48_1","unstructured":"OptiTrack. 2018. Retrieved from http:\/\/optitrack.com\/products\/prime-13\/.  OptiTrack. 2018. Retrieved from http:\/\/optitrack.com\/products\/prime-13\/."},{"key":"e_1_2_2_49_1","unstructured":"Parker Hannifin EAP Sensor. 2018. Retrieved from http:\/\/ph.parker.com\/us\/en\/electroactive-polymer-technology-monitors-movement-and-stretch-eap-sensor-evaluation-kits.  Parker Hannifin EAP Sensor. 2018. Retrieved from http:\/\/ph.parker.com\/us\/en\/electroactive-polymer-technology-monitors-movement-and-stretch-eap-sensor-evaluation-kits."},{"key":"e_1_2_2_50_1","volume-title":"Anderson","author":"O\u2019Brien Ben","year":"2014"},{"key":"e_1_2_2_51_1","volume-title":"NIPS Autodiff Workshop: The Future of Gradient-Based Machine Learning Software and Techniques","author":"Paszke Adam","year":"2017"},{"key":"e_1_2_2_52_1","volume-title":"Flexible microfluidic normal force sensor skin for tactile feedback. Sensors and Actuators A 179 (06","author":"Ponce Wong Ruben D.","year":"2012"},{"key":"e_1_2_2_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/2766993"},{"key":"e_1_2_2_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858176"},{"key":"e_1_2_2_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/503376.503397"},{"key":"e_1_2_2_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/2380116.2380180"},{"key":"e_1_2_2_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/2642918.2647405"},{"key":"e_1_2_2_58_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.94"},{"key":"e_1_2_2_59_1","first-page":"8","article-title":"Moven: Full 6dof human motion tracking using miniature inertial sensors","volume":"2","author":"Roetenberg Daniel","year":"2007","journal-title":"Xsen Technol."},{"key":"e_1_2_2_60_1","doi-asserted-by":"publisher","DOI":"10.3791\/53423"},{"key":"e_1_2_2_61_1","volume-title":"Shea","author":"Rosset Samuel","year":"2013"},{"key":"e_1_2_2_62_1","volume-title":"stretch, and touch: Locating a finger on an actively deformed transparent sensor array. Sci. Adv. 3, 3","author":"Sarwar Mirza Saquib","year":"2017"},{"key":"e_1_2_2_63_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-10470-1_14"},{"key":"e_1_2_2_64_1","doi-asserted-by":"publisher","DOI":"10.1145\/985692.985726"},{"key":"e_1_2_2_65_1","doi-asserted-by":"publisher","DOI":"10.1109\/JSEN.2003.815771"},{"key":"e_1_2_2_66_1","first-page":"1","article-title":"A soft stretchable bending sensor and data glove applications","volume":"3","author":"Shen Zhong","year":"2016","journal-title":"Robot. Biomimet."},{"key":"e_1_2_2_67_1","doi-asserted-by":"publisher","DOI":"10.5555\/645908.673287"},{"key":"e_1_2_2_68_1","doi-asserted-by":"publisher","DOI":"10.1145\/2398356.2398381"},{"key":"e_1_2_2_69_1","doi-asserted-by":"publisher","DOI":"10.3390\/s140304050"},{"key":"e_1_2_2_70_1","unstructured":"Silbione RTV 4420. 2018. Retrieved from https:\/\/silicones.elkem.com\/EN\/our_offer\/Product\/90060082\/90060081\/SILBIONE-RTV-4420-B-U1.  Silbione RTV 4420. 2018. Retrieved from https:\/\/silicones.elkem.com\/EN\/our_offer\/Product\/90060082\/90060081\/SILBIONE-RTV-4420-B-U1."},{"key":"e_1_2_2_72_1","volume-title":"Null","author":"Starck Jonathan"},{"key":"e_1_2_2_73_1","unstructured":"STM32 Nucleo-F446RE. 2018. Retrieved from http:\/\/www.st.com\/en\/evaluation-tools\/nucleo-f446re.html.  STM32 Nucleo-F446RE. 2018. Retrieved from http:\/\/www.st.com\/en\/evaluation-tools\/nucleo-f446re.html."},{"key":"e_1_2_2_74_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2011.6126338"},{"key":"e_1_2_2_75_1","unstructured":"StretchSense. 2018. Retrieved from https:\/\/www.stretchsense.com\/.  StretchSense. 2018. Retrieved from https:\/\/www.stretchsense.com\/."},{"key":"e_1_2_2_76_1","doi-asserted-by":"publisher","DOI":"10.1145\/1966394.1966397"},{"key":"e_1_2_2_77_1","doi-asserted-by":"publisher","DOI":"10.1145\/2897824.2925965"},{"key":"e_1_2_2_78_1","doi-asserted-by":"publisher","DOI":"10.5555\/2354409.2354668"},{"key":"e_1_2_2_79_1","volume-title":"Fusing 2D uncertainty and 3D cues for monocular body pose estimation. arXiv preprint arXiv:1611.05708","author":"Tekin Bugra","year":"2016"},{"key":"e_1_2_2_80_1","volume-title":"Proceedings of the Conference on Neural Information Processing Systems (NIPS\u201914)","author":"Tompson Jonathan J.","year":"2014"},{"key":"e_1_2_2_81_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2014.214"},{"key":"e_1_2_2_82_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.13131"},{"key":"e_1_2_2_83_1","doi-asserted-by":"publisher","DOI":"10.1145\/2766952"},{"key":"e_1_2_2_84_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.511"},{"key":"e_1_2_2_85_1","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702391"},{"key":"e_1_2_2_86_1","doi-asserted-by":"publisher","DOI":"10.1145\/2984511.2984521"},{"key":"e_1_2_2_87_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSENS.2013.6688217"},{"key":"e_1_2_2_88_1","doi-asserted-by":"publisher","DOI":"10.1039\/C4TC00392F"},{"key":"e_1_2_2_89_1","doi-asserted-by":"publisher","DOI":"10.1088\/0964-1726\/25\/1\/015012"},{"key":"e_1_2_2_90_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.537"},{"key":"e_1_2_2_91_1","doi-asserted-by":"publisher","DOI":"10.1145\/223904.223940"},{"key":"e_1_2_2_92_1","doi-asserted-by":"publisher","DOI":"10.1145\/2601097.2601165"}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3311972","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3311972","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3311972","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T23:54:28Z","timestamp":1750204468000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3311972"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,3,19]]},"references-count":90,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2019,4,30]]}},"alternative-id":["10.1145\/3311972"],"URL":"https:\/\/doi.org\/10.1145\/3311972","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,3,19]]},"assertion":[{"value":"2018-06-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2019-01-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2019-03-19","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}