{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,1]],"date-time":"2026-05-01T18:26:40Z","timestamp":1777660000946,"version":"3.51.4"},"reference-count":49,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2022,7,1]],"date-time":"2022-07-01T00:00:00Z","timestamp":1656633600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Swiss National Sciene Foundation","award":["200502"],"award-info":[{"award-number":["200502"]}]},{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["IIS-181507"],"award-info":[{"award-number":["IIS-181507"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100002428","name":"FWF Der Wissenschaftsfonds","doi-asserted-by":"crossref","award":["M 3319"],"award-info":[{"award-number":["M 3319"]}],"id":[{"id":"10.13039\/501100002428","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100000781","name":"European Research Council","doi-asserted-by":"publisher","award":["MATERIALIZABLE-715767"],"award-info":[{"award-number":["MATERIALIZABLE-715767"]}],"id":[{"id":"10.13039\/501100000781","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2022,7]]},"abstract":"<jats:p>Enabling additive manufacturing to employ a wide range of novel, functional materials can be a major boost to this technology. However, making such materials printable requires painstaking trial-and-error by an expert operator, as they typically tend to exhibit peculiar rheological or hysteresis properties. Even in the case of successfully finding the process parameters, there is no guarantee of print-to-print consistency due to material differences between batches. These challenges make closed-loop feedback an attractive option where the process parameters are adjusted on-the-fly. There are several challenges for designing an efficient controller: the deposition parameters are complex and highly coupled, artifacts occur after long time horizons, simulating the deposition is computationally costly, and learning on hardware is intractable. In this work, we demonstrate the feasibility of learning a closed-loop control policy for additive manufacturing using reinforcement learning. We show that approximate, but efficient, numerical simulation is sufficient as long as it allows learning the behavioral patterns of deposition that translate to real-world experiences. In combination with reinforcement learning, our model can be used to discover control policies that outperform baseline controllers. Furthermore, the recovered policies have a minimal sim-to-real gap. We showcase this by applying our control policy in-vivo on a single-layer printer using low and high viscosity materials.<\/jats:p>","DOI":"10.1145\/3528223.3530144","type":"journal-article","created":{"date-parts":[[2022,7,22]],"date-time":"2022-07-22T21:06:27Z","timestamp":1658523987000},"page":"1-10","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":41,"title":["Closed-loop control of direct ink writing via reinforcement learning"],"prefix":"10.1145","volume":"41","author":[{"given":"Michal","family":"Piovar\u010di","sequence":"first","affiliation":[{"name":"ISTA, Austria"}]},{"given":"Michael","family":"Foshey","sequence":"additional","affiliation":[{"name":"MIT CSAIL"}]},{"given":"Jie","family":"Xu","sequence":"additional","affiliation":[{"name":"MIT CSAIL"}]},{"given":"Timmothy","family":"Erps","sequence":"additional","affiliation":[{"name":"MIT CSAIL"}]},{"given":"Vahid","family":"Babaei","sequence":"additional","affiliation":[{"name":"MPI Informatics, Germany"}]},{"given":"Piotr","family":"Didyk","sequence":"additional","affiliation":[{"name":"Universit\u00e0 della Svizzera italiana, Switzerland"}]},{"given":"Szymon","family":"Rusinkiewicz","sequence":"additional","affiliation":[{"name":"Princeton University"}]},{"given":"Wojciech","family":"Matusik","sequence":"additional","affiliation":[{"name":"MIT CSAIL"}]},{"given":"Bernd","family":"Bickel","sequence":"additional","affiliation":[{"name":"ISTA, Austria."}]}],"member":"320","published-online":{"date-parts":[[2022,7,22]]},"reference":[{"key":"e_1_2_2_1_1","unstructured":"Ilge Akkaya Marcin Andrychowicz Maciek Chociej Mateusz Litwin Bob McGrew Arthur Petron Alex Paino Matthias Plappert Glenn Powell Raphael Ribas et al. 2019. Solving rubik's cube with a robot hand. arXiv preprint arXiv:1910.07113 (2019)."},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.procir.2017.12.204"},{"key":"e_1_2_2_3_1","volume-title":"Computer graphics forum","author":"Bender Jan","unstructured":"Jan Bender, Matthias M\u00fcller, Miguel A Otaduy, Matthias Teschner, and Miles Macklin. 2014. A survey on position-based simulation methods in computer graphics. In Computer graphics forum, Vol. 33. Wiley Online Library, 228--251."},{"key":"e_1_2_2_4_1","volume-title":"Maximum Entropy Spectral Analysis","author":"Burg John Parker","unstructured":"John Parker Burg. 1975. Maximum Entropy Spectral Analysis. Stanford University."},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/3272127.3275048"},{"key":"e_1_2_2_6_1","unstructured":"Erwin Coumans and Yunfei Bai. 2016. Pybullet a python module for physics simulation for games robotics and machine learning. (2016)."},{"key":"e_1_2_2_7_1","volume-title":"End-to-end differentiable physics for learning and control. Advances in neural information processing systems 31","author":"de Avila Belbute-Peres Filipe","year":"2018","unstructured":"Filipe de Avila Belbute-Peres, Kevin Smith, Kelsey Allen, Josh Tenenbaum, and J Zico Kolter. 2018. End-to-end differentiable physics for learning and control. Advances in neural information processing systems 31 (2018), 7178--7189."},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA.2018.8460915"},{"key":"e_1_2_2_9_1","volume-title":"Wan Shou, Hanns Hagen Goetzke, Herve Dietsch, Klaus Stoll","author":"Erps Timothy","year":"2021","unstructured":"Timothy Erps, Michael Foshey, Mina Konakovi\u0107 Lukovi\u0107, Wan Shou, Hanns Hagen Goetzke, Herve Dietsch, Klaus Stoll, Bernhard von Vacano, and Wojciech Matusik. 2021. Accelerated Discovery of 3D Printing Materials Using Data-Driven Multi-Objective Optimization. arXiv:2106.15697"},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cad.2015.04.001"},{"key":"e_1_2_2_11_1","unstructured":"Angus Johnson. 2015. Clipper - an open source freeware library for clipping and offsetting lines and polygons. http:\/\/www.angusj.com\/delphi\/clipper.php."},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-89480-5_39"},{"key":"e_1_2_2_13_1","volume-title":"ABC: A Big CAD Model Dataset For Geometric Deep Learning. In CVPR.","author":"Koch Sebastian","year":"2019","unstructured":"Sebastian Koch, Albert Matveev, Zhongshi Jiang, Francis Williams, Alexey Artemov, Evgeny Burnaev, Marc Alexa, Denis Zorin, and Daniele Panozzo. 2019. ABC: A Big CAD Model Dataset For Geometric Deep Learning. In CVPR."},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.21105\/joss.00500"},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/3306346.3322972"},{"key":"e_1_2_2_16_1","volume-title":"International Conference on Learning Representations.","author":"Li Yunzhu","year":"2019","unstructured":"Yunzhu Li, Jiajun Wu, Russ Tedrake, Joshua B. Tenenbaum, and Antonio Torralba. 2019a. Learning Particle Dynamics for Manipulating Rigid Bodies, Deformable Objects, and Fluids. In International Conference on Learning Representations."},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA.2019.8793509"},{"key":"e_1_2_2_18_1","volume-title":"Proceedings. Institute of Industrial and Systems Engineers (IISE).","author":"Liu Chenang","year":"2017","unstructured":"Chenang Liu, David Roberson, and Zhenyu Kong. 2017. Textural analysis-based online closed-loop quality control for additive manufacturing processes. In IIE Annual Conference. Proceedings. Institute of Industrial and Systems Engineers (IISE)."},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/3197517.3201315"},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/3197517.3201334"},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/2461912.2461984"},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/TASSP.1980.1163429"},{"key":"e_1_2_2_23_1","doi-asserted-by":"crossref","unstructured":"Volodymyr Mnih Koray Kavukcuoglu David Silver Andrei A Rusu Joel Veness Marc G Bellemare Alex Graves Martin Riedmiller Andreas K Fidjeland Georg Ostrovski et al. 2015. Human-level control through deep reinforcement learning. Nature 518 7540 (2015) 529--533.","DOI":"10.1038\/nature14236"},{"key":"e_1_2_2_24_1","volume-title":"Data-driven prediction of the high-dimensional thermal history in directed energy deposition processes via recurrent neural networks. Manufacturing letters 18","author":"Mozaffar Mojtaba","year":"2018","unstructured":"Mojtaba Mozaffar, Arindam Paul, Reda Al-Bahrani, Sarah Wolff, Alok Choudhary, Ankit Agrawal, Kornel Ehmann, and Jian Cao. 2018. Data-driven prediction of the high-dimensional thermal history in directed energy deposition processes via recurrent neural networks. Manufacturing letters 18 (2018), 35--39."},{"key":"e_1_2_2_25_1","volume-title":"Symposium on Computer animation.","author":"M\u00fcller Matthias","year":"2003","unstructured":"Matthias M\u00fcller, David Charypar, and Markus H Gross. 2003. Particle-based fluid simulation for interactive applications.. In Symposium on Computer animation."},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jvcir.2007.01.005"},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA.2018.8463189"},{"key":"e_1_2_2_28_1","volume-title":"Thermal control of laser powder bed fusion using deep reinforcement learning. Additive Manufacturing 46","author":"Ogoke Francis","year":"2021","unstructured":"Francis Ogoke and Amir Barati Farimani. 2021. Thermal control of laser powder bed fusion using deep reinforcement learning. Additive Manufacturing 46 (2021)."},{"key":"e_1_2_2_29_1","unstructured":"Junhyuk Oh Satinder Singh and Honglak Lee. 2017. Value Prediction Network. In NIPS."},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/3197517.3201311"},{"key":"e_1_2_2_31_1","volume-title":"Conference on Robot Learning. PMLR, 317--335","author":"Schenck Connor","year":"2018","unstructured":"Connor Schenck and Dieter Fox. 2018. Spnets: Differentiable fluid dynamics for deep neural networks. In Conference on Robot Learning. PMLR, 317--335."},{"key":"e_1_2_2_32_1","volume-title":"Proximal policy optimization algorithms. arXiv preprint arXiv:1707.06347","author":"Schulman John","year":"2017","unstructured":"John Schulman, Filip Wolski, Prafulla Dhariwal, Alec Radford, and Oleg Klimov. 2017. Proximal policy optimization algorithms. arXiv preprint arXiv:1707.06347 (2017)."},{"key":"e_1_2_2_33_1","volume-title":"International Conference on Machine Learning. PMLR, 3191--3199","author":"Silver David","year":"2017","unstructured":"David Silver, Hado Hasselt, Matteo Hessel, Tom Schaul, Arthur Guez, Tim Harley, Gabriel Dulac-Arnold, David Reichert, Neil Rabinowitz, Andre Barreto, et al. 2017. The predictron: End-to-end learning and planning. In International Conference on Machine Learning. PMLR, 3191--3199."},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/2766962"},{"key":"e_1_2_2_35_1","volume-title":"International Conference on Machine Learning. PMLR, 4732--4741","author":"Srinivas Aravind","year":"2018","unstructured":"Aravind Srinivas, Allan Jabri, Pieter Abbeel, Sergey Levine, and Chelsea Finn. 2018. Universal planning networks: Learning generalizable representations for visuomotor control. In International Conference on Machine Learning. PMLR, 4732--4741."},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijheatmasstransfer.2018.06.073"},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1109\/IROS.2012.6386109"},{"key":"e_1_2_2_38_1","volume-title":"Kevin A Smith, and Joshua B Tenenbaum.","author":"Toussaint Marc A","year":"2018","unstructured":"Marc A Toussaint, Kelsey Rebecca Allen, Kevin A Smith, and Joshua B Tenenbaum. 2018. Differentiable physics and stable modes for tool-use and manipulation planning. Robotics: Science and Systems Foundation (2018)."},{"key":"e_1_2_2_39_1","volume-title":"Process parameter optimization and mechanical properties for additively manufactured stainless steel 316L parts by selective electron beam melting. Materials & Design 147","author":"Wang Chengcheng","year":"2018","unstructured":"Chengcheng Wang, Xipeng Tan, Erjia Liu, and Shu Beng Tor. 2018. Process parameter optimization and mechanical properties for additively manufactured stainless steel 316L parts by selective electron beam melting. Materials & Design 147 (2018)."},{"key":"e_1_2_2_40_1","volume-title":"Machine learning in additive manufacturing: State-of-the-art and perspectives. Additive Manufacturing","author":"Wang Chengcheng","year":"2020","unstructured":"Chengcheng Wang, XP Tan, SB Tor, and CS Lim. 2020. Machine learning in additive manufacturing: State-of-the-art and perspectives. Additive Manufacturing (2020)."},{"key":"e_1_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2017.2655523"},{"key":"e_1_2_2_42_1","volume-title":"Learning to manipulate deformable objects without demonstrations. arXiv preprint arXiv:1910.13439","author":"Wu Yilin","year":"2019","unstructured":"Yilin Wu, Wilson Yan, Thanard Kurutach, Lerrel Pinto, and Pieter Abbeel. 2019. Learning to manipulate deformable objects without demonstrations. arXiv preprint arXiv:1910.13439 (2019)."},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/3306346.3322940"},{"key":"e_1_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.matdes.2017.12.031"},{"key":"e_1_2_2_45_1","doi-asserted-by":"publisher","DOI":"10.1109\/LRA.2018.2839973"},{"key":"e_1_2_2_46_1","volume-title":"Computer graphics forum","author":"Yu Ri","unstructured":"Ri Yu, Hwangpil Park, and Jehee Lee. 2019. Figure skating simulation from video. In Computer graphics forum, Vol. 38. Wiley Online Library, 225--234."},{"key":"e_1_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/3414685.3417868"},{"key":"e_1_2_2_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/2897824.2925958"},{"key":"e_1_2_2_49_1","first-page":"3D","article-title":"Thingi10K","volume":"10","author":"Zhou Qingnan","year":"2016","unstructured":"Qingnan Zhou and Alec Jacobson. 2016. Thingi10K: A Dataset of 10,000 3D-Printing Models. arXiv preprint arXiv:1605.04797 (2016).","journal-title":"A Dataset of"}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3528223.3530144","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3528223.3530144","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3528223.3530144","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T19:02:48Z","timestamp":1750186968000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3528223.3530144"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,7]]},"references-count":49,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2022,7]]}},"alternative-id":["10.1145\/3528223.3530144"],"URL":"https:\/\/doi.org\/10.1145\/3528223.3530144","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,7]]},"assertion":[{"value":"2022-07-22","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}