{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,8]],"date-time":"2025-11-08T13:59:33Z","timestamp":1762610373211,"version":"build-2065373602"},"reference-count":37,"publisher":"Association for Computing Machinery (ACM)","issue":"1","funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["62572396 and 62372109"],"award-info":[{"award-number":["62572396 and 62372109"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"name":"National Foreign Experts Program","award":["H20240911"],"award-info":[{"award-number":["H20240911"]}]},{"DOI":"10.13039\/501100003392","name":"Natural Science Foundation of Fujian Province","doi-asserted-by":"crossref","award":["2024J01984"],"award-info":[{"award-number":["2024J01984"]}],"id":[{"id":"10.13039\/501100003392","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Research Grants Council of Hong Kong SAR","award":["CUHK 14217022"],"award-info":[{"award-number":["CUHK 14217022"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Des. Autom. Electron. Syst."],"published-print":{"date-parts":[[2026,1,31]]},"abstract":"<jats:p>With the increasing integration level of flow-based microfluidics, fully programmable valve arrays (FPVAs) have emerged as the next generation of flow-based microfluidic devices. Microvalves in an FPVA are typically managed by a control logic, where valves are connected to a core input via control channels to receive control signals that guide their state switchings. When executing bioassays using an FPVA, however, some valves need to be switched synchronously at different time points, so that both fluid transportation and biochemical operations can be executed correctly. Consequently, the channel lengths from the core input to these valves must be equal, which poses a big challenge to the channel routing of the control logic. To solve this problem, we propose a deep reinforcement learning-based adaptive routing flow for the control logic of FPVAs. With the proposed routing flow, an efficient control-channel network can be automatically constructed to realize accurate control signal propagation. Meanwhile, timing skews among synchronized valves and the total length of control channels are minimized simultaneously, thus generating an optimized control logic with excellent timing performance. Furthermore, by introducing backups of identified critical valves and flexible routing of backup paths without restrictions on control valve locations, a novel fault-tolerant design method considering length matching is implemented to efficiently improve the reliability of the control logic. Simulation results on multiple benchmarks demonstrate that the proposed routing flow leads to control logics with accurate valve synchronization, low cost, and high reliability.<\/jats:p>\n                  <jats:p\/>","DOI":"10.1145\/3765631","type":"journal-article","created":{"date-parts":[[2025,9,1]],"date-time":"2025-09-01T11:23:56Z","timestamp":1756725836000},"page":"1-22","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Adaptive Control-Logic Routing with Length Matching and Fault Tolerance for FPVA Biochips Using Deep Reinforcement Learning"],"prefix":"10.1145","volume":"31","author":[{"ORCID":"https:\/\/orcid.org\/0009-0003-7876-9944","authenticated-orcid":false,"given":"Huayang","family":"Cai","sequence":"first","affiliation":[{"name":"Fuzhou University","place":["Fuzhou, China"]}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3099-4371","authenticated-orcid":false,"given":"Genggeng","family":"Liu","sequence":"additional","affiliation":[{"name":"Fuzhou University","place":["Fuzhou, China"]}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4118-8823","authenticated-orcid":false,"given":"Wenzhong","family":"Guo","sequence":"additional","affiliation":[{"name":"Fuzhou University","place":["Fuzhou, China"]}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5896-2542","authenticated-orcid":false,"given":"Zipeng","family":"Li","sequence":"additional","affiliation":[{"name":"Apple Inc","place":["Cupertino, United States"]}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7348-5625","authenticated-orcid":false,"given":"Tsungyi","family":"Ho","sequence":"additional","affiliation":[{"name":"The Chinese University of Hong Kong","place":["Hong Kong, Hong Kong"]}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5396-110X","authenticated-orcid":false,"given":"Xing","family":"Huang","sequence":"additional","affiliation":[{"name":"Northwestern Polytechnical University","place":["Xi'an, China"]},{"name":"Fuzhou University of International Studies and Trade","place":["Xi'an, China"]}]}],"member":"320","published-online":{"date-parts":[[2025,11,8]]},"reference":[{"key":"e_1_3_1_2_2","first-page":"564","volume-title":"Asia and South Pacific Design Automation Conference","author":"Cai Huayang","year":"2024","unstructured":"Huayang Cai, Genggeng Liu, Wenzhong Guo, Zipeng Li, Tsung-Yi Ho, and Xing Huang. 2024. Adaptive control-logic routing for fully programmable valve array biochips using deep reinforcement learning. In Asia and South Pacific Design Automation Conference. 564\u2013569."},{"key":"e_1_3_1_3_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-56255-1"},{"issue":"5","key":"e_1_3_1_4_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3450504","article-title":"Computer-aided design techniques for flow-based microfluidic lab-on-a-chip systems","volume":"54","author":"Huang Xing","year":"2021","unstructured":"Xing Huang, Tsung-Yi Ho, Wenzhong Guo, Bing Li, Krishnendu Chakrabarty, and Ulf Schlichtmann. 2021. Computer-aided design techniques for flow-based microfluidic lab-on-a-chip systems. Comput. Surveys 54, 5 (2021), 1\u201329.","journal-title":"Comput. Surveys"},{"key":"e_1_3_1_5_2","doi-asserted-by":"publisher","DOI":"10.1145\/3357604"},{"key":"e_1_3_1_6_2","doi-asserted-by":"crossref","unstructured":"Genggeng Liu Hongbin Huang Zhisheng Chen Hongxing Lin Hui Liu Xing Huang and Wenzhong Guo. 2022. Design automation for continuous-flow microfluidic biochips: A comprehensive review. Integration 82 (2022) 48\u201366.","DOI":"10.1016\/j.vlsi.2021.09.002"},{"key":"e_1_3_1_7_2","doi-asserted-by":"crossref","unstructured":"Daniel Mark Stefan Haeberle G\u00fcnter Roth F. von Stetten and Roland Zengerle. 2010. Microfluidic lab-on-a-chip platforms: Requirements characteristics and applications. In Microfluidics Based Microsystems. 305\u2013376.","DOI":"10.1007\/978-90-481-9029-4_17"},{"key":"e_1_3_1_8_2","doi-asserted-by":"publisher","DOI":"10.1145\/3306492"},{"key":"e_1_3_1_9_2","doi-asserted-by":"publisher","DOI":"10.2144\/000112071"},{"key":"e_1_3_1_10_2","doi-asserted-by":"publisher","DOI":"10.1088\/0953-8984\/18\/18\/S14"},{"issue":"5903","key":"e_1_3_1_11_2","doi-asserted-by":"crossref","first-page":"975","DOI":"10.1126\/science.322.5903.975","article-title":"Life science technologies: Microfluidics\u2014Bringing new things to life science","volume":"322","author":"Perkel Jeffrey M","year":"2008","unstructured":"Jeffrey M Perkel. 2008. Life science technologies: Microfluidics\u2014Bringing new things to life science. Science 322, 5903 (2008), 975\u2013977.","journal-title":"Science"},{"key":"e_1_3_1_12_2","first-page":"205","volume-title":"Asia and South Pacific Design Automation Conference","author":"Minhass Wajid Hassan","year":"2013","unstructured":"Wajid Hassan Minhass, Paul Pop, Jan Madsen, and Tsung-Yi Ho. 2013. Control synthesis for the flow-based microfluidic large-scale integration biochips. In Asia and South Pacific Design Automation Conference. 205\u2013212."},{"key":"e_1_3_1_13_2","doi-asserted-by":"publisher","DOI":"10.1145\/3659952"},{"key":"e_1_3_1_14_2","doi-asserted-by":"publisher","DOI":"10.1126\/science.288.5463.113"},{"key":"e_1_3_1_15_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCAD.2021.3103832"},{"key":"e_1_3_1_16_2","doi-asserted-by":"publisher","DOI":"10.1103\/RevModPhys.77.977"},{"key":"e_1_3_1_17_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCAD.2022.3157691"},{"issue":"2","key":"e_1_3_1_18_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3564288","article-title":"Application mapping and control-system design for microfluidic biochips with distributed channel storage","volume":"28","author":"Chen Zhisheng","year":"2022","unstructured":"Zhisheng Chen, Wenzhong Guo, Genggeng Liu, and Xing Huang. 2022. Application mapping and control-system design for microfluidic biochips with distributed channel storage. ACM Transactions on Design Automation of Electronic Systems 28, 2 (2022), 1\u201330.","journal-title":"ACM Transactions on Design Automation of Electronic Systems"},{"key":"e_1_3_1_19_2","doi-asserted-by":"publisher","DOI":"10.1039\/c2lc40258k"},{"key":"e_1_3_1_20_2","doi-asserted-by":"publisher","DOI":"10.1039\/c0lc00537a"},{"key":"e_1_3_1_21_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCAD.2016.2547902"},{"key":"e_1_3_1_22_2","doi-asserted-by":"publisher","DOI":"10.1109\/TVLSI.2019.2924915"},{"key":"e_1_3_1_23_2","first-page":"524","volume-title":"Asia and South Pacific Design Automation Conference","author":"Wang Qin","year":"2017","unstructured":"Qin Wang, Shiliang Zuo, Hailong Yao, Tsung-Yi Ho, Bing Li, Ulf Schlichtmann, and Yici Cai. 2017. Hamming-distance-based valve-switching optimization for control-layer multiplexing in flow-based microfluidic biochips. In Asia and South Pacific Design Automation Conference. 524\u2013529."},{"issue":"10","key":"e_1_3_1_24_2","first-page":"2489","article-title":"Multicontrol: Advanced control-logic synthesis for flow-based microfluidic biochips","volume":"39","author":"Zhu Ying","year":"2019","unstructured":"Ying Zhu, Xing Huang, Bing Li, Tsung-Yi Ho, Qin Wang, Hailong Yao, Robert Wille, and Ulf Schlichtmann. 2019. Multicontrol: Advanced control-logic synthesis for flow-based microfluidic biochips. IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems 39, 10 (2019), 2489\u20132502.","journal-title":"IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems"},{"key":"e_1_3_1_25_2","first-page":"1","volume-title":"International Conference on Computer-Aided Design","author":"Liang Siyuan","year":"2022","unstructured":"Siyuan Liang, Mengchu Li, Tsun-Ming Tseng, Ulf Schlichtmann, and Tsung-Yi Ho. 2022. CoMUX: Combinatorial-coding-based high-performance microfluidic control multiplexer design. In International Conference on Computer-Aided Design. 1\u20139."},{"key":"e_1_3_1_26_2","first-page":"570","volume-title":"Asia and South Pacific Design Automation Conference","author":"Liu Genggeng","year":"2024","unstructured":"Genggeng Liu, Yuqin Zeng, Yuhan Zhu, Huayang Cai, Wenzhong Guo, Zipeng Li, Tsung-Yi Ho, and Xing Huang. 2024. Towards automated testing of multiplexers in fully programmable valve array biochips. In Asia and South Pacific Design Automation Conference. 570\u2013575."},{"issue":"1","key":"e_1_3_1_27_2","doi-asserted-by":"crossref","first-page":"277","DOI":"10.1109\/TCAD.2023.3309740","article-title":"Control-logic synthesis of fully programmable valve array using reinforcement learning","volume":"43","author":"Huang Xing","year":"2023","unstructured":"Xing Huang, Huayang Cai, Wenzhong Guo, Genggeng Liu, Tsung-Yi Ho, Krishnendu Chakrabarty, and Ulf Schlichtmann. 2023. Control-logic synthesis of fully programmable valve array using reinforcement learning. IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems 43, 1 (2023), 277\u2013290.","journal-title":"IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems"},{"key":"e_1_3_1_28_2","first-page":"1667","volume-title":"Design, Automation & Test in Europe Conference & Exhibition","author":"Huang Wei-Lun","year":"2017","unstructured":"Wei-Lun Huang, Ankur Gupta, Sudip Roy, Tsung-Yi Ho, and Paul Pop. 2017. Fast architecture-level synthesis of fault-tolerant flow-based microfluidic biochips. In Design, Automation & Test in Europe Conference & Exhibition. IEEE, 1667\u20131672."},{"key":"e_1_3_1_29_2","volume-title":"Reinforcement Learning: An Introduction","author":"Sutton Richard S","year":"2018","unstructured":"Richard S Sutton and Andrew G Barto. 2018. Reinforcement Learning: An Introduction. MIT Press."},{"key":"e_1_3_1_30_2","doi-asserted-by":"crossref","unstructured":"Jens Kober J. Andrew Bagnell and Jan Peters. 2013. Reinforcement learning in robotics: A survey. The International Journal of Robotics Research 32 11 (2013) 1238\u20131274.","DOI":"10.1177\/0278364913495721"},{"key":"e_1_3_1_31_2","doi-asserted-by":"publisher","DOI":"10.1038\/nature14236"},{"key":"e_1_3_1_32_2","first-page":"2140","volume-title":"AAAI Conference on Artificial Intelligence","author":"Lample Guillaume","year":"2017","unstructured":"Guillaume Lample and Devendra Singh Chaplot. 2017. Playing FPS games with deep reinforcement learning. In AAAI Conference on Artificial Intelligence. 2140\u20132146."},{"key":"e_1_3_1_33_2","first-page":"1995","volume-title":"International Conference on Machine Learning","author":"Wang Ziyu","year":"2016","unstructured":"Ziyu Wang, Tom Schaul, Matteo Hessel, Hado Hasselt, Marc Lanctot, and Nando Freitas. 2016. Dueling network architectures for deep reinforcement learning. In International Conference on Machine Learning. 1995\u20132003."},{"key":"e_1_3_1_34_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v30i1.10295"},{"key":"e_1_3_1_35_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCAD.2020.2994267"},{"key":"e_1_3_1_36_2","doi-asserted-by":"publisher","DOI":"10.1021\/ac0519460"},{"key":"e_1_3_1_37_2","first-page":"1","volume-title":"Design Automation Conference","author":"Yao Hailong","year":"2015","unstructured":"Hailong Yao, Tsung-Yi Ho, and Yici Cai. 2015. PACOR: Practical control-layer routing flow with length-matching constraint for flow-based microfluidic biochips. In Design Automation Conference. 1\u20136."},{"key":"e_1_3_1_38_2","unstructured":"Volodymyr Mnih Koray Kavukcuoglu David Silver Alex Graves Ioannis Antonoglou Daan Wierstra and Martin Riedmiller. 2013. Playing atari with deep reinforcement learning. arXiv:1312.5602. Retrieved from https:\/\/arxiv.org\/abs\/1312.5602"}],"container-title":["ACM Transactions on Design Automation of Electronic Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3765631","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,11,8]],"date-time":"2025-11-08T13:56:39Z","timestamp":1762610199000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3765631"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,11,8]]},"references-count":37,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2026,1,31]]}},"alternative-id":["10.1145\/3765631"],"URL":"https:\/\/doi.org\/10.1145\/3765631","relation":{},"ISSN":["1084-4309","1557-7309"],"issn-type":[{"type":"print","value":"1084-4309"},{"type":"electronic","value":"1557-7309"}],"subject":[],"published":{"date-parts":[[2025,11,8]]},"assertion":[{"value":"2024-12-19","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-08-04","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-11-08","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}