{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,17]],"date-time":"2026-07-17T06:02:04Z","timestamp":1784268124036,"version":"3.55.0"},"reference-count":60,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2018,7,30]],"date-time":"2018-07-30T00:00:00Z","timestamp":1532908800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100006785","name":"Google","doi-asserted-by":"crossref","id":[{"id":"10.13039\/100006785","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/100004344","name":"Adobe Systems","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100004344","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2018,8,31]]},"abstract":"<jats:p>Quadruped motion includes a wide variation of gaits such as walk, pace, trot and canter, and actions such as jumping, sitting, turning and idling. Applying existing data-driven character control frameworks to such data requires a significant amount of data preprocessing such as motion labeling and alignment. In this paper, we propose a novel neural network architecture called Mode-Adaptive Neural Networks for controlling quadruped characters. The system is composed of the motion prediction network and the gating network. At each frame, the motion prediction network computes the character state in the current frame given the state in the previous frame and the user-provided control signals. The gating network dynamically updates the weights of the motion prediction network by selecting and blending what we call the expert weights, each of which specializes in a particular movement. Due to the increased flexibility, the system can learn consistent expert weights across a wide range of non-periodic\/periodic actions, from unstructured motion capture data, in an end-to-end fashion. In addition, the users are released from performing complex labeling of phases in different gaits. We show that this architecture is suitable for encoding the multi-modality of quadruped locomotion and synthesizing responsive motion in real-time.<\/jats:p>","DOI":"10.1145\/3197517.3201366","type":"journal-article","created":{"date-parts":[[2018,7,31]],"date-time":"2018-07-31T15:56:23Z","timestamp":1533052583000},"page":"1-11","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":234,"title":["Mode-adaptive neural networks for quadruped motion control"],"prefix":"10.1145","volume":"37","author":[{"given":"He","family":"Zhang","sequence":"first","affiliation":[{"name":"University of Edinburgh"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sebastian","family":"Starke","sequence":"additional","affiliation":[{"name":"University of Edinburgh"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Taku","family":"Komura","sequence":"additional","affiliation":[{"name":"University of Edinburgh"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jun","family":"Saito","sequence":"additional","affiliation":[{"name":"Adobe Research"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2018,7,30]]},"reference":[{"key":"e_1_2_2_1_1","volume-title":"Proceedings of the 12th USENIX Conference on Operating Systems Design and Implementation (OSDI'16)","author":"Abadi Mart\u00edn","year":"2016","unstructured":"Mart\u00edn Abadi , Paul Barham , Jianmin Chen , Zhifeng Chen , Andy Davis , Jeffrey Dean , Matthieu Devin , Sanjay Ghemawat , Geoffrey Irving , Michael Isard , Manjunath Kudlur , Josh Levenberg , Rajat Monga , Sherry Moore , Derek G. Murray , Benoit Steiner , Paul Tucker , Vijay Vasudevan , Pete Warden , Martin Wicke , Yuan Yu , and Xiaoqiang Zheng . 2016 . TensorFlow: A System for Large-scale Machine Learning . In Proceedings of the 12th USENIX Conference on Operating Systems Design and Implementation (OSDI'16) . USENIX Association, Berkeley, CA, USA, 265--283. http:\/\/dl.acm.org\/citation.cfm?id=3026877.3026899 Mart\u00edn Abadi, Paul Barham, Jianmin Chen, Zhifeng Chen, Andy Davis, Jeffrey Dean, Matthieu Devin, Sanjay Ghemawat, Geoffrey Irving, Michael Isard, Manjunath Kudlur, Josh Levenberg, Rajat Monga, Sherry Moore, Derek G. Murray, Benoit Steiner, Paul Tucker, Vijay Vasudevan, Pete Warden, Martin Wicke, Yuan Yu, and Xiaoqiang Zheng. 2016. TensorFlow: A System for Large-scale Machine Learning. In Proceedings of the 12th USENIX Conference on Operating Systems Design and Implementation (OSDI'16). USENIX Association, Berkeley, CA, USA, 265--283. http:\/\/dl.acm.org\/citation.cfm?id=3026877.3026899"},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2012.325"},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/566654.566606"},{"key":"e_1_2_2_4_1","volume-title":"HP-GAN: Probabilistic 3D human motion prediction via GAN. CoRR abs\/1711.09561","author":"Barsoum Emad","year":"2017","unstructured":"Emad Barsoum , John Kender , and Zicheng Liu . 2017. HP-GAN: Probabilistic 3D human motion prediction via GAN. CoRR abs\/1711.09561 ( 2017 ). arXiv:1711.09561 http:\/\/arxiv.org\/abs\/1711.09561 Emad Barsoum, John Kender, and Zicheng Liu. 2017. HP-GAN: Probabilistic 3D human motion prediction via GAN. CoRR abs\/1711.09561 (2017). arXiv:1711.09561 http:\/\/arxiv.org\/abs\/1711.09561"},{"key":"e_1_2_2_5_1","volume-title":"Conditional computation in neural networks for faster models. arXiv preprint arXiv:1511.06297","author":"Bengio Emmanuel","year":"2015","unstructured":"Emmanuel Bengio , Pierre-Luc Bacon , Joelle Pineau , and Doina Precup . 2015. Conditional computation in neural networks for faster models. arXiv preprint arXiv:1511.06297 ( 2015 ). https:\/\/arxiv.org\/abs\/1511.06297 Emmanuel Bengio, Pierre-Luc Bacon, Joelle Pineau, and Doina Precup. 2015. Conditional computation in neural networks for faster models. arXiv preprint arXiv:1511.06297 (2015). https:\/\/arxiv.org\/abs\/1511.06297"},{"key":"e_1_2_2_6_1","volume-title":"Proc. NIPS. 523--531","author":"Bertinetto Luca","year":"2016","unstructured":"Luca Bertinetto , Jo\u00e3o F Henriques , Jack Valmadre , Philip Torr , and Andrea Vedaldi . 2016 . Learning feed-forward one-shot learners . In Proc. NIPS. 523--531 . Luca Bertinetto, Jo\u00e3o F Henriques, Jack Valmadre, Philip Torr, and Andrea Vedaldi. 2016. Learning feed-forward one-shot learners. In Proc. NIPS. 523--531."},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/1073204.1073248"},{"key":"e_1_2_2_8_1","volume-title":"Multi-level factorisation net for person re-identification. arXiv preprint arXiv:1803.09132","author":"Chang Xiaobin","year":"2018","unstructured":"Xiaobin Chang , Timothy M Hospedales , and Tao Xiang . 2018. Multi-level factorisation net for person re-identification. arXiv preprint arXiv:1803.09132 ( 2018 ). https:\/\/arxiv.org\/abs\/1803.09132v2 Xiaobin Chang, Timothy M Hospedales, and Tao Xiang. 2018. Multi-level factorisation net for person re-identification. arXiv preprint arXiv:1803.09132 (2018). https:\/\/arxiv.org\/abs\/1803.09132v2"},{"key":"e_1_2_2_9_1","volume-title":"Proc. of GDC","author":"Clavet Simon","year":"2016","unstructured":"Simon Clavet . 2016 . Motion Matching and The Road to Next-Gen Animation . In Proc. of GDC 2016. Simon Clavet. 2016. Motion Matching and The Road to Next-Gen Animation. In Proc. of GDC 2016."},{"key":"e_1_2_2_10_1","volume-title":"Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs). CoRR abs\/1511.07289","author":"Clevert Djork-Arn\u00e9","year":"2015","unstructured":"Djork-Arn\u00e9 Clevert , Thomas Unterthiner , and Sepp Hochreiter . 2015. Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs). CoRR abs\/1511.07289 ( 2015 ). http:\/\/arxiv.org\/abs\/1511.07289 Djork-Arn\u00e9 Clevert, Thomas Unterthiner, and Sepp Hochreiter. 2015. Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs). CoRR abs\/1511.07289 (2015). http:\/\/arxiv.org\/abs\/1511.07289"},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/2010324.1964954"},{"key":"e_1_2_2_12_1","volume-title":"Marc' Aurelio Ranzato, and Ilya Sutskever","author":"Eigen David","year":"2013","unstructured":"David Eigen , Marc' Aurelio Ranzato, and Ilya Sutskever . 2013 . Learning factored representations in a deep mixture of experts. arXiv preprint arXiv:1312.4314 (2013). David Eigen, Marc' Aurelio Ranzato, and Ilya Sutskever. 2013. Learning factored representations in a deep mixture of experts. arXiv preprint arXiv:1312.4314 (2013)."},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.5555\/2919332.2919834"},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/1015706.1015755"},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/1360612.1360626"},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/3072959.3073663"},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/2897824.2925975"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/2820903.2820918"},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/1073204.1073315"},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1002\/cav.1469"},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/1477926.1477927"},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1162\/neco.1991.3.1.79"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1162\/neco.1994.6.2.181"},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1002\/cav.1467"},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/1015706.1015760"},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/566654.566605"},{"key":"e_1_2_2_27_1","volume-title":"Computer Graphics Forum","author":"Kry Paul G","unstructured":"Paul G Kry , Lionel Rev\u00e9ret , Fran\u00e7ois Faure , and M-P Cani . 2009. Modal locomotion: Animating virtual characters with natural vibrations . In Computer Graphics Forum , Vol. 28 . Wiley Online Library , 289--298. Paul G Kry, Lionel Rev\u00e9ret, Fran\u00e7ois Faure, and M-P Cani. 2009. Modal locomotion: Animating virtual characters with natural vibrations. In Computer Graphics Forum, Vol. 28. Wiley Online Library, 289--298."},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/1073368.1073408"},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/566654.566607"},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/1882261.1866160"},{"key":"e_1_2_2_31_1","volume-title":"Proc. SCA. 221--230","author":"Levine Sergey","year":"2012","unstructured":"Sergey Levine and Jovan Popovi\u0107 . 2012 . Physically Plausible Simulation for Character Animation . In Proc. SCA. 221--230 . http:\/\/dl.acm.org\/citation.cfm?id=2422356.2422388 Sergey Levine and Jovan Popovi\u0107. 2012. Physically Plausible Simulation for Character Animation. In Proc. SCA. 221--230. http:\/\/dl.acm.org\/citation.cfm?id=2422356.2422388"},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/2185520.2185524"},{"key":"e_1_2_2_33_1","volume-title":"Auto-Conditioned LSTM Network for Extended Complex Human Motion Synthesis. arXiv preprint arXiv:1707.05363","author":"Li Zimo","year":"2017","unstructured":"Zimo Li , Yi Zhou , Shuangjiu Xiao , Chong He , and Hao Li. 2017. Auto-Conditioned LSTM Network for Extended Complex Human Motion Synthesis. arXiv preprint arXiv:1707.05363 ( 2017 ). https:\/\/arxiv.org\/abs\/1707.05363 Zimo Li, Yi Zhou, Shuangjiu Xiao, Chong He, and Hao Li. 2017. Auto-Conditioned LSTM Network for Extended Complex Human Motion Synthesis. arXiv preprint arXiv:1707.05363 (2017). https:\/\/arxiv.org\/abs\/1707.05363"},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/1073204.1073314"},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/566654.566596"},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/3083723"},{"key":"e_1_2_2_37_1","volume-title":"Fixing Weight Decay Regularization in Adam. CoRR abs\/1711.05101","author":"Loshchilov Ilya","year":"2017","unstructured":"Ilya Loshchilov and Frank Hutter . 2017. Fixing Weight Decay Regularization in Adam. CoRR abs\/1711.05101 ( 2017 ). arXiv:1711.05101 http:\/\/arxiv.org\/abs\/1711.05101 Ilya Loshchilov and Frank Hutter. 2017. Fixing Weight Decay Regularization in Adam. CoRR abs\/1711.05101 (2017). arXiv:1711.05101 http:\/\/arxiv.org\/abs\/1711.05101"},{"key":"e_1_2_2_38_1","volume-title":"Learning human behaviors from motion capture by adversarial imitation. arXiv preprint arXiv:1707.02201","author":"Merel Josh","year":"2017","unstructured":"Josh Merel , Yuval Tassa , Sriram Srinivasan , Jay Lemmon , Ziyu Wang , Greg Wayne , and Nicolas Heess . 2017a. Learning human behaviors from motion capture by adversarial imitation. arXiv preprint arXiv:1707.02201 ( 2017 ). https:\/\/arxiv.org\/abs\/1707.02201 Josh Merel, Yuval Tassa, Sriram Srinivasan, Jay Lemmon, Ziyu Wang, Greg Wayne, and Nicolas Heess. 2017a. Learning human behaviors from motion capture by adversarial imitation. arXiv preprint arXiv:1707.02201 (2017). https:\/\/arxiv.org\/abs\/1707.02201"},{"key":"e_1_2_2_39_1","volume-title":"Learning human behaviors from motion capture by adversarial imitation. CoRR abs\/1707.02201","author":"Merel Josh","year":"2017","unstructured":"Josh Merel , Yuval Tassa , Dhruva TB , Sriram Sr inivasan, Jay Lemmon , Ziyu Wang , Greg Wayne , and Nicolas Heess . 2017b. Learning human behaviors from motion capture by adversarial imitation. CoRR abs\/1707.02201 ( 2017 ). arXiv:1707.02201 http:\/\/arxiv.org\/abs\/1707.02201 Josh Merel, Yuval Tassa, Dhruva TB, Sriram Srinivasan, Jay Lemmon, Ziyu Wang, Greg Wayne, and Nicolas Heess. 2017b. Learning human behaviors from motion capture by adversarial imitation. CoRR abs\/1707.02201 (2017). arXiv:1707.02201 http:\/\/arxiv.org\/abs\/1707.02201"},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/2366145.2366172"},{"key":"e_1_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/1073204.1073313"},{"key":"e_1_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/2766910"},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/2897824.2925881"},{"key":"e_1_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/122718.122755"},{"key":"e_1_2_2_45_1","volume-title":"Learning multiple visual domains with residual adapters. arXiv preprint arXiv:1705.08045","author":"Rebuffi Sylvestre-Alvise","year":"2017","unstructured":"Sylvestre-Alvise Rebuffi , Hakan Bilen , and Andrea Vedaldi . 2017. Learning multiple visual domains with residual adapters. arXiv preprint arXiv:1705.08045 ( 2017 ). https:\/\/arxiv.org\/abs\/1705.08045 Sylvestre-Alvise Rebuffi, Hakan Bilen, and Andrea Vedaldi. 2017. Learning multiple visual domains with residual adapters. arXiv preprint arXiv:1705.08045 (2017). https:\/\/arxiv.org\/abs\/1705.08045"},{"key":"e_1_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1109\/38.708559"},{"key":"e_1_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/1276377.1276510"},{"key":"e_1_2_2_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/1015706.1015754"},{"key":"e_1_2_2_49_1","volume-title":"Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer. CoRR abs\/1701.06538","author":"Shazeer Noam","year":"2017","unstructured":"Noam Shazeer , Azalia Mirhoseini , Krzysztof Maziarz , Andy Davis , Quoc V Le , Geoffrey E. Hinton , and Jeff Dean . 2017. Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer. CoRR abs\/1701.06538 ( 2017 ). arXiv:1701.06538 http:\/\/arxiv.org\/abs\/1701.06538 Noam Shazeer, Azalia Mirhoseini, Krzysztof Maziarz, Andy Davis, Quoc V Le, Geoffrey E. Hinton, and Jeff Dean. 2017. Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer. CoRR abs\/1701.06538 (2017). arXiv:1701.06538 http:\/\/arxiv.org\/abs\/1701.06538"},{"key":"e_1_2_2_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/1966394.1966397"},{"key":"e_1_2_2_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/1553374.1553505"},{"key":"e_1_2_2_52_1","doi-asserted-by":"publisher","DOI":"10.5555\/1953048.2021035"},{"key":"e_1_2_2_53_1","doi-asserted-by":"publisher","DOI":"10.1109\/38.486679"},{"key":"e_1_2_2_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/1531326.1531366"},{"key":"e_1_2_2_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/2601097.2601192"},{"key":"e_1_2_2_56_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2007.1167"},{"key":"e_1_2_2_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/2766999"},{"key":"e_1_2_2_58_1","doi-asserted-by":"publisher","DOI":"10.1145\/2185520.2185537"},{"key":"e_1_2_2_59_1","doi-asserted-by":"publisher","DOI":"10.1145\/1276377.1276509"},{"key":"e_1_2_2_60_1","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2012.2200299"}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3197517.3201366","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3197517.3201366","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T01:39:45Z","timestamp":1750210785000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3197517.3201366"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,7,30]]},"references-count":60,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2018,8,31]]}},"alternative-id":["10.1145\/3197517.3201366"],"URL":"https:\/\/doi.org\/10.1145\/3197517.3201366","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,7,30]]},"assertion":[{"value":"2018-07-30","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}