{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,17]],"date-time":"2026-07-17T06:09:57Z","timestamp":1784268597342,"version":"3.55.0"},"reference-count":46,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2016,7,11]],"date-time":"2016-07-11T00:00:00Z","timestamp":1468195200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2016,7,11]]},"abstract":"<jats:p>We present a framework to synthesize character movements based on high level parameters, such that the produced movements respect the manifold of human motion, trained on a large motion capture dataset. The learned motion manifold, which is represented by the hidden units of a convolutional autoencoder, represents motion data in sparse components which can be combined to produce a wide range of complex movements. To map from high level parameters to the motion manifold, we stack a deep feedforward neural network on top of the trained autoencoder. This network is trained to produce realistic motion sequences from parameters such as a curve over the terrain that the character should follow, or a target location for punching and kicking. The feedforward control network and the motion manifold are trained independently, allowing the user to easily switch between feedforward networks according to the desired interface, without re-training the motion manifold. Once motion is generated it can be edited by performing optimization in the space of the motion manifold. This allows for imposing kinematic constraints, or transforming the style of the motion, while ensuring the edited motion remains natural. As a result, the system can produce smooth, high quality motion sequences without any manual pre-processing of the training data.<\/jats:p>","DOI":"10.1145\/2897824.2925975","type":"journal-article","created":{"date-parts":[[2016,7,11]],"date-time":"2016-07-11T12:04:33Z","timestamp":1468238673000},"page":"1-11","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":560,"title":["A deep learning framework for character motion synthesis and editing"],"prefix":"10.1145","volume":"35","author":[{"given":"Daniel","family":"Holden","sequence":"first","affiliation":[{"name":"University of Edinburgh"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jun","family":"Saito","sequence":"additional","affiliation":[{"name":"Marza Animation Planet"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Taku","family":"Komura","sequence":"additional","affiliation":[{"name":"University of Edinburgh"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2016,7,11]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-10347-6_20"},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/566654.566606"},{"key":"e_1_2_2_3_1","volume-title":"Proc. of the Python for Scientific Computing Conference (SciPy). Oral Presentation.","author":"Bergstra J.","unstructured":"Bergstra , J. , Breuleux , O. , Bastien , F. , Lamblin , P. , Pascanu , R. , Desjardins , G. , Turian , J. , Warde-Farley , D. , and Bengio , Y . 2010. Theano: a CPU and GPU math expression compiler . In Proc. of the Python for Scientific Computing Conference (SciPy). Oral Presentation. Bergstra, J., Breuleux, O., Bastien, F., Lamblin, P., Pascanu, R., Desjardins, G., Turian, J., Warde-Farley, D., and Bengio, Y. 2010. Theano: a CPU and GPU math expression compiler. In Proc. of the Python for Scientific Computing Conference (SciPy). Oral Presentation."},{"key":"e_1_2_2_4_1","unstructured":"CMU. Carnegie-Mellon Mocap Database. http:\/\/mocap.cs.cmu.edu\/.  CMU. Carnegie-Mellon Mocap Database. http:\/\/mocap.cs.cmu.edu\/."},{"key":"e_1_2_2_5_1","volume-title":"Proc. of the IEEE Conference on Computer Vision and Pattern Recognition.","author":"Du Y.","unstructured":"Du , Y. , Wang , W. , and Wang , L . 2015. Hierarchical recurrent neural network for skeleton based action recognition . In Proc. of the IEEE Conference on Computer Vision and Pattern Recognition. Du, Y., Wang, W., and Wang, L. 2015. Hierarchical recurrent neural network for skeleton based action recognition. In Proc. of the IEEE Conference on Computer Vision and Pattern Recognition."},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.5555\/2919332.2919834"},{"key":"e_1_2_2_7_1","unstructured":"Gatys L. A. Ecker A. S. and Bethge M. 2015. A neural algorithm of artistic style. CoRR abs\/1508.06576.  Gatys L. A. Ecker A. S. and Bethge M. 2015. A neural algorithm of artistic style. CoRR abs\/1508.06576."},{"key":"e_1_2_2_8_1","volume-title":"Proc. of Advances in Neural Information Processing Systems. 2672--2680","author":"Goodfellow I.","unstructured":"Goodfellow , I. , Pouget-Abadie , J. , Mirza , M. , Xu , B. , Warde-Farley , D. , Ozair , S. , Courville , A. , and Bengio , Y . 2014. Generative adversarial nets . In Proc. of Advances in Neural Information Processing Systems. 2672--2680 . Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., and Bengio, Y. 2014. Generative adversarial nets. In Proc. of Advances in Neural Information Processing Systems. 2672--2680."},{"key":"e_1_2_2_9_1","volume-title":"Speech and Signal Processing (ICASSP), 2013 IEEE International Conference on, IEEE, 6645--6649","author":"Graves A.","unstructured":"Graves , A. , Mohamed , A.-R. , and Hinton , G . 2013. Speech recognition with deep recurrent neural networks. In Acoustics , Speech and Signal Processing (ICASSP), 2013 IEEE International Conference on, IEEE, 6645--6649 . Graves, A., Mohamed, A.-R., and Hinton, G. 2013. Speech recognition with deep recurrent neural networks. In Acoustics, Speech and Signal Processing (ICASSP), 2013 IEEE International Conference on, IEEE, 6645--6649."},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/1015706.1015755"},{"key":"e_1_2_2_11_1","doi-asserted-by":"crossref","unstructured":"Hariharan B. Arbel\u00e1ez P. A. Girshick R. B. and Malik J. 2014. Hypercolumns for object segmentation and fine-grained localization. CoRR abs\/1411.5752.  Hariharan B. Arbel\u00e1ez P. A. Girshick R. B. and Malik J. 2014. Hypercolumns for object segmentation and fine-grained localization. CoRR abs\/1411.5752.","DOI":"10.1109\/CVPR.2015.7298642"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/1230100.1230123"},{"key":"e_1_2_2_13_1","series-title":"Lecture Notes in Computer Science","volume-title":"Neural Networks: Tricks of the Trade, G. Montavon, G. Orr, and K.-R","author":"Hinton G.","unstructured":"Hinton , G. 2012. A practical guide to training restricted boltzmann machines . In Neural Networks: Tricks of the Trade, G. Montavon, G. Orr, and K.-R . Mller, Eds., vol. 7700 of Lecture Notes in Computer Science . 599--619. Hinton, G. 2012. A practical guide to training restricted boltzmann machines. In Neural Networks: Tricks of the Trade, G. Montavon, G. Orr, and K.-R. Mller, Eds., vol. 7700 of Lecture Notes in Computer Science. 599--619."},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/2820903.2820918"},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/1531326.1531385"},{"key":"e_1_2_2_16_1","volume-title":"Adam: A method for stochastic optimization. CoRR abs\/1412.6980.","author":"Kingma D. P.","year":"2014","unstructured":"Kingma , D. P. , and Ba , J . 2014 . Adam: A method for stochastic optimization. CoRR abs\/1412.6980. Kingma, D. P., and Ba, J. 2014. Adam: A method for stochastic optimization. CoRR abs\/1412.6980."},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/1015706.1015760"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/566654.566605"},{"key":"e_1_2_2_19_1","volume-title":"Proc. of Advances in Neural Information Processing Systems, 1097--1105","author":"Krizhevsky A.","unstructured":"Krizhevsky , A. , Sutskever , I. , and Hinton , G. E . 2012. Imagenet classification with deep convolutional neural networks . In Proc. of Advances in Neural Information Processing Systems, 1097--1105 . Krizhevsky, A., Sutskever, I., and Hinton, G. E. 2012. Imagenet classification with deep convolutional neural networks. In Proc. of Advances in Neural Information Processing Systems, 1097--1105."},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/1028523.1028535"},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/311535.311539"},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/566654.566607"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/1882261.1866160"},{"key":"e_1_2_2_24_1","volume-title":"Proc. of the 31st International Conference on Machine Learning (ICML-14)","author":"Levine S.","unstructured":"Levine , S. , and Koltun , V . 2014. Learning complex neural network policies with trajectory optimization . In Proc. of the 31st International Conference on Machine Learning (ICML-14) , 829--837. Levine, S., and Koltun, V. 2014. Learning complex neural network policies with trajectory optimization. In Proc. of the 31st International Conference on Machine Learning (ICML-14), 829--837."},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/2185520.2185524"},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/2366145.2366172"},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/1640443.1640452"},{"key":"e_1_2_2_28_1","volume-title":"Proc. of the 31st International Conference on Machine Learning (ICML-14)","author":"Mittelman R.","unstructured":"Mittelman , R. , Kuipers , B. , Savarese , S. , and Lee , H . 2014. Structured recurrent temporal restricted boltzmann machines . In Proc. of the 31st International Conference on Machine Learning (ICML-14) , 1647--1655. Mittelman, R., Kuipers, B., Savarese, S., and Lee, H. 2014. Structured recurrent temporal restricted boltzmann machines. In Proc. of the 31st International Conference on Machine Learning (ICML-14), 1647--1655."},{"key":"e_1_2_2_29_1","volume-title":"Proc. of Advances in Neural Information Processing Systems.","author":"Mordatch I.","unstructured":"Mordatch , I. , Lowrey , K. , Andrew , G. , Popovic , Z. , and Todorov , E . 2015. Interactive control of diverse complex characters with neural networks . In Proc. of Advances in Neural Information Processing Systems. Mordatch, I., Lowrey, K., Andrew, G., Popovic, Z., and Todorov, E. 2015. Interactive control of diverse complex characters with neural networks. In Proc. of Advances in Neural Information Processing Systems."},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/1073204.1073313"},{"key":"e_1_2_2_31_1","volume-title":"Tech. Rep. CG-2007-2, Universit\u00e4t Bonn, June.","author":"M\u00fcller M.","year":"2007","unstructured":"M\u00fcller , M. , R\u00f6der , T. , Clausen , M. , Eberhardt , B. , Kr\u00fcger , B. , and Weber , A . 2007 . Documentation mocap database hdm05. Tech. Rep. CG-2007-2, Universit\u00e4t Bonn, June. M\u00fcller, M., R\u00f6der, T., Clausen, M., Eberhardt, B., Kr\u00fcger, B., and Weber, A. 2007. Documentation mocap database hdm05. Tech. Rep. CG-2007-2, Universit\u00e4t Bonn, June."},{"key":"e_1_2_2_32_1","volume-title":"Proc. of the 27th International Conference on Machine Learning (ICML-10)","author":"Nair V.","unstructured":"Nair , V. , and Hinton , G. E . 2010. Rectified linear units improve restricted boltzmann machines . In Proc. of the 27th International Conference on Machine Learning (ICML-10) , 807--814. Nair, V., and Hinton, G. E. 2010. Rectified linear units improve restricted boltzmann machines. In Proc. of the 27th International Conference on Machine Learning (ICML-10), 807--814."},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1109\/WACV.2013.6474999"},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/38.708559"},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1111\/1467-8659.00516"},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/1276377.1276510"},{"key":"e_1_2_2_37_1","volume-title":"Proc. of the 2006 ACM SIGGRAPH\/Eurographics Symposium on Computer Animation, Eurographics Association, 291--298","author":"Shin H. J.","unstructured":"Shin , H. J. , and Oh , H. S . 2006. Fat graphs: constructing an interactive character with continuous controls . In Proc. of the 2006 ACM SIGGRAPH\/Eurographics Symposium on Computer Animation, Eurographics Association, 291--298 . Shin, H. J., and Oh, H. S. 2006. Fat graphs: constructing an interactive character with continuous controls. In Proc. of the 2006 ACM SIGGRAPH\/Eurographics Symposium on Computer Animation, Eurographics Association, 291--298."},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.5555\/2627435.2670313"},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/2601097.2601121"},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/1553374.1553505"},{"key":"e_1_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.5555\/1953048.2021035"},{"key":"e_1_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.5555\/1756006.1953039"},{"key":"e_1_2_2_43_1","volume-title":"Proc. of Advances in Neural Information Processing Systems, 1441--1448","author":"Wang J.","unstructured":"Wang , J. , Hertzmann , A. , and Blei , D. M . 2005. Gaussian process dynamical models . In Proc. of Advances in Neural Information Processing Systems, 1441--1448 . Wang, J., Hertzmann, A., and Blei, D. M. 2005. Gaussian process dynamical models. In Proc. of Advances in Neural Information Processing Systems, 1441--1448."},{"key":"e_1_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/2766999"},{"key":"e_1_2_2_45_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2003.1207443"},{"key":"e_1_2_2_46_1","doi-asserted-by":"crossref","unstructured":"Zeiler M. D. and Fergus R. 2014. Visualizing and understanding convolutional networks. In Computer Vision--ECCV 2014. Springer 818--833.  Zeiler M. D. and Fergus R. 2014. Visualizing and understanding convolutional networks. In Computer Vision--ECCV 2014 . Springer 818--833.","DOI":"10.1007\/978-3-319-10590-1_53"}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2897824.2925975","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2897824.2925975","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T00:55:05Z","timestamp":1750208105000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2897824.2925975"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,7,11]]},"references-count":46,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2016,7,11]]}},"alternative-id":["10.1145\/2897824.2925975"],"URL":"https:\/\/doi.org\/10.1145\/2897824.2925975","relation":{"is-identical-to":[{"id-type":"doi","id":"10.1145\/3596711.3596789","asserted-by":"object"}]},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2016,7,11]]},"assertion":[{"value":"2016-07-11","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}