{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,18]],"date-time":"2025-11-18T12:06:12Z","timestamp":1763467572088,"version":"3.33.0"},"reference-count":37,"publisher":"SAGE Publications","issue":"1","license":[{"start":{"date-parts":[[2003,3,1]],"date-time":"2003-03-01T00:00:00Z","timestamp":1046476800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Adaptive Behavior"],"published-print":{"date-parts":[[2003,3]]},"abstract":"<jats:p> Human upright posture is an unstable position: Continuous activation of postural muscles is required to avoid falling down. This is the output of a complex control system that monitors a very large number of inputs, related to the orientation of the body segments, to produce an adequate output as muscle activation. Complexity arises because of the very large number of correlated inputs and out puts: The finite contraction and release time of muscles and the neural control loop delays make the problem even more difficult. Nevertheless, upright posture is a capability that is learned in the first year of life. Here, the learning process is investigated by using a neural network model for the controller and the reinforcement learning paradigm. To this end, after creating a mechanically realistic digital human body, a feedback postural controller is defined, which outputs a set of joint torques as a function of orientation and rotation speed of the body segments. The controller is made up of a neural net work, whose `synaptic weights' are determined through trial-and-error (failure in maintaining upright posture) by using a reinforcement learning strategy. No desired control action is specified nor particular structure given to the controller. The results show that the anatomical arrangement of the skeleton is sufficient to shape a postural control, robust against torque perturbations and noise, and flexible enough to adapt to changes in the body model in a short time. Moreover, the learned kinematics closely resembles the data reported in the literature; it emerges from the interaction with the environment, only through trial-and-error. Overall, the results suggest that anatomical arrangement of the body segments may play a major role in shaping human motor control. <\/jats:p>","DOI":"10.1177\/10597123030111002","type":"journal-article","created":{"date-parts":[[2003,8,16]],"date-time":"2003-08-16T10:07:02Z","timestamp":1061028422000},"page":"19-35","source":"Crossref","is-referenced-by-count":5,"title":["Learning to Maintain Upright Posture: What can be Learned Using Adaptive                Neural Network Models?"],"prefix":"10.1177","volume":"11","author":[{"given":"N. Alberto","family":"Borghese","sequence":"first","affiliation":[{"name":"Laboratory of Human Motion Analysis and Virtual Reality (MAVR),                        Department of Computer Science, University of Milan,"}]},{"given":"Andrea","family":"Calvi","sequence":"additional","affiliation":[{"name":"Department of Bioengineering, Politechnic of Milan"}]}],"member":"179","published-online":{"date-parts":[[2003,3,1]]},"reference":[{"key":"atypb1","doi-asserted-by":"publisher","DOI":"10.1016\/S0021-9290(00)00155-X"},{"key":"atypb2","unstructured":"Astrom, K. J. & Wittenmark, B. (1989). Adaptive control. New York: Addison-Wesley ."},{"key":"atypb3","doi-asserted-by":"crossref","unstructured":"Barto, A. G., Sutton, R. S. & Anderson, C. W. (1983). Neuron-like adaptive elements that can solve difficult learning problems . IEEE Transactions on Systems Man and Cybernetics, 13, 834-846 .","DOI":"10.1109\/TSMC.1983.6313077"},{"key":"atypb4","unstructured":"Bernstein, N. (1967). The co-ordination and regulation of movement. Oxford: Pergamon Press ."},{"key":"atypb5","doi-asserted-by":"crossref","unstructured":"Bizzi, E. (1980). Central and peripheral mechanisms in motor control. In G. E. Stelmach & J. Requen (Eds.), Tutorials in motor behavior (pp. 131-144). Amsterdam: North Holland .","DOI":"10.1016\/S0166-4115(08)61942-1"},{"key":"atypb6","doi-asserted-by":"publisher","DOI":"10.1113\/jphysiol.1996.sp021539"},{"key":"atypb7","doi-asserted-by":"publisher","DOI":"10.1016\/0021-9290(87)90052-2"},{"key":"atypb8","unstructured":"Bryson, A. E. & Ho, Y. C. (1975). Applied optimal control. Wahsington, DC: Hemisphere ."},{"key":"atypb9","doi-asserted-by":"crossref","unstructured":"Collins, J. J. & De Luca, C. J. (1994). Upright, correlated random walks: A statistical-biomechanics approach to the human postural control system . Chaos, 5(1), pp. 57-63 .","DOI":"10.1063\/1.166086"},{"key":"atypb10","doi-asserted-by":"publisher","DOI":"10.1016\/0021-9290(96)00021-8"},{"key":"atypb11","doi-asserted-by":"crossref","unstructured":"Doya, K. (2001). Reinforcement learning in continuous time and space . Neural Computation, 12, 219-245 .","DOI":"10.1162\/089976600300015961"},{"key":"atypb12","doi-asserted-by":"publisher","DOI":"10.1017\/S0140525X0004070X"},{"key":"atypb13","doi-asserted-by":"publisher","DOI":"10.1016\/S0959-4388(99)00037-9"},{"key":"atypb14","unstructured":"Ghez, C. (1991). Posture. In E. Kandel, J. Schwartz, & T. Jessell (Eds.), Principles of neural science (3rd edn., part VI, pp. 534-659). Amsterdam: Elsevier ."},{"key":"atypb15","doi-asserted-by":"crossref","unstructured":"Gurfinkel, V. S., Levik, Y. S., Popov, K. E., Smetanin, B. M. & Shilkov, V. Y. (1988). Body scheme in the control of postural activity. In V. S. Gurfinkel, M. E. Ioffe, J. Massion, & J. P. Rolle (Eds.), Stance and motion: Facts and concepts (pp. 147-185). New York: Plenum Press .","DOI":"10.1007\/978-1-4899-0821-6_17"},{"key":"atypb16","doi-asserted-by":"publisher","DOI":"10.1162\/neco.1994.6.2.181"},{"key":"atypb17","doi-asserted-by":"publisher","DOI":"10.1613\/jair.301"},{"key":"atypb18","doi-asserted-by":"publisher","DOI":"10.1007\/s004220050445"},{"key":"atypb19","unstructured":"Lacquaniti, F. (1997). Frames of reference in sensorimotor coordination. In F. Boller & J. Grafman (Eds.), Handbook of neuropsychology (Vol. 11, pp. 27-64). Amsterdam: Elsevier ."},{"key":"atypb20","doi-asserted-by":"publisher","DOI":"10.1152\/jn.1993.69.5.1443"},{"key":"atypb21","unstructured":"Lacquaniti, F. & Maioli, C. (1995). In M. Arbib (Ed.), Handbook of brain theory and neural networks (pp. 567-568). Cambridge, MA: MIT Press ."},{"key":"atypb22","doi-asserted-by":"publisher","DOI":"10.1080\/00222895.1994.9941664"},{"key":"atypb23","doi-asserted-by":"publisher","DOI":"10.1016\/0959-4388(94)90137-6"},{"key":"atypb24","doi-asserted-by":"crossref","unstructured":"Miller, T., Sutton, R. & Werbos, P. (Eds). (1990). Neural networks for control. Cambridge, MA: MIT Press .","DOI":"10.7551\/mitpress\/4939.001.0001"},{"key":"atypb25","doi-asserted-by":"crossref","unstructured":"Morasso, P. & Schieppati, M. (1999). Can muscle stiffness alone stabilize upright standing? Journal of Neurophysiology, 83, 1622-1626 .","DOI":"10.1152\/jn.1999.82.3.1622"},{"key":"atypb26","doi-asserted-by":"publisher","DOI":"10.1152\/jn.1996.76.2.1212"},{"key":"atypb27","doi-asserted-by":"crossref","unstructured":"Nashner, L. M. (1977). Fixed patterns of rapid postural responses among leg muscles during stance . Experimental Brain Resesarch, 30, 13-24 .","DOI":"10.1007\/BF00237855"},{"key":"atypb28","doi-asserted-by":"publisher","DOI":"10.1007\/BF00363992"},{"key":"atypb29","doi-asserted-by":"publisher","DOI":"10.1016\/0025-5564(78)90018-4"},{"key":"atypb30","doi-asserted-by":"crossref","unstructured":"Popovic, J., Seitz, S. M., Erdmann, M., Popovic, Z. & Witkin, A. P. (2000). Interactive manipulation of rigid body simulations . Proceedings of SIGGRAPH 2000 (pp. 209-218 ). Washington, DC: Addison-Wesley.","DOI":"10.1145\/344779.344880"},{"key":"atypb31","doi-asserted-by":"crossref","unstructured":"Pozzo, T., Berthoz, A. & Lefort, L. (1990). Head stabilization during various locomotor tasks in humans . Experimental Brain Research, 82, 97-106 .","DOI":"10.1007\/BF00230842"},{"key":"atypb32","doi-asserted-by":"publisher","DOI":"10.1007\/s002210050733"},{"key":"atypb33","unstructured":"Winter, D. (1990). Biomechanics and motor control of human movement. Waterloo, Canada: Wiley InterScience ."},{"key":"atypb34","doi-asserted-by":"publisher","DOI":"10.1152\/jn.1998.80.3.1211"},{"key":"atypb35","doi-asserted-by":"publisher","DOI":"10.1016\/S1364-6613(98)01221-2"},{"key":"atypb36","doi-asserted-by":"publisher","DOI":"10.1007\/BF01836124"},{"key":"atypb37","unstructured":"Zatsiorsky, V. M., Raitsin, L. M., Seluyanov, V. N., Aruin, A. S. & Prilutzky, B. J. (1993). Biomechanical characteristics of the human body. In W. Baumann (Ed.), Biomechanics and performance in sport (pp. 71-83). Washington, DC: Addison-Wesley ."}],"container-title":["Adaptive Behavior"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/10597123030111002","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/10597123030111002","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,1,28]],"date-time":"2025-01-28T16:47:47Z","timestamp":1738082867000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/10597123030111002"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2003,3]]},"references-count":37,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2003,3]]}},"alternative-id":["10.1177\/10597123030111002"],"URL":"https:\/\/doi.org\/10.1177\/10597123030111002","relation":{},"ISSN":["1059-7123","1741-2633"],"issn-type":[{"type":"print","value":"1059-7123"},{"type":"electronic","value":"1741-2633"}],"subject":[],"published":{"date-parts":[[2003,3]]}}}