Lab of Biomechatronics and Intelligent Robotics, Department of Mechanical and Aerospace Engineering, North Carolina State University, Raleigh, NC, USA.
Department of Mechanical Engineering, Embry-Riddle Aeronautical University, Daytona Beach, FL, USA.
Nature. 2024 Jun;630(8016):353-359. doi: 10.1038/s41586-024-07382-4. Epub 2024 Jun 12.
Exoskeletons have enormous potential to improve human locomotive performance. However, their development and broad dissemination are limited by the requirement for lengthy human tests and handcrafted control laws. Here we show an experiment-free method to learn a versatile control policy in simulation. Our learning-in-simulation framework leverages dynamics-aware musculoskeletal and exoskeleton models and data-driven reinforcement learning to bridge the gap between simulation and reality without human experiments. The learned controller is deployed on a custom hip exoskeleton that automatically generates assistance across different activities with reduced metabolic rates by 24.3%, 13.1% and 15.4% for walking, running and stair climbing, respectively. Our framework may offer a generalizable and scalable strategy for the rapid development and widespread adoption of a variety of assistive robots for both able-bodied and mobility-impaired individuals.
外骨骼在提高人类运动表现方面具有巨大的潜力。然而,它们的开发和广泛传播受到需要进行长时间的人体测试和手工控制律的限制。在这里,我们展示了一种无需人体实验即可在模拟中学习通用控制策略的无实验方法。我们的模拟学习框架利用了感知动力学的肌肉骨骼和外骨骼模型以及数据驱动的强化学习来弥合模拟和现实之间的差距。所学习的控制器被部署在一个定制的臀部外骨骼上,可以在不同的活动中自动生成辅助,分别降低代谢率 24.3%、13.1%和 15.4%,用于步行、跑步和爬楼梯。我们的框架可以为各种辅助机器人的快速开发和广泛采用提供一种通用且可扩展的策略,这些机器人适用于健全人和行动不便的人。