Menu Close

A robot that teaches itself to walk using reinforcement learning

A team of researchers at the University of California, Berkeley, has built a two-legged robot with t he ability to teach itself to walk using reinforcement learning. The team has written a paper describing their work and has uploaded it to the arXiv preprint server.

The work involved building a consisting of a pair of legs attached together and connected to a small holding frame. Currently, the robot carries out its tasks tethered to the frame, which is guided by one of the researchers. Compared to other robots, such as several made by Boston Dynamics, the robot seems primitive. But the robot, which the team has named Cassie, represents the leading edge of a new kind of technology—in which a robot teaches itself to walk, rather than having it learn it through direct programming, or mimicry.

Reinforcement learning is the kind exhibited by humans—babies learn to walk by trying new movements. They do not get the whole process at once but remember steps that lead to walking. And then they build on what they have learned, adding more information that eventually leads to walking upright. But they do not stop there; they keep learning, and in so doing, grow better at it. In time, they learn new tricks, such as running, jumping or even skipping down a sidewalk.

To help a robot learn to walk in the same way, the researchers began with a of a robot in a virtual world. In the simulation, the robot was trained with information that described goals such as walking upright; an AI engine could remember and use what was learned. The simulation allowed the robot to learn to walk without damaging the actual hardware and sped the process.

Once the robot in the simulation learned to walk, the researchers ported its knowledge to Cassie, who used it to walk in ways similar to a toddler. And just like a toddler, Cassie continued to learn. She learned how to keep from falling when slipping slightly, or to recover when shoved from the side. She also learned to compensate when two of her motors were damaged. The researchers plan to continue their work with in robots to see how far they can go with it.

Article: A robot that teaches itself to walk using reinforcement learning


Leave a Reply

Your email address will not be published. Required fields are marked *

(UN General Assembly, 1948) The Universal Declaration of Human Rights: 1. All human beings are free and equal 2. No discrimination 3. Right to life 4. No slavery 5. No torture and inhuman treatment 6. Same right to use law 7. Equal before the law 8. Right to be treated fair by court 9. No unfair detainment 10. Right to trial 11. Innocent until proved guilty 12. Right to privacy 13. Freedom to movement and residence 14. Right to asylum 15. Right to nationality 16. Rights to marry and have family 17. Right to own things 18. Freedom of thought and religion 19. Freedom of opinion and expression 20. Right to assemble 21. Right to democracy 22. Right to social security 23. Right to work 24. Right to rest and holiday 25. Right of social service 26. Right to education 27. Right of cultural and art 28. Freedom around the world 29. Subject to law 30. Human rights can’t be taken away