AI researchers from Google’s DeepMind team used reinforcement learning to teach simulated robots how to play soccer. They then managed to transfer those learned abilities onto real, physical robots. We are left with not only impressive research, but a bunch of videos of super cute, tottering robots playing soccer with each other.
Our agents, with 20 actuated joints, were trained in simulation using the MuJoCo physics engine, and transferred zero-shot to real robots… The trained soccer players exhibit robust and dynamic movement skills such as rapid fall recovery, walking, turning, kicking and more… The agents also developed a basic strategic understanding of the game, learning to anticipate ball movements and to block opponent shots.
As I mentioned above, the linked page is full of videos that are all fascinating and impressive; if nothing else, don’t miss the clip where a researcher repeatedly pushes down an adorable, tiny, humanoid robot as it runs around playing with a soccer ball. Her discomfort with each push is palpable.