Robots Learn by Watching Videos

Robots are able to learn the intricate grasping and manipulation movements required for cooking by watching online cooking videos.

The key breakthrough is that the robots can “think” for themselves, determining the best combination of observed motions that will allow them to efficiently accomplish a given task.

“Others have tried to copy the movements. Instead, we try to copy the goals. This is the breakthrough.” This approach allows the robots to decide for themselves how best to combine various actions, rather than reproducing a predetermined series of actions.