Skip to main content
Back to News Hub
🤖OpenAI
October 15, 2019
General AI

Solving Rubik's Cube with a robot hand

Overview

OpenAI has trained two neural networks to solve a Rubik's Cube using a human-like robotic hand. The training occurred completely in simulation by combining the reinforcement learning software behind OpenAI Five with a new method named Automatic Domain Randomization (ADR). Even when facing unfamiliar real-world disruptions, such as being poked with a "stuffed giraffe", the robotic system managed to perform successfully.

Key Takeaways

  • OpenAI developed a robotic system capable of solving a Rubik's Cube using a human-like hand operated by two neural networks.

    Rather than practicing on physical hardware, the system underwent its entire training phase inside a simulated environment.

  • To achieve this, researchers combined the core reinforcement learning code previously used for OpenAI Five with a newly created method called "Automatic Domain Randomization (ADR)".

    This simulation-based approach enabled the physical robot hand to adapt to unexpected real-world challenges that were absent during training, such as being poked with a "stuffed giraffe".

  • For individuals studying artificial intelligence, this breakthrough illustrates how reinforcement learning can transcend virtual environments like games and successfully manage delicate physical tasks requiring physical dexterity.

    OpenAI successfully taught a humanoid robotic hand to solve a Rubik's Cube.

  • The system was trained entirely inside a virtual simulation rather than on physical hardware.

    Training utilized the reinforcement learning code from OpenAI Five alongside Automatic Domain Randomization (ADR).

  • This advancement demonstrates that reinforcement learning can master complex physical tasks that demand high dexterity.

OpenAI developed a robotic system capable of solving a Rubik's Cube using a human-like hand operated by two neural networks. Rather than practicing on physical hardware, the system underwent its entire training phase inside a simulated environment. To achieve this, researchers combined the core reinforcement learning code previously used for OpenAI Five with a newly created method called "Automatic Domain Randomization (ADR)".

This simulation-based approach enabled the physical robot hand to adapt to unexpected real-world challenges that were absent during training, such as being poked with a "stuffed giraffe". For individuals studying artificial intelligence, this breakthrough illustrates how reinforcement learning can transcend virtual environments like games and successfully manage delicate physical tasks requiring physical dexterity. OpenAI successfully taught a humanoid robotic hand to solve a Rubik's Cube.

The system was trained entirely inside a virtual simulation rather than on physical hardware. Training utilized the reinforcement learning code from OpenAI Five alongside Automatic Domain Randomization (ADR). The physical robot can withstand unexpected real-world interference, including being prodded by a "stuffed giraffe".

For more details please read the original article at OpenAI.

Continue Learning

Comments

Comments appear only after moderation. Your email identifies your submission to the moderator and is never displayed here.

No approved comments yet.

Originally published by OpenAI
Read the original