The silver medal was won by Marcel Nguyen of Germany. The bronze went to Danell Leyva of the United States.
Leyva seemed out of medal contention, but turned in the best overall performance of the night in each of his last two exercises to climb into third place.
It was the first gold medal in the event for a Japanese gymnast in 28 years. Japan won a gold medal in the all-around four times over the course of six Olympics beginning in 1964.
Joan Rivers refuses to apologize for kidnapping joke
Avril Lavigne denies racism in 'Hello Kitty' music video