With a steal in the first inning, Soriano became the fourth player in major league history with 40 home runs and 40 stolen bases in the same season.
Pedro Astacio (4-5) picked up the win, giving up four runs and six hits through 5 2/3 innings for the Nationals, who had lost six of their last eight games.
Bush (11-11) took the loss, yielding five runs on seven hits in four innings.
Soriano's game jersey was shipped to the Hall of Fame after the game.
Toddler uninjured after being knocked over by Obama family dog
Gal Gadot cast as Wonder Woman for 'Batman vs. Superman'