Ovechkin scored twice in a four-goal third period for the Caps, who had lost to the Devils Thursday.
Ovechkin opened the scoring in the second period but Ilya Kovalchuk tied it 1-1 at 19:22 of the second.
Braden Holtby stopped 21 shots for the Caps.
New Jersey's Johan Hedberg made 21 saves but allowed all five Washington goals.
Justin Bieber crashes Drake Bell's album release party
Putin thinks Obama would save him if he were drowning