Ovechkin scored twice in a four-goal third period for the Caps, who had lost to the Devils Thursday.
Ovechkin opened the scoring in the second period but Ilya Kovalchuk tied it 1-1 at 19:22 of the second.
Braden Holtby stopped 21 shots for the Caps.
New Jersey's Johan Hedberg made 21 saves but allowed all five Washington goals.
Exploding whale video goes viral on Internet
Gal Gadot cast as Wonder Woman for 'Batman vs. Superman'