Ovechkin scored twice in a four-goal third period for the Caps, who had lost to the Devils Thursday.
Ovechkin opened the scoring in the second period but Ilya Kovalchuk tied it 1-1 at 19:22 of the second.
Braden Holtby stopped 21 shots for the Caps.
New Jersey's Johan Hedberg made 21 saves but allowed all five Washington goals.
Ohio crash that killed two caught on camera [VIDEO]
Wisconsin business offering 'therapeutic cuddling' forced to close