Ovechkin scored twice in a four-goal third period for the Caps, who had lost to the Devils Thursday.
Ovechkin opened the scoring in the second period but Ilya Kovalchuk tied it 1-1 at 19:22 of the second.
Braden Holtby stopped 21 shots for the Caps.
New Jersey's Johan Hedberg made 21 saves but allowed all five Washington goals.
Ukrainian protestors topple Lenin statue [VIDEO]
'SNL': 'Anchorman 2' cast, One Direction sing 'Afternoon Delight' [VIDEO]