Ovechkin scored twice in a four-goal third period for the Caps, who had lost to the Devils Thursday.
Ovechkin opened the scoring in the second period but Ilya Kovalchuk tied it 1-1 at 19:22 of the second.
Braden Holtby stopped 21 shots for the Caps.
New Jersey's Johan Hedberg made 21 saves but allowed all five Washington goals.
Beautician charged with giving client fatal silicone butt injection
Duggar sisters unveil Christian dating rules in new book