Ilya Kovalchuk's 400th career goal accounted for all the scoring in the game.
New Jersey strengthened its hold on the sixth seed in the Eastern Conference, moving five points ahead of the Senators and pulling to within three of fifth-seeded Philadelphia, which lost to Florida Tuesday.
Ottawa dropped its fourth in five games despite 33 saves from Ben Bishop.
Hedberg stopped 12 shots in the third period.
2014: The Year in Music [PHOTOS]