The Blue Jackets extended their winning streak to a season-best five games.
Atkinson scored the second of two Columbus goals in the first period and he finished off the scoring early in the third. Columbus also came up with scores from Ryan Johansen, James Wisniewski and Mark Letestu.
Philipp Grubauer opened in net for the Capitals and was removed early in the second period after giving up three goals on 14 shots. It was Washington's fourth straight loss.
Jessica Simpson shares three-way kiss with friends in photo
Senate Democrats to pull all-nighter on climate change