Moss, who was called up from the minors last week, smacked a two-run blast that highlighted a six-run third inning and then added a solo shot in the fifth.
Bartolo Colon (6-6) picked up the win after battling through five innings in which he allowed five runs on nine hits. Colon gave up four runs in the first inning.
Ryan Cook had to scramble to notch his first career save. Cook put the first two batters aboard in the ninth but then set down the next three to put the game on ice.
Jeremy Guthrie (3-5) took the loss after giving up seven runs on eight hits over five innings.