The Phillies snapped a four-game losing streak.
Atlanta was unable to solve Milton (7-1) for the second time this season. He limited the Braves to a run and five hits in seven innings with two walks and five strikeouts.
Milton was supported by an offense that scored just 11 runs during its recent skid. Bobby Abreu and Mike Lieberthal each homered and drove in a pair of runs, and Rollins stroked a three-run double during a six-run eighth-inning outburst.
Eddie Perez had two hits and an RBI for the Braves, who have split the first six games of their season series with the Phillies.