Lee (4-7) logged his second straight win, baffling the Braves on five hits while walking one and striking out five. The left-hander threw 67 of his 93 pitches for strikes in the gem.
The hurler also knocked in a run by drawing a bases-loaded walk.
Rollins' solo shot in the third inning staked the Phillies to a 2-0 lead.
Atlanta's Tim Hudson (13-5) was knocked around for his first loss since July 1, a span of 10 starts. The right-hander allowed five runs on nine hits in a five-inning effort.
Martin Prado homered for the National League wild card-leading Braves, who lost for the 10th time in 14 games.
Ohio crash that killed two caught on camera [VIDEO]
Workers accuse National Zoo of animal mismanagement