The Phillies took a 4-3 lead into the ninth, when they scored six times on five hits. Freddy Galvis drew a leadoff walk from Jon Rauch (3-4) and John Mayberry singled before Rollins hit his second homer of the season.
A would-be New York rally in the bottom of the ninth fell short despite the second homer of the game from Lucas Duda.
Antonio Bastardo, the second of five Philadelphia pitchers, got the win by working a scoreless seventh.
Interpol investigating stolen passports on missing flight
Susan Sarandon 'very excited' about daughter's pregnancy