The Red Sox let a five-run lead slip away in the seventh inning and then took advantage of a blown save suffered by Mariano Rivera to end the Yankees' winning streak at three games.
Ellsbury stole second and scored the winning run on Victorino's single to right. The run was charged to Joba Chamberlain (2-1), the seventh of eight New York pitchers.
Boston owned a 7-2 lead heading into the New York seventh, but the Yankees sent 10 men to the plate in that inning while scoring six runs. Lyle Overbay finished off the inning with a two-run single that gave the Yankees an 8-7 lead.
Rivera then came on to protect the lead and retired the first two men in the ninth before Mike Napoli singled. Berry ran for Napoli, stole second and moved on to third on a throwing error by catcher Austin Romine.
Drew hit Rivera's next pitch into right field to tie the score.