Jones' hit put the Bucs ahead to stay and Neil Walker added three RBI on a pair of hits as Pittsburgh evened its three-game series with Orioles at one win apiece.
Chris Resop (3-2) earned the victory in relief of James McDonald, who surrendered three runs on seven hits through 4 2/3 innings.
Baltimore's Jeremy Guthrie (2-9) was pounded for six runs (five earned) on 11 hits before being yanked after 6 1/3 frames.
Adam Jones clubbed a two-run homer and J.J Hardy added a solo shot to account for the Orioles' runs.
Rosie O'Donnell unveils nearly 50-pound weight loss
Members of Congress to keep receiving porn magazine