A three-run double by Riggans highlighted a five-run third and Pena hit a three-run homer during a seven-run eighth.
The beneficiary of the 15-hit Tampa Bay attack was Andy Sonnanstine (1-0), who gave up six hits and four runs over six innings.
Tampa Bay roughed up Yankees' starter Ian Kennedy (0-1) for six runs on four hits and four walks in 2 1/3 innings. LaTroy Hawkins, the fifth of six New York pitchers, surrendered six runs on six hits in the eighth.
Hideki Matsui hit a solo homer for New York.
Five Tampa Bay players had two hits and seven starters had at least one RBI.