Martinez lined a 1-2 pitch into right field, scoring Rocco Baldelli, as the Devils extended their winning streak to four games.
Tampa Bay had not won four straight since last Sept. 29-Aug. 1. Cleveland has lost four in a row.
Riske (0-2) picked up the loss after relieving starter Cliff Lee. Travis Harper (1-0) pitched three scoreless innings in relief to earn the win.
Cleveland's Alex Escobar homered in the fourth to snap a 3-3 tie, but Toby Hall responded with a shot in the bottom of the inning to tie the score.