Cincinnati squandered a four-run lead but tied it with two out in the ninth on a run-scoring single by Wilton Guerrero.
Lloyd (0-1) had saves in the first two games of the series but could not complete the hat trick. Jason Larue led off the 10th with a single for his third hit of the game, moved to second on a sacrifice by Reggie Taylor and took third on a grounder to the right side by Todd Walker.
Robinson ordered the lefthanded Lloyd to intentionally walk righthanded hitters Barry Larkin and Brady Clark to load the bases for the lefthanded-hitting Casey, a lifetime .311 batter.
Casey promptly lined Lloyd's first pitch to center field for a single.
Scott Sullivan (1-0) struck out two in a hitless 10th for the win.
The victory was dampened by an injury to Reds star center fielder Ken Griffey Jr., who hit his first home run of the season in the third inning and doubled in the seventh. But he left in the seventh after being caught in a rundown between third and home with a subluxed right knee cap and strained right patellar tendon.
Griffey had been bothered by the ailing knee throughout spring training and is not expected to make the trip to Pittsburgh for Cincinnati's upcoming series.