The Angels had a seven-game winning streak snapped with Jerome Williams suffering through the tough second frame.
Daniel Descalso doubled home two runs in the second and scored on a single by Matt Carpenter before Jay delivered his fifth home run of the season.
The big inning made things easy for starter Shelby Miller (9-6), who lasted six innings while giving up two runs on five hits with six strikeouts.
Carpenter also doubled home a run in the fifth and hit a solo homer in the seventh as part of a 13-hit attack. The Cardinals had lost their previous two games.
Williams (5-4) gave up seven hits with four hits and four walks in just 1 2/3 innings.
LGBT community has 'bullied the American people': Bachmann
Handler slams Piers Morgan: 'You're a terrible interviewer'