Sabathia (1-0) notched the victory in his third start of the season after overcoming a rocky start. The left-hander went 7 1/3 innings, allowing three runs on four hits while walking one and striking out seven.
Stewart delivered a two-run single during a big third inning that saw the Yankees score four times to erase a 3-1 deficit. The backup catcher also added an RBI single in the seventh.
Andruw Jones socked a solo homer for the Yanks, who evened their four-game set with the Twins at one apiece.
Minnesota's Francisco Liriano (0-2) was roughed up for five runs on seven hits and four walks over 2 1/3 innings.
Josh Willingham clouted his American League-leading fifth homer for the Twins.