Gustavsson made 25 saves as the Leafs registered just their second win in six contests.
Michael Lombardi netted a pair of goals and Phil Kessel added a marker in Toronto's victory.
Evgeni Nabokov absorbed the defeat for the Islanders, yielding three goals on 35 shots.
New York had a three-game winning streak snapped.
McPhee, Cokas 'working on their marriage' after affair
LGBT community has 'bullied the American people': Bachmann