The two scores in regulation were delivered during a span of 1:32 of the third period. Logan Couture put a slap shot past Gustavsson 4:49 into the third and Patrick Eaves quickly tied it with his first goal of the season.
Gustavsson made 24 saves in his first start of the year He had twice come on in relief during the campaign after appearing in 42 games for Toronto last season.
Antti Niemi took the loss while stopping 30 shots.
Handler slams Piers Morgan: 'You're a terrible interviewer'
Beautician charged with giving client fatal silicone butt injection