The Knicks handed Miami its first home loss of the season, dominating the final two periods after the game had been deadlocked at the halftime.
Felton scored 30 points and was one of six New York players in double figures. Of the 91 shots New York took from the field, 45 were from beyond the arc. The Knicks made 18 of those 45.
The Knicks overcame a 31-point effort from LeBron James, who narrowly missed a triple-double with 11 rebounds and nine assists.
Miami had won its first eight games in its own building this season and the meeting with New York opened a six-game home stand that lasts through Dec. 18.
The only team left in the NBA with a perfect home record is New York, which is 7-0 at Madison Square Garden.