Ellis canned five of his 13 three-pointers in the final frame, during which he poured in 25 of his total points to help the the Bucks rally from 13-point deficit.
Ersan Ilyasova (20 points, 11 rebounds) and Brandon Jennings (15, 14 assists) each provided a double-double as Milwaukee halted a three-game losing streak.
The Magic got a combined 47 points from Arron Afflalo and Maurice Harkless but still fell for the fifth time in six games.
Nikola Vucevic supplied 20 points and 15 boards for Orlando.
Celebrity Breakups and divorces of 2014 [PHOTOS]