Ellis also dished off 11 assists while Larry Sanders provided 17 points, 13 rebounds and six blocks for the Bucks.
Ersan Ilyasova supplied two-way contributions with 16 points and eight boards for Milwaukee.
The Magic's woes continued, meanwhile, as they lost Jameer Nelson to a forearm injury en route to their ninth straight defeat.
Nikola Vucevic led Orlando with 20 points, 12 rebounds and six assists, while Maurice Harkless notched a double-double of 19 points and 14 rebounds.
2014: The Year in Music [PHOTOS]