Ellis also dished off 11 assists while Larry Sanders provided 17 points, 13 rebounds and six blocks for the Bucks.
Ersan Ilyasova supplied two-way contributions with 16 points and eight boards for Milwaukee.
The Magic's woes continued, meanwhile, as they lost Jameer Nelson to a forearm injury en route to their ninth straight defeat.
Nikola Vucevic led Orlando with 20 points, 12 rebounds and six assists, while Maurice Harkless notched a double-double of 19 points and 14 rebounds.
Couple mistakenly served bag of cash at McDonald's drive-thru
Jordana Brewster on Paul Walker: 'He was an enormous presence in my life'