The Magic owns the next-to-worst record in the league and Milwaukee has the worst, a mark that fell to 8-38 with Friday's loss. The Bucks have dropped five in a row while Orlando ended a three-game losing streak.
Orlando grabbed a 15-point lead after one period and had a 24-point cushion heading into the final quarter.
Afflalo scored 21 points to pace the quick start. Tobias Harris added 18 for the Magic and Victor Oladipo had 15. Orlando shot 52 percent from the field.
Caron Butler scored 20 points to lead Milwaukee, which has won just once in its last 15 games.