The Trail Blazers led by as many as 21 points in the second quarter and limited the Raptors to 32 in the opening half. Toronto lost its seventh straight and has only four wins in 16 games this season.
Aldridge added 23 rebounds, five assists and two steals in the next-to-last outing of Portland's six-game road trip. The Trail Blazers are 2-3 on the trip with a stop remaining in Detroit.
Raymond Felton was the only other Portland player in double figures with 14.
James Johnson had 23 points for the Raptors and DeMar DeRozan had 22.