Alan Anderson struck for 18 points as the Raptors bounced back from Friday's overtime loss to the Los Angeles Lakers.
Kyle Lowry (15 points) and DeMar DeRozan (13) also reached double figures for the Raptors.
Cleveland got 21 points from Dion Waiters but still fell for the fourth time in five contests.
Kyrie Irving put in 12 points while Tristan Thompson added 11 and 10 rebounds for the Cavaliers.
Swim Week Miami Beach 2014 [PHOTOS]