Ellis (21 points, 11 rebounds), Tharpe (20, eight assists) and Andrew Wiggins (20, five rebounds) comprised a potent attack for the Jayhawks (9-3), who won a third straight.
Joel Embiid contributed 14 points and 10 rebounds to help Kansas overcome a slow start and put the game away with an 11-2 run in the second half.
Toledo (12-1) was dealt its first loss of the season despite 15 points and five assists from Nathan Boothe.
Ray Liotta sues skin care company over use of likeness
Millions of Getty images now available for free via embed tool