Potter hit a three-pointer with 1:21 left to break an 80-80 tie and the Tigers held the Hokies scoreless for the final 60 seconds.
Clemson (18-2, 4-2 ACC) has won two straight since suffering its only two losses of the season in back-to-back contests against Wake Forest and North Carolina.
Virginia Tech fell to 14-6 overall and 4-2 in league play.
North Carolina, Wake Forest, Duke, Clemson and Virginia Tech are all within a game of each other at the top of the ACC.
Virginia Tech owned a 63-48 lead with less than 17 minutes to play before the Tigers went on a 17-0 run.
Rivers finished with 29 points and Booker had 21 to go with 13 rebounds.
The Hokies were led by Malcolm Delaney with 37. Delaney hit 11-of-17 field goal attempts and 9-of-10 from the free throw line.