Smith hit a trio of 3-pointers and grabbed five rebounds for the Cardinals (17-4, 5-3 Big East), who avoided their first four-game skid since 2004.
Gorgui Dieng contributed 14 points with 12 rebounds and sank two game-clinching free throws to secure the victory.
Chane Behanan also reached double figures with 12 points for Louisville, which played without injured starting forward Wayne Blackshear.
The Panthers (17-5, 5-4) were led Tray Woodall with 14 points.
Millions of Getty images now available for free via embed tool
Ray Liotta sues skin care company over use of likeness