Its Tuesday 10 p.m. time slot will be filled by the news program "48 Hours" for the next two weeks, then the drama series "Shark" will take over the spot.
Variety.com said CBS ordered "Stars" during the Writers Guild of America strike, which shut down production on most scripted television shows.
TV personality John O'Hurley was the show's host, while entertainer Debbie Reynolds, singer Brian McKnight and movie producer Gavin Polone served as judges.
The show challenged celebrities to compete in a tournament-structured format to determine who has the best unknown talent.
The lineup also included wrestler Ric Flair, boxing great Joe Frazier, Playboy Playmate Bridget Marquardt, singer Mya, actor Danny Bonaduce, musician Sheila E., boxer Roy Jones Jr., model Cindy Margolis and political pundit Ben Stein.