Chase's departure is effective immediately and was done by mutual agreement with the NBC comedy's producers, the entertainment industry newspaper reported.
Chase, 69, is to appear in most of Season 4 of the series, which has already been taped and is to begin airing in February. However, it is unclear how Chase's departure will be handled within the show, The Hollywood Reporter said.
The former film star has been vocal about his unhappiness on the show.
2014: The Year in Music [PHOTOS]