Cassel died Sunday in Los Angeles from complications of Alzheimer's disease, his son Matt confirmed to The Hollywood Reporter.
Variety also confirmed the film star's death.
Cassel received an Oscar nomination for his role as Chet in 1968's Faces, which Cassavetes directed. He appeared in other features from Cassavetes, including Shadows in an uncredited role, Too Late Blues, Minnie and Moskowitz, The Killing of a Chinese Bookie, Opening Night and Love Streams.
Anderson used Cassel in his films Rushmore, The Royal Tenenbaums and The Life Aquatic with Steve Zissou. Other film credits include Dick Tracy, Tin Men, The Last Tycoon, Honeymoon in Vegas, Convoy and Indecent Proposal, among others.
Cassel's television roles include appearances on Twelve O'Clock High, Combat!, The F.B.I., Batman and The Lloyd Bridges Show in an episode directed by Cassavetes.
Cassel is survived by his three children, Matt, Dilyn and Lisa, along with seven grandchildren and three great-grandchildren.
Read MoreNadja Regin, 'From Russia with Love,' 'Goldfinger' star, dead at 87 Musician Scott Walker dead at 76 'Love Island' alum Mike Thalassitis dead at 26
Notable deaths of 2019