The former first-round draft pick, taken sixth overall in 2008, started only five games in his three seasons with the team, including two in 2010.
He failed to record a sack in 45 games career games, logging 42 total tackles.
The Jets also said they had terminated the contract of veteran tight end Ben Hartsock, who played in 16 games in each of the past two seasons.
The departures of Gholston and Hartsock came one day after the Jets also released linebacker Jason Taylor, defensive lineman Kris Jenkins and offensive lineman Damien Woody.
Video of Victoria’s Secret models trying to 'twerk' hits Instagram
Britney Spears debuts 'Perfume' video