Chen, who had been free on bond while facing corruption charges, was ordered to return to his cell by a panel of three district court judges who approved a prosecutors' request, CNN reported.
The ruling came after Taiwan's high court indicated it wasn't happy with an earlier district court ruling granting bail to the ex-president and replaced the local Taipei judge in charge of Chen's case.
"We question the work of the Taipei district court," Chen's attorney told CNN. "Changing the judge is an interference with the justice system."
Chen has been indicted on several corruption charges, including embezzlement and accepting bribes. He is accused of embezzling about $18 million. Chen denies all the charges and says they are politically motivated.
A trial date hasn't been set in the case, the broadcaster said.
Celebrity Breakups and divorces of 2014 [PHOTOS]