Attorney John Sneddon told the Australian Broadcasting Corp. he is very concerned about the welfare of Marcus Lee and Matthew Joyce as well as their wives.
The women had to surrender their passports to secure bail for their husbands and the Lees have had to sell everything they own, he said.
"I've watched my clients deteriorate remarkably over the course of the four years that I've been involved in this case," Sneddon said.
The two men are accused of bribery in a property deal involving their former employer, the emir of Dubai.
They were arrested in January 2009 after the building boom in the United Arab Emirates went bust during the global financial crisis.
A court in Australia determined the bribery story was invented and the accuser has admitted that Marcus Lee did nothing wrong.