The rescue took place Saturday evening in the Gulf Stream off the coast of Boca Raton, Fla., the South Florida Sun Sentinel reported.
The men, whose names have not been released, set out for a fishing trip eight days before hand and capsized at some point.
A passing freighter spotted the men laying on top of their capsized boat and called the Coast Guard.
"Timing was huge in this -- if the freighter hadn't seen them they would have been riding that Gulf Stream up to the north," said U.S. Coast Guard Pilot Jerod Glover.
Glover and his crew spotted the stranded men 30 miles off shore.
"They had nothing to hold onto; they were just laying flat and hoping they didn't slide off," Glover said.
Coast Guard rescue swimmer Kyle Stallings, who was lowered down from a helicopter to save the men, said: "They were really exposed and really deteriorating quickly."
After being rescued, the men were taken to a hospital where they were treated for dehydration and hypothermia.
U.S. Customs and Border Protection is now handling the case.
Puzzle-maker slips 'Murdoch Is Evil' into Rupert Murdoch's Sunday Telegraph
Sign language interpreter at Mandela service called out as fake on Twitter