The displaced residents live in 271 official tent camps, without water or electricity.
"It's the worst place to be in Haiti," Gregoire Goodstein, mission chief for the International Organization for Migration, said. "We're talking about the higher hanging fruit; people who are unable to get out of the tent camp system because they really don't have any other solutions for themselves."
Goodstein said relocation efforts could be complete next year, but it depends on the hurricane season.
Slowdown could also occur due to the upcoming parliamentary elections, and the money needed for relocation is the biggest obstacles, NPR reported.
"It will take $800 per person to get them out of the camps," Harry Adam, the leader of the Haitian government agency that's in charge of reconstruction. "It's quite a big amount of money."