Yishai alleged most African migrants are involved in criminal activity and said Israel is willing to pay to send them home, Haaretz reported Wednesday.
Yishai told Army Radio refugees could stay but asylum seekers must go.
"One cannot forsake the security of Israelis," he said.
The Foreign Ministry is looking at deporting 700 South Sudanese asylum seekers but said the government should look at each case to determine if their lives would be at risk if they were sent back to South Sudan.
Celebrity Families of 2014 [PHOTOS]