Only 44 of the Parliament's 200 members voted in support of Abushagur, while 125 voted against him and the rest abstained or didn't show up for the vote, The Washington Post reported.
It could take weeks for the national legislators to pick a successor.
Abushagur, who had been an engineering professor in the United States, got himself into trouble by first proposing a Cabinet that critics faulted for being heavy on political unknowns, the Post said. His next attempt at putting together an acceptable slate also failed.
Gal Gadot cast as Wonder Woman for 'Batman vs. Superman'
Texas principal bans speaking Spanish, stirs controversy