The incident allegedly happened Saturday night after the victim met the suspects -- all women in their 30s -- at a nightclub, the Toronto Star reported.
The victim left the club with the suspects because they offered him a ride home, police said.
However, the victim was taken to a parking lot and sexually assaulted by all four suspects.
After the attack, the victim was released and the women fled the scene.
Detective Constable Thomas Ueberholz with the Toronto Police Sex Crimes Unit told the National Post that although the majority of sexual assault victims his unit works with are female, some complaints are filed by males.
"Although the majority generally is females that are victims or complainants, it is not completely unusual for a male to be the victim of a sexual assault," he said.
Florida bear attack: Black bear mauls woman's face
Martin Bashir resigns from MSNBC over Sarah Palin comments