No one was arrested or injured in the Tuesday incident, which Hackman said began when the man approached him and his wife in a menacing manner, police told E! News.
Hackman said the man called his wife, Betsy, a derogatory name so he responded by smacking him. Police Sgt. Andrea Dobyns said the blow was "more like a slap than a punch."
Police got involved when the alleged victim contacted them and said he had been beaten up by Hackman. Dobyns said the man had no visible injuries.
Hackman was still in the area when he was contacted by officers.
"It looked like Mr. Hackman did this purely out of self-defense to protect himself and his wife," Dobyns said.