The Detroit News reported Wednesday that the Rev. David Murray lost custody of his children March 20 after an investigation by state Children's Protective Services.
The newspaper said state authorities are seeking to take custody of two of Murray's other children, who are not currently living with him.
Murray's wife, Tanisha Murray, filed abuse and neglect complaints with the state Feb. 28.
"The house we were in was not fit for no children to stay in," Tanisha Murray told the newspaper. "The house was deplorable, it was dirty, there's a hole in the ceiling in the living room, there's broken windows, there's a hole in the basement ceiling from water leaking in the kitchen."
David Murray is the pastor of First Holy Temple Church of God in Christ and a licensed social worker, the newspaper said.
"A couple of the children are emotionally impaired and I don't want to embarrass them. I can't discuss anything pertaining to the children," he said.