Ruhama Buni Cutie, wife of the Rev. Alberto Cutié, gave birth to the child, Camila Victoria, Tuesday, The Miami Herald reported.
"We … take this opportunity to thank our family, church community and friends for your love and support," Cutie, who is now rector of the Episcopal Church of the Resurrection, said in an e-mail announcement.
"There is great joy in being a father who is also a 'father.' We are truly blessed!" he said.
Cutie was defrocked by the Catholic Church after a tabloid photographer caught him kissing Buni on a beach last year.
The couple wed in a civil ceremony weeks later and Cutie joined the Episcopal Church.
They later had a religious ceremony at St. Bernard de Clairvaux Episcopal Church in North Miami Beach, also known as the Ancient Spanish Monastery.
Reindeer recovered after escaping from Santa during lighting ceremony
Wisconsin business offering 'therapeutic cuddling' forced to close