Police said the confrontation in Hawke's Bay began when officers attempted to arrest the 22-year-old man Monday at his home for outstanding warrants, The (Wellington) Dominion Post reported. He allegedly became violent and, when the officers attempted to subdue him with pepper spray, tried to protect himself by grabbing his partner and the baby.
He jumped through a window but was subdued with a Taser and arrested before he got very far.
During a court appearance Tuesday, a judge ordered him held without bail until another hearing later this month. The judge also ruled his name will be withheld, at least temporarily.
He faces new charges of resisting arrest and escaping police custody as well as failing to respond to outstanding warrants. His lawyer, Amit Malik, said the man denies trying to use the baby as a shield.
The baby was treated at a hospital and released Monday night.
2014: The Year in Music [PHOTOS]