"He was extremely unwilling to go with the officers at first, and not at all interested in the pizza crusts or peppermints they offered," the post said.
The horse led officers "in a low-speed foot pursuit" for about two hours before they managed to capture it.
"He eventually allowed himself to be caught, and was happy to get pets and pose for selfies," police wrote.
The department jokingly posted a mugshot for the mini horse, which they dubbed Ginuwine in honor of the "Pony" singer. The mugshot said the horse was booked on charges of resisting arrest and disorderly conduct.
Police said they are now trying to find the animal's owner.