Police said members of the Fair Haven Rescue Squad witnessed the incident and reported it to police, who found the man driving the tractor in a nearby apartment complex. The suspect got off the tractor and fled into the nearby woods, police said.
The tractor continued moving after being abandoned by the suspect and drove over a lawn until it struck a tree and came to a stop.
Police said there was extensive damage to the credit union's building and deposit box.
Siliski was charged with felony counts of grand larceny, attempted grand larceny and a misdemeanor count of unlawful mischief. He was released and is due in court May 23.