Police said Andrew Bishop, 21, of Roseville, Minn., apparently climbed the outside of the Madison building early Sunday and entered by smashing a window, The Wisconsin State Journal, Madison, reported Wednesday.
Investigators said Bishop used a fire extinguisher to smash a second window.
The criminal complaint filed in Dane County Circuit Court said Bishop told police officers he did not know how he got inside the capital and appeared to be extremely drunk.
Police said Bishop apologized several times and told them he wanted to fly like an angel.
Bishop was charged with felony criminal damage and entry into a locked building. He was jailed in lieu of $10,000 bail.