Police say he then tackled the man, threw another man into a wall and wrestled with a police sergeant before being subdued with a stun gun and arrested, The (Madison, Wis.) Capital Times reported.
Brandin Hochstrasser, 31, better known as "Bongo Jesus," was charged with battery, battery to a police officer, resisting arrest and disorderly conduct.
"The dispute started over some questionable guitar playing," police spokesman Joel DeSpain said.
A 54-year-old homeless man apparently had an opinion of Hochstrasser's musical ability.
"He went over to 'Bongo Jesus' and provided some sort of critique which did not sit well," DeSpain told the newspaper.
An argument ensued and then the disagreement escalated, he said.
After he was subdued and arrested, Hochstrasser reportedly continued to yell expletives at officers and passersby.
"At one point, he said the victim who commented about his guitar playing had been his friend," DeSpain said, "His friend up until the time he made the comment about the guitar playing."