It was the first of his residency shows at the arena, but the 65-year-old singer already had to pull out a spray to help soothe his voice an throat before a song, TMZ reported.
After using the spray he tells the audience, "I saw Madonna use this once."
"It didn't help her much," he continued after a beat.
The crowd cheered Joel's badmouthing of the "Like a Virgin" singer.
2014: The Year in Music [PHOTOS]