"This is how I feel -- if you want to see the Pittsburgh Steelers, invite us when we don't win the Super Bowl. As far as I'm concerned, he would've invited Arizona if they had won," Harrison told WTAE-TV, Pittsburgh.
The Steelers are to visit the White House Thursday minus Harrison - who made Super Bowl history with a 100-yard interception return for a touchdown in the 2009 Superbowl.
The NFL's Defensive Player of the Year, Harrison also skipped the Steelers' White House visit after their Super Bowl victory in 2006, Harrison's agent Bill Parise said.
"It absolutely is not political. He just doesn't want to go," Parise told the Pittsburgh Post-Gazette in a story published Tuesday.
Megyn Kelly: Santa Claus and Jesus are both white men
Penelope Cruz named 2013's 'Best Body' by Fitness magazine