In an interview on ABC's "This Week," which aired Sunday, Bush commented on a remark he made to a journalist asking about gay marriage and its capability with Christian values while he was in Zambia on a tour of Africa.
"I shouldn't be taking a speck out of somebody else's eye when I have a log in my own," Bush told the journalist.
Bush told "This Week's" Jonathan Karl that to comment on the topic would either criticize President Barack Obama or his own party, and he didn't want to do either.
"I meant that I'm not going to answer the question then and I'm not going to answer it now. ... I just don't want to weigh back in the debate. I'm out of politics," he said. "But I meant it's very important for people not to be overly critical of someone else until you've examined your own heart."
He said unless it's an issue he strongly believes in, he's "off the stage."
Beyonce flaunts bikini body, Blue Ivy in vacation pics
Gal Gadot cast as Wonder Woman for 'Batman vs. Superman'