Ryan's comments came Thursday during a luncheon in Texas, Politico reported.
When asked whether he wanted to be speaker, Ryan, the House budget chairman, said he doesn't, because it would mean too much time away from his family.
"When Janna and I joined [Mitt Romney's presidential] ticket, we looked at what would this do to our family and we realized that actually we would see each other more in the vice presidency than as a member of the House," Ryan, R-Wis., said. "We would see each other less in the speakership than as a member of the House."
"I could've decided to go on the elected leadership route years ago," Ryan said. "I'm more of a policy person. I prefer spending my days on policy and my weekends at home with my family. My weekends consist of going to the YMCA for basketball and then one of their neighborhood parishes for basketball these days. I want to keep doing that. The speaker is expected to fly around the country on weekends as well, helping folks -- I'm not going to do that. I'm four days a week in D.C. and three days a week in Janesville -- it's a good mix, I like that mix."
Ryan said he is keeping his "options open" when it comes to a possible 2016 presidential bid.
"I feel like I have an important job to do as [a] leader in the House -- we're in the majority right now, I'm going to focus on that, then after this session," he will consider a run for the White House, he said.
Celebrity Families of 2014 [PHOTOS]