"I just think everyone has to do it their own way," Dunham told the magazine. "When I was lesser known, I was like, 'Who could not share their opinion?'"
"Then I found out that when you talk about politics, people straight up tweet you the floor plan of your house and say they're coming to your house. You have to [expletive] watch it because people are nuts," she said.
Swift faced backlash in the fall for not addressing the election, with one fan asking, "@taylorswift13 who are you voting for? As a self proclaimed feminist, how have you not spoken up yet?" Dunham, meanwhile, openly campaigned for Hillary Clinton, but was roundly criticized after Clinton lost to Trump.
"It was painful when people were like, 'Hillary lost because Lena Dunham is such a bad example of liberalism,'" the star admitted. "But everyone's scared and upset, and they need someone to blame. It's easier to blame me than it is to, like, blame George Clooney for not giving enough speeches or whatever."
"If I'm gonna be the punching bag for that, I know where my heart is and I know why I felt like I needed to campaign for her. I know what those experiences on the road meant to me with other women, the connections that I made -- and I just have to hold on to that," she said.
Dunham previously defended Swift on The Howard Stern Show this month while discussing the singer's love life. She is best known as the creator and star of Girls, which premiered a sixth and final season last week on HBO.