Brady knows a thing or two about NFL punishment after he received a four-game suspension to start the season over Deflategate, in which the league claims the quarterback played a role in deliberately deflating footballs before the AFC Championship Game in 2015.
In his weekly radio interview with WEEI radio in Boston, Brady was asked about Brown, who was given a one-game suspension to start the season and was subsequently placed on the commissioner's exempt list last week after documents were released showing the kicker admitted to physically abusing his now ex-wife.
"Domestic violence is a horrible issue," Brady said Monday. "I have no respect for that. The NFL claims to take tough stances, this is their situation.
"I grew up with three sisters, I was very fortunate to learn from a loving father and a loving mother how to treat and respect women. I have a daughter of my own and domestic violence is a horrible issue. It's a tragedy when it happens. Any type of abuse or bullying of people who can't defend or fight for themselves, I have no respect for that."
Brady would not go as far as saying he has issues with how the NFL handled the Brown case.
"I think it is the league's issue," Brady told WEEI. "Obviously, there is a lot of controversy with that. I'm trying to stay out of all that. I will let them handle it. I think that is their responsibility. I certainly don't condone any part of domestic violence. I think it is a terrible, terrible thing. I think the league, they have to handle those types of things.
"I'm just going to stay in my lane. Like I said, it's up to them to decide whatever they want to do. I'm just going to try and stay out of any kind of my opinion. I certainly have opinions, I just don't really care to share them."
Brown was put on the exempt list Friday after new documents released last week by the King County (Wash.) Sheriff's Office showed he admitted to years of physical, verbal and emotional abuse against his then-wife Molly Brown.
NFL commissioner Roger Goodell's trip to London for Sunday's NFL game brought questions about the Brown case.
Goodell told the BBC that he understands "the public's misunderstanding of those things and how that can be difficult for them to understand how we get to those positions. But those are things that we have to do. I think it's a lot deeper and a lot more complicated than it appears but it gets a lot of focus."