Houston Police Sgt. Steve Murdock said one resident of the house was arrested. He said residents were holding the men against their will and stealing their Social Security allotments, the Houston Chronicle reported Friday.
Murdock said three of the men were sleeping on a linoleum floor in the garage and a fourth was locked inside the house.
Adult Protective Services officials said police were questioning one of the men and the other three were receiving medical treatment.
"They were prisoners in that house," Murdock said.
He said it appeared the men were invalids who may also have been homeless or military veterans -- and other men may previously have been held at the house.
Monica Booker, who said his mother lives near the house, told the Chronicle a woman lived at the house with a son, a daughter and granddaughter.
Booker said the son of the woman who lives at the house has said he gets Social Security checks from people in exchange for rooms at the house.
Caroline Berg Eriksen: Soccer player's wife triggers debate with post-birth selfie
Man behind Doritos Locos Tacos passed away on Thanksgiving