The San Antonio Express-News reported Brown wouldn't identify the players or whether they were starters.
"As has been reported, we had a couple of young men that broke team rules last night," Brown said at a news conference. "They have been suspended from the team, and they will be sent home and will not be available for the game."
No arrests had made and no charges filed, the Forth Worth Star-Telegram reported.
A police report stated a 21-year-old woman said she had been drinking with two players, one who is 20 years old and the other 21 years old, at a bar and invited them back to her room at the Holiday Inn Riverwalk in San Antonio early Friday, the Express-News said. She told police one man had intercourse with her while the other watched. The report said she had trouble remembering details and it didn't describe how the situation developed into sexual assault, the newspaper said.
A university spokesman said the school was gathering additional information.
Texas (8-4) plays Oregon State (9-3) Saturday night.