Officers shot the man, a 37-year-old San Jose resident, Sunday night, the San Jose (Calif.) Mercury News reported.
The woman's roomate had called police and said the woman was being attacked by her husband.
When officers arrived, they saw a woman fleeing the residence with a naked knife-wielding man in pursuit. The man refused orders to drop the weapon and was shot, police said.
He was taken to a trauma center where he was pronounced dead.
The officers involved in the shooting were placed on paid administrative leave per department policy, police officials said.