Broadway star Marissa Jaret Winokur was voted off the show with just one week to go in the season.
Winokur and partner Tony Dovolani danced a rumba and a tango on Monday's live show. The show's judges found the performance lacking.
"It's been incredible. No one expected us to get us this far," Winokur said.
"Through all the ups and downs of the competition, we were always a team," said Dovolani, who described Winokur's personality as "infectious."
Yamaguchi, an Olympic gold medal skater paired with professional dancer Mark Ballas, has been a favorite since the beginning of the season.
Two weeks ago, de la Fuente, a Chilean actor paired with professional dancer Cheryl Burke, suffered a ruptured tendon in his left arm during a samba. He danced the samba again Monday, earning a near-perfect score.
Taylor, paired with Edyta Sliwinska, was this season's NFL Man of the Year. He has played defensive end for the Miami Dolphins for more than a decade.
Next week the contestants will all dance to the same song and then dance a free-style routine.
Celebrity Families of 2014 [PHOTOS]