Frazier stepped up to bat in the top of the third inning with the game tied 1-1 at the Rogers Centre in Toronto. He worked the count to 2-2 against Blue Jays righty Marco Estrada before ripping a sharp line drive to right field for a double.
Blue Jays second baseman Ryan Goins gloved a throw from the outfield after a fly ball by Jacoby Ellbury as Frazier stood on second base.
Frazier looked away from Goins until Goins whipped his arm in a throwing motion toward Estrada.
But Goins didn't release the ball. He slickly put it into his glove again. Frazier briefly stepped off of the base and Goins applied the tag to the bewildered third baseman for the final out of the inning.
"With the new rules, you keep the tag on for a long time sometimes," Goins told reporters after the game, according to MLB.com. "So I just joke around, keep it on there, knowing guys aren't going to come off. That time, I just arm faked and was going to sit there and watch him. Something in my head told me he was going to take his foot off the base. I put my glove on him, and that was it really."
Frazier went 1-for-2 with a walk in the 8-1 loss to Toronto.
"I thought I did and I didn't [have both feet on the base],'' Frazier told reporters, according to the New York Post. "It's a bonehead play by me to be honest with you. I have to have a better mindset about what is going on in the game. It's not a good play on my part. It could have changed the game. If I stay on the base we had [Aaron] Judge up and you never know what happens.''
The Yankees loss ended a three-game winning streak.