Laughing about Petty's remarks while talking to reporters Friday at the Kentucky Speedway, Patrick said, "I really don't care."
"There's going to be people who believe in you and people who don't. Plenty of people say bad things about me. I see it on Twitter. Some people want me to die. But at the end of the day, you get over that stuff and trust you're doing a good job for the people who believe in you."
Petty, a former NASCAR driver and the son of seven-time champion Richard Petty, said he doesn't think Patrick, who he called a "marketing machine," will ever be a race car driver.
"Danica has been the perfect example of somebody who can qualify better than what she runs," he said. "She can go fast, but she can't race. I think she's come a long way, but she's still not a race car driver."
"It's funny he said I can qualify and not race," Patrick responded. "Anyone who has watched what I do knows I'm crap in qualifying. In the races, things go much better."
Swim Week Miami Beach 2014 [PHOTOS]