The Hawks trailed by as many as 14 points in the second half but used Millsap's accurate shooting to emerge with a win in their straight overtime contest.
Millsap also supplied 13 rebounds as Atlanta defeated its division rival for a 10th consecutive time.
Al Jefferson erupted for 24 points and 23 rebounds for the Bobcats.
NBC reportedly holds celebs hostage to Jimmy Fallon's show
Aaron Carter is still in love with Hilary Duff