Karzai told a development conference the Taliban should only hold talks with the Afghan High Peace Council since the council represents all ethnicities, Khaama Press reported.
He said foreigners are trying to encourage his country to hold talks outside the high council frame but warned such talks will have no impact on the security situation.
Karzai's remarks came as Afghan government officials said peace talks with the Taliban would be held through the Taliban's liaison office in Qatar.
The president did not mention anything about the Taliban office in Qatar during his speech to the country's third national conference on water resources and development.
Since U.S.-backed talks broke down last year, Afghanistan's High Peace Council has tried to take a greater role.