"I'd be happy to talk to him. I had not thought about talking to him about a head coach," Richardson said.
Richardson said he wanted to hire a coach who could build the Panthers into a team that could put together consecutive winning seasons, WCNC-TV in Charlotte, N.C., reported.
ESPN.com said the Panthers' strategy thus far has been to talk to a top NFL assistant about the job.
Harbaugh, one of the hotter college prospects for an NFL job, mentored Andrew Luck, the Stanford quarterback who is expected to be among the top selections in the draft. Carolina holds the No. 1 pick.
Richardson did not tip Carolina's hand as to whom the team would take in the draft.