August Byron Kreis III, 59, was arrested after the victim's mother filed a report Feb. 3, the (Columbia) State newspaper reported Wednesday.
Her complaint said the offenses occurred between September and November.
Kreis is charged with second-degree criminal sexual conduct with a minor under 12 and disseminating pornography to a child 12 or younger.
No bond was set during a bond hearing Wednesday.
At one time a leader of an Aryan Nation faction, Kreis served six months in jail in 2011 for tax evasion.
Interpol investigating stolen passports on missing flight
Dennis Rodman pledges to end trips to North Korea