August Byron Kreis III, 59, was arrested after the victim's mother filed a report Feb. 3, the (Columbia) State newspaper reported Wednesday.
Her complaint said the offenses occurred between September and November.
Kreis is charged with second-degree criminal sexual conduct with a minor under 12 and disseminating pornography to a child 12 or younger.
No bond was set during a bond hearing Wednesday.
At one time a leader of an Aryan Nation faction, Kreis served six months in jail in 2011 for tax evasion.
NBC reportedly holds celebs hostage to Jimmy Fallon's show
Ray Liotta sues skin care company over use of likeness