August Byron Kreis III, 59, was arrested after the victim's mother filed a report Feb. 3, the (Columbia) State newspaper reported Wednesday.
Her complaint said the offenses occurred between September and November.
Kreis is charged with second-degree criminal sexual conduct with a minor under 12 and disseminating pornography to a child 12 or younger.
No bond was set during a bond hearing Wednesday.
At one time a leader of an Aryan Nation faction, Kreis served six months in jail in 2011 for tax evasion.
Celebrity Families of 2014 [PHOTOS]