The Islamic Society of North America alleged that the author, who is scheduled to speak to the state's Joint Terrorism Task Force, misinterprets Islamic writings to fit his political agenda and should not be used by the FBI, the Indianapolis Star reported.
The author of such books as "The Politically Incorrect Guide to Islam," Spencer analyzes Islamic writings to help recognize potential underlying terrorist ideals, the report said.
The leader of the Muslim group, Louay Safi, said the FBI's use of Spencer would ultimately only cause a further rift between federal officials and the Muslim community.
"When they bring in someone like that, it makes it difficult even for us to explain to the Muslim community that (the FBI) is neutral and is not listening to extremists who really hate Muslims," he said.
The paper said that in response to the claim, Spencer denied being an "Islamaphobe" but criticized the group for its inaction towards Islamist terror.
Duggar sisters unveil Christian dating rules in new book
LGBT community has 'bullied the American people': Bachmann