The ministry said the suspects were members of a banned organization, Tunisia Live reported.
During a raid on a shop, police seized a Kalashnikov rifle, ammunition, explosive material and equipment for making bombs, the ministry said.
Express FM said a police officer was wounded by gunfire during the raid, but the ministry statement did not mention any casualties.
The revolution that ousted former President Zine el-Abidine Ben Ali began in Sidi Bouzid in 2011 after a street vendor set himself on fire to protest a local official confiscating his wares.
2014: The Year in Fashion [PHOTOS]