An Egyptian army patrol spotted two unlicensed vehicles parked between the church and a military building that is under construction while Egypt's minority Coptic Christian community celebrated Christmas Monday, the Egypt Independent reported.
Some masked men fled in one of the vehicles and soldiers seized the second vehicle and found two machine guns, a rocket-propelled grenade and about 50 rounds of ammunition, the report said.
There was no mention if any arrests had been made.
Egypt's Coptic Christians are celebrating their first Christmas under the country's newly elected Islamist president, Mohamed Morsi. The community also has a new pope, Tawadros II, elected in November to replace Pope Shenouda III, who died in March.
Coptic Christians observe Christmas on Jan.7.