Delhomme, who has thrown 100 scoring passes for the Panthers, completed 20-of-29 passes for 294 yards.
Muhsin Muhammad caught eight throws for 147 yards and a touchdown, Steve Smith had six receptions for 96 yards and a score and Jonathan Stewart rushed 14 times for 52 yards and a touchdown for Carolina (3-1).
Three Jason Elam field goals provided Atlanta's points.
Matt Ryan was 21-of-41 passing for 158 yards for the Falcons (2-2). Roddy White had seven catches for 90 yards.