Freeman, who overcame two interceptions, connected on 22 of his 32 pass attempts and ran for 35 yards, including a 1-yard touchdown in the second quarter that put the Bucs up 10-3.
LeGarrette Blount rushed for 81 yards on 24 carries and Mike Williams reeled in five passes for 43 yards as Tampa Bay (2-1) ended a five-game losing skid against the Falcons (1-2).
Atlanta's Matt Ryan lost a pair of fumbles and was picked off once, offsetting his 330 passing yards and a touchdown on 26-of-47 efficiency.
Roddy White hauled down nine passes for 140 yards while Julio Jones made six catches for 115 yards for Atlanta.
Texas principal bans speaking Spanish, stirs controversy
Gal Gadot cast as Wonder Woman for 'Batman vs. Superman'