Freeman, who overcame two interceptions, connected on 22 of his 32 pass attempts and ran for 35 yards, including a 1-yard touchdown in the second quarter that put the Bucs up 10-3.
LeGarrette Blount rushed for 81 yards on 24 carries and Mike Williams reeled in five passes for 43 yards as Tampa Bay (2-1) ended a five-game losing skid against the Falcons (1-2).
Atlanta's Matt Ryan lost a pair of fumbles and was picked off once, offsetting his 330 passing yards and a touchdown on 26-of-47 efficiency.
Roddy White hauled down nine passes for 140 yards while Julio Jones made six catches for 115 yards for Atlanta.
Costly malfunction causes beer flood at Boston-area brewery
Megyn Kelly: Santa Claus and Jesus are both white men