Knowshon Moreno added 90 yards and a touchdown rushing for the Bulldogs (4-1, 2-1 SEC), who rolled up 328 rushing yards and have won three straight since a 16-12 loss to South Carolina.
Matthew Stafford completed 13-of-21 passes for 144 yards with a touchdown in the victory.
BenJarvus Green-Ellis ran for 108 yards with a touchdown and Seth Adams passed for 228 yards with a TD for Ole Miss (1-4, 0-3), which has lost four in a row.
The Rebels took the opening kickoff of the second half and marched 84 yards in 18 plays to tie the score. Ellis' two-yard run made it a 17-17 game with 5:53 remaining in the third quarter, but Georgia scored the game's last 28 points -- 21 in the final period.