In an appearance Sunday on CNN's "State of the Union," Baer said it is not enough for Obama to present a statement of unity at his public inauguration Monday.
"This has to be a statement of direction, of forward momentum, about where we are going to move and how he is going to move us there as president," he said.
Obama, though, should not try to gloss over the political divisions within the United States, Baer added.
"I think the president does need to address, in a forthright manner, the profound polarization in our society, a polarization that makes common purposes difficult, a polarization between Congress and the president that produces gridlock and polarization of opportunity in our country, where there's stalled mobility at the bottom of our country, durable problems about the opportunity of the nation, the promise of the nation, those would be very rich themes for a president to address," he said.
"If he writes a large, generous speech, he will actually gain leverage in the system, because he will put the system itself on a different plane than himself and the presidency," he said. "America is bigger than these small fights we have been having."
'How to Train Your Dragon 2' releases 5-minute clip
Moore to attend retreat in to avoid Kutcher's wedding