"The recovery clearly remains incomplete," Bernanke told an audience at the American Economic Association's annual meeting in Philadelphia.
Chief among the unfinished business concerning Bernanke is the jobless rate which "still is elevated" at 7 percent, he said.
Also, he said participation in the labor market still is declining, partly because workers remain discouraged about job prospects.
As of December, 63 percent of Americans over the age of 16 participated in the job market, either by having a job or looking for one, CNN Money said. Before the recession, it was about 66 percent.
Bernanke also cautiously defended the success of his most controversial policy to try to pull the U.S. economy out of its malaise: quantitative easing. He kept the Fed's key interest rate near zero since December 2008, but when that wasn't enough, the Fed started a three-part bond-buying spree to try to lower longer-term interest rates as well.
Quantitative easing more than quadrupled the size of the Fed's assets to above $4 trillion. Skeptics, though question whether the policy really helped the job market and whether pumping that much money into the economy eventually would lead to rapid inflation, CNN Money said.
Addressing his critics Friday, Bernanke said research mostly supports his view that the program "helped promote the recovery."
In December, the Fed decided to wind down the program gradually.
Looking ahead, Bernanke said he thinks barriers to economic improvements are beginning to fall, CNN Money said.
"The combination of financial healing, greater balance in the housing market, less fiscal restraint, and, of course, continued monetary policy accommodation bodes well for U.S. economic growth in coming quarters," he said.
"Of course, if the experience of the past few years teaches us anything, it is that we should be cautious in our forecasts," Bernanke warned.
Bernanke's term ends Jan. 31. The U.S. Senate is expected to confirm his successor, Janet Yellen, Monday.
Swim Week Miami Beach 2014 [PHOTOS]