Controversy has erupted over the events leading to Bergdahl's detention and whether or not he was a deserter.
"Until we get the facts, it's not in the interest of anyone, and certainly I think a bit unfair to Sgt. Bergdahl's family and to him to presume anything," Hagel said.
The defense secretary went on to those who have attacked Bergdahl's service record and the merit of his rank.
"It's not my place as a former sergeant in the United States Army, which I am very proud of, to decide who is worthy of being a sergeant and who isn't, and I think any further talk of that is irresponsible. ... Let's get the facts, but let's first focus on getting Sgt. Bergdahl well, getting his health back, getting him reunified with his family."
Bergdahl is being treated at the U.S. Landstuhl Regional Medical Center in Germany where doctors are paying close attention to his diet and nutritional intake.