The Belgian Malinois fell from a six-story deck next to The Ritz Carlton were Biden was speaking, CNN reported.
Federal agents rushed the dog to a nearby veterinary hospital, but veterinarians were unable to revive the dog, WWL-TV, of New Orleans, reported.
The dog and its handler were working security for Biden's visit to the city, WWL-TV said. Biden spoke at a fundraiser for the re-election campaign for U.S. Sen. Mary Landrieu.
CNN said the agency began its canine program in 1975 to detect explosives, and they use Belgian Malinois because they are small and are sociable.
The dogs retire after about 10 years.
Florida bear attack: Black bear mauls woman's face
Gal Gadot cast as Wonder Woman for 'Batman vs. Superman'