Jackson died June 25 at age 50. His death was declared a homicide after lethal levels of propofol were found in his system, and his personal physician is under investigation for his treatment of Jackson leading up to the singer's death.
Jackson reportedly will be interred in the cemetery's Great Mausoleum where the remains of Hollywood icons Clark Gable, Carole Lombard, Jean Harlow and Red Skelton are entombed. The building is not open to the general public.
Among the mourners Thursday were Jackson's children, parents, siblings, his film star friends Elizabeth Taylor and Macaulay Culkin, music mogul Quincy Jones and the Rev. Al Sharpton.
The service started more than an hour later than expected.
CNN said the Jackson family provided close-up footage of the arrivals to the service up until the moment when the recording artist's brothers carried in his casket.
The television news network said it was unclear whether the family would make additional footage of the service available.