Some 6,000 guests were invited to the ceremony on the lawn of the governor's King's House mansion, the Jamaica Gleaner reported.
Miller is succeeding P.J. Patterson, who has been prime minister for 14 years.
Among those confirmed to attend the ceremony are Nation of Islam head Louis Farrakhan and 14 members of the U. S. Congress, led by Rep. Charles Rangle, D-N.Y.
Wednesday, British Prime Minister Tony Blair sent the retiring Patterson a bon voyage message, and thanked him for his "wisdom, courtesy and kindness" over the years, the Jamaica Observer said.
U.S. President George Bush also telephoned Patterson to wish him well, the newspaper said.