Fregosi suffered a stroke while on a Caribbean cruise with other MLB alumni. He was flown to a hospital in Miami but a decision was made to remove life support.
He died about 2:30 a.m. Friday "in peace and with no pain," his son, Jim Fregosi Jr., said.
Fregosi had been involved in professional baseball since signing as an amateur free agent by the Boston Red Sox in 1960 and last year worked as an advance scout for the Atlanta Braves.
He made his major league debut in September 1961 for the Los Angeles Angels at the age of 19. He played 11 seasons with the Angels and later played for the New York Mets, Texas Rangers and Pittsburgh Pirates, retiring in 1978.
Over 1,902 games, Fregosi hit .265 with 151 home runs and 706 runs batted in.
Fregosi was first chosen for the MLB All-Star Game in 1964 and then five consecutive seasons over 1966-70.
The Angels retired his jersey No. 11.
He managed the Angels from 1978-81 and also managed the Chicago White Sox (1986-88), Philadelphia Phillies (1991-96) and Toronto Blue Jays (1999-2000), building an overall record of 1,028-1,095. His 1993 Philadelphia team advanced to the World Series, losing in six games to Toronto.