The fight was quickly broken up by players and Cubs coaches, the Chicago Tribune reported.
The outburst happened after the Cubs had committed three errors in the first inning behind Silva against Milwaukee at the Brewers' spring training park in Maryvale, Ariz.
The newspaper said Silva refused to talk to the media before being driven away from the ballpark on a cart while Ramirez called the incident "a misunderstanding."
"(The errors were) the only thing that happened, so it was obvious he was kind of upset," Ramirez told the Tribune. "Nobody wants to make errors. Nobody feels worse than an infielder or an outfielder when they make errors. We talked about (it), and everything's cool."
"It was a brutal first inning," Cubs Manager Mike Quade said. "Plenty of blame to go around. Maybe it's what we freaking need -- maybe we need to get ticked off."
2014: The Year in Fashion [PHOTOS]
LeBron James reveals his new Nike shoes