Police were called to an attempted burglary at about 4 p.m. The suspect, later identified as 32-year-old Raymond Cuny, escaped to a neighboring house, where he took the boy hostage.
The rest of the family were able to escape, though the suspect held the boy in the home for six hours.
"We do have a very volatile, ongoing situation where a suspect has a two-year-old child and is holding him hostage," Rapid City Police Chief Karl Jegeris said Tuesday night.
As negotiations stalled, armed police were able to gain access to the home and apprehend the suspect.
No one was injured.
Baby rescued and safe. Suspect in custody. All officers and deputies are safe.— Karl Jegeris (@chiefjegeris) July 2, 2014
Notable deaths of 2014 [PHOTOS]