Cave and Speleothem Formation Caves can form when slightly acidic water dissolves a soluble rock, such as limestone. Water that originates as rainfall can drip into a cave, losing dissolved carbon dioxide to the cave air. ...