Caves are naturally occurring underground spaces formed over long periods of time by the action of water. They can be formed in limestone, dolomite, and other rocks that are soluble. Caves often contain stalactites, stalagmites, and other geological formations that are formed as water drips through the cave ceiling and floor over thousands of years.