Caves Beach Caves Beach Caves Beach is located on the Swansea peninsula between Lake Macquarie and the Pacific Ocean.