In the late 19th century the site was used for Army barracks, but this ceased when some of the blocks were destroyed by fire in 1936.
The site was again put to military use in World War I when a coastal battery command post was established on the headland and in World War II when a coastal defence battery was sited here.
The site was vacated by the Ministry of Defence in 1960, at which time they demolished most of the remaining 19th/ 20th century buildings on the site. In 1980 a new coastguard station was opened with in the ruins of the old Priory. However, this was short lived and it was closed again in 2001.
The site is now managed by English Heritage as a historical site.