The site of the house was originally founded between 1115-1120, and had several owners until the priory (as it was known then) was dissolved in 1538 at about the same time as the monasteries.