who would live in a castle