The Yeoman guards live here with their families, but these houses have also been occupied by many members of nobility in the past.