This was undoubtedly one of the two original houses of the Phillips family