The building was extended early in the 17th century, with three small rooms on the ground floor and two bed-chambers above. At this time the house belonged to Batholomew Hathaway, Anne's brother.