Adjacent to the church is a two-and-one-half-story brick house in the Greene manner. The five-bay house has end chimneys and a monitor which may originally have been screened by an ornamental parapet at the eaves. A mason who worked for John Holden Greene built the house on speculation and sold it to a mariner, who passed it on to his son-in-law partner. It ultimately became the repository for a collection of American antiques owned by the George W. Gardners, who left the house and its contents to Brown University. It now serves as a guest house for distinguished visitors to the campus.