Built as the Cross Keys Inn, this three-story Federal-style building on the corner of the village green is constructed of brick laid in Flemish bond on a stone foundation. Original six-over-six windows survive only on the second floor; the Italianate bracketed cornice and door surround were introduced when the building was remodeled as a residence and physician's office by Priestley's great-grandson Dr. Joseph Priestley in 1864. His daughter, Frances Priestley Forsyth, and her sister-in-law, Mary Forsyth Herr, endowed the library as a memorial to their families in 1926.