The original building was a three-bay, two-andone-half-story town house built as the residence of Philip and Elizabeth Lee Fendall. In the 1850s it received some additions and new Greek Revival trim. As indicated, the house has many associations with the Lees, and then, incongruously, with John L. Lewis, the labor leader, who occupied it 1937–1969.