The library is a one-and-one-half-story brick structure which originally served as a storehouse for tobacco awaiting shipment. Constructed for factor James Mills, the building sits on a full basement and has large openings at each end, which facilitated the handling of tobacco. The long wooden porch is a reconstruction undertaken by the APVA after it purchased the property in 1938. Since 1969 the warehouse has served as the local library.