The primary architectural interest of Grace Church is the original walls, of so-called Yorktown marl, cut slabs of shell deposits mixed with muck and clay from the nearby cliffs. It is the only known example of a colonial church built with this material. Originally rectangular in plan, the church later received a north wing. It was severely damaged during the Revolution (British General Cornwallis used it as a magazine). It burned in 1814, was not returned to service until 1848, and was again damaged during the Civil War. About the only remaining original features are the walls. The churchyard contains some early markers, including the Nelson family tombs. The churchyard wall dates from 1931.