The cruciform plan was reserved for the more important Anglican parishes. This building was originally the lower church of St. Stephen's parish. The exterior brickwork is a particularly fine Flemish bond with glazed headers. The pedimented doorways employ gauged and molded bricks. Abandoned during disestablishment, the church was taken over by a Baptist congregation in 1803. A fire in 1921 destroyed the interior. It has been rebuilt, although with alterations.