On this site stood St Mary's Chapel designed by John Wood I (1704-1754) in 1734 and demolished 1875. The Chapel was erected for subscribers residing in this area and sited to close the western vista across the south side of the Square. Some Ionic capitals and a base can be seen nearby. One complete column stands near Cleveland Bridge.