Thomas Ivory (1709-1779) distinguished local architect built St Helen's House in 1752 and lived here from 1756 until he died. Other buildings attributed to him include the Octagon Chapel and the Assembly House.