This house was the residence of the Duke of York (afterwards James II) occasionally during the Dutch War 1665 to 1672
58 High Street, Southwold
Google Streetview
OpenStreetMap
Colour: brown
Wikimedia:
Flickr: