Whites Chocolate House in St. James, London Whites was popular with both aristocrats and wealthy city people who would gather daily, drinking chocolate, discussing politics and even gambling. It came to prominence during 1783 when William Pitt joined, turning it into a tory stronghold which survived well into the 19th century.