Courthouse Burned. Twenty-two Kentucky courthouses were burned during Civil War, nineteen in last fifteen months: twelve by Confederates, eight by guerrillas, two by Union accident. See map on reverse side. Dec. 24, 1864, a contingent of CSA Gen. Lyon's force, ordered to harass and delay pursuing Union troops, burned courthouse at Leitchfield. Records destroyed. Dedicated July 1963. For more information, see ExploreKYHistory: Courthouse Burned