Courthouse Burned. Twenty-two Kentucky courthouses were burned during Civil War, nineteen in last fifteen months: twelve by Confederates, eight by guerrillas, two by Union accident. See map on the reverse side. March 21, 1864, Union troops fled courthouse here as CSA force came up. Overheated stove started fire, burning building. Guerrillas burned many county records December 4. Erected in 1963. For more information, see ExploreKYHistory: Courthouse Burned