Courthouse Burned. Twenty-two Kentucky courthouses were burned during Civil War, nineteen in last fifteen months: twelve by Confederates, eight by guerrillas, two by Union accident. See map on reverse side. The courthouse at Albany was burned by guerrillas late in 1864 and all county records destroyed. Erected in 1963. For more information, see ExploreKYHistory: Courthouse Burned