Historic Mt. Calvary Presbyterian Church's congregation was established in Clay, Jefferson County, around 1806 and is one of the oldest continually meeting congregations in the state. Its current home, this stone structure, was built in 1925 after the previous structure burned.