"The present parish church, St Martin, is on the east side of the parish, in the populous village of Horseley Heath, two miles NE of Dudley. It is a plain brick building commenced in 1795, and finished in 1797. The ancient parish church, at Summer Hill, near Princes End, on the west side of the parish, was long a neglected ruin. Both it and the burial ground were too small for the increased wants of the parish, even in 1795, when the new church was commenced. The ancient tower is still standing, and attached to it is a small chapel of ease (St John), to the present parish church, erected in 1850.
The benefit is a perpetual curacy, in the patronage of the Executers of the late JS Hellier, Esq, and incumbency of the Rev William Ker, MA."
[From History, Gazetteer and Directory of Staffordshire, William White, Sheffield, 1851]