St Matthew's Church, the largest Anglican Church in the Albury Parish of the Diocese of Wangaratta, is situated in the heart of the city, in Kiewa Street next to the Post office. The cross atop the steeple, placed following the devastating fire of September 1991 represents the highest point in the central business district of the City of Albury.