The building was begun in 1760 by Wills Hill, and became the residence of the governor of Northern Ireland. Today, it is use by State services. It occupies the western side of the square, behind a fine wrought iron gate erected in 1936 but designed in 1745 by the Thornberry brothers. To begin with, it was intended for Richill Castle in County Armagh.