The late-13C church contains a painting at the high altar by Dorfmeister, one of the great masters of Baroque, who lived at Sopron. The beautiful chapter room has pointed vaults with ribs running right down to the bases of the columns. The church's name derives perhaps from the sculptures that may be seen in various places of a goat's head and a kid, or from a legend about a goatherd who found a treasure and then gave up part of it to build the church.