In the place of an unfinished fortress, Peter II of Savoy, who took Yverdo in 1259, had this building built with its four round towers. Today, the castle houses a local museum with a section devoted to Johann Heinrich Pestalozzi (1746-1827). This eminent figure encouraged teaching of poor children and put his theories into practice, including in Yverdon.