On a hillside by the town, made of bricks and flanked by an enormous keep, the castle stands proud. Jeanne la Folle stayed here often and the sinister Cesar Borgia was imprisoned here for two years.