Well, that's one possibility out of the window then...
According to the walkthrough (
http://www.gamebanshee.com/lionheart...montaillou.php) you should be able to talk to the 'Weird Woman' found in the Southeast of the Montaillou map and she should reveal the location of the Caverns.