Hehe, I also went berserk when that happend for the first time...
Senario:
When you deliver the lanthorn, the elf brings you too a forest...
Don´t move the entrance too the city is right next too you about two meters too the north....
It is a door in the tree...
Hope you understood....