I got him ... he leaves the tavern at about 4:00 AM, long wait, but it made it easier. Followed him and just before he turns down that small alley to go to the upper level I confronted him. Took him down with fists, used the spell, relieved him of his walking cane, and went on my way.
It went pretty smooth.
