To add Jormund to your party, you must clear him of Wrath's murder, even if all you can do is implicate Sharpe (who didn't do it). Jormund is a dwarf spellcaster, which means he must spend twice as much mana as other races when casting spells, and for that reason he isn't a very good follower.
