I seem to recall a similar problem myself. Unfortunately I'm not entirely sure how I got rid of it. I think it may be a curse. If you have a cleric or paladin try some of their spells and feats. I would imagine you have already tried resting. Maybe someone else can offer more help or you could do a search for removing curses. I know....thanks for nothing.
