Spoilers
Hmm, I had the most trouble with Dagoth Ur, but that was before I followed the main quest line and thus wasn't able to use Sunder and Keening safely + I didn't know that's what they were for.
The thoughest opponent I've had was Gaenor the Bosmer with ebony equipment in Mournhold, dude is fast strong and though.
