Eventually you get swamped in magical Medium Shields anyway
.
As for reputation increases there are plenty in the game to avoid the Bjornin quest.
From what I remember the ogres that Bjornin want dead are between a couple of large hills in the top left corner of one of the maps. I'm not sure which one but it should be somewhere in the walthrough