Well i'm not a pole arm fan but if you increase your agility you will attack faster and have faster movement speed. My friend has a pole arm and his agility is around 55-70. Try boosting up your agility and most probably you will have no trouble attacking.
