I found myself having the same problem. I was 4-5 levels above the NPCs but was still getting my butt handed to me. I started looking at their endurance and and that's when I found out. If they have much higher Endurance that makes it very difficult to beat them, so every mod I have used since then has increased my endurance.