You can beat him as early as level 30, I went when I was 29 but he was red still and I couldn't interrupt his cast. After 30 though you should be able to no problem.
I agree, I'm new to MMO's and liked the idea of world pvp but also had similar concerns to "over ganking" after some research I settled on a RP-PVP server.