I think this fight is seriously bugged because his "guards" just stood there watching us fight for 2 or 3 rounds before they decided to attack me while Jadus was healing himself. Seriously, those are some lazy guards. The mechanic is wonky and I finally managed to beat him (marksman lvl 32 with Kaliyo) after quite a few tries. Basically, if I stayed within melee range I could snipe him. Kaliyo would tank and I would crouch behind him.