Yeah, unfortunately you can't ditch shield; you have to use augments to get the other two up instead.
And if you want more Endurance, you can use the comm "B" mods, which cost give you 2 End for 1 Def/Abs+1 Mainstat, while keeping the ops enhancements.