Kicking only works if the player is AFK for a certain amount of time after the votes are cast, it isn't instant..
just a food for thought here, if you are actively participating by guarding, maybe clue your team in my giving them status updates on your node.. an occasional ALL CLEAR...
If you are on a small server maybe you need to build your rep up a bit as an active participant... don't be the guy that is ALWAYS sitting in one spot doing nothing but "guarding" a node can you even make your medals just sitting at one node the whole time??