And you don't need to click the x-server LFG tool, you just do it the "old way", write on channel or whisper to your friends, guild, whatever you use actually.. I believe patient people like you will still use the old way and meet people from they're server, as I said, no need to use the automated tool.
In another mmo with this tool, i rarely used it , because i had lots of friends and guildies, we just joined up and we were good, but sometimes when i logged at "strange" hours and friends, guildies, where not online and server was with very low activity due to the late hours, i liked a lot having that x-server LFG, it was really really nice.
"The impatient people and greedy people" will use the tool, the patient and nice people will use the old way, and gather up together.
Don't see whats really the big problem here with this tool. Its like the end of the world for some ppl.