You would not be transferring your legacy. Only your character. The legacy is not tied to your characters at all, although they are tied to it.
Even if you were to delete all your characters on a server, assuming you had unlocked the legacy, it would still exist. People found that out when they tried to "reset" their legacy name on a server by deleting all their characters. Too late.