I've experienced this issue in spades as well. It's not keeping me from playing, but it is enough of a nuisance to make me cringe a little bit when it happens. Most noticeable (as the OP stated) with Force Sweep, but I see it with Sundering Strike and other animations.
I've been curious if this same issue is what cause my knight to flourish his lightsaber a little more sometimes when I use Slash. I.e., he does the initial wrist twirl and then it's supposed to be "thwap!" but he adds in another wrist twirl. (I'm laughing at how that sounds coming out...too many wrist twirls, dammit! )
However, I also notice it with Riposte, but it's not the delayed animation so much as it is delayed damage. I stab the bad guy and then he doesn't take the damage until a good 1 or 2 seconds later.
Like I said, it's not going to keep me from playing, but I would be very thankful if it was fixed.