Not really, that hasn’t been an issue for me.
Another thing that comes to mind is the grippy fabric at the bottom of the pant legs: it works almost too well, so for hairy dudes like myself, putting them on can be a bit tricky. But they do stay put and I haven’t noticed any fraying yet.