Totally agree with this. It’s easy to decide what you’re doing isn’t working and stop, then before you know it 6 months have gone by and you’re new habit is to do nothing and it’s even harder to get involved in something more fulfilling. I’ve done major sport switches twice in my life and having something to fall into right away was huge. And you get to go from something where you’re experienced and progress is so hard to find into something where you’re a newbie again and you get to learn and progress super fast.
If you think you still love cycling to some degree, maybe take the off season to ride/train more casually. Commit to a regular group ride at least every other week with people you race with. Drop the hours maybe like 20% so you’re still on top of your fitness but it’s more manageable. Maybe mix it up and throw a run or lift in there for variety.
I’m in a fairly similar place minus the extreme race anxiety. I recently moved back home and am living with my parents for a bit. So there aren’t many great group rides here or teams based out of the far out suburbs. So I do 98% of my training solo except for the odd endurance ride I’ll do with my mom. Being in a new area I’m not on a team and though I know one or two people here they live in the city and I see them at maybe every third race. It’s definitely starting to wear on my motivation. I’m also a Cat 2 (the hardest category to be in IMO because you’re trying to get points toward Cat 1 but all your races are P123s and you just constantly get smacked by super fast Cat 1s and the occasional pro) and I’m 1 point away from my Cat 1. Hopefully I get that last point this year and then I’m looking forward to taking a half step back. Lift more again, throw some running into the mix, maybe begin a multiyear build to do an Ironman, still do some crits but maybe only like 5-7/yr and not 15+. More local, less travel. More group rides, less focused training. More social, less solo. Etc.