The first time I saw O/Us on the plan, I was stressed about that training day. Then I rode it and thought, “Okay. I survived that. It wasn’t that painful.” So I plowed on through the others, even McAdie +1 in week 5. Then I got to SSB2 and saw Huffaker, took a deep breath and, an hour later, added VO2max to my list of things I could do. 
So I recommend doing them. Besides the physical benefit, the psychological benefit is worth it. You may want to do Reinstein instead of McAdie or Palisade for your first.
I am not a racer either, but higher FTP means higher endurance power zone means you finish that century instead of getting time cut.