No advise from me, just wanted to say I had a similar response. One-off efforts and rides were great but overall recovery seemed to be impacted and I felt more fatigued after the shots. I got Pfizer shots in mid-March and early April. I felt bullet-proof coming out of a base phase when I got the first shot and was able to mostly execute key workouts during the following build but had cut back other rides and overall did not feel great. Repeatability and recovery felt the most impacted.
Personally, I started another base phase 1 month ago and think the lower intensities have been beneficial. I feel like recovery is moving in the right direction finally and am moving towards that bullet-proof feeling I had back in March.