Low Volume Build - Weekend Rides

I started with a MV plan and include a Saturday fast group ride, well I was missing my Sunday’s rides because the saturday ride was destroying me. I switched to a LV plan and can do the sunday ride but I have to adjust it to finish it. I feel like the Saturday ride really fatigued me for the end of the week but it helps build endurance, intensity and we do a fair amount of attacking on flats and hills. I won’t ever not do the Saturday ride just trying to find a way to include it. Me train so we can ride fast outside, right?