If it ain’t broke, why fix it? 
As long as you’re doing well and progressing, enjoy yourself and those outside rides! If the fatigue adds up, you can still adjust it down or just replace your “self-guided” outside ride with an outside TR ride. My guess is by week 4-5 of SSB2 and in build you will feel it 