Regain fitness - how long does it take?

what if you do a week or 2 of endurance-only rides and test again?
almost 50 watts lost in 3 weeks doesn’t sound right…