May sound weird but I usually treat off season as time to lose a few pounds (If need to lose some) as easier to cut down food when not training as much or at high intensities. Since end of Sept I’ve gone from 187lb / 85kg down to 168lb/76kg. I’m about 6ft2/185cm.
However was bit too heavy before (still skinnier than most my non cycling friends!) so that wasn’t really about a rise/fall from race weight.
However if you do want to lose some weight, I believe off season is the best time.