How fast does your fitness fall off?

Many years ago I was told from a Sports science graduate that you roughly lose fitness six times faster than you gain it. Not as in depth as previous answer, probably no were as near as accurate, but easier to remember and works for me…