Yes, drift is completely normal but if you work specifically on time to exhaustion, you can almost eliminate it, assuming weather, fueling, etc are not changing.
Here are 2 samples, with LTHR being 178bpm and for both drift below 1%
SS90/1x105 (cool spring day)
Z4/1x70 (cool autumn day)
