Making modifications to plan shows new "Start" date on the UI?

I’ve experienced similar behaviour - adding and subsequently removing a “time-off” annotation was enough to trigger this: