Any downside to an 11-34?

Do you need to change the chain when you swap the cassettes? Either swapping them around depending on the day, or even keeping the 28 on my training wheel