A lot of it is subjective, really. Being cranky, tired, etc. A key to this is keeping the rest of your rides really easy, like bottom of zone 2, easy endurance pace or lower. If you do these blocks right, the mental fatigue is as much a factor as the physical, if not more. Being able to go truly max for that many days in a short period is hard.
I think the too hard hard start is probably limiting the overall effectiveness of the intervals. Done properly, you aren’t building power throughout and finishing strong. I think you’re leaving some work on the table, while creating some muscular fatigue that we’re generally trying to avoid with these.
As happens with some people, you’re overcomplicating these with the hard stuff followed by lower and steadier IMO. Take a look at the graph I shared above - that’s really what you’re looking for. You want to be going as hard as you reasonably can at basically any part of the interval, keeping in mind you’re doing this for 20 min. If at any point you’re really managing your power (except probably the hard start in many cases) while spinning like a crazy person, you’re leaving some on the table.
Spin fast, go repeatably all-out for the duration of each interval. Recover (up to 1:2 work:rest ratio). Go again. If you’re doing it right, the fish out of water breathing takes care of itself. I absolutely do not obsess over HR in real time as a standalone metric at any point during these blocks.
Actually this is a completely normal and expected response. There are numbers that I look at (and Kolie’s coaches do too) during these blocks that can help us determine from afar if progress is still happening or if you’re cooked. Kolie protects it on his podcast, and out of respect for him, I’ll just stick to my usual guns of, “I manage these blocks very closely with my athletes for a reason.” Kolie and his coaches do the same. (Disclosure is while I was coaching a couple years ago I hired Cory Lockwood from EC to coach me for my race season - coaches need coaches too!)
I talk face-to-face with all of my athletes before a block like this to go over interval execution. These can be tough to explain and get right, but once you get them, you “get” them and you know the difference. I also typically lead into these blocks with high cadence work such that it’s not such a shock to the system, especially for people used to riding at like 80rpm.
Don’t be afraid to fail an interval early in one of these blocks. It can help you learn what your sustainable/repeatable all out is, and then you can keep going back to that feeling over and over again and you’ll get a lot more out of it. I usually start people with something like a 3x6 just so they can f around and find out, then execute the 4x5 and 5x4 type sets more effectively.