I’ve discussed my approach on some other threads but for what it’s worth, after a lot of experience, I can share some pretty concrete data:
I got pretty far using Redshift’s aero setup on a 2013 entry level carbon road bike. Seconds to take on an off using Redshift’s novel quick release connector and adjustable seat. I had Di2 as well, so I inserted a junction B under my stem between hoods and could connect for aerobar end shifting as well. This added another 10 seconds to the road/TT swap. As I got into it more, I started moving to longer, and more negative stems - which got progressively faster. With 65 mm wheels, no bottles/cages on frame, BTA hydration, tight 2-piece jersey/bibs, GP5000TL 25mm, and a TT helmet - My best result with this road setup was 58:56 for a 40k flat TT at 260W. I was still riding this as a road bike regularly, and probably had better core fitness to handle the long/low stem.
I then got a “real” 2016 TT bike (P3) - the day I got it, and replicated my position I had pushed to on the road bike, I saw no obvious gain in speed on usual loops - within 0.2 mph either way. Then, I swapped in a TriRig front end that both let me go even longer/lower, and more importantly, allowed lots of easy tuning to do field testing to make subtle tweaks working on improving CdA. I also got a skinsuit, and cover for the same rear 65 mm wheel. With all of this… My best result with this TT setup was 56:58 for a 40k flat TT at 268W. Not the same course, but both courses were loop/out&back with no net wind bias, similar temperatures, maybe a tad more traffic drag assistance on the course with the TT bike.
Net - a 0.9 mph advantage for total combination of a TT bike + 8W + rear disc cover + skin suit + further position tuning over a pretty well-optimized 10 year old non-aero road bike with clip-ons.
How much of that do you think was really attributable to the TT bike frame itself?
And I’m sure I could adapt my road bike even more closely to what I’ve learned as an optimal TT position. Similarly, at our weekly local 10 mile TT series or strava segments - continued incremental gains, but nothing like the huge gains the first time I hit some of these with my dialed-in road bike/aerobar combo vs. prior PRs.
All that being said, I do really like my TT bike and I still have more opportunity to keep pushing the position on it while also returning my road bike to a more conventional position now, so I don’t regret it at all. But unless money is no object, I highly highly recommend the redshift kit and a couple inexpensive UNO stems off e-Bay as a gateway to see if you like TT’ing first.