I’ve done some calculations for myself. At my average speed of 30 km/h roughly 2% of my power is frame, 2% is wheels, 2% is cockpit.
I’m not much faster on my Tarmac than on my Roubaix. Hence I go for the comfort.
But at 40 km/h all aero components add up quickly.
Here is a great article:
Aerodynamics vs. Weight: What’s the Tipping Point for Pro and Amateur Cyclists? - Bikerumor