Time away from VO2 max efforts

Assuming you have no issue recovering from them, and they don’t detract from your primary aim during that training session or period. If you’re focusing on building aerobic base, and VO2 intervals thrown in prevent you from finishing a future workout or from recovering well enough, then that’s counterproductive.