Not sure I’d rate it as a concern but it seems like it’d be more cooling than necessary. I usually lower the fan speed in the winter depending on both temperature and the type of workout.
If you’re not dripping sweat you can lower the fan speed without losing that much in the way of heat transfer.