You should also consider what type of riding you have around your area. Is there good single track that you can ride through most of the year? Are there great gravel roads to ride?
I’m biased towards an XC bike as I long riding single track. It’s great to get away from cars and traffic and relax with a long ride on the trails. I also like the interval aspect of XC mountain biking that contrasts nicely with my long road rides.
Do you have any interest in long endurance mountain bike events in the future like Leadville? Perhaps another argument for an XC bike.