Training fitness vs skill

The local riding is mostly banked turns with a couple short but hard climbs. Nothing super technical going up or down. I’m definitely interested in XC. There’s a weekly race Here I’ll be doing. I would like to be as fast as genetically possible. Currently I’m training about 8-10 hours a week spread over 6 days. Before I got my mtb I was doing sweet spot base mid volume and recovering/adapting very well.

Edit: I’ve never ridden a mountain bike before last week but I’ve ridden dirt bikes and bmx as a kid and typically pick up two wheeled activities relatively fast.