Is muscle mass a limiter for lighter rider?

I certainly notice that pulling into the wind I cannot churn with the same power as some of my larger riding partners - and I am 179cm/5’9" and 64kg.