Yes, I wouldn’t take the Gralloch as an example, especially this year, where it was both a UCI Worlds qualifier, and British champs.
But to be honest, gravel races might not be the safest anyway, I think they attract a lot of people with little racing experience, who then go all out on surfaces they don’t have much experience with. If you want a friendly atmosphere, and safe-from-other-riders racing, try a local cross or MTB race.