It’s Pedaling Fork 
The closest you lodge to Santa Monica/Malibu area, the best riding you’ll have access to.
Climbs like Decker Rd, Latigo Cayon, Piuma Rd, Fernwood are amazing!
Downhill Tuna Rd is a roller coaster, all these are road rides, but gravel riding in those same mountains is also an option.
These routes from Rapha Club House are a good starting point: Los Angeles | Rapha - some of them take you to East LA but the drive is worth it and traffic hasn’t been that bad lately.
This list from Strava top Los Angeles rides is very useful too: Strava