I had a big ol' post here on a Godot collision issue I've been running into but I figured it out as I was getting screenshots.
I'm finding that if a collision shape 3D is set to 'concave polygon shape 3D', it doesn't show up in RayCast3D hits(?) no matter what the collision layer or mask is.
@justdaveisfine I saw something about a similar problem with ConvexPolygonShape that was caused by the collision mesh being scaled.