Well, I was going to suggest Morton’s neuroma but I see you had that ruled out.
Still, have you seen a podiatrist? What you’re describing sounds a lot like a Morton’s neuroma. I only say that because that’s what I had about 4-5 years ago. It got so painful that I had to walk off the trail a couple of times rather than even ride back to my truck. It finally took surgery to fix it.