It’s very interesting, and a little odd, having symptoms in just your middle finger. Usually folks notice pain with OA diagnosis of their thumbs or index finger more. Disclaimer, I’m a PT, but maybe look into seeing a certified hand therapist (either physical therapist or occupational therapist). Other than that, arthritic joints, especially small ones, tend to respond well to heat.