All gauges need to let same air out of the tyre to measure the pressure. Are you saying that the air continues to leak when you have the gauge on the valve? That shouldn’t happen.
With these gauges it best to over-pump and then use the release button to get down to the pressure you want before quickly pulling the gauge off the valve.
Mike