It took me a while to make the association, but typically after a race is when this would occur. It happened at USAT Nationals in Milwaukee, and while waiting to get my bike out of transition mentioned it to a guy next to me. Turned out he was an ENT doc and he explained why this develops.
Lots of fluids always cures it.