Sorry, I misread and thought that was just RDP. It sounds like the RTCP is going missing and without reading carefully I jumped to a quick silly conclusion.
Hopefully the timeout above resolves the problem, it certainly would make sense as nothing is obviously wrong. Translations dropping out of state tables is too common.