mss mtu might fix problems when sending (almost) max ethernet size packets.
A 32 bytes ping isn't affected by mtu mss problems.
Maybe a WAN connection on a site is bad (or its uplink saturated), making all traffic slow
Over here, 2 DSL connections , VTI tunnels, 40 mS ping
Try tracerouting to partner public address, and see where delay comes from