Indeed on faster links you're better off without QoS, and use offload to get max bandwidth combined with low CPU
On slower links, no offload and QoS is the best.
Question remains: at what speed do we need to switch between QoS without offload <-> Offload without QoS ?
100Mbit is sort of in between.
Try without QoS first, that's easiest to configure...