Comment by dan-robertson

Two things that can have a big impact on SSH throughput are cipher choice and the hardcoded receive buffer size. These are described in the fork https://github.com/rapier1/hpn-ssh

Maybe that will be useful for thinking about workarounds or maybe you can just use hpn-ssh.