← Back to context

Comment by cptnntsoobv

9 hours ago

> IPtables couldn’t do more than 5Gbps of throughput (TCP!)

Is this for a single connection? IIRC, AWS has a 5gbps limit per connection, does it not? I am guessing since you were able to get to ~10 it must be a multi connection number.

No this was multiple connections - and we tried with both `iperf2` and `iperf3`, UDP and TCP traffic. UDP actually does much worse on `iptables` than TCP, and I'm not sure why just yet.

  • For UDP I'd look into GSO/GRO to get an upper bound on what pure kernel can do.

    With performance benchmarking, specially in networking there is no end to "oh, but did you think of that?!" :)

    • That's a great point. This was one of my iPerf3 runs at one point:

      `iperf3 -c 172.31.45.187 -p 5201 -P 128 -t 5 -b 512M -u -l 1448 --bidir | grep "\[SUM\]\[\(TX\|RX\)-C\].*receiver"`

      We're also looking at using packet generators to test raw packet throughput. There's a lot more bottlenecks we can cleanup I'm sure.