Comment by tucnak

10 hours ago

They said the same thing about 40G but hey, I've loved it for bridging the gap between my two (10G and 100G, respectively) Mikrotik switches. You can have a dozen Gigabit ports, as well as up to four true 10G devices on your aggregation switch, and neither would be bottlenecked by traffic to and from the backside. This has been a massive boon. However, when it comes to 2.5G, I struggle to find one good reason to use it; such a tiny step-up in bandwidth, and for what?

> However, when it comes to 2.5G, I struggle to find one good reason to use it; such a tiny step-up in bandwidth, and for what?

Portability and heat. You can get a small USB 2.5G adapter that produces negligible heat, but a Thunderbolt 10G adapter is large and produces a substantial amount of heat.

I use 10G at home, but the adapter I throw into my laptop bag is a tiny 2.5G adapter.

  • I’m sure it depends on the model, but in my experience if you force a 10G copper transceiver to 2.5G the insane heat generation goes away. I don’t have any Thunderbolt 10G adapters, but I’m kind of surprised they’re much larger. A SFP+ transceiver is the same size as a SFP one.

    • I think a major reason for the size is for heat dissipation, because it has to be prepared to handle the heat of a full 10G copper connection. Mine runs hot.

      1 reply →

1x PCIE 3.0 has 8 Gbps raw speed - for 2.5Gbps duplex Ethernet you'll need 6~7 Gbps of raw link to CPU.

For 5Gbps and higher, you'll need another PCIE line - and SOHO motherboards are usually already pretty tight on PCIE lanes.

10GbE will require 4x3.0 lanes

  • > 10GbE will require 4x3.0 lanes

    3.0 PCIE is irrelevant today when it comes to devices you want on 10G. I'm pretty sure the real reason is that 2.5G can comfortably run on cable you used for 1G[1], while 10G get silly hot or requires transceiver and user understanding of a hundred 2-3 letter acronyms.

    Combine it with IPS speeds lagging behind. 2.5G while feels odd to some, makes total sense on consumer market.

    [1]: at short distances, I had replaced one run with shielded cable to get 2.5G, but it had POE, so it might contribute to noise?)

  • PCIe is full duplex. And there's no requirement for ethernet ports to be able to do full tilt. Even with a 1x PCIe 3.0, a 10G port will be much much better than a 2.5G one.

    (But PCIe 3.0 of course is from 2010 and isn't too relevant today - 4.0, 5.0, 6.0 and 7.0 have 16/32/64/128 Gbps per lane respectively)

  • Are motherboards commonly using PCIe 3.0 for onboard peripherals these days? I wouldn’t expect it to save them much money, but my PCIe knowledge is constrained to the application layer - I know next to nothing about the PHY or associated costs.

40G on Mikrotik is just channel bonding of 4 10G links at layer 2. It’s not like the vast majority of 100G that does layer 1 bonding. I really don’t know why they did it other than to have a bigger number on the spec sheet - I can’t imagine they save any money having a weird MAC setup almost nobody else uses on a few low-volume models.