Comment by toast0
1 day ago
> Can you actually saturate the links with the spinning drives?
There can easily be a bottleneck depending on how the setup the sata/sas, but if you can get sustained sequential reads or writes, 16x drives at 6 Gbps sata should be able to saturate 2x 25 Gbps ethernet. The store link shows two expansion ports as well which should help get bandwidth to the point where 25 Gbps is useful.
Less likely with random reads/writes or mixed use.
I must have had a bottle neck somewhere.
How did you configure the array? If you did a single RAID-Z2 say then uncached reads are limited about what a single disk will do. Writes should saturate though.
https://arstechnica.com/gadgets/2020/05/zfs-versus-raid-eigh...
Yes I did use Raid-Z2 as I figured that was best for the 12 drives I had.
I will be honest that moving to a pure NVMe setup means I never have to read another long article about how to tweak my spinning disk setup for performance and all the tradeoffs to consider. It is honestly freeing, and just feels like discarding old baggage. I do recommend it.
1 reply →