[PVE-User] Disk performance test guidance...

[PVE-User] Disk performance test guidance...

[Marco Gaiarin]

In a set of servers (some brand new dell T440 with 64GB or RAM, 2 500M SSD
ZFS Raid 1, three 4TB HDD in ZFS raid3) we are catching some performance
issue, eg in some operation we catch 10/20 MB/s maximal performance, with
load that go sky high (load 40).


An example: a couple of identical servers, connected via single gigabit
connection.
I've setup on server B a NFS server on HDD ZFS pool, then a NFS type storage
(on both servers, they are clustered).

I've copied from my PC a PVE VM backup, roughly 500GB of data, via NFS to
server B: 80-90 MB/s, load 2-4.

I've restored the VM on server A, thus *reading* data fron NFS, and
restoring again on HDD ZFS pool on server A: 10-20 MB/s transfer rate, load
at 40.


This make no sense to me. As subject say, there's some 'Disk performance test
guidance' document, so i can test and find the bottleneck?


Thanks.

-- 
  Consolatevi! Sul sito http://www.sorryeverybody.com migliaia di americani
  chiedono scusa al mondo per la rielezione di Bush.	(da Cacao Elefante)

Re: [PVE-User] Disk performance test guidance...

[Sylvain Le Blanc]

ZFS RAIDZ Drive Requirements

   - RAID Z requires 3 drives or more
   - RAID Z2 requires 5 drives or more
   - RAID Z3 requires 8 drives or more

https://raidcalculators.com/zfs-raidz-capacity.php

Hope this help !

Le dim. 24 avr. 2022 14 h 40, Marco Gaiarin <gaio@lilliput.linux.it> a
écrit :

>
> In a set of servers (some brand new dell T440 with 64GB or RAM, 2 500M SSD
> ZFS Raid 1, three 4TB HDD in ZFS raid3) we are catching some performance
> issue, eg in some operation we catch 10/20 MB/s maximal performance, with
> load that go sky high (load 40).
>
>
> An example: a couple of identical servers, connected via single gigabit
> connection.
> I've setup on server B a NFS server on HDD ZFS pool, then a NFS type
> storage
> (on both servers, they are clustered).
>
> I've copied from my PC a PVE VM backup, roughly 500GB of data, via NFS to
> server B: 80-90 MB/s, load 2-4.
>
> I've restored the VM on server A, thus *reading* data fron NFS, and
> restoring again on HDD ZFS pool on server A: 10-20 MB/s transfer rate, load
> at 40.
>
>
> This make no sense to me. As subject say, there's some 'Disk performance
> test
> guidance' document, so i can test and find the bottleneck?
>
>
> Thanks.
>
> --
>   Consolatevi! Sul sito http://www.sorryeverybody.com migliaia di
> americani
>   chiedono scusa al mondo per la rielezione di Bush.    (da Cacao Elefante)
>
>
>
> _______________________________________________
> pve-user mailing list
> pve-user@lists.proxmox.com
> https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-user
>
>

Re: [PVE-User] Disk performance test guidance...

[Marco Gaiarin]

Mandi! Sylvain Le Blanc
  In chel di` si favelave...

> ZFS RAIDZ Drive Requirements

Sorry for not using the correct nomenclature, but i was not speaking about
'size' rather about 'speed'.

I meant 'RAID Z' for 'ZFS raid3', and clearly 'ZFS mirror' for 'ZFS Raid 1'.
Again, sorry.


The question in subject, remain. Thanks.

-- 
  Sono i figli di quest'Italia, quest'Italia antifascista
  se cerchi casa non c'e` problema, basta conoscere un socialista
							(L. Barabarossa)

Re: [PVE-User] Disk performance test guidance...

[nada]

hi Marco
you have NFS at server B so the speed must be better @B
but before disk performance test you may also test
traffic e.g. by iperf or iperf3
memory e.g. by memtest
all the best
Nada

On 2022-04-24 19:56, Marco Gaiarin wrote:
> In a set of servers (some brand new dell T440 with 64GB or RAM, 2 500M 
> SSD
> ZFS Raid 1, three 4TB HDD in ZFS raid3) we are catching some 
> performance
> issue, eg in some operation we catch 10/20 MB/s maximal performance, 
> with
> load that go sky high (load 40).
> 
> 
> An example: a couple of identical servers, connected via single gigabit
> connection.
> I've setup on server B a NFS server on HDD ZFS pool, then a NFS type 
> storage
> (on both servers, they are clustered).
> 
> I've copied from my PC a PVE VM backup, roughly 500GB of data, via NFS 
> to
> server B: 80-90 MB/s, load 2-4.
> 
> I've restored the VM on server A, thus *reading* data fron NFS, and
> restoring again on HDD ZFS pool on server A: 10-20 MB/s transfer rate, 
> load
> at 40.
> 
> 
> This make no sense to me. As subject say, there's some 'Disk 
> performance test
> guidance' document, so i can test and find the bottleneck?
> 
> 
> Thanks.

Re: [PVE-User] Disk performance test guidance...

[Marco Gaiarin]

Mandi! nada
  In chel di` si favelave...

> you have NFS at server B so the speed must be better @B
> but before disk performance test you may also test
> traffic e.g. by iperf or iperf3

Sure, i need also to test network, but fortunately i know decently
iperf, while i know little ZFS...

Thanks.