From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from firstgate.proxmox.com (firstgate.proxmox.com [212.224.123.68]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits)) (No client certificate requested) by lists.proxmox.com (Postfix) with ESMTPS id 256489484 for ; Tue, 26 Apr 2022 08:42:40 +0200 (CEST) Received: from firstgate.proxmox.com (localhost [127.0.0.1]) by firstgate.proxmox.com (Proxmox) with ESMTP id 17962FC17 for ; Tue, 26 Apr 2022 08:42:40 +0200 (CEST) Received: from ip1-isp1-algemesi.verdnatura.es (ip1-isp1-algemesi.verdnatura.es [195.77.191.178]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits)) (No client certificate requested) by firstgate.proxmox.com (Proxmox) with ESMTPS id 758CFFBD4 for ; Tue, 26 Apr 2022 08:42:39 +0200 (CEST) Received: from webmail.verdnatura.es (swarm-worker3.static.verdnatura.es [10.0.2.70]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by ip1-isp1-algemesi.verdnatura.es (Postfix) with ESMTPSA id 5A7DAA00B8; Tue, 26 Apr 2022 08:36:37 +0200 (CEST) MIME-Version: 1.0 Date: Tue, 26 Apr 2022 08:36:37 +0200 From: nada To: Proxmox VE user list In-Reply-To: References: User-Agent: Roundcube Webmail/1.4.11 Message-ID: <7c154f7ca6db8be70a34468150cf7875@verdnatura.es> X-Sender: nada@verdnatura.es Content-Type: text/plain; charset=US-ASCII; format=flowed Content-Transfer-Encoding: 7bit X-SPAM-LEVEL: Spam detection results: 0 AWL -0.018 Adjusted score from AWL reputation of From: address BAYES_00 -1.9 Bayes spam probability is 0 to 1% KAM_DMARC_STATUS 0.01 Test Rule for DKIM or SPF Failure with Strict Alignment SPF_HELO_NONE 0.001 SPF: HELO does not publish an SPF Record SPF_PASS -0.001 SPF: sender matches SPF record Subject: Re: [PVE-User] Disk performance test guidance... X-BeenThere: pve-user@lists.proxmox.com X-Mailman-Version: 2.1.29 Precedence: list List-Id: Proxmox VE user list List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 26 Apr 2022 06:42:40 -0000 hi Marco you have NFS at server B so the speed must be better @B but before disk performance test you may also test traffic e.g. by iperf or iperf3 memory e.g. by memtest all the best Nada On 2022-04-24 19:56, Marco Gaiarin wrote: > In a set of servers (some brand new dell T440 with 64GB or RAM, 2 500M > SSD > ZFS Raid 1, three 4TB HDD in ZFS raid3) we are catching some > performance > issue, eg in some operation we catch 10/20 MB/s maximal performance, > with > load that go sky high (load 40). > > > An example: a couple of identical servers, connected via single gigabit > connection. > I've setup on server B a NFS server on HDD ZFS pool, then a NFS type > storage > (on both servers, they are clustered). > > I've copied from my PC a PVE VM backup, roughly 500GB of data, via NFS > to > server B: 80-90 MB/s, load 2-4. > > I've restored the VM on server A, thus *reading* data fron NFS, and > restoring again on HDD ZFS pool on server A: 10-20 MB/s transfer rate, > load > at 40. > > > This make no sense to me. As subject say, there's some 'Disk > performance test > guidance' document, so i can test and find the bottleneck? > > > Thanks.