From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from firstgate.proxmox.com (firstgate.proxmox.com [212.224.123.68]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by lists.proxmox.com (Postfix) with ESMTPS id 4E09A8208 for ; Sun, 24 Apr 2022 20:40:18 +0200 (CEST) Received: from firstgate.proxmox.com (localhost [127.0.0.1]) by firstgate.proxmox.com (Proxmox) with ESMTP id 703D5B35 for ; Sun, 24 Apr 2022 20:40:17 +0200 (CEST) Received: from picard.linux.it (picard.linux.it [IPv6:2001:1418:10:5::2]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by firstgate.proxmox.com (Proxmox) with ESMTPS id A95CFB2B for ; Sun, 24 Apr 2022 20:40:16 +0200 (CEST) Received: by picard.linux.it (Postfix, from userid 10) id 1007D3CA727; Sun, 24 Apr 2022 20:40:04 +0200 (CEST) Received: from news by eraldo.lilliput.linux.it with local (Exim 4.89) (envelope-from ) id 1nih5V-0008KY-UL for pve-user@lists.proxmox.com; Sun, 24 Apr 2022 20:36:01 +0200 From: Marco Gaiarin Date: Sun, 24 Apr 2022 19:56:35 +0200 Organization: Il gaio usa sempre TIN per le liste, fallo anche tu!!! Message-ID: X-Trace: eraldo.lilliput.linux.it 1650823854 31504 192.168.1.24 (24 Apr 2022 18:10:54 GMT) X-Mailer: tin/2.4.4-20191224 ("Millburn") (Linux/5.4.0-109-generic (x86_64)) X-Gateway-System: SmartGate 1.4.5 To: pve-user@lists.proxmox.com X-SPAM-LEVEL: Spam detection results: 0 AWL -0.531 Adjusted score from AWL reputation of From: address BAYES_05 -0.5 Bayes spam probability is 1 to 5% JMQ_SPF_NEUTRAL 0.5 SPF set to ?all KAM_DMARC_STATUS 0.01 Test Rule for DKIM or SPF Failure with Strict Alignment SPF_HELO_NONE 0.001 SPF: HELO does not publish an SPF Record SPF_PASS -0.001 SPF: sender matches SPF record Subject: [PVE-User] Disk performance test guidance... X-BeenThere: pve-user@lists.proxmox.com X-Mailman-Version: 2.1.29 Precedence: list List-Id: Proxmox VE user list List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 24 Apr 2022 18:40:18 -0000 In a set of servers (some brand new dell T440 with 64GB or RAM, 2 500M SSD ZFS Raid 1, three 4TB HDD in ZFS raid3) we are catching some performance issue, eg in some operation we catch 10/20 MB/s maximal performance, with load that go sky high (load 40). An example: a couple of identical servers, connected via single gigabit connection. I've setup on server B a NFS server on HDD ZFS pool, then a NFS type storage (on both servers, they are clustered). I've copied from my PC a PVE VM backup, roughly 500GB of data, via NFS to server B: 80-90 MB/s, load 2-4. I've restored the VM on server A, thus *reading* data fron NFS, and restoring again on HDD ZFS pool on server A: 10-20 MB/s transfer rate, load at 40. This make no sense to me. As subject say, there's some 'Disk performance test guidance' document, so i can test and find the bottleneck? Thanks. -- Consolatevi! Sul sito http://www.sorryeverybody.com migliaia di americani chiedono scusa al mondo per la rielezione di Bush. (da Cacao Elefante)