From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from firstgate.proxmox.com (firstgate.proxmox.com [212.224.123.68]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits)) (No client certificate requested) by lists.proxmox.com (Postfix) with ESMTPS id 093C171039 for ; Fri, 1 Oct 2021 09:18:54 +0200 (CEST) Received: from firstgate.proxmox.com (localhost [127.0.0.1]) by firstgate.proxmox.com (Proxmox) with ESMTP id EEC5628091 for ; Fri, 1 Oct 2021 09:18:53 +0200 (CEST) Received: from mail.ud08.udmedia.de (ud08.udmedia.de [194.117.254.48]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by firstgate.proxmox.com (Proxmox) with ESMTPS id C8CED28088 for ; Fri, 1 Oct 2021 09:18:52 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=simple; d=aeppelbroe.de; h=from:to :subject:message-id:date:content-type:mime-version :content-transfer-encoding; s=k1; bh=oTFvK3LPCMe9BS/jrlrJG7hkAs0 vmQewVROwaEbfGQU=; b=Fzvn6/DhivSRWIvsyLtwOjNVPozA31zoMzet7rVf36t vLW3sDd2ywc+72HVy+GSZWwgxPOpEs4Jj9P2L87DP58HxJ6hujW57wPildiY/asA YiiglBeLple0OH/Ir3RBO1okfWffmKxUYH+cKQtsSz0LA0frUdW62pAuZq8teRpA = Received: (qmail 3577816 invoked from network); 1 Oct 2021 09:18:52 +0200 Received: by mail.ud08.udmedia.de with ESMTPSA (TLS_AES_256_GCM_SHA384 encrypted, authenticated); 1 Oct 2021 09:18:52 +0200 X-UD-Smtp-Session: ud08?166p2@n2QZYEXN3upf3hNG Received: from localhost (localhost [127.0.0.1]) by baikonur.fritz.box (Postfix) with ESMTP id 3955BD27866 for ; Fri, 1 Oct 2021 09:18:52 +0200 (CEST) X-Virus-Scanned: Debian amavisd-new at baikonur.orbit.local Received: from baikonur.fritz.box ([127.0.0.1]) by localhost (baikonur.fritz.box [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id MxK1sQdSAKor for ; Fri, 1 Oct 2021 09:18:52 +0200 (CEST) Received: from baikonur (localhost [127.0.0.1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by baikonur.fritz.box (Postfix) with ESMTPS id EF68BD27865 for ; Fri, 1 Oct 2021 09:18:51 +0200 (CEST) User-Agent: EGroupware API 17.1.007 From: Gregor Burck X-Priority: 3 X-Mailer: EGroupware-Mail To: Proxmox VE user list Message-ID: <20211001091851.EGroupware.HVxe1rjAizNRB0o9XSoY2QH@heim.aeppelbroe.de> Date: Fri, 01 Oct 2021 09:18:51 +0200 Content-Type: text/plain; charset=utf-8; format=flowed; DelSp=Yes MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-SPAM-LEVEL: Spam detection results: 0 AWL 0.755 Adjusted score from AWL reputation of From: address BAYES_00 -1.9 Bayes spam probability is 0 to 1% DKIM_INVALID 0.1 DKIM or DK signature exists, but is not valid DKIM_SIGNED 0.1 Message has a DKIM or DK signature, not necessarily valid FORGED_SPF_HELO 1 - KAM_DMARC_STATUS 0.01 Test Rule for DKIM or SPF Failure with Strict Alignment KHOP_HELO_FCRDNS 0.399 Relay HELO differs from its IP's reverse DNS SPF_HELO_PASS -0.001 SPF: HELO matches SPF record SPF_NONE 0.001 SPF: sender does not publish an SPF Record Subject: Re: [PVE-User] proxmox-restore - performance issues X-BeenThere: pve-user@lists.proxmox.com X-Mailman-Version: 2.1.29 Precedence: list List-Id: Proxmox VE user list List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 01 Oct 2021 07:18:54 -0000 Hi, it is PVE and PBS on the same machine, I wrote it on my first mail ;-) an additional information: I made in the moment a new test aftar an reboot to exclude to much RAM iisues on the zfs cache. With 6 jobs the total io I see over iotop alter between 120MB/s and 240MB/s with peaks of 300 MB/s When I start htop I see work on all cores but no core is on 100% and the benchmark: root@ph-pbs:~# proxmox-backup-client benchmark --repository root@pam@localhost:BACKUPSTORE001 Password for "root@pam": ************ Uploaded 373 chunks in 5 seconds. Time per request: 13456 microseconds. TLS speed: 311.70 MB/s SHA256 speed: 418.54 MB/s Compression speed: 572.10 MB/s Decompress speed: 818.43 MB/s AES256/GCM speed: 1838.87 MB/s Verify speed: 298.19 MB/s ┌───────────────────────────────────┬────────────────────┐ │ Name │ Value │ ╞═══════════════════════════════════╪════════════════════╡ │ TLS (maximal backup upload speed) │ 311.70 MB/s (25%) │ ├───────────────────────────────────┼────────────────────┤ │ SHA256 checksum computation speed │ 418.54 MB/s (21%) │ ├───────────────────────────────────┼────────────────────┤ │ ZStd level 1 compression speed │ 572.10 MB/s (76%) │ ├───────────────────────────────────┼────────────────────┤ │ ZStd level 1 decompression speed │ 818.43 MB/s (68%) │ ├───────────────────────────────────┼────────────────────┤ │ Chunk verification speed │ 298.19 MB/s (39%) │ ├───────────────────────────────────┼────────────────────┤ │ AES256 GCM encryption speed │ 1838.87 MB/s (50%) │ └───────────────────────────────────┴────────────────────┘