From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from firstgate.proxmox.com (firstgate.proxmox.com [212.224.123.68]) by lore.proxmox.com (Postfix) with ESMTPS id 589F41FF183 for ; Wed, 16 Jul 2025 13:50:59 +0200 (CEST) Received: from firstgate.proxmox.com (localhost [127.0.0.1]) by firstgate.proxmox.com (Proxmox) with ESMTP id E9D8EDF01; Wed, 16 Jul 2025 13:52:02 +0200 (CEST) To: Proxmox VE development discussion Date: Wed, 16 Jul 2025 13:51:21 +0200 In-Reply-To: <175260709111.2310514.11288961991494643201.b4-ty@proxmox.com> References: <20250714083439.1240349-1-d.csapak@proxmox.com> <20250714083439.1240349-2-d.csapak@proxmox.com> <175260709111.2310514.11288961991494643201.b4-ty@proxmox.com> MIME-Version: 1.0 Message-ID: List-Id: Proxmox VE development discussion List-Post: From: Adam Kalisz via pve-devel Precedence: list Cc: Adam Kalisz , pbs-devel@lists.proxmox.com X-Mailman-Version: 2.1.29 X-BeenThere: pve-devel@lists.proxmox.com List-Subscribe: , List-Unsubscribe: , List-Archive: Reply-To: Proxmox VE development discussion List-Help: Subject: Re: [pve-devel] applied: [PATCH proxmox-backup-qemu 1/1] restore: make chunk loading more parallel Content-Type: multipart/mixed; boundary="===============4886324150704087106==" Errors-To: pve-devel-bounces@lists.proxmox.com Sender: "pve-devel" --===============4886324150704087106== Content-Type: message/rfc822 Content-Disposition: inline Return-Path: X-Original-To: pve-devel@lists.proxmox.com Delivered-To: pve-devel@lists.proxmox.com Received: from firstgate.proxmox.com (firstgate.proxmox.com [212.224.123.68]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits)) (No client certificate requested) by lists.proxmox.com (Postfix) with ESMTPS id 6C23BC8402 for ; Wed, 16 Jul 2025 13:52:01 +0200 (CEST) Received: from firstgate.proxmox.com (localhost [127.0.0.1]) by firstgate.proxmox.com (Proxmox) with ESMTP id 35BE9DE87 for ; Wed, 16 Jul 2025 13:51:31 +0200 (CEST) Received: from mail-ed1-x531.google.com (mail-ed1-x531.google.com [IPv6:2a00:1450:4864:20::531]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by firstgate.proxmox.com (Proxmox) with ESMTPS for ; Wed, 16 Jul 2025 13:51:28 +0200 (CEST) Received: by mail-ed1-x531.google.com with SMTP id 4fb4d7f45d1cf-605b9488c28so11804714a12.2 for ; Wed, 16 Jul 2025 04:51:28 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=notnullmakers.com; s=google; t=1752666682; x=1753271482; darn=lists.proxmox.com; h=mime-version:user-agent:content-transfer-encoding:references :in-reply-to:date:cc:to:from:subject:message-id:from:to:cc:subject :date:message-id:reply-to; bh=xTcTgKv0LpDUIBpZPiaZ/hXntFEqQeH45S3Ts+CS7X8=; b=IKgc/p/lbNLfy9us1EXRIS+OuofZIBC5xpFBDRFnoGFrJlre1hZ5a8JU53HRQDpDbU 0znS1gIpEd/939sFqaY83zoSDcpgF0tDbVXHHthdFePy2C4RJOX+r/s/zlqZh79bRmhB ssPWQpXtZD0Tc2H9Rzh6/7+GkJvKCkTcHJAgG+YPCvVs9S+rQCWTroz/zDX7TnZWoQgi 3xzVbMJ9ipkEd2CaqqAFCzh0K1GD0utI5+V5yABNH2Y3jIKKhiki+DIA+W9NtVnWwhaN u/YC6700iUed6mg6G+lCCZ8p2/VLdWmmGfCREe4+huy7MxMfHNtCmtfjoOqDb6JVTOYK MnDw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1752666682; x=1753271482; h=mime-version:user-agent:content-transfer-encoding:references :in-reply-to:date:cc:to:from:subject:message-id:x-gm-message-state :from:to:cc:subject:date:message-id:reply-to; bh=xTcTgKv0LpDUIBpZPiaZ/hXntFEqQeH45S3Ts+CS7X8=; b=ScGbXTu5gqv8xCPUriIM6anjDJq7SC1uD9WmaauEwLejSgbqkxiMjOCnTVgKJaAUkt r8hgWFmnc6Z5PZnXSI5tLb7X2HIij4LYHDTBqIG+vH6V/t9QrfEYfvtKlvT5LisuV8IU RztrNFVSskD9sGnVWxTJQ/JxrHghU/hTXLBEheUNuwKP7rknj/tZ7VMl9tSA8oDCRbMd DgL76xiQk9SSJjKIZhZXqH3WXwyYuQ7sYyBvuXDTWCYfgwb35K7L12dophScSweMiodw K0lo3uyFVwndxuj2uADZironlRhLzG+ET46dGDGIxuk5bbtILUeLMPcwlvxlQmRbH02K l7HA== X-Gm-Message-State: AOJu0Yxgl3cxhIVjkTqcaMREXm/8F0FfRMOS/EbNWSMbJ060pe1ioICF icjUiNEFiEKcOgTBut+grf11Q1V5PhBq3Iy9e4BxUd9VVFepiRzAIsdGJYeY3TcWuWUmnuY/AXq pXyvp X-Gm-Gg: ASbGncuOJ44in3QKtf7nPKDDhFQ1MWyedoDh5PKndBpiIVZXNNdgI3xvB/tsiOKdb+6 I5/bAO867WyEDnJgLZuAI+JzOdPFR6+vv2TBxm6xpdy5PSeViWoYRzdgwEELEQ6CUcG9NQIFtiL qRaMMoEVwiV01zvRaniRhG+208LA66bV6vcM6/uNFlTX0WqX23U9IxipgmaxFIEvgZ/sNUWcHgP lvyhL9EG6WIqRFEWJBUezCaZyTvEb8ZyFML56u+qWZLy9jBLER5R2tv8jpvcE1s/jaEEhB58c4T 830QWrqhbcNUDzs7LJDyr6ovU8DRfz101YGfGPzrZVNbQvRF21oomguNVW0+b7sSxuMAsO1bQLw CM+vHR11E4rK2Lrii9T+t6LFvmIXyu8iLl4A1lr1/sPatbw== X-Google-Smtp-Source: AGHT+IHeYHNmCZfmzjmIwKbuprDp7iMfzjX6mOxrdCFW54V7j9fTnbfHL2oxZtne818cvz0c9sBn8g== X-Received: by 2002:a17:907:d508:b0:add:ed3a:e792 with SMTP id a640c23a62f3a-ae9ce11c674mr224402066b.47.1752666682074; Wed, 16 Jul 2025 04:51:22 -0700 (PDT) Received: from ?IPv6:2a02:8308:299:4600::9185? ([2a02:8308:299:4600::9185]) by smtp.gmail.com with ESMTPSA id a640c23a62f3a-ae6e7e91caasm1183270366b.9.2025.07.16.04.51.21 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 16 Jul 2025 04:51:21 -0700 (PDT) Message-ID: <0fb686395742d507041329058c1b59134701bde2.camel@notnullmakers.com> Subject: Re: [pve-devel] applied: [PATCH proxmox-backup-qemu 1/1] restore: make chunk loading more parallel From: Adam Kalisz To: Proxmox VE development discussion Cc: pbs-devel@lists.proxmox.com, Dominik Csapak Date: Wed, 16 Jul 2025 13:51:21 +0200 In-Reply-To: <175260709111.2310514.11288961991494643201.b4-ty@proxmox.com> References: <20250714083439.1240349-1-d.csapak@proxmox.com> <20250714083439.1240349-2-d.csapak@proxmox.com> <175260709111.2310514.11288961991494643201.b4-ty@proxmox.com> Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable User-Agent: Evolution 3.56.1-1 MIME-Version: 1.0 X-SPAM-LEVEL: Spam detection results: 0 AWL 0.017 Adjusted score from AWL reputation of From: address BAYES_00 -1.9 Bayes spam probability is 0 to 1% DKIM_SIGNED 0.1 Message has a DKIM or DK signature, not necessarily valid DKIM_VALID -0.1 Message has at least one valid DKIM or DK signature DKIM_VALID_AU -0.1 Message has a valid DKIM or DK signature from author's domain DKIM_VALID_EF -0.1 Message has a valid DKIM or DK signature from envelope-from domain DMARC_PASS -0.1 DMARC pass policy RCVD_IN_DNSWL_NONE -0.0001 Sender listed at https://www.dnswl.org/, no trust SPF_HELO_NONE 0.001 SPF: HELO does not publish an SPF Record SPF_PASS -0.001 SPF: sender matches SPF record Hi Thomas, would you please consider applying it also to the bookworm branch? Thank you Adam On Tue, 2025-07-15 at 21:18 +0200, Thomas Lamprecht wrote: > On Mon, 14 Jul 2025 10:34:38 +0200, Dominik Csapak wrote: > > by using async futures to load chunks and stream::buffer_unordered > > to > > buffer up to 16 of them, depending on write/load speed, use tokio's > > task > > spawn to make sure the continue to run in the background, since > > buffer_unordered starts them, but does not poll them to completion > > unless we're awaiting. > >=20 > > With this, we don't need to increase the number of threads in the > > runtime to trigger parallel reads and network traffic to us. This > > way > > it's only limited by CPU if decoding and/or decrypting is the > > bottleneck. > >=20 > > [...] >=20 > Applied, thanks! >=20 > [1/1] restore: make chunk loading more parallel > =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 commit: 429256c05f2526632e16f6ef261669b9d0= e0ee6b >=20 >=20 > _______________________________________________ > pve-devel mailing list > pve-devel@lists.proxmox.com > https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-devel --===============4886324150704087106== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ pve-devel mailing list pve-devel@lists.proxmox.com https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-devel --===============4886324150704087106==--