From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from firstgate.proxmox.com (firstgate.proxmox.com [IPv6:2a01:7e0:0:424::9]) by lore.proxmox.com (Postfix) with ESMTPS id 50AC11FF165 for ; Thu, 11 Sep 2025 10:09:48 +0200 (CEST) Received: from firstgate.proxmox.com (localhost [127.0.0.1]) by firstgate.proxmox.com (Proxmox) with ESMTP id 45972CE15; Thu, 11 Sep 2025 10:09:50 +0200 (CEST) To: Proxmox Backup Server development discussion Date: Thu, 11 Sep 2025 10:09:41 +0200 In-Reply-To: <1d041343-39be-4d90-8553-6d4fa82e4e2b@proxmox.com> References: <2ac072513fdb726fd0e22fbc79425537dcf63a41.camel@notnullmakers.com> <1d041343-39be-4d90-8553-6d4fa82e4e2b@proxmox.com> MIME-Version: 1.0 Message-ID: List-Id: Proxmox VE development discussion List-Post: From: Adam Kalisz via pve-devel Precedence: list Cc: Adam Kalisz , Proxmox VE development discussion , Thomas Lamprecht X-Mailman-Version: 2.1.29 X-BeenThere: pve-devel@lists.proxmox.com List-Subscribe: , List-Unsubscribe: , List-Archive: Reply-To: Proxmox VE development discussion List-Help: Subject: Re: [pve-devel] [pbs-devel] Chunk verification speedup discussion, similar speedup opportunities elsewhere Content-Type: multipart/mixed; boundary="===============7467370564981674314==" Errors-To: pve-devel-bounces@lists.proxmox.com Sender: "pve-devel" --===============7467370564981674314== Content-Type: message/rfc822 Content-Disposition: inline Return-Path: X-Original-To: pve-devel@lists.proxmox.com Delivered-To: pve-devel@lists.proxmox.com Received: from firstgate.proxmox.com (firstgate.proxmox.com [212.224.123.68]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits)) (No client certificate requested) by lists.proxmox.com (Postfix) with ESMTPS id 7FE55D6B43 for ; Thu, 11 Sep 2025 10:09:49 +0200 (CEST) Received: from firstgate.proxmox.com (localhost [127.0.0.1]) by firstgate.proxmox.com (Proxmox) with ESMTP id 5D3C8CD72 for ; Thu, 11 Sep 2025 10:09:49 +0200 (CEST) Received: from mail-ej1-x635.google.com (mail-ej1-x635.google.com [IPv6:2a00:1450:4864:20::635]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by firstgate.proxmox.com (Proxmox) with ESMTPS for ; Thu, 11 Sep 2025 10:09:48 +0200 (CEST) Received: by mail-ej1-x635.google.com with SMTP id a640c23a62f3a-b07ba1c3df4so69766b.3 for ; Thu, 11 Sep 2025 01:09:48 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=notnullmakers.com; s=google; t=1757578182; x=1758182982; darn=lists.proxmox.com; h=mime-version:user-agent:content-transfer-encoding:references :in-reply-to:date:cc:to:from:subject:message-id:from:to:cc:subject :date:message-id:reply-to; bh=JdjslNwv3ORqdHHXQbS8DJV9u7rqGo6FIE6WMrujB9w=; b=tFXLHIqvZPWgFQnQRgOF9ToIg2T/9pi4J8tf1NoUlZagPYogk3sLQGeqgP9UwTI2lp RkyadXQ2V9yfFeRRRqUUHuvdjaDhC3J3sgACpUDGvF/wVmIkUacGl/V9+/v9UUPQkZCc aPGrKXO6BVsXIb3233Coui+9lLkarcwGVr+WiXy0P/HFalQACaRpTXrau1RzItOcVx5O vtQl1psR6/eWK0YmCscpiiSY86YuuguZq5YAClg8DsU3cJHPfmNF6CtPY8jrgqLCm5jj xrU4rrrbNx+m7rRkg3Rxe2bYowyGJxqgYi3L8/boDK8+j3qWk0e+jHjsvKpk7cRmadzP uvUw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1757578182; x=1758182982; h=mime-version:user-agent:content-transfer-encoding:references :in-reply-to:date:cc:to:from:subject:message-id:x-gm-message-state :from:to:cc:subject:date:message-id:reply-to; bh=JdjslNwv3ORqdHHXQbS8DJV9u7rqGo6FIE6WMrujB9w=; b=kGIM8zY+S/58gEgrqRG6PBrJm8P+j9I8AF1mPZhGVxBWPU67OIzYyNOHoYv0zxXaOv YPtZcCkn/jSc6zhVXO2ZGKZD6UP2OwoELhhvx8vjIPoZ/KFYtppexdb/xW2LxnvkI80R KLHpjjmcNoklOSN3TTavTy2y1uXXaepAKjEl/nin3aEgbQE+XIkEYjL2Eku+i72CQ4Wn +u7FtG6Lc2EkUVd1ZX/S9xOJJIA9zuT4bQ5TwOhZ/dhN3hQdyInYwo8RN3lPDZkG1B08 g+YznN1upGqKegTXdAMifwvdVCcR+O85MPhA/xTCpmEmmkz66j62P6c4sH+IhJb9ACi2 pVwg== X-Gm-Message-State: AOJu0Yy1fxHMhSARbrTbFmxFbS74bEbJ3hArIq3o51/fNxg9oFZ9J5/x lPWLrV5oXAQwYnNkAes+olx7bavrtZnlzyLp40/jF985dGW+qiZOCPb/IqG+IawVFa0= X-Gm-Gg: ASbGncsF6ZhQubYItiPE4LtpLFbUu7BsJhm6f9jt4dohCziCN8mmTHgTP5qnGQSj+fd b8T8zvKDZJJVwFvDG53kiPHPV+r+8wI2ofaLGR365+l/L1JaKBJRP6w4UT2AenGyWbhHyDD0Khs xyYANi64ULqgaE8GjTXcrUZbxJC2AXDgam1yU0eu19dyha5SfuDwoDCUxnki3whPqZFnQOKw08z D0+mZMDeI+SVEtTMOp8IhWED6RYWrCH0IppGM08xl0p0OhcV/a2PIzesnaz1/pN0JDtaW2/IhLF wkMz6pagyJg4+6u0U58c1lC87CMsOiVoCly7twSXlzmGPL6E5N1dWfN6pBrlu5zZ7Ne3FtqJBL8 bSVH5bIuoBcXm7Kt5Gy4WrtU1sgfZS17mGdoPb0jjwlGU9w== X-Google-Smtp-Source: AGHT+IEGBQWlndQsqgK9XEwD0yj/I7JUCHEs7xYOdQ8WwhK6igna4eywQDWY2Xb4wAxSJSL1OlJH/w== X-Received: by 2002:a17:906:dc8d:b0:b04:4de8:7c70 with SMTP id a640c23a62f3a-b04b140d189mr1847421666b.14.1757578182024; Thu, 11 Sep 2025 01:09:42 -0700 (PDT) Received: from ?IPv6:2a02:8308:299:4600::9185? ([2a02:8308:299:4600::9185]) by smtp.gmail.com with ESMTPSA id 4fb4d7f45d1cf-62ec33a51fdsm692917a12.7.2025.09.11.01.09.41 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Thu, 11 Sep 2025 01:09:41 -0700 (PDT) Message-ID: <8c7b0af096f4ae6d333908c9fcd3369c649c189b.camel@notnullmakers.com> Subject: Re: [pbs-devel] Chunk verification speedup discussion, similar speedup opportunities elsewhere From: Adam Kalisz To: Proxmox Backup Server development discussion Cc: Proxmox VE development discussion , Dominik Csapak , Thomas Lamprecht Date: Thu, 11 Sep 2025 10:09:41 +0200 In-Reply-To: <1d041343-39be-4d90-8553-6d4fa82e4e2b@proxmox.com> References: <2ac072513fdb726fd0e22fbc79425537dcf63a41.camel@notnullmakers.com> <1d041343-39be-4d90-8553-6d4fa82e4e2b@proxmox.com> Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable User-Agent: Evolution 3.56.1-1 MIME-Version: 1.0 X-SPAM-LEVEL: Spam detection results: 0 AWL 0.010 Adjusted score from AWL reputation of From: address BAYES_00 -1.9 Bayes spam probability is 0 to 1% DKIM_SIGNED 0.1 Message has a DKIM or DK signature, not necessarily valid DKIM_VALID -0.1 Message has at least one valid DKIM or DK signature DKIM_VALID_AU -0.1 Message has a valid DKIM or DK signature from author's domain DKIM_VALID_EF -0.1 Message has a valid DKIM or DK signature from envelope-from domain DMARC_PASS -0.1 DMARC pass policy RCVD_IN_DNSWL_NONE -0.0001 Sender listed at https://www.dnswl.org/, no trust SPF_HELO_NONE 0.001 SPF: HELO does not publish an SPF Record SPF_PASS -0.001 SPF: sender matches SPF record Hi, is there any progress with the chunk verification speedup with the adjustment as suggested by Thomas? On Fri, 2025-07-25 at 17:03 +0200, Thomas Lamprecht wrote: > Am 25.07.25 um 13:24 schrieb Adam Kalisz: > > I missed whether the chunk verification speedup when loading chunks > > got applied or whether it was somehow included in the S3-like > > storage option change set. >=20 > btw. had a quick talk with Dominik about this topic, while having the > possibility for this would be nice, server side parallelism is a > different thing than client-side, as being able to starve the rest of > the system of all available IO is much easier possible in the server- > side case, as there is currently no knob to enforce some kind of > pacing or maximum bandwidth like the bandwidth limits that client can > be enforced too. >=20 > So the mentioned series should IMO only be applied if it can be opted > out, or, better in the long term, a pacing/IO bandwidth limit can be > enforced. That is naturally a big amount of work, mostly in > evaluating different options and deciding for what can make sense, > that's why I mentioned that being able to opt-out could be enough, > then admins could at least keep the status quo. Thanks Adam --===============7467370564981674314== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ pve-devel mailing list pve-devel@lists.proxmox.com https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-devel --===============7467370564981674314==--