Re: [pbs-devel] Chunk verification speedup discussion, similar speedup opportunities elsewhere

From: Thomas Lamprecht <t.lamprecht@proxmox.com>
To: Proxmox Backup Server development discussion
	<pbs-devel@lists.proxmox.com>,
	Adam Kalisz <adam.kalisz@notnullmakers.com>
Cc: Proxmox VE development discussion <pve-devel@lists.proxmox.com>
Subject: Re: [pbs-devel] Chunk verification speedup discussion, similar speedup opportunities elsewhere
Date: Fri, 25 Jul 2025 17:03:44 +0200	[thread overview]
Message-ID: <1d041343-39be-4d90-8553-6d4fa82e4e2b@proxmox.com> (raw)
In-Reply-To: <2ac072513fdb726fd0e22fbc79425537dcf63a41.camel@notnullmakers.com>

Am 25.07.25 um 13:24 schrieb Adam Kalisz:
> I missed whether the chunk verification speedup when loading chunks got
> applied or whether it was somehow included in the S3-like storage
> option change set.

btw. had a quick talk with Dominik about this topic, while having the
possibility for this would be nice, server side parallelism is a different
thing than client-side, as being able to starve the rest of the system
of all available IO is much easier possible in the server-side case, as
there is currently no knob to enforce some kind of pacing or maximum
bandwidth like the bandwidth limits that client can be enforced too.

So the mentioned series should IMO only be applied if it can be opted
out, or, better in the long term, a pacing/IO bandwidth limit can be
enforced. That is naturally a big amount of work, mostly in evaluating
different options and deciding for what can make sense, that's why I
mentioned that being able to opt-out could be enough, then admins
could at least keep the status quo.

_______________________________________________
pbs-devel mailing list
pbs-devel@lists.proxmox.com
https://lists.proxmox.com/cgi-bin/mailman/listinfo/pbs-devel