Re: [PATCH proxmox{,-backup} v6 00/15] fix #4182: concurrent group pull/push support for sync jobs

["Fabian Grünbichler" <f.gruenbichler@proxmox.com>]

On Fri, 17 Apr 2026 11:26:06 +0200, Christian Ebner wrote:
> Syncing contents from/to a remote source via a sync job suffers from
> low throughput on high latency networks because of limitations by the
> HTTP/2 connection, as described in [0]. To improve, syncing multiple
> groups in parallel by establishing multiple reader instances has been
> suggested.
> 
> This patch series implements the functionality by adding the sync job
> configuration property `worker-threads`, allowing to define the
> number of groups pull/push tokio tasks to be executed in parallel on
> the runtime during each job.
> 
> [...]

Applied some of the preparatory patches, thanks!

[02/15] tools: group and sort module imports
        commit: c7fe846a0f0c92594ce91f66e76361f9a2b2c1d3
[07/15] sync: pull: revert avoiding reinstantiation for encountered chunks map
        commit: 173059e31a9dbc7f463019cc92ade864d02af6ef
[08/15] sync: pull: factor out backup group locking and owner check
        commit: 5e1e7bb0de424af1c6466dc750882cd11d9b1675
[09/15] sync: pull: prepare pull parameters to be shared across parallel tasks
        commit: 9213b1ed3fd9f5469b78cc2934f1dcebf13c8fc3
[12/15] sync: push: prepare push parameters to be shared across parallel tasks
        commit: f2843b84f9d2219ff7213691af7f263133a4b039

left the rest out for now, as at least the logging part still needs some
improvements/rework to be really functional, and without functional logging
enabling parallelism is a mess.

I don't think there is that much missing anymore to pull this across the line
though.

Best regards,
-- 
Fabian Grünbichler <f.gruenbichler@proxmox.com>