From: "Fabian Grünbichler" <f.gruenbichler@proxmox.com>
To: Proxmox Backup Server development discussion
<pbs-devel@lists.proxmox.com>
Subject: [pbs-devel] superseded: [PATCH proxmox-backup v2 0/3] reduce GC S3 locking
Date: Fri, 21 Nov 2025 13:39:03 +0100 [thread overview]
Message-ID: <1763728715.y27qmevugp.astroid@yuna.none> (raw)
In-Reply-To: <20251121101849.463119-1-f.gruenbichler@proxmox.com>
by https://lore.proxmox.com/pbs-devel/20251121123829.701196-1-f.gruenbichler@proxmox.com
On November 21, 2025 11:18 am, Fabian Grünbichler wrote:
> this patch series tries to reduce the number of open locks held by GC,
> in particular in case most objects returned by the S3 backend are
> garbage that need deletion.
>
> the first patch reduces the number of open locks by at least a factor of
> 10 in the worst case (from up to 1000 to up to 100).
>
> the second patch just refactors some now common code.
>
> the third patch tries to reduce the number of delete calls for regular
> GC runs by batching deletes more efficiently, while still periodically
> flushing the deferred deletes.
>
> Fabian Grünbichler (3):
> GC: S3: reduce number of open FDs for to-be-deleted objects
> GC: S3: factor out batch object deletion
> GC: S3: phase2: do not force delete for every list iteration
>
> pbs-datastore/src/datastore.rs | 61 ++++++++++++++++++++++++----------
> 1 file changed, 44 insertions(+), 17 deletions(-)
>
> --
> 2.47.3
>
>
>
> _______________________________________________
> pbs-devel mailing list
> pbs-devel@lists.proxmox.com
> https://lists.proxmox.com/cgi-bin/mailman/listinfo/pbs-devel
>
_______________________________________________
pbs-devel mailing list
pbs-devel@lists.proxmox.com
https://lists.proxmox.com/cgi-bin/mailman/listinfo/pbs-devel
prev parent reply other threads:[~2025-11-21 12:39 UTC|newest]
Thread overview: 8+ messages / expand[flat|nested] mbox.gz Atom feed top
2025-11-21 10:18 [pbs-devel] " Fabian Grünbichler
2025-11-21 10:18 ` [pbs-devel] [PATCH proxmox-backup v2 1/3] GC: S3: reduce number of open FDs for to-be-deleted objects Fabian Grünbichler
2025-11-21 10:18 ` [pbs-devel] [PATCH proxmox-backup v2 2/3] GC: S3: factor out batch object deletion Fabian Grünbichler
2025-11-21 10:18 ` [pbs-devel] [PATCH proxmox-backup v2 3/3] GC: S3: phase2: do not force delete for every list iteration Fabian Grünbichler
2025-11-21 11:28 ` Christian Ebner
2025-11-21 11:54 ` [pbs-devel] [PATCH RESEND " Fabian Grünbichler
2025-11-21 12:04 ` Christian Ebner
2025-11-21 12:39 ` Fabian Grünbichler [this message]
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=1763728715.y27qmevugp.astroid@yuna.none \
--to=f.gruenbichler@proxmox.com \
--cc=pbs-devel@lists.proxmox.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox