From: Thomas Lamprecht <t.lamprecht@proxmox.com>
To: Proxmox Backup Server development discussion
<pbs-devel@lists.proxmox.com>, Graeme Seaton <lists@graemes.com>
Subject: Re: [pbs-devel] Verify, Prune & GC sequence
Date: Fri, 30 Oct 2020 12:09:39 +0100 [thread overview]
Message-ID: <d3249ddb-e2a6-bf33-450f-ba8109c6dc82@proxmox.com> (raw)
In-Reply-To: <215c8b24-84f6-c244-f3d0-347390001707@graemes.com>
Hi,
On 30.10.20 10:31, Graeme Seaton wrote:
> If I have verify, prune & GC all set to run daily do the jobs run concurrently or in sequence?
Well, you could just try out ;-)
But yes, they can run in parallel.
Since PBS allows multiple potentially interfering operations at the same time (e.g., garbage collect,
prune, multiple backup creations (only in separate groups), forget, ...), these need to lock against
each other in certain scenarios. There is no overarching global lock though, instead always the finest
grained lock possible is used, because running these operations concurrently is treated as a feature
on its own.
Still, while we handle locking fine grained an admin could try to optimize the order of scheduling
such things.
1. Prune, to increase the chance that GC can sweep more data and verify has less to look at.
This is rather quick, so one could schedule the next probably half an hour afterwards and
be confident it finishes before 2.
2. GC, as chunks are deleted, which may make verify also faster as it can make the underlying
FS faster - but that's rather theory.
3. Verify
I think the order of 2. and 3. is not to important, but personally, I'd always schedule pruning
first, can only help.
cheers,
Thomas
next prev parent reply other threads:[~2020-10-30 11:10 UTC|newest]
Thread overview: 7+ messages / expand[flat|nested] mbox.gz Atom feed top
2020-10-30 9:31 Graeme Seaton
2020-10-30 11:09 ` Thomas Lamprecht [this message]
2020-10-30 16:31 ` Graeme Seaton
2020-10-30 17:17 ` Thomas Lamprecht
2020-10-31 6:43 ` Dietmar Maurer
2020-10-31 6:53 ` Thomas Lamprecht
2020-10-31 8:27 ` Graeme Seaton
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=d3249ddb-e2a6-bf33-450f-ba8109c6dc82@proxmox.com \
--to=t.lamprecht@proxmox.com \
--cc=lists@graemes.com \
--cc=pbs-devel@lists.proxmox.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox