public inbox for pbs-devel@lists.proxmox.com
 help / color / mirror / Atom feed
From: Thomas Lamprecht <t.lamprecht@proxmox.com>
To: Proxmox Backup Server development discussion
	<pbs-devel@lists.proxmox.com>,
	Dominik Csapak <d.csapak@proxmox.com>
Subject: Re: [pbs-devel] [PATCH proxmox-backup v4 3/3] datastore: make 'filesystem' the default sync-level
Date: Fri, 28 Oct 2022 13:24:31 +0200	[thread overview]
Message-ID: <b8191d79-56ce-505c-37c0-1b8b55a523ab@proxmox.com> (raw)
In-Reply-To: <20221028073449.1120342-4-d.csapak@proxmox.com>

Updated stats would be nice, maybe with the following parings:

(v)Disk backed by
* nvme
* spinner

FS of:
- ext4
- XFS
- ZFS

Each combined with each disk backing type and current newest default
software (i.e. kernel 5.15).

Additionally maybe also NFS or CIFS. Those results would then maybe
again nice to have in the commit message.

Would help to find a more clear verdict, as currently I'm close to, but
not yet fully 100% sure if we just want to switch plainly, maybe making
it easier to change by adding it in the web interface, to the datastore
options tab and emphasizing it in the upcoming 2.3 changelog could be
already enough; depending on the numbers.

On 28/10/2022 09:34, Dominik Csapak wrote:
> Signed-off-by: Dominik Csapak <d.csapak@proxmox.com>
> ---
>  docs/storage.rst               | 4 ++--
>  pbs-api-types/src/datastore.rs | 2 +-
>  2 files changed, 3 insertions(+), 3 deletions(-)
> 
> diff --git a/docs/storage.rst b/docs/storage.rst
> index c4e44c72..d61c3a40 100644
> --- a/docs/storage.rst
> +++ b/docs/storage.rst
> @@ -344,13 +344,13 @@ and only available on the CLI:
>    the crash resistance of backups in case of a powerloss or hard shutoff.
>    There are currently three levels:
>  
> -  - `none` (default): Does not do any syncing when writing chunks. This is fast
> +  - `none` : Does not do any syncing when writing chunks. This is fast
>      and normally OK, since the kernel eventually flushes writes onto the disk.
>      The kernel sysctls `dirty_expire_centisecs` and `dirty_writeback_centisecs`
>      are used to tune that behaviour, while the default is to flush old data
>      after ~30s.
>  
> -  - `filesystem` : This triggers a ``syncfs(2)`` after a backup, but before
> +  - `filesystem` (default): This triggers a ``syncfs(2)`` after a backup, but before
>      the task returns `OK`. This way it is ensured that the written backups
>      are on disk. This is a good balance between speed and consistency.
>      Note that the underlying storage device still needs to protect itself against
> diff --git a/pbs-api-types/src/datastore.rs b/pbs-api-types/src/datastore.rs
> index 4c9eda2f..ff8fe55f 100644
> --- a/pbs-api-types/src/datastore.rs
> +++ b/pbs-api-types/src/datastore.rs
> @@ -181,7 +181,6 @@ pub enum DatastoreFSyncLevel {
>      /// which reduces IO pressure.
>      /// But it may cause losing data on powerloss or system crash without any uninterruptible power
>      /// supply.
> -    #[default]
>      None,
>      /// Triggers a fsync after writing any chunk on the datastore. While this can slow down
>      /// backups significantly, depending on the underlying file system and storage used, it
> @@ -196,6 +195,7 @@ pub enum DatastoreFSyncLevel {
>      /// Depending on the setup, it might have a negative impact on unrelated write operations
>      /// of the underlying filesystem, but it is generally a good compromise between performance
>      /// and consitency.
> +    #[default]
>      Filesystem,
>  }
>  





      reply	other threads:[~2022-10-28 11:24 UTC|newest]

Thread overview: 7+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2022-10-28  7:34 [pbs-devel] [PATCH proxmox-backup v4 0/3] add 'sync-level' to datatore tuning options Dominik Csapak
2022-10-28  7:34 ` [pbs-devel] [PATCH proxmox-backup v4 1/3] datastore: improve sync level code a bit Dominik Csapak
2022-10-28 11:05   ` [pbs-devel] applied: " Thomas Lamprecht
2022-10-28  7:34 ` [pbs-devel] [PATCH proxmox-backup v4 2/3] docs: add documentation about the 'sync-level' tuning Dominik Csapak
2022-10-28 11:11   ` [pbs-devel] applied: " Thomas Lamprecht
2022-10-28  7:34 ` [pbs-devel] [PATCH proxmox-backup v4 3/3] datastore: make 'filesystem' the default sync-level Dominik Csapak
2022-10-28 11:24   ` Thomas Lamprecht [this message]

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=b8191d79-56ce-505c-37c0-1b8b55a523ab@proxmox.com \
    --to=t.lamprecht@proxmox.com \
    --cc=d.csapak@proxmox.com \
    --cc=pbs-devel@lists.proxmox.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox
Service provided by Proxmox Server Solutions GmbH | Privacy | Legal