public inbox for pbs-devel@lists.proxmox.com
 help / color / mirror / Atom feed
From: Christian Ebner <c.ebner@proxmox.com>
To: Robert Obkircher <r.obkircher@proxmox.com>, pbs-devel@lists.proxmox.com
Subject: Re: [PATCH proxmox-backup 4/6] task tracking: count WriteNonExpanding datastore operations
Date: Wed, 3 Jun 2026 14:18:41 +0200	[thread overview]
Message-ID: <89791648-e7ea-4a49-b132-6404d7f8e6d4@proxmox.com> (raw)
In-Reply-To: <20260602130001.217482-10-r.obkircher@proxmox.com>

Code wise this looks good to me, but I was pondering a bit if we should 
take the occasion here and define a `format-version` field in order to 
have some way of checking this in case of future extension. The older 
process might then only update values it knows about, but write out all 
the contents known to the newer versions.

Other opinions on that?

On 6/2/26 3:00 PM, Robert Obkircher wrote:
> Count WriteNonExpanding as writes to ensure that switching over from
> Write does not break forward compatibility when older versions read
> the counters.
> 
> Also add a new counter to display the GarbageCollection maintenance
> mode conflicts. It may not be accurate while older processes are
> running but it should be good enough for the UI.
> 
> Signed-off-by: Robert Obkircher <r.obkircher@proxmox.com>

Reviewed-by: Christian Ebner <c.ebner@proxmox.com>

> ---
>   pbs-datastore/src/task_tracking.rs | 12 ++++++++++++
>   src/api2/admin/datastore.rs        |  1 +
>   2 files changed, 13 insertions(+)
> 
> diff --git a/pbs-datastore/src/task_tracking.rs b/pbs-datastore/src/task_tracking.rs
> index a67b77221..87ce4f5de 100644
> --- a/pbs-datastore/src/task_tracking.rs
> +++ b/pbs-datastore/src/task_tracking.rs
> @@ -13,6 +13,12 @@ use serde::{Deserialize, Serialize};
>   pub struct ActiveOperationStats {
>       pub read: i64,
>       pub write: i64,
> +    /// The number of writers that do not significantly increase disk usage.
> +    ///
> +    /// The count is unreliable because older processes without this field
> +    /// will delete it on every update!
> +    #[serde(default)]
> +    pub write_non_expanding: i64,
>   }
>   
>   impl ActiveOperationStats {
> @@ -20,6 +26,11 @@ impl ActiveOperationStats {
>           match operation {
>               Operation::Read => self.read += count,
>               Operation::Write => self.write += count,
> +            Operation::WriteNonExpanding => {
> +                self.write += count;
> +                // prevent underflow if an older process deleted the field
> +                self.write_non_expanding = (self.write_non_expanding + count).max(0);
> +            }
>               Operation::Lookup => (), // no IO must happen there
>           }
>       }
> @@ -33,6 +44,7 @@ impl Sum<Self> for ActiveOperationStats {
>           iter.fold(Self::default(), |a, b| Self {
>               read: a.read + b.read,
>               write: a.write + b.write,
> +            write_non_expanding: a.write_non_expanding + b.write_non_expanding,
>           })
>       }
>   }
> diff --git a/src/api2/admin/datastore.rs b/src/api2/admin/datastore.rs
> index 94272c32d..3cbdd8922 100644
> --- a/src/api2/admin/datastore.rs
> +++ b/src/api2/admin/datastore.rs
> @@ -2024,6 +2024,7 @@ pub fn get_active_operations(store: String, _param: Value) -> Result<Value, Erro
>       Ok(json!({
>           "read": active_operations.read,
>           "write": active_operations.write,
> +        "writeNonExpanding": active_operations.write_non_expanding,
>       }))
>   }
>   





  reply	other threads:[~2026-06-03 12:18 UTC|newest]

Thread overview: 28+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2026-06-02 12:58 [PATCH proxmox{,-backup} 00/11] add GarbageCollection maintenance mode Robert Obkircher
2026-06-02 12:58 ` [PATCH proxmox 1/5] pbs-api-types: propagate maintenance mode parse errors Robert Obkircher
2026-06-03 10:33   ` Christian Ebner
2026-06-02 12:58 ` [PATCH proxmox 2/5] pbs-api-types: use match statement for maintenance mode check Robert Obkircher
2026-06-03 10:36   ` Christian Ebner
2026-06-03 11:04     ` Robert Obkircher
2026-06-03 11:30       ` Christian Ebner
2026-06-02 12:58 ` [PATCH proxmox 3/5] pbs-api-types: deny non-lookup operations for unknown modes Robert Obkircher
2026-06-03 10:38   ` Christian Ebner
2026-06-03 11:18     ` Robert Obkircher
2026-06-03 11:38       ` Christian Ebner
2026-06-02 12:58 ` [PATCH proxmox 4/5] pbs-api-types: add WriteNonExpanding datastore operation Robert Obkircher
2026-06-03 10:45   ` Christian Ebner
2026-06-02 12:58 ` [PATCH proxmox 5/5] pbs-api-types: add GarbageCollection maintenance mode Robert Obkircher
2026-06-03 10:50   ` Christian Ebner
2026-06-02 12:58 ` [PATCH proxmox-backup 1/6] datastore: propagate maintenance mode parse errors Robert Obkircher
2026-06-03 11:20   ` Christian Ebner
2026-06-02 12:58 ` [PATCH proxmox-backup 2/6] task tracking: use parameter for initial count and refactor updates Robert Obkircher
2026-06-03 11:58   ` Christian Ebner
2026-06-02 12:58 ` [PATCH proxmox-backup 3/6] www: access active operation fields by name instead of index Robert Obkircher
2026-06-03 12:04   ` Christian Ebner
2026-06-02 12:59 ` [PATCH proxmox-backup 4/6] task tracking: count WriteNonExpanding datastore operations Robert Obkircher
2026-06-03 12:18   ` Christian Ebner [this message]
2026-06-02 12:59 ` [PATCH proxmox-backup 5/6] datastore: open datastores with WriteNonExpanding instead of Write Robert Obkircher
2026-06-03 12:28   ` Christian Ebner
2026-06-02 12:59 ` [PATCH proxmox-backup 6/6] fix #5797: www: display new GarbageCollection maintenance mode Robert Obkircher
2026-06-03 13:03   ` Christian Ebner
2026-06-03 13:28 ` [PATCH proxmox{,-backup} 00/11] add " Christian Ebner

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=89791648-e7ea-4a49-b132-6404d7f8e6d4@proxmox.com \
    --to=c.ebner@proxmox.com \
    --cc=pbs-devel@lists.proxmox.com \
    --cc=r.obkircher@proxmox.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox
Service provided by Proxmox Server Solutions GmbH | Privacy | Legal