all lists on lists.proxmox.com
 help / color / mirror / Atom feed
From: "Lukas Wagner" <l.wagner@proxmox.com>
To: "Arthur Bied-Charreton" <a.bied-charreton@proxmox.com>,
	"Lukas Wagner" <l.wagner@proxmox.com>
Cc: pbs-devel@lists.proxmox.com, pve-devel@lists.proxmox.com
Subject: Re: [PATCH proxmox 01/29] add new proxmox-match-expression crate
Date: Fri, 04 Sep 2026 11:48:38 +0200	[thread overview]
Message-ID: <DL6FRMK4RMI4.3C0RYE3VQF33K@proxmox.com> (raw)
In-Reply-To: <zvtmjzgjyb35x4zopadkre2hvnzeonjqm4unwyfgrx572edprd@bmfk4r7cpci3>

On Fri Jul 24, 2026 at 8:46 AM CEST, Arthur Bied-Charreton wrote:
> On Thu, Jul 09, 2026 at 01:56:48PM +0200, Lukas Wagner wrote:
>> This new crate is a generic implementation of a serializable expression
>> language. It supports basic combinators, such as AnyOf, OneOf and AllOf,
>> constants, Not, as well as custom matcher leave nodes that are injected
>> via a generic type parameter.
>> 
>> The first user of this implementation will be the notification stack.
>> 
> i really like this crate, great job! 

Thanks!

> beeing able to serialize evaluated
> expressions is a cool feature for notifications history. some comments
> inline. 

[...]

>> +
>> +/// Evaluated expression resulting from [`Expression::evaluate`].
>> +///
>> +/// This type contains the original expression, augmented with per-node
>> +/// results. This is useful for recording 'traces', e.g. for recording
>> +/// exactly why a notification matcher matched a notification or not.
>> +#[derive(Serialize, Deserialize, Debug, Clone, PartialEq, Eq)]
>> +pub struct EvaluatedExpressionWithResult<M> {
>> +    /// The actual expression.
>> +    #[serde(flatten)]
>> +    expression: EvaluatedExpression<M>,
>> +    /// The evaluated expression matched the notification.
> since this crate is meant to be generic, we might want to drop
> 'notification' in favor of 'input' or something like that
>> +    matches: bool,
>> +}
>> +
>> +impl<M> EvaluatedExpressionWithResult<M> {
>> +    /// Return whether the expression matched the notification.
> here as well

Done, thanks. This was a leftover from when this was still inside
proxmox-notify.

>> +    pub fn is_match(&self) -> bool {
>> +        self.matches
>> +    }
>> +
>> +    /// Borrow the contained [`EvaluatedExpression`].
>> +    pub fn expression(&self) -> &EvaluatedExpression<M> {
>> +        &self.expression
>> +    }
>> +
>> +    /// Return the contained [`EvaluatedExpression`], consuming `self`.
>> +    pub fn into_expression(self) -> EvaluatedExpression<M> {
>> +        self.expression
>> +    }
> nit: is there any reason why this is not an impl From<A> for B? if not i
> would personally find such an API more idiomatic

Will add a From implementation in v2, but I will keep into_expression
and have `from` call just that

>> +
>> +    /// The direct child nodes, uniform across all combinator kinds.
>> +    ///
>> +    /// 'not' yields its single operand as a one-element slice; leaf nodes
>> +    /// ('constant', 'match') yield an empty slice. This lets a generic tree
>> +    /// walker recurse without special-casing each variant.
>> +    pub fn children(&self) -> &[EvaluatedExpressionWithResult<M>] {
>> +        match &self.expression {
>> +            EvaluatedExpression::AllOf(expressions)
>> +            | EvaluatedExpression::AnyOf(expressions)
>> +            | EvaluatedExpression::OneOf(expressions) => expressions,
>> +            EvaluatedExpression::Not(expression) => std::slice::from_ref(&**expression),
>> +            EvaluatedExpression::Constant(_) | EvaluatedExpression::Match(_) => &[],
>> +        }
>> +    }
>> +}
>> +
>> +impl<M, D, E> Expression<M>
>> +where
>> +    M: Clone + MatchExpression<Data = D, Error = E>,
>> +{
>> +    /// Evaluate this expression against a provided variable.
>> +    ///
>> +    /// This function returns an `EvaluatedExpression`, replicating the exact structure
>> +    /// of `self`, but annotated with a per-subexpression trace to record which of
>> +    /// the subexpressions matched or not.
>> +    ///
>> +    /// # Note
>> +    /// This evaluates the expression and *all* sub-expressions fully and does not return
>> +    /// early if the final result is already determined by the already evaluated sub-expressions
>> +    /// (for instance, [`Expression::AnyOf`] and the first sub-expression matched).
>> +    /// This is done so that we can return the full trace via the [`EvaluatedExpressionWithResult`]
>> +    /// type.
>> +    ///
>> +    /// If you need fast evaluation and do not care about the trace, feel free to add a
>> +    /// `evaluate_fast` (or similar), which does early returns as appropriate and simply returns
>> +    /// `bool`.
>> +    pub fn evaluate(&self, data: &D) -> Result<EvaluatedExpressionWithResult<M>, E> {
>> +        let evaluated_expression = match self {
>> +            Expression::AllOf(expressions) => {
>> +                if expressions.is_empty() {
>> +                    // 'all-of' without any sub-expressions is *not* a match
>> +                    EvaluatedExpressionWithResult {
>> +                        expression: EvaluatedExpression::AllOf(Vec::new()),
>> +                        matches: false,
>> +                    }
> this probaly does not matter too much as long as it's documented, but
> intuitively (and based on implementations for all-expressions in 
> other languages like rust and python) i would expect all([]) to evaluate to
> true.

Yeah, I see where you are coming from, but after some consideration I've
decided that I'd like to keep it this way.

For non-coders, all([]) being true is not very intuitive, and I'd prefer
to just say "hey, all combinators eval to false if they have no
children" in the docs.

>> +                } else {
>> +                    let (matches, evaluated_expressions) =
>> +                        Self::evaluate_subexpressions(data, expressions, true, |a, b| a && b)?;
>> +
>> +                    EvaluatedExpressionWithResult {
>> +                        expression: EvaluatedExpression::AllOf(evaluated_expressions),
>> +                        matches,
>> +                    }
>> +                }
>> +            }

[...]

>> +
>> +#[cfg(test)]
>> +mod test {
>> +    use super::*;
>> +
>> +    #[derive(Serialize, Deserialize, Debug, Clone)]
>> +    #[serde(rename_all = "kebab-case", tag = "type")]
>> +    pub enum TestMatcher {
>> +        CustomFailure,
>> +        CustomTrue,
>> +        CustomFalse,
>> +    }
> nit: this enum does not pass clippy because of the common prefix

fixed, thanks!

>> +
>> +    impl MatchExpression for TestMatcher {
>> +        type Data = ();
>> +        type Error = ();
>> +
>> +        fn evaluate(&self, _data: &Self::Data) -> Result<bool, ()> {
>> +            match self {
>> +                TestMatcher::CustomFailure => Err(()),
>> +                TestMatcher::CustomTrue => Ok(true),
>> +                TestMatcher::CustomFalse => Ok(false),
>> +            }
>> +        }
>> +    }
>> +
> [...]





  reply	other threads:[~2026-09-04  9:48 UTC|newest]

Thread overview: 52+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2026-07-09 11:56 [PATCH many 00/29] notifications: add nested match expressions Lukas Wagner
2026-07-09 11:56 ` [PATCH proxmox 01/29] add new proxmox-match-expression crate Lukas Wagner
2026-07-24  6:46   ` Arthur Bied-Charreton
2026-09-04  9:48     ` Lukas Wagner [this message]
2026-09-04 12:25       ` Robert Obkircher
2026-07-09 11:56 ` [PATCH proxmox 02/29] notify: promote matcher to dir-style module Lukas Wagner
2026-07-09 11:56 ` [PATCH proxmox 03/29] notify: fix doc comment Lukas Wagner
2026-07-09 11:56 ` [PATCH proxmox 04/29] notify: matcher: break out severity matcher into submodule Lukas Wagner
2026-07-09 11:56 ` [PATCH proxmox 05/29] notify: matcher: break out field " Lukas Wagner
2026-07-09 11:56 ` [PATCH proxmox 06/29] notify: matcher: break out calendar " Lukas Wagner
2026-07-09 11:56 ` [PATCH proxmox 07/29] notify: matcher: calendar: add basic unit test Lukas Wagner
2026-07-09 11:56 ` [PATCH proxmox 08/29] notify: matcher: add InlineSeverityMatcher Lukas Wagner
2026-07-09 11:56 ` [PATCH proxmox 09/29] notify: matcher: add InlineFieldMatcher Lukas Wagner
2026-07-09 11:56 ` [PATCH proxmox 10/29] notify: matcher: add InlineCalendarMatcher Lukas Wagner
2026-07-24  6:47   ` Arthur Bied-Charreton
2026-07-24  9:43     ` Wolfgang Bumiller
2026-09-04 12:23     ` Lukas Wagner
2026-07-09 11:56 ` [PATCH proxmox 11/29] notify: matcher: add expression support Lukas Wagner
2026-07-24  6:59   ` Arthur Bied-Charreton
2026-07-24  8:27     ` PVE::Cluster::cfs_lock_domain - bizarre issue Anthony Galica
2026-07-24  9:38       ` :Cluster::cfs_lock_domain " Anthony Galica
2026-07-25  7:14         ` Anthony Galica
2026-07-09 11:56 ` [PATCH proxmox 12/29] notify: api: support new expression parameter Lukas Wagner
2026-07-24  6:46   ` Arthur Bied-Charreton
2026-07-24 10:01     ` Wolfgang Bumiller
2026-07-24 11:38       ` Arthur Bied-Charreton
2026-07-09 11:57 ` [PATCH proxmox 13/29] notify: api: add `get_matcher_as_expression` Lukas Wagner
2026-07-09 11:57 ` [PATCH proxmox 14/29] notify: migrate PBS's and PVE's default matcher to expression syntax Lukas Wagner
2026-07-24  6:47   ` Arthur Bied-Charreton
2026-07-09 11:57 ` [PATCH proxmox 15/29] notify: move legacy matcher keys behind feature flag Lukas Wagner
2026-07-09 11:57 ` [PATCH proxmox-widget-toolkit 16/29] notification: increase matcher window width Lukas Wagner
2026-07-09 11:57 ` [PATCH proxmox-widget-toolkit 17/29] notifications: matcher: add support for match expressions Lukas Wagner
2026-07-24  6:45   ` Arthur Bied-Charreton
2026-07-09 11:57 ` [PATCH proxmox-widget-toolkit 18/29] notification: matcher: add better calendar editor Lukas Wagner
2026-07-24  6:46   ` Arthur Bied-Charreton
2026-09-04 12:16     ` Lukas Wagner
2026-07-09 11:57 ` [PATCH proxmox-widget-toolkit 19/29] notifications: matcher: consistently use title case for UI elements Lukas Wagner
2026-07-09 11:57 ` [PATCH proxmox-backup 20/29] notification: opt into 'legacy-matchers' feature in proxmox-notify Lukas Wagner
2026-07-09 11:57 ` [PATCH proxmox-backup 21/29] api: notification: add 'migrate-to-expression' parameter to get_matcher Lukas Wagner
2026-07-09 11:57 ` [PATCH proxmox-backup 22/29] ui: notification: enable new matcher UI Lukas Wagner
2026-07-09 11:57 ` [PATCH proxmox-perl-rs 23/29] notify: matcher: pass matcher config / updater directly Lukas Wagner
2026-07-28 13:09   ` Wolfgang Bumiller
2026-07-09 11:57 ` [PATCH proxmox-perl-rs 24/29] notify: opt into 'legacy-matchers' feature in proxmox-notify Lukas Wagner
2026-07-24  6:48   ` Arthur Bied-Charreton
2026-07-09 11:57 ` [PATCH proxmox-perl-rs 25/29] notify: add 'migrate_to_expression' parameter for get_matcher Lukas Wagner
2026-07-09 11:57 ` [PATCH manager 26/29] api: notification: pass config/updater directly to rust bindings Lukas Wagner
2026-07-31  7:19   ` Lukas Wagner
2026-07-09 11:57 ` [PATCH manager 27/29] api: notification: get_matcher: add 'migrate-to-expression' parameter Lukas Wagner
2026-07-09 11:57 ` [PATCH manager 28/29] api: notification: add 'expression' to matcher parameter schema Lukas Wagner
2026-07-09 11:57 ` [PATCH manager 29/29] ui: notification: enable new matcher UI Lukas Wagner
2026-07-24  6:44 ` [PATCH many 00/29] notifications: add nested match expressions Arthur Bied-Charreton
2026-07-24  6:53   ` Arthur Bied-Charreton

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=DL6FRMK4RMI4.3C0RYE3VQF33K@proxmox.com \
    --to=l.wagner@proxmox.com \
    --cc=a.bied-charreton@proxmox.com \
    --cc=pbs-devel@lists.proxmox.com \
    --cc=pve-devel@lists.proxmox.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.
Service provided by Proxmox Server Solutions GmbH | Privacy | Legal