public inbox for pbs-devel@lists.proxmox.com
 help / color / mirror / Atom feed
From: "Lukas Wagner" <l.wagner@proxmox.com>
To: "Arthur Bied-Charreton" <a.bied-charreton@proxmox.com>,
	"Lukas Wagner" <l.wagner@proxmox.com>
Cc: pbs-devel@lists.proxmox.com, pve-devel@lists.proxmox.com
Subject: Re: [PATCH proxmox 01/29] add new proxmox-match-expression crate
Date: Fri, 04 Sep 2026 11:48:38 +0200	[thread overview]
Message-ID: <DL6FRMK4RMI4.3C0RYE3VQF33K@proxmox.com> (raw)
In-Reply-To: <zvtmjzgjyb35x4zopadkre2hvnzeonjqm4unwyfgrx572edprd@bmfk4r7cpci3>

On Fri Jul 24, 2026 at 8:46 AM CEST, Arthur Bied-Charreton wrote:
> On Thu, Jul 09, 2026 at 01:56:48PM +0200, Lukas Wagner wrote:
>> This new crate is a generic implementation of a serializable expression
>> language. It supports basic combinators, such as AnyOf, OneOf and AllOf,
>> constants, Not, as well as custom matcher leave nodes that are injected
>> via a generic type parameter.
>> 
>> The first user of this implementation will be the notification stack.
>> 
> i really like this crate, great job! 

Thanks!

> beeing able to serialize evaluated
> expressions is a cool feature for notifications history. some comments
> inline. 

[...]

>> +
>> +/// Evaluated expression resulting from [`Expression::evaluate`].
>> +///
>> +/// This type contains the original expression, augmented with per-node
>> +/// results. This is useful for recording 'traces', e.g. for recording
>> +/// exactly why a notification matcher matched a notification or not.
>> +#[derive(Serialize, Deserialize, Debug, Clone, PartialEq, Eq)]
>> +pub struct EvaluatedExpressionWithResult<M> {
>> +    /// The actual expression.
>> +    #[serde(flatten)]
>> +    expression: EvaluatedExpression<M>,
>> +    /// The evaluated expression matched the notification.
> since this crate is meant to be generic, we might want to drop
> 'notification' in favor of 'input' or something like that
>> +    matches: bool,
>> +}
>> +
>> +impl<M> EvaluatedExpressionWithResult<M> {
>> +    /// Return whether the expression matched the notification.
> here as well

Done, thanks. This was a leftover from when this was still inside
proxmox-notify.

>> +    pub fn is_match(&self) -> bool {
>> +        self.matches
>> +    }
>> +
>> +    /// Borrow the contained [`EvaluatedExpression`].
>> +    pub fn expression(&self) -> &EvaluatedExpression<M> {
>> +        &self.expression
>> +    }
>> +
>> +    /// Return the contained [`EvaluatedExpression`], consuming `self`.
>> +    pub fn into_expression(self) -> EvaluatedExpression<M> {
>> +        self.expression
>> +    }
> nit: is there any reason why this is not an impl From<A> for B? if not i
> would personally find such an API more idiomatic

Will add a From implementation in v2, but I will keep into_expression
and have `from` call just that

>> +
>> +    /// The direct child nodes, uniform across all combinator kinds.
>> +    ///
>> +    /// 'not' yields its single operand as a one-element slice; leaf nodes
>> +    /// ('constant', 'match') yield an empty slice. This lets a generic tree
>> +    /// walker recurse without special-casing each variant.
>> +    pub fn children(&self) -> &[EvaluatedExpressionWithResult<M>] {
>> +        match &self.expression {
>> +            EvaluatedExpression::AllOf(expressions)
>> +            | EvaluatedExpression::AnyOf(expressions)
>> +            | EvaluatedExpression::OneOf(expressions) => expressions,
>> +            EvaluatedExpression::Not(expression) => std::slice::from_ref(&**expression),
>> +            EvaluatedExpression::Constant(_) | EvaluatedExpression::Match(_) => &[],
>> +        }
>> +    }
>> +}
>> +
>> +impl<M, D, E> Expression<M>
>> +where
>> +    M: Clone + MatchExpression<Data = D, Error = E>,
>> +{
>> +    /// Evaluate this expression against a provided variable.
>> +    ///
>> +    /// This function returns an `EvaluatedExpression`, replicating the exact structure
>> +    /// of `self`, but annotated with a per-subexpression trace to record which of
>> +    /// the subexpressions matched or not.
>> +    ///
>> +    /// # Note
>> +    /// This evaluates the expression and *all* sub-expressions fully and does not return
>> +    /// early if the final result is already determined by the already evaluated sub-expressions
>> +    /// (for instance, [`Expression::AnyOf`] and the first sub-expression matched).
>> +    /// This is done so that we can return the full trace via the [`EvaluatedExpressionWithResult`]
>> +    /// type.
>> +    ///
>> +    /// If you need fast evaluation and do not care about the trace, feel free to add a
>> +    /// `evaluate_fast` (or similar), which does early returns as appropriate and simply returns
>> +    /// `bool`.
>> +    pub fn evaluate(&self, data: &D) -> Result<EvaluatedExpressionWithResult<M>, E> {
>> +        let evaluated_expression = match self {
>> +            Expression::AllOf(expressions) => {
>> +                if expressions.is_empty() {
>> +                    // 'all-of' without any sub-expressions is *not* a match
>> +                    EvaluatedExpressionWithResult {
>> +                        expression: EvaluatedExpression::AllOf(Vec::new()),
>> +                        matches: false,
>> +                    }
> this probaly does not matter too much as long as it's documented, but
> intuitively (and based on implementations for all-expressions in 
> other languages like rust and python) i would expect all([]) to evaluate to
> true.

Yeah, I see where you are coming from, but after some consideration I've
decided that I'd like to keep it this way.

For non-coders, all([]) being true is not very intuitive, and I'd prefer
to just say "hey, all combinators eval to false if they have no
children" in the docs.

>> +                } else {
>> +                    let (matches, evaluated_expressions) =
>> +                        Self::evaluate_subexpressions(data, expressions, true, |a, b| a && b)?;
>> +
>> +                    EvaluatedExpressionWithResult {
>> +                        expression: EvaluatedExpression::AllOf(evaluated_expressions),
>> +                        matches,
>> +                    }
>> +                }
>> +            }

[...]

>> +
>> +#[cfg(test)]
>> +mod test {
>> +    use super::*;
>> +
>> +    #[derive(Serialize, Deserialize, Debug, Clone)]
>> +    #[serde(rename_all = "kebab-case", tag = "type")]
>> +    pub enum TestMatcher {
>> +        CustomFailure,
>> +        CustomTrue,
>> +        CustomFalse,
>> +    }
> nit: this enum does not pass clippy because of the common prefix

fixed, thanks!

>> +
>> +    impl MatchExpression for TestMatcher {
>> +        type Data = ();
>> +        type Error = ();
>> +
>> +        fn evaluate(&self, _data: &Self::Data) -> Result<bool, ()> {
>> +            match self {
>> +                TestMatcher::CustomFailure => Err(()),
>> +                TestMatcher::CustomTrue => Ok(true),
>> +                TestMatcher::CustomFalse => Ok(false),
>> +            }
>> +        }
>> +    }
>> +
> [...]





  reply	other threads:[~2026-09-04  9:48 UTC|newest]

Thread overview: 48+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2026-07-09 11:56 [PATCH many 00/29] notifications: add nested match expressions Lukas Wagner
2026-07-09 11:56 ` [PATCH proxmox 01/29] add new proxmox-match-expression crate Lukas Wagner
2026-07-24  6:46   ` Arthur Bied-Charreton
2026-09-04  9:48     ` Lukas Wagner [this message]
2026-07-09 11:56 ` [PATCH proxmox 02/29] notify: promote matcher to dir-style module Lukas Wagner
2026-07-09 11:56 ` [PATCH proxmox 03/29] notify: fix doc comment Lukas Wagner
2026-07-09 11:56 ` [PATCH proxmox 04/29] notify: matcher: break out severity matcher into submodule Lukas Wagner
2026-07-09 11:56 ` [PATCH proxmox 05/29] notify: matcher: break out field " Lukas Wagner
2026-07-09 11:56 ` [PATCH proxmox 06/29] notify: matcher: break out calendar " Lukas Wagner
2026-07-09 11:56 ` [PATCH proxmox 07/29] notify: matcher: calendar: add basic unit test Lukas Wagner
2026-07-09 11:56 ` [PATCH proxmox 08/29] notify: matcher: add InlineSeverityMatcher Lukas Wagner
2026-07-09 11:56 ` [PATCH proxmox 09/29] notify: matcher: add InlineFieldMatcher Lukas Wagner
2026-07-09 11:56 ` [PATCH proxmox 10/29] notify: matcher: add InlineCalendarMatcher Lukas Wagner
2026-07-24  6:47   ` Arthur Bied-Charreton
2026-07-24  9:43     ` Wolfgang Bumiller
2026-09-04 12:23     ` Lukas Wagner
2026-07-09 11:56 ` [PATCH proxmox 11/29] notify: matcher: add expression support Lukas Wagner
2026-07-24  6:59   ` Arthur Bied-Charreton
2026-07-09 11:56 ` [PATCH proxmox 12/29] notify: api: support new expression parameter Lukas Wagner
2026-07-24  6:46   ` Arthur Bied-Charreton
2026-07-24 10:01     ` Wolfgang Bumiller
2026-07-24 11:38       ` Arthur Bied-Charreton
2026-07-09 11:57 ` [PATCH proxmox 13/29] notify: api: add `get_matcher_as_expression` Lukas Wagner
2026-07-09 11:57 ` [PATCH proxmox 14/29] notify: migrate PBS's and PVE's default matcher to expression syntax Lukas Wagner
2026-07-24  6:47   ` Arthur Bied-Charreton
2026-07-09 11:57 ` [PATCH proxmox 15/29] notify: move legacy matcher keys behind feature flag Lukas Wagner
2026-07-09 11:57 ` [PATCH proxmox-widget-toolkit 16/29] notification: increase matcher window width Lukas Wagner
2026-07-09 11:57 ` [PATCH proxmox-widget-toolkit 17/29] notifications: matcher: add support for match expressions Lukas Wagner
2026-07-24  6:45   ` Arthur Bied-Charreton
2026-07-09 11:57 ` [PATCH proxmox-widget-toolkit 18/29] notification: matcher: add better calendar editor Lukas Wagner
2026-07-24  6:46   ` Arthur Bied-Charreton
2026-09-04 12:16     ` Lukas Wagner
2026-07-09 11:57 ` [PATCH proxmox-widget-toolkit 19/29] notifications: matcher: consistently use title case for UI elements Lukas Wagner
2026-07-09 11:57 ` [PATCH proxmox-backup 20/29] notification: opt into 'legacy-matchers' feature in proxmox-notify Lukas Wagner
2026-07-09 11:57 ` [PATCH proxmox-backup 21/29] api: notification: add 'migrate-to-expression' parameter to get_matcher Lukas Wagner
2026-07-09 11:57 ` [PATCH proxmox-backup 22/29] ui: notification: enable new matcher UI Lukas Wagner
2026-07-09 11:57 ` [PATCH proxmox-perl-rs 23/29] notify: matcher: pass matcher config / updater directly Lukas Wagner
2026-07-28 13:09   ` Wolfgang Bumiller
2026-07-09 11:57 ` [PATCH proxmox-perl-rs 24/29] notify: opt into 'legacy-matchers' feature in proxmox-notify Lukas Wagner
2026-07-24  6:48   ` Arthur Bied-Charreton
2026-07-09 11:57 ` [PATCH proxmox-perl-rs 25/29] notify: add 'migrate_to_expression' parameter for get_matcher Lukas Wagner
2026-07-09 11:57 ` [PATCH manager 26/29] api: notification: pass config/updater directly to rust bindings Lukas Wagner
2026-07-31  7:19   ` Lukas Wagner
2026-07-09 11:57 ` [PATCH manager 27/29] api: notification: get_matcher: add 'migrate-to-expression' parameter Lukas Wagner
2026-07-09 11:57 ` [PATCH manager 28/29] api: notification: add 'expression' to matcher parameter schema Lukas Wagner
2026-07-09 11:57 ` [PATCH manager 29/29] ui: notification: enable new matcher UI Lukas Wagner
2026-07-24  6:44 ` [PATCH many 00/29] notifications: add nested match expressions Arthur Bied-Charreton
2026-07-24  6:53   ` Arthur Bied-Charreton

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=DL6FRMK4RMI4.3C0RYE3VQF33K@proxmox.com \
    --to=l.wagner@proxmox.com \
    --cc=a.bied-charreton@proxmox.com \
    --cc=pbs-devel@lists.proxmox.com \
    --cc=pve-devel@lists.proxmox.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox
Service provided by Proxmox Server Solutions GmbH | Privacy | Legal