public inbox for pve-devel@lists.proxmox.com
 help / color / mirror / Atom feed
From: Daniel Kral <d.kral@proxmox.com>
To: Fiona Ebner <f.ebner@proxmox.com>,
	Proxmox VE development discussion <pve-devel@lists.proxmox.com>
Subject: Re: [pve-devel] [PATCH ha-manager 04/15] add rules section config base plugin
Date: Fri, 25 Apr 2025 15:30:36 +0200	[thread overview]
Message-ID: <e3eaf7ca-1cd4-456f-9219-05ae444fe628@proxmox.com> (raw)
In-Reply-To: <e1f0f8c8-0286-48b4-b5b5-719016783e29@proxmox.com>

On 4/25/25 11:12, Fiona Ebner wrote:
> Am 25.04.25 um 10:29 schrieb Daniel Kral:
>> On 4/24/25 15:03, Fiona Ebner wrote:
>>> Am 25.03.25 um 16:12 schrieb Daniel Kral:
>>>> +
>>>> +    $func->($rule, $ruleid);
>>>> +    }
>>>> +}
>>>> +
>>>> +sub canonicalize {
>>>> +    my ($class, $rules, $groups, $services) = @_;
>>>> +
>>>> +    die "implement in subclass";
>>>> +}
>>>> +
>>>> +sub are_satisfiable {
>>>> +    my ($class, $rules, $groups, $services) = @_;
>>>> +
>>>> +    die "implement in subclass";
>>>> +}
>>>
>>> This might not be possible to implement in just the subclasses. E.g.
>>> services 1 and 2 have strict colocation with each other, but 1 has
>>> restricted location on node A and 2 has restricted location on node B.
>>>
>>> I don't think it hurts to rather put the implementation here with
>>> knowledge of all rule types and what inter-dependencies they entail. And
>>> maybe have it be a function rather than a method then?
>>
>> Yes, you're right, it would make more sense to have these be functions
>> rather than methods. In the current implementation it's rather confusing
>> and in the end $rules should consist of all types of rules, so $groups
>> and $services are hopefully not needed as separate parameters anymore
>> (The only usage for these are to check for HA group members).
> 
> For canonicalize(), I don't think it's a hard requirement. Can still be
> useful for further optimization of course.
> 
>> What do you think about something like a
>>
>> sub register_rule_check {
>>      my ($class, $check_func, $canonicalize_func, $satisfiable_func) = @_;
>> }
>>
>> in the base plugin and then each plugin can register their checker
>> methods with the behavior what is done when running canonicalize(...)
>> and are_satisfiable(...)? These then have to go through every registered
>> entry in the list and call $check_func and then either
>> $canonicalize_func and $satisfiable_func.
> 
> I don't see how that would help with the scenario I described above
> where the non-satisfiability can only be seen by knowing about
> inter-dependencies between rules.
> 
>> Another (simpler) option would be to just put all checker subroutines in
>> the base plugin, but that could get unmaintainable quite fast.
> 
> I think the helpers should go into the plugins. These can be designed to
> take the constraints arising from the inter-dependency as arguments.
> E.g. a helper in the location plugin, simply checking if the location
> rules are satisfiable (no constraints) and returning the arising
> services<->nodes constraints. A helper in the colocation plugin to check
> if colocation rules are satisfiable given certain services<->nodes
> constraints. The main function in the base plugin would just need to
> call these two in order then.

As discussed off-list, I'll take a closer look how we can improve the 
interface of the helpers between the Location and Colocation plugin 
here, so that they are less coupled on one another.

Depending on how large the rule set can get, I could see some possible 
improvements to factor out some of the common checks as pointed out by 
Fabian and you on/off-list, so that they're only done once, but as 
discussed off-list, I'll wait until their configuration variables are 
settled (nofailback, enabled/disabled/conflict).

> 
>>>> +sub checked_config {
>>>> +    my ($rules, $groups, $services) = @_;
>>>> +
>>>> +    my $types = __PACKAGE__->lookup_types();
>>>> +
>>>> +    for my $type (@$types) {
>>>> +    my $plugin = __PACKAGE__->lookup($type);
>>>> +
>>>> +    $plugin->canonicalize($rules, $groups, $services);
>>>
>>> Shouldn't we rather only pass the rules that belong to the specific
>>> plugin rather than always all?
>>
>> As in the previous comment, I think it would be reasonable to pass all
>> types of rules as there are some checks that require to check between
>> colocation and location rules, for example. But it would also make sense
>> to move these more general checks in the base plugin, so that the
>> checkers in the plugins have to only care about their own feasibility.
> 
> Again, IMHO we could have the plugins implement suitable helper
> functions, but put the logic that knows about inter-dependencies into
> the base plugin itself. Otherwise, you essentially need every plugin to
> care about all others, rather than having only the common base plugin
> care about all.
> 
> So design the helpers in expectation of what inter-dependencies we need
> to consider (this will of course change with future rules, but we are
> flexible to adapt), but don't have the plugins be concerned with other
> plugins directly, i.e. they don't need to know how the constraints arise
> from other rule types.

Similar to the above, having a more decoupled interface or separating 
check helpers into "plugin-local" and "global" (e.g. checking 
inconsistent inter-dependencies between location and colocation rules) 
makes sense here.


_______________________________________________
pve-devel mailing list
pve-devel@lists.proxmox.com
https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-devel

  reply	other threads:[~2025-04-25 13:31 UTC|newest]

Thread overview: 71+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2025-03-25 15:12 [pve-devel] [RFC cluster/ha-manager 00/16] HA colocation rules Daniel Kral
2025-03-25 15:12 ` [pve-devel] [PATCH cluster 1/1] cfs: add 'ha/rules.cfg' to observed files Daniel Kral
2025-03-25 15:12 ` [pve-devel] [PATCH ha-manager 01/15] ignore output of fence config tests in tree Daniel Kral
2025-03-25 17:49   ` [pve-devel] applied: " Thomas Lamprecht
2025-03-25 15:12 ` [pve-devel] [PATCH ha-manager 02/15] tools: add hash set helper subroutines Daniel Kral
2025-03-25 17:53   ` Thomas Lamprecht
2025-04-03 12:16     ` Fabian Grünbichler
2025-04-11 11:24       ` Daniel Kral
2025-03-25 15:12 ` [pve-devel] [PATCH ha-manager 03/15] usage: add get_service_node and pin_service_node methods Daniel Kral
2025-04-24 12:29   ` Fiona Ebner
2025-04-25  7:39     ` Daniel Kral
2025-03-25 15:12 ` [pve-devel] [PATCH ha-manager 04/15] add rules section config base plugin Daniel Kral
2025-04-24 13:03   ` Fiona Ebner
2025-04-25  8:29     ` Daniel Kral
2025-04-25  9:12       ` Fiona Ebner
2025-04-25 13:30         ` Daniel Kral [this message]
2025-03-25 15:12 ` [pve-devel] [PATCH ha-manager 05/15] rules: add colocation rule plugin Daniel Kral
2025-04-03 12:16   ` Fabian Grünbichler
2025-04-11 11:04     ` Daniel Kral
2025-04-25 14:06       ` Fiona Ebner
2025-04-29  8:37         ` Daniel Kral
2025-04-29  9:15           ` Fiona Ebner
2025-05-07  8:41             ` Daniel Kral
2025-04-25 14:05   ` Fiona Ebner
2025-04-29  8:44     ` Daniel Kral
2025-03-25 15:12 ` [pve-devel] [PATCH ha-manager 06/15] config, env, hw: add rules read and parse methods Daniel Kral
2025-04-25 14:11   ` Fiona Ebner
2025-03-25 15:12 ` [pve-devel] [PATCH ha-manager 07/15] manager: read and update rules config Daniel Kral
2025-04-25 14:30   ` Fiona Ebner
2025-04-29  8:04     ` Daniel Kral
2025-03-25 15:12 ` [pve-devel] [PATCH ha-manager 08/15] manager: factor out prioritized nodes in select_service_node Daniel Kral
2025-04-28 13:03   ` Fiona Ebner
2025-03-25 15:12 ` [pve-devel] [PATCH ha-manager 09/15] manager: apply colocation rules when selecting service nodes Daniel Kral
2025-04-03 12:17   ` Fabian Grünbichler
2025-04-11 15:56     ` Daniel Kral
2025-04-28 12:46       ` Fiona Ebner
2025-04-29  9:07         ` Daniel Kral
2025-04-29  9:22           ` Fiona Ebner
2025-04-28 12:26   ` Fiona Ebner
2025-04-28 14:33     ` Fiona Ebner
2025-04-29  9:39       ` Daniel Kral
2025-04-29  9:50     ` Daniel Kral
2025-04-30 11:09   ` Daniel Kral
2025-05-02  9:33     ` Fiona Ebner
2025-05-07  8:31       ` Daniel Kral
2025-03-25 15:12 ` [pve-devel] [PATCH ha-manager 10/15] sim: resources: add option to limit start and migrate tries to node Daniel Kral
2025-04-28 13:20   ` Fiona Ebner
2025-03-25 15:12 ` [pve-devel] [PATCH ha-manager 11/15] test: ha tester: add test cases for strict negative colocation rules Daniel Kral
2025-04-28 13:44   ` Fiona Ebner
2025-03-25 15:12 ` [pve-devel] [PATCH ha-manager 12/15] test: ha tester: add test cases for strict positive " Daniel Kral
2025-04-28 13:51   ` Fiona Ebner
2025-05-09 11:22     ` Daniel Kral
2025-03-25 15:12 ` [pve-devel] [PATCH ha-manager 13/15] test: ha tester: add test cases for loose " Daniel Kral
2025-04-28 14:44   ` Fiona Ebner
2025-05-09 11:20     ` Daniel Kral
2025-03-25 15:12 ` [pve-devel] [PATCH ha-manager 14/15] test: ha tester: add test cases in more complex scenarios Daniel Kral
2025-04-29  8:54   ` Fiona Ebner
2025-04-29  9:01   ` Fiona Ebner
2025-03-25 15:12 ` [pve-devel] [PATCH ha-manager 15/15] test: add test cases for rules config Daniel Kral
2025-03-25 16:47 ` [pve-devel] [RFC cluster/ha-manager 00/16] HA colocation rules Daniel Kral
2025-04-24 10:12   ` Fiona Ebner
2025-04-01  1:50 ` DERUMIER, Alexandre
2025-04-01  9:39   ` Daniel Kral
2025-04-01 11:05     ` DERUMIER, Alexandre via pve-devel
2025-04-03 12:26     ` Fabian Grünbichler
2025-04-24 10:12     ` Fiona Ebner
2025-04-24 10:12 ` Fiona Ebner
2025-04-25  8:36   ` Daniel Kral
2025-04-25 12:25     ` Fiona Ebner
2025-04-25 13:25       ` Daniel Kral
2025-04-25 13:58         ` Fiona Ebner

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=e3eaf7ca-1cd4-456f-9219-05ae444fe628@proxmox.com \
    --to=d.kral@proxmox.com \
    --cc=f.ebner@proxmox.com \
    --cc=pve-devel@lists.proxmox.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox
Service provided by Proxmox Server Solutions GmbH | Privacy | Legal