From: Fiona Ebner <f.ebner@proxmox.com>
To: "Daniel Kral" <d.kral@proxmox.com>,
"Proxmox VE development discussion" <pve-devel@lists.proxmox.com>,
"Fabian Grünbichler" <f.gruenbichler@proxmox.com>
Subject: Re: [pve-devel] [PATCH ha-manager 05/15] rules: add colocation rule plugin
Date: Tue, 29 Apr 2025 11:15:58 +0200 [thread overview]
Message-ID: <a7528f74-2b8f-4961-940d-05574b2c046e@proxmox.com> (raw)
In-Reply-To: <bdea044b-68fb-45b8-b7c4-23b9fdd52d06@proxmox.com>
Am 29.04.25 um 10:37 schrieb Daniel Kral:
> On 4/25/25 16:06, Fiona Ebner wrote:
>> Am 11.04.25 um 13:04 schrieb Daniel Kral:
>>> On 4/3/25 14:16, Fabian Grünbichler wrote:
>>>> On March 25, 2025 4:12 pm, Daniel Kral wrote:
>>> Also, I was curious about how that would work out for the case where a
>>> negative colocation rule was defined for three nodes with those rules
>>> split into three rules (essentially a cycle dependence). This should in
>>> theory have the same semantics as the above rule set:
>>>
>>> colocation: stick-together1
>>> services vm:101,vm:104
>>> affinity together
>>> strict 1
>>>
>>> colocation: stick-together2
>>> services vm:104,vm:102
>>> affinity together
>>> strict 1
>>>
>>> colocation: very-lonely-services1
>>> services vm:101,vm:102
>>> affinity separate
>>> strict 1
>>>
>>> colocation: very-lonely-services2
>>> services vm:102,vm:103
>>> affinity separate
>>> strict 1
>>>
>>> colocation: very-lonely-services3
>>> services vm:101,vm:103
>>> affinity separate
>>> strict 1
>>>
>>> Without the merge of positive rules, 'check_inner_consistency' would
>>> again not detect the inconsistency here. But with the merge correctly
>>> applied before checking the consistency, this would be resolved and the
>>> effective rule set would be:
>>
>> I suppose the effective rule set would still also contain the two
>> 'together' rules, or?
>
> No, here it would not. I found it would be most fair or reasonable that
> if a positive and a negative colocation rule contradict each other to
> drop both of them. Here the conflicts are
>
> stick-together1 -- very-lonely-services1
> stick-together2 -- very-lonely-services1
>
> so all three of them will be dropped from the rule set.
>
> Seeing this again here, such cases definitely benefit from the immediate
> response with the 'conflict'/'ineffective' state to show users that
> those won't be applied instead of only logging it.
I don't think dropping all conflicting rules is best. Say you have a
rule between 100 services and that conflicts with a rule with just 2
services. Dropping the latter only is much preferred then IMHO. In
general, I'd argue that the more rules we can still honor, the better
from a user perspective. I don't think it's worth going out of our way
though and introduce much complexity to minimize it, because conflicts
are usually prevented while configuring already.
>>> colocation: very-lonely-services2
>>> services vm:102,vm:103
>>> affinity separate
>>> strict 1
>>>
>>> colocation: very-lonely-services3
>>> services vm:101,vm:103
>>> affinity separate
>>> strict 1
>>>
>>> It could be argued, that the negative colocation rules should be merged
>>> in a similar manner here, as there's now a "effective" difference in the
>>> semantics of the above rule sets, as the negative colocation rule
>>> between vm 101 and vm 103 and vm 102 and vm 103 remains.
>>>
>>> What do you think?
>>
>> I don't think there's a particular need to also merge negative rules
>> between services (when they form a complete graph). It won't make a
>> difference if there are no conflicts with positive rules and in edge
>> cases when there are conflicts (which usually gets caught while editing
>> the rules), it's better to drop fewer rules, so not merging is an
>> advantage. Or do you have a particular advantage in favor of merging in
>> mind?
>
> Yes, I think so too.
>
> There's quite the semantic difference between positive and negative
> colocation rules here. "Connected" positive colocation relationships
> (strict ones in particular) must be co-located in the end anyway, so it
> makes sense to merge them. Negative colocation relationships must be
> defined in a "circular" way and might just happen by coincidence for
> small scenarios.
>
> But one thing that just struck me is that what if the user intentionally
> wrote them as separate rules? Then it might be confusing that all rules
> are dropped and not just the minimal amount that contradict other
> rules... Then check_inner_consistency() would just drop the minimal
> amount of rules that need to be dropped as in the above example.
>
> It would be a softer interpretation of the rules indeed, but it might
> benefit the user in the end and make things easier to follow from the
> user perspective. If there's no opposition to that, I'd tend to drop the
> merging for any rules after all.
Having conflicts is already a bit of an edge case, so I don't think we
need to go out of our way to avoid merging of positive rules. But if it
doesn't increase the complexity much, it's fine either way IMHO.
_______________________________________________
pve-devel mailing list
pve-devel@lists.proxmox.com
https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-devel
next prev parent reply other threads:[~2025-04-29 9:15 UTC|newest]
Thread overview: 71+ messages / expand[flat|nested] mbox.gz Atom feed top
2025-03-25 15:12 [pve-devel] [RFC cluster/ha-manager 00/16] HA colocation rules Daniel Kral
2025-03-25 15:12 ` [pve-devel] [PATCH cluster 1/1] cfs: add 'ha/rules.cfg' to observed files Daniel Kral
2025-03-25 15:12 ` [pve-devel] [PATCH ha-manager 01/15] ignore output of fence config tests in tree Daniel Kral
2025-03-25 17:49 ` [pve-devel] applied: " Thomas Lamprecht
2025-03-25 15:12 ` [pve-devel] [PATCH ha-manager 02/15] tools: add hash set helper subroutines Daniel Kral
2025-03-25 17:53 ` Thomas Lamprecht
2025-04-03 12:16 ` Fabian Grünbichler
2025-04-11 11:24 ` Daniel Kral
2025-03-25 15:12 ` [pve-devel] [PATCH ha-manager 03/15] usage: add get_service_node and pin_service_node methods Daniel Kral
2025-04-24 12:29 ` Fiona Ebner
2025-04-25 7:39 ` Daniel Kral
2025-03-25 15:12 ` [pve-devel] [PATCH ha-manager 04/15] add rules section config base plugin Daniel Kral
2025-04-24 13:03 ` Fiona Ebner
2025-04-25 8:29 ` Daniel Kral
2025-04-25 9:12 ` Fiona Ebner
2025-04-25 13:30 ` Daniel Kral
2025-03-25 15:12 ` [pve-devel] [PATCH ha-manager 05/15] rules: add colocation rule plugin Daniel Kral
2025-04-03 12:16 ` Fabian Grünbichler
2025-04-11 11:04 ` Daniel Kral
2025-04-25 14:06 ` Fiona Ebner
2025-04-29 8:37 ` Daniel Kral
2025-04-29 9:15 ` Fiona Ebner [this message]
2025-05-07 8:41 ` Daniel Kral
2025-04-25 14:05 ` Fiona Ebner
2025-04-29 8:44 ` Daniel Kral
2025-03-25 15:12 ` [pve-devel] [PATCH ha-manager 06/15] config, env, hw: add rules read and parse methods Daniel Kral
2025-04-25 14:11 ` Fiona Ebner
2025-03-25 15:12 ` [pve-devel] [PATCH ha-manager 07/15] manager: read and update rules config Daniel Kral
2025-04-25 14:30 ` Fiona Ebner
2025-04-29 8:04 ` Daniel Kral
2025-03-25 15:12 ` [pve-devel] [PATCH ha-manager 08/15] manager: factor out prioritized nodes in select_service_node Daniel Kral
2025-04-28 13:03 ` Fiona Ebner
2025-03-25 15:12 ` [pve-devel] [PATCH ha-manager 09/15] manager: apply colocation rules when selecting service nodes Daniel Kral
2025-04-03 12:17 ` Fabian Grünbichler
2025-04-11 15:56 ` Daniel Kral
2025-04-28 12:46 ` Fiona Ebner
2025-04-29 9:07 ` Daniel Kral
2025-04-29 9:22 ` Fiona Ebner
2025-04-28 12:26 ` Fiona Ebner
2025-04-28 14:33 ` Fiona Ebner
2025-04-29 9:39 ` Daniel Kral
2025-04-29 9:50 ` Daniel Kral
2025-04-30 11:09 ` Daniel Kral
2025-05-02 9:33 ` Fiona Ebner
2025-05-07 8:31 ` Daniel Kral
2025-03-25 15:12 ` [pve-devel] [PATCH ha-manager 10/15] sim: resources: add option to limit start and migrate tries to node Daniel Kral
2025-04-28 13:20 ` Fiona Ebner
2025-03-25 15:12 ` [pve-devel] [PATCH ha-manager 11/15] test: ha tester: add test cases for strict negative colocation rules Daniel Kral
2025-04-28 13:44 ` Fiona Ebner
2025-03-25 15:12 ` [pve-devel] [PATCH ha-manager 12/15] test: ha tester: add test cases for strict positive " Daniel Kral
2025-04-28 13:51 ` Fiona Ebner
2025-05-09 11:22 ` Daniel Kral
2025-03-25 15:12 ` [pve-devel] [PATCH ha-manager 13/15] test: ha tester: add test cases for loose " Daniel Kral
2025-04-28 14:44 ` Fiona Ebner
2025-05-09 11:20 ` Daniel Kral
2025-03-25 15:12 ` [pve-devel] [PATCH ha-manager 14/15] test: ha tester: add test cases in more complex scenarios Daniel Kral
2025-04-29 8:54 ` Fiona Ebner
2025-04-29 9:01 ` Fiona Ebner
2025-03-25 15:12 ` [pve-devel] [PATCH ha-manager 15/15] test: add test cases for rules config Daniel Kral
2025-03-25 16:47 ` [pve-devel] [RFC cluster/ha-manager 00/16] HA colocation rules Daniel Kral
2025-04-24 10:12 ` Fiona Ebner
2025-04-01 1:50 ` DERUMIER, Alexandre
2025-04-01 9:39 ` Daniel Kral
2025-04-01 11:05 ` DERUMIER, Alexandre via pve-devel
2025-04-03 12:26 ` Fabian Grünbichler
2025-04-24 10:12 ` Fiona Ebner
2025-04-24 10:12 ` Fiona Ebner
2025-04-25 8:36 ` Daniel Kral
2025-04-25 12:25 ` Fiona Ebner
2025-04-25 13:25 ` Daniel Kral
2025-04-25 13:58 ` Fiona Ebner
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=a7528f74-2b8f-4961-940d-05574b2c046e@proxmox.com \
--to=f.ebner@proxmox.com \
--cc=d.kral@proxmox.com \
--cc=f.gruenbichler@proxmox.com \
--cc=pve-devel@lists.proxmox.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox
Service provided by Proxmox Server Solutions GmbH | Privacy | Legal