From: Daniel Kral <d.kral@proxmox.com>
To: pve-devel@lists.proxmox.com
Subject: [pve-devel] [PATCH ha-manager 2/3] manager: fix precedence in mixed resource affinity rules usage
Date: Fri, 19 Sep 2025 16:08:10 +0200 [thread overview]
Message-ID: <20250919140856.1361124-3-d.kral@proxmox.com> (raw)
In-Reply-To: <20250919140856.1361124-1-d.kral@proxmox.com>
Strict positive resource affinity rules narrow down the possible nodes
to a single candidate for a HA resource A, which is the node, where the
most of the HA resources in the positive affinity rule are already
running on and in case of a tie the alphabetically first node is chosen.
If the chosen node contains a HA resource B, which is in negative
affinity with the HA resource A, then $pri_nodes will become empty and
will not result in any migration.
Therefore, apply the negative resource affinity rules before the
positive resource affinity rules to prevent the premature pruning of
nodes.
Signed-off-by: Daniel Kral <d.kral@proxmox.com>
---
src/PVE/HA/Manager.pm | 2 +-
.../README | 13 ++++++-
.../log.expect | 36 ++++++++++++++-----
3 files changed, 41 insertions(+), 10 deletions(-)
diff --git a/src/PVE/HA/Manager.pm b/src/PVE/HA/Manager.pm
index ba59f642..3d74288d 100644
--- a/src/PVE/HA/Manager.pm
+++ b/src/PVE/HA/Manager.pm
@@ -176,8 +176,8 @@ sub select_service_node {
}
}
- apply_positive_resource_affinity($together, $pri_nodes);
apply_negative_resource_affinity($separate, $pri_nodes);
+ apply_positive_resource_affinity($together, $pri_nodes);
return $maintenance_fallback
if defined($maintenance_fallback) && $pri_nodes->{$maintenance_fallback};
diff --git a/src/test/test-resource-affinity-strict-mixed2/README b/src/test/test-resource-affinity-strict-mixed2/README
index c56d1a2d..a4d89ff3 100644
--- a/src/test/test-resource-affinity-strict-mixed2/README
+++ b/src/test/test-resource-affinity-strict-mixed2/README
@@ -7,4 +7,15 @@ The test scenario is:
- vm:101, vm:103, vm:201, and vm:203 are currently running on node1
- vm:102 and vm:202 are running on node3 and node2 respectively
-The current outcome is incorrect.
+The expected outcome is:
+- The resource-node placements do not adhere to the defined resource affinity
+ rules, therefore the HA resources must be moved accordingly: As vm:101 and
+ vm:103 must be kept separate from vm:201 and vm:203, which are all currently
+ running on node1, these must be migrated to separate nodes:
+ - As the negative resource affinity rule is strict, resources must neither
+ share the current nor the migration target node, so both positive
+ affinity groups must be put on "spare" nodes, which in that case is node3
+ (for vm:101 and vm:103) and node2 (for vm:201 and vm:203) respectively.
+ These node selections are because there are already other positive
+ resource affinity rule members running on these nodes (vm:102 on node3
+ and vm:202 on node2).
diff --git a/src/test/test-resource-affinity-strict-mixed2/log.expect b/src/test/test-resource-affinity-strict-mixed2/log.expect
index 9cdc8b14..e7081e4b 100644
--- a/src/test/test-resource-affinity-strict-mixed2/log.expect
+++ b/src/test/test-resource-affinity-strict-mixed2/log.expect
@@ -25,16 +25,24 @@ info 20 node1/crm: service 'vm:103': state changed from 'request_start' t
info 20 node1/crm: service 'vm:201': state changed from 'request_start' to 'started' (node = node1)
info 20 node1/crm: service 'vm:202': state changed from 'request_start' to 'started' (node = node2)
info 20 node1/crm: service 'vm:203': state changed from 'request_start' to 'started' (node = node1)
+info 20 node1/crm: migrate service 'vm:101' to node 'node3' (running)
+info 20 node1/crm: service 'vm:101': state changed from 'started' to 'migrate' (node = node1, target = node3)
+info 20 node1/crm: migrate service 'vm:103' to node 'node3' (running)
+info 20 node1/crm: service 'vm:103': state changed from 'started' to 'migrate' (node = node1, target = node3)
+info 20 node1/crm: migrate service 'vm:201' to node 'node2' (running)
+info 20 node1/crm: service 'vm:201': state changed from 'started' to 'migrate' (node = node1, target = node2)
+info 20 node1/crm: migrate service 'vm:203' to node 'node2' (running)
+info 20 node1/crm: service 'vm:203': state changed from 'started' to 'migrate' (node = node1, target = node2)
info 21 node1/lrm: got lock 'ha_agent_node1_lock'
info 21 node1/lrm: status change wait_for_agent_lock => active
-info 21 node1/lrm: starting service vm:101
-info 21 node1/lrm: service status vm:101 started
-info 21 node1/lrm: starting service vm:103
-info 21 node1/lrm: service status vm:103 started
-info 21 node1/lrm: starting service vm:201
-info 21 node1/lrm: service status vm:201 started
-info 21 node1/lrm: starting service vm:203
-info 21 node1/lrm: service status vm:203 started
+info 21 node1/lrm: service vm:101 - start migrate to node 'node3'
+info 21 node1/lrm: service vm:101 - end migrate to node 'node3'
+info 21 node1/lrm: service vm:103 - start migrate to node 'node3'
+info 21 node1/lrm: service vm:103 - end migrate to node 'node3'
+info 21 node1/lrm: service vm:201 - start migrate to node 'node2'
+info 21 node1/lrm: service vm:201 - end migrate to node 'node2'
+info 21 node1/lrm: service vm:203 - start migrate to node 'node2'
+info 21 node1/lrm: service vm:203 - end migrate to node 'node2'
info 22 node2/crm: status change wait_for_quorum => slave
info 23 node2/lrm: got lock 'ha_agent_node2_lock'
info 23 node2/lrm: status change wait_for_agent_lock => active
@@ -45,4 +53,16 @@ info 25 node3/lrm: got lock 'ha_agent_node3_lock'
info 25 node3/lrm: status change wait_for_agent_lock => active
info 25 node3/lrm: starting service vm:102
info 25 node3/lrm: service status vm:102 started
+info 40 node1/crm: service 'vm:101': state changed from 'migrate' to 'started' (node = node3)
+info 40 node1/crm: service 'vm:103': state changed from 'migrate' to 'started' (node = node3)
+info 40 node1/crm: service 'vm:201': state changed from 'migrate' to 'started' (node = node2)
+info 40 node1/crm: service 'vm:203': state changed from 'migrate' to 'started' (node = node2)
+info 43 node2/lrm: starting service vm:201
+info 43 node2/lrm: service status vm:201 started
+info 43 node2/lrm: starting service vm:203
+info 43 node2/lrm: service status vm:203 started
+info 45 node3/lrm: starting service vm:101
+info 45 node3/lrm: service status vm:101 started
+info 45 node3/lrm: starting service vm:103
+info 45 node3/lrm: service status vm:103 started
info 620 hardware: exit simulation - done
--
2.47.3
_______________________________________________
pve-devel mailing list
pve-devel@lists.proxmox.com
https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-devel
next prev parent reply other threads:[~2025-09-19 14:09 UTC|newest]
Thread overview: 4+ messages / expand[flat|nested] mbox.gz Atom feed top
2025-09-19 14:08 [pve-devel] [PATCH ha-manager 0/3] fix mixed resource affinity precedence Daniel Kral
2025-09-19 14:08 ` [pve-devel] [PATCH ha-manager 1/3] tests: add regression tests for mixed resource affinity rules Daniel Kral
2025-09-19 14:08 ` Daniel Kral [this message]
2025-09-19 14:08 ` [pve-devel] [PATCH ha-manager 3/3] test: add additional mixed resource affinity rule test cases Daniel Kral
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20250919140856.1361124-3-d.kral@proxmox.com \
--to=d.kral@proxmox.com \
--cc=pve-devel@lists.proxmox.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.