From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from gate001.proxmox.com (gate001.proxmox.com [IPv6:2a0f:8001:1:32::40]) by lore.proxmox.com (Postfix) with ESMTPS id E516B1FF0AF for ; Fri, 06 Nov 2026 10:58:22 +0100 (CET) Received: from gate001.proxmox.com (localhost.localdomain [127.0.0.1]) by gate001.proxmox.com (Proxmox) with ESMTP id 3851821735; Fri, 06 Nov 2026 10:57:42 +0100 (CET) From: Daniel Kral To: pve-devel@lists.proxmox.com Subject: [PATCH ha-manager v2 2/7] test: add test cases for node affinity rules with maintenance mode Date: Fri, 6 Nov 2026 10:56:45 +0100 Message-ID: <20261106095650.72865-3-d.kral@proxmox.com> X-Mailer: git-send-email 2.47.3 In-Reply-To: <20261106095650.72865-1-d.kral@proxmox.com> References: <20261106095650.72865-1-d.kral@proxmox.com> MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Bm-Milter-Handled: 55990f41-d878-4baa-be0a-ee34c49e34d2 X-Bm-Transport-Timestamp: 1793959024427 X-SPAM-LEVEL: Spam detection results: 0 AWL 0.663 Adjusted score from AWL reputation of From: address DMARC_MISSING 0.1 Missing DMARC policy KAM_DMARC_STATUS 0.01 Test Rule for DKIM or SPF Failure with Strict Alignment (newer systems) RCVD_IN_DNSWL_MED -2.3 Sender listed at https://www.dnswl.org/, medium trust SPF_HELO_NONE 0.001 SPF: HELO does not publish an SPF Record SPF_PASS -0.001 SPF: sender matches SPF record Message-ID-Hash: YWZRWOJTSWUOJ5HZACNQVZDGNASBWUNV X-Message-ID-Hash: YWZRWOJTSWUOJ5HZACNQVZDGNASBWUNV X-MailFrom: d.kral@proxmox.com X-Mailman-Rule-Misses: dmarc-mitigation; no-senders; approved; loop; banned-address; emergency; member-moderation; nonmember-moderation; administrivia; implicit-dest; max-recipients; max-size; news-moderation; no-subject; digests; suspicious-header X-Mailman-Version: 3.3.10 Precedence: list List-Id: Proxmox VE development discussion List-Help: List-Owner: List-Post: List-Subscribe: List-Unsubscribe: These test cases document how the HA Manager currently behaves for node affinity with HA resources with failback enabled and disabled, whose current nodes are put in maintenance mode and available afterwards again. The strict node affinity rule tests evaluate single and multi node priority classes cases. For the non-strict node affinity rule test cases, the single node member cases are sufficient, since non-strict node affinity rules are implicitly multi-priority node affinity rules with the non-member nodes having priority class -1. As noted in the relevant test cases, it's up for debate whether HA resources, whose maintenance node is a node of a lower node priority class should move back as the maintenance mode is lifted. These test cases do only document the current behavior of letting them stay on the replacement node, which is in the highest node priority class. Signed-off-by: Daniel Kral --- changes since v1: - add test cases which document the behavior of an HA resource, which is not on one of the nodes in its highest node priority class - reword related test cases accordingly for consistency .../README | 4 ++ .../cmdlist | 5 ++ .../hardware_status | 5 ++ .../log.expect | 48 +++++++++++++++++++ .../manager_status | 1 + .../rules_config | 3 ++ .../service_config | 3 ++ .../README | 3 ++ .../cmdlist | 5 ++ .../hardware_status | 5 ++ .../log.expect | 40 ++++++++++++++++ .../manager_status | 1 + .../rules_config | 3 ++ .../service_config | 3 ++ .../README | 9 ++++ .../cmdlist | 6 +++ .../hardware_status | 5 ++ .../log.expect | 39 +++++++++++++++ .../manager_status | 1 + .../rules_config | 3 ++ .../service_config | 1 + .../README | 10 ++++ .../cmdlist | 5 ++ .../hardware_status | 5 ++ .../log.expect | 40 ++++++++++++++++ .../manager_status | 1 + .../rules_config | 3 ++ .../service_config | 3 ++ .../README | 3 ++ .../cmdlist | 5 ++ .../hardware_status | 5 ++ .../log.expect | 36 ++++++++++++++ .../manager_status | 1 + .../rules_config | 4 ++ .../service_config | 3 ++ .../README | 3 ++ .../cmdlist | 5 ++ .../hardware_status | 5 ++ .../log.expect | 36 ++++++++++++++ .../manager_status | 1 + .../rules_config | 4 ++ .../service_config | 3 ++ .../README | 4 ++ .../cmdlist | 5 ++ .../hardware_status | 5 ++ .../log.expect | 48 +++++++++++++++++++ .../manager_status | 1 + .../rules_config | 4 ++ .../service_config | 3 ++ .../README | 3 ++ .../cmdlist | 5 ++ .../hardware_status | 5 ++ .../log.expect | 40 ++++++++++++++++ .../manager_status | 1 + .../rules_config | 4 ++ .../service_config | 3 ++ 56 files changed, 505 insertions(+) create mode 100644 src/test/test-node-affinity-maintenance-nonstrict1/README create mode 100644 src/test/test-node-affinity-maintenance-nonstrict1/cmdlist create mode 100644 src/test/test-node-affinity-maintenance-nonstrict1/hardware_status create mode 100644 src/test/test-node-affinity-maintenance-nonstrict1/log.expect create mode 100644 src/test/test-node-affinity-maintenance-nonstrict1/manager_status create mode 100644 src/test/test-node-affinity-maintenance-nonstrict1/rules_config create mode 100644 src/test/test-node-affinity-maintenance-nonstrict1/service_config create mode 100644 src/test/test-node-affinity-maintenance-nonstrict2/README create mode 100644 src/test/test-node-affinity-maintenance-nonstrict2/cmdlist create mode 100644 src/test/test-node-affinity-maintenance-nonstrict2/hardware_status create mode 100644 src/test/test-node-affinity-maintenance-nonstrict2/log.expect create mode 100644 src/test/test-node-affinity-maintenance-nonstrict2/manager_status create mode 100644 src/test/test-node-affinity-maintenance-nonstrict2/rules_config create mode 100644 src/test/test-node-affinity-maintenance-nonstrict2/service_config create mode 100644 src/test/test-node-affinity-maintenance-nonstrict3/README create mode 100644 src/test/test-node-affinity-maintenance-nonstrict3/cmdlist create mode 100644 src/test/test-node-affinity-maintenance-nonstrict3/hardware_status create mode 100644 src/test/test-node-affinity-maintenance-nonstrict3/log.expect create mode 100644 src/test/test-node-affinity-maintenance-nonstrict3/manager_status create mode 100644 src/test/test-node-affinity-maintenance-nonstrict3/rules_config create mode 100644 src/test/test-node-affinity-maintenance-nonstrict3/service_config create mode 100644 src/test/test-node-affinity-maintenance-nonstrict4/README create mode 100644 src/test/test-node-affinity-maintenance-nonstrict4/cmdlist create mode 100644 src/test/test-node-affinity-maintenance-nonstrict4/hardware_status create mode 100644 src/test/test-node-affinity-maintenance-nonstrict4/log.expect create mode 100644 src/test/test-node-affinity-maintenance-nonstrict4/manager_status create mode 100644 src/test/test-node-affinity-maintenance-nonstrict4/rules_config create mode 100644 src/test/test-node-affinity-maintenance-nonstrict4/service_config create mode 100644 src/test/test-node-affinity-maintenance-strict1/README create mode 100644 src/test/test-node-affinity-maintenance-strict1/cmdlist create mode 100644 src/test/test-node-affinity-maintenance-strict1/hardware_status create mode 100644 src/test/test-node-affinity-maintenance-strict1/log.expect create mode 100644 src/test/test-node-affinity-maintenance-strict1/manager_status create mode 100644 src/test/test-node-affinity-maintenance-strict1/rules_config create mode 100644 src/test/test-node-affinity-maintenance-strict1/service_config create mode 100644 src/test/test-node-affinity-maintenance-strict2/README create mode 100644 src/test/test-node-affinity-maintenance-strict2/cmdlist create mode 100644 src/test/test-node-affinity-maintenance-strict2/hardware_status create mode 100644 src/test/test-node-affinity-maintenance-strict2/log.expect create mode 100644 src/test/test-node-affinity-maintenance-strict2/manager_status create mode 100644 src/test/test-node-affinity-maintenance-strict2/rules_config create mode 100644 src/test/test-node-affinity-maintenance-strict2/service_config create mode 100644 src/test/test-node-affinity-maintenance-strict3/README create mode 100644 src/test/test-node-affinity-maintenance-strict3/cmdlist create mode 100644 src/test/test-node-affinity-maintenance-strict3/hardware_status create mode 100644 src/test/test-node-affinity-maintenance-strict3/log.expect create mode 100644 src/test/test-node-affinity-maintenance-strict3/manager_status create mode 100644 src/test/test-node-affinity-maintenance-strict3/rules_config create mode 100644 src/test/test-node-affinity-maintenance-strict3/service_config create mode 100644 src/test/test-node-affinity-maintenance-strict4/README create mode 100644 src/test/test-node-affinity-maintenance-strict4/cmdlist create mode 100644 src/test/test-node-affinity-maintenance-strict4/hardware_status create mode 100644 src/test/test-node-affinity-maintenance-strict4/log.expect create mode 100644 src/test/test-node-affinity-maintenance-strict4/manager_status create mode 100644 src/test/test-node-affinity-maintenance-strict4/rules_config create mode 100644 src/test/test-node-affinity-maintenance-strict4/service_config diff --git a/src/test/test-node-affinity-maintenance-nonstrict1/README b/src/test/test-node-affinity-maintenance-nonstrict1/README new file mode 100644 index 00000000..66111400 --- /dev/null +++ b/src/test/test-node-affinity-maintenance-nonstrict1/README @@ -0,0 +1,4 @@ +Test whether an HA resource with failback enabled on the single member node of +its non-strict node affinity rule will move to a replacement node if its +current node is in maintenance mode and moves back to the previous maintenance +node as soon as the node is available again. diff --git a/src/test/test-node-affinity-maintenance-nonstrict1/cmdlist b/src/test/test-node-affinity-maintenance-nonstrict1/cmdlist new file mode 100644 index 00000000..7e577b68 --- /dev/null +++ b/src/test/test-node-affinity-maintenance-nonstrict1/cmdlist @@ -0,0 +1,5 @@ +[ + [ "power node1 on", "power node2 on", "power node3 on"], + [ "crm node3 enable-node-maintenance" ], + [ "crm node3 disable-node-maintenance" ] +] diff --git a/src/test/test-node-affinity-maintenance-nonstrict1/hardware_status b/src/test/test-node-affinity-maintenance-nonstrict1/hardware_status new file mode 100644 index 00000000..451beb13 --- /dev/null +++ b/src/test/test-node-affinity-maintenance-nonstrict1/hardware_status @@ -0,0 +1,5 @@ +{ + "node1": { "power": "off", "network": "off" }, + "node2": { "power": "off", "network": "off" }, + "node3": { "power": "off", "network": "off" } +} diff --git a/src/test/test-node-affinity-maintenance-nonstrict1/log.expect b/src/test/test-node-affinity-maintenance-nonstrict1/log.expect new file mode 100644 index 00000000..339ce3ab --- /dev/null +++ b/src/test/test-node-affinity-maintenance-nonstrict1/log.expect @@ -0,0 +1,48 @@ +info 0 hardware: starting simulation +info 20 cmdlist: execute power node1 on +info 20 node1/crm: status change startup => wait_for_quorum +info 20 node1/lrm: status change startup => wait_for_agent_lock +info 20 cmdlist: execute power node2 on +info 20 node2/crm: status change startup => wait_for_quorum +info 20 node2/lrm: status change startup => wait_for_agent_lock +info 20 cmdlist: execute power node3 on +info 20 node3/crm: status change startup => wait_for_quorum +info 20 node3/lrm: status change startup => wait_for_agent_lock +info 20 node1/crm: got lock 'ha_manager_lock' +info 20 node1/crm: status change wait_for_quorum => master +info 20 node1/crm: node 'node1': state changed from 'unknown' => 'online' +info 20 node1/crm: node 'node2': state changed from 'unknown' => 'online' +info 20 node1/crm: node 'node3': state changed from 'unknown' => 'online' +info 20 node1/crm: adding new service 'vm:101' on node 'node3' +info 20 node1/crm: service 'vm:101': state changed from 'request_start' to 'started' (node = node3) +info 22 node2/crm: status change wait_for_quorum => slave +info 24 node3/crm: status change wait_for_quorum => slave +info 25 node3/lrm: got lock 'ha_agent_node3_lock' +info 25 node3/lrm: status change wait_for_agent_lock => active +info 25 node3/lrm: starting service vm:101 +info 25 node3/lrm: service status vm:101 started +info 120 cmdlist: execute crm node3 enable-node-maintenance +info 125 node3/lrm: status change active => maintenance +info 140 node1/crm: node 'node3': state changed from 'online' => 'maintenance' +info 140 node1/crm: migrate service 'vm:101' to node 'node1' (running) +info 140 node1/crm: service 'vm:101': state changed from 'started' to 'migrate' (node = node3, target = node1) +info 141 node1/lrm: got lock 'ha_agent_node1_lock' +info 141 node1/lrm: status change wait_for_agent_lock => active +info 145 node3/lrm: service vm:101 - start migrate to node 'node1' +info 145 node3/lrm: service vm:101 - end migrate to node 'node1' +info 160 node1/crm: service 'vm:101': state changed from 'migrate' to 'started' (node = node1) +info 161 node1/lrm: starting service vm:101 +info 161 node1/lrm: service status vm:101 started +info 220 cmdlist: execute crm node3 disable-node-maintenance +info 225 node3/lrm: got lock 'ha_agent_node3_lock' +info 225 node3/lrm: status change maintenance => active +info 240 node1/crm: node 'node3': state changed from 'maintenance' => 'online' +info 240 node1/crm: moving service 'vm:101' back to 'node3', node came back from maintenance. +info 240 node1/crm: migrate service 'vm:101' to node 'node3' (running) +info 240 node1/crm: service 'vm:101': state changed from 'started' to 'migrate' (node = node1, target = node3) +info 241 node1/lrm: service vm:101 - start migrate to node 'node3' +info 241 node1/lrm: service vm:101 - end migrate to node 'node3' +info 260 node1/crm: service 'vm:101': state changed from 'migrate' to 'started' (node = node3) +info 265 node3/lrm: starting service vm:101 +info 265 node3/lrm: service status vm:101 started +info 820 hardware: exit simulation - done diff --git a/src/test/test-node-affinity-maintenance-nonstrict1/manager_status b/src/test/test-node-affinity-maintenance-nonstrict1/manager_status new file mode 100644 index 00000000..0967ef42 --- /dev/null +++ b/src/test/test-node-affinity-maintenance-nonstrict1/manager_status @@ -0,0 +1 @@ +{} diff --git a/src/test/test-node-affinity-maintenance-nonstrict1/rules_config b/src/test/test-node-affinity-maintenance-nonstrict1/rules_config new file mode 100644 index 00000000..f758b512 --- /dev/null +++ b/src/test/test-node-affinity-maintenance-nonstrict1/rules_config @@ -0,0 +1,3 @@ +node-affinity: vm101-should-be-on-node3 + nodes node3 + resources vm:101 diff --git a/src/test/test-node-affinity-maintenance-nonstrict1/service_config b/src/test/test-node-affinity-maintenance-nonstrict1/service_config new file mode 100644 index 00000000..7f0b1bf9 --- /dev/null +++ b/src/test/test-node-affinity-maintenance-nonstrict1/service_config @@ -0,0 +1,3 @@ +{ + "vm:101": { "node": "node3", "state": "started" } +} diff --git a/src/test/test-node-affinity-maintenance-nonstrict2/README b/src/test/test-node-affinity-maintenance-nonstrict2/README new file mode 100644 index 00000000..aa65a55a --- /dev/null +++ b/src/test/test-node-affinity-maintenance-nonstrict2/README @@ -0,0 +1,3 @@ +Test whether an HA resource with failback disabled on the single member node of +its non-strict node affinity rule with a single node member will move to a +replacement node if its current node is in maintenance mode. diff --git a/src/test/test-node-affinity-maintenance-nonstrict2/cmdlist b/src/test/test-node-affinity-maintenance-nonstrict2/cmdlist new file mode 100644 index 00000000..7e577b68 --- /dev/null +++ b/src/test/test-node-affinity-maintenance-nonstrict2/cmdlist @@ -0,0 +1,5 @@ +[ + [ "power node1 on", "power node2 on", "power node3 on"], + [ "crm node3 enable-node-maintenance" ], + [ "crm node3 disable-node-maintenance" ] +] diff --git a/src/test/test-node-affinity-maintenance-nonstrict2/hardware_status b/src/test/test-node-affinity-maintenance-nonstrict2/hardware_status new file mode 100644 index 00000000..451beb13 --- /dev/null +++ b/src/test/test-node-affinity-maintenance-nonstrict2/hardware_status @@ -0,0 +1,5 @@ +{ + "node1": { "power": "off", "network": "off" }, + "node2": { "power": "off", "network": "off" }, + "node3": { "power": "off", "network": "off" } +} diff --git a/src/test/test-node-affinity-maintenance-nonstrict2/log.expect b/src/test/test-node-affinity-maintenance-nonstrict2/log.expect new file mode 100644 index 00000000..05a77a24 --- /dev/null +++ b/src/test/test-node-affinity-maintenance-nonstrict2/log.expect @@ -0,0 +1,40 @@ +info 0 hardware: starting simulation +info 20 cmdlist: execute power node1 on +info 20 node1/crm: status change startup => wait_for_quorum +info 20 node1/lrm: status change startup => wait_for_agent_lock +info 20 cmdlist: execute power node2 on +info 20 node2/crm: status change startup => wait_for_quorum +info 20 node2/lrm: status change startup => wait_for_agent_lock +info 20 cmdlist: execute power node3 on +info 20 node3/crm: status change startup => wait_for_quorum +info 20 node3/lrm: status change startup => wait_for_agent_lock +info 20 node1/crm: got lock 'ha_manager_lock' +info 20 node1/crm: status change wait_for_quorum => master +info 20 node1/crm: node 'node1': state changed from 'unknown' => 'online' +info 20 node1/crm: node 'node2': state changed from 'unknown' => 'online' +info 20 node1/crm: node 'node3': state changed from 'unknown' => 'online' +info 20 node1/crm: adding new service 'vm:101' on node 'node3' +info 20 node1/crm: service 'vm:101': state changed from 'request_start' to 'started' (node = node3) +info 22 node2/crm: status change wait_for_quorum => slave +info 24 node3/crm: status change wait_for_quorum => slave +info 25 node3/lrm: got lock 'ha_agent_node3_lock' +info 25 node3/lrm: status change wait_for_agent_lock => active +info 25 node3/lrm: starting service vm:101 +info 25 node3/lrm: service status vm:101 started +info 120 cmdlist: execute crm node3 enable-node-maintenance +info 125 node3/lrm: status change active => maintenance +info 140 node1/crm: node 'node3': state changed from 'online' => 'maintenance' +info 140 node1/crm: migrate service 'vm:101' to node 'node1' (running) +info 140 node1/crm: service 'vm:101': state changed from 'started' to 'migrate' (node = node3, target = node1) +info 141 node1/lrm: got lock 'ha_agent_node1_lock' +info 141 node1/lrm: status change wait_for_agent_lock => active +info 145 node3/lrm: service vm:101 - start migrate to node 'node1' +info 145 node3/lrm: service vm:101 - end migrate to node 'node1' +info 160 node1/crm: service 'vm:101': state changed from 'migrate' to 'started' (node = node1) +info 161 node1/lrm: starting service vm:101 +info 161 node1/lrm: service status vm:101 started +info 220 cmdlist: execute crm node3 disable-node-maintenance +info 225 node3/lrm: got lock 'ha_agent_node3_lock' +info 225 node3/lrm: status change maintenance => active +info 240 node1/crm: node 'node3': state changed from 'maintenance' => 'online' +info 820 hardware: exit simulation - done diff --git a/src/test/test-node-affinity-maintenance-nonstrict2/manager_status b/src/test/test-node-affinity-maintenance-nonstrict2/manager_status new file mode 100644 index 00000000..0967ef42 --- /dev/null +++ b/src/test/test-node-affinity-maintenance-nonstrict2/manager_status @@ -0,0 +1 @@ +{} diff --git a/src/test/test-node-affinity-maintenance-nonstrict2/rules_config b/src/test/test-node-affinity-maintenance-nonstrict2/rules_config new file mode 100644 index 00000000..f758b512 --- /dev/null +++ b/src/test/test-node-affinity-maintenance-nonstrict2/rules_config @@ -0,0 +1,3 @@ +node-affinity: vm101-should-be-on-node3 + nodes node3 + resources vm:101 diff --git a/src/test/test-node-affinity-maintenance-nonstrict2/service_config b/src/test/test-node-affinity-maintenance-nonstrict2/service_config new file mode 100644 index 00000000..c7266eec --- /dev/null +++ b/src/test/test-node-affinity-maintenance-nonstrict2/service_config @@ -0,0 +1,3 @@ +{ + "vm:101": { "node": "node3", "state": "started", "failback": 0 } +} diff --git a/src/test/test-node-affinity-maintenance-nonstrict3/README b/src/test/test-node-affinity-maintenance-nonstrict3/README new file mode 100644 index 00000000..73217fba --- /dev/null +++ b/src/test/test-node-affinity-maintenance-nonstrict3/README @@ -0,0 +1,9 @@ +Test whether an HA resource with failback enabled on a non-member node of its +non-strict node affinity rule will move to a replacement node if its current +node is in maintenance mode. As the member node in the non-strict node affinity +rule is available, the HA Manager will choose the member node as its +replacement node. + +Moving the HA resource back to its previous maintenance node as the node is +available again would be wasteful, because the HA resource would fail back to +the member node immediately after. diff --git a/src/test/test-node-affinity-maintenance-nonstrict3/cmdlist b/src/test/test-node-affinity-maintenance-nonstrict3/cmdlist new file mode 100644 index 00000000..9d78d8cd --- /dev/null +++ b/src/test/test-node-affinity-maintenance-nonstrict3/cmdlist @@ -0,0 +1,6 @@ +[ + [ "power node1 on", "power node2 on", "power node3 on" ], + [ "crm node2 enable-node-maintenance" ], + [ "service vm:101 add node2 started 1" ], + [ "crm node2 disable-node-maintenance" ] +] diff --git a/src/test/test-node-affinity-maintenance-nonstrict3/hardware_status b/src/test/test-node-affinity-maintenance-nonstrict3/hardware_status new file mode 100644 index 00000000..451beb13 --- /dev/null +++ b/src/test/test-node-affinity-maintenance-nonstrict3/hardware_status @@ -0,0 +1,5 @@ +{ + "node1": { "power": "off", "network": "off" }, + "node2": { "power": "off", "network": "off" }, + "node3": { "power": "off", "network": "off" } +} diff --git a/src/test/test-node-affinity-maintenance-nonstrict3/log.expect b/src/test/test-node-affinity-maintenance-nonstrict3/log.expect new file mode 100644 index 00000000..6f3ff1a2 --- /dev/null +++ b/src/test/test-node-affinity-maintenance-nonstrict3/log.expect @@ -0,0 +1,39 @@ +info 0 hardware: starting simulation +info 20 cmdlist: execute power node1 on +info 20 node1/crm: status change startup => wait_for_quorum +info 20 node1/lrm: status change startup => wait_for_agent_lock +info 20 cmdlist: execute power node2 on +info 20 node2/crm: status change startup => wait_for_quorum +info 20 node2/lrm: status change startup => wait_for_agent_lock +info 20 cmdlist: execute power node3 on +info 20 node3/crm: status change startup => wait_for_quorum +info 20 node3/lrm: status change startup => wait_for_agent_lock +info 120 cmdlist: execute crm node2 enable-node-maintenance +info 120 node1/crm: got lock 'ha_manager_lock' +info 120 node1/crm: status change wait_for_quorum => master +info 120 node1/crm: node 'node1': state changed from 'unknown' => 'online' +info 120 node1/crm: node 'node2': state changed from 'unknown' => 'online' +info 120 node1/crm: node 'node3': state changed from 'unknown' => 'online' +info 140 node1/crm: node 'node2': state changed from 'online' => 'maintenance' +info 220 cmdlist: execute service vm:101 add node2 started 1 +info 220 node1/crm: adding new service 'vm:101' on node 'node2' +info 220 node1/crm: service 'vm:101': state changed from 'request_start' to 'started' (node = node2) +info 220 node1/crm: migrate service 'vm:101' to node 'node3' (running) +info 220 node1/crm: service 'vm:101': state changed from 'started' to 'migrate' (node = node2, target = node3) +info 222 node2/crm: status change wait_for_quorum => slave +info 223 node2/lrm: got lock 'ha_agent_node2_lock' +info 223 node2/lrm: status change wait_for_agent_lock => active +info 223 node2/lrm: service vm:101 - start migrate to node 'node3' +info 223 node2/lrm: service vm:101 - end migrate to node 'node3' +info 224 node3/crm: status change wait_for_quorum => slave +info 225 node3/lrm: got lock 'ha_agent_node3_lock' +info 225 node3/lrm: status change wait_for_agent_lock => active +info 240 node1/crm: service 'vm:101': state changed from 'migrate' to 'started' (node = node3) +info 243 node2/lrm: status change active => maintenance +info 245 node3/lrm: starting service vm:101 +info 245 node3/lrm: service status vm:101 started +info 320 cmdlist: execute crm node2 disable-node-maintenance +info 323 node2/lrm: got lock 'ha_agent_node2_lock' +info 323 node2/lrm: status change maintenance => active +info 340 node1/crm: node 'node2': state changed from 'maintenance' => 'online' +info 920 hardware: exit simulation - done diff --git a/src/test/test-node-affinity-maintenance-nonstrict3/manager_status b/src/test/test-node-affinity-maintenance-nonstrict3/manager_status new file mode 100644 index 00000000..0967ef42 --- /dev/null +++ b/src/test/test-node-affinity-maintenance-nonstrict3/manager_status @@ -0,0 +1 @@ +{} diff --git a/src/test/test-node-affinity-maintenance-nonstrict3/rules_config b/src/test/test-node-affinity-maintenance-nonstrict3/rules_config new file mode 100644 index 00000000..f758b512 --- /dev/null +++ b/src/test/test-node-affinity-maintenance-nonstrict3/rules_config @@ -0,0 +1,3 @@ +node-affinity: vm101-should-be-on-node3 + nodes node3 + resources vm:101 diff --git a/src/test/test-node-affinity-maintenance-nonstrict3/service_config b/src/test/test-node-affinity-maintenance-nonstrict3/service_config new file mode 100644 index 00000000..0967ef42 --- /dev/null +++ b/src/test/test-node-affinity-maintenance-nonstrict3/service_config @@ -0,0 +1 @@ +{} diff --git a/src/test/test-node-affinity-maintenance-nonstrict4/README b/src/test/test-node-affinity-maintenance-nonstrict4/README new file mode 100644 index 00000000..3239e369 --- /dev/null +++ b/src/test/test-node-affinity-maintenance-nonstrict4/README @@ -0,0 +1,10 @@ +Test whether an HA resource with failback disabled on a non-member node of its +non-strict node affinity rule will move to a replacement node if its current +node is in maintenance mode. As the member node in the non-strict node affinity +rule is available, the HA Manager will choose the member node as its +replacement node. + +It's up for debate whether the HA resource should move back to its previous +maintenance node as the node is available again, but currently the HA resource +will be kept on the member node, because the member node is in the higher node +priority class than the other non-member nodes. diff --git a/src/test/test-node-affinity-maintenance-nonstrict4/cmdlist b/src/test/test-node-affinity-maintenance-nonstrict4/cmdlist new file mode 100644 index 00000000..5aa42a6c --- /dev/null +++ b/src/test/test-node-affinity-maintenance-nonstrict4/cmdlist @@ -0,0 +1,5 @@ +[ + [ "power node1 on", "power node2 on", "power node3 on" ], + [ "crm node1 enable-node-maintenance" ], + [ "crm node1 disable-node-maintenance" ] +] diff --git a/src/test/test-node-affinity-maintenance-nonstrict4/hardware_status b/src/test/test-node-affinity-maintenance-nonstrict4/hardware_status new file mode 100644 index 00000000..451beb13 --- /dev/null +++ b/src/test/test-node-affinity-maintenance-nonstrict4/hardware_status @@ -0,0 +1,5 @@ +{ + "node1": { "power": "off", "network": "off" }, + "node2": { "power": "off", "network": "off" }, + "node3": { "power": "off", "network": "off" } +} diff --git a/src/test/test-node-affinity-maintenance-nonstrict4/log.expect b/src/test/test-node-affinity-maintenance-nonstrict4/log.expect new file mode 100644 index 00000000..840f31be --- /dev/null +++ b/src/test/test-node-affinity-maintenance-nonstrict4/log.expect @@ -0,0 +1,40 @@ +info 0 hardware: starting simulation +info 20 cmdlist: execute power node1 on +info 20 node1/crm: status change startup => wait_for_quorum +info 20 node1/lrm: status change startup => wait_for_agent_lock +info 20 cmdlist: execute power node2 on +info 20 node2/crm: status change startup => wait_for_quorum +info 20 node2/lrm: status change startup => wait_for_agent_lock +info 20 cmdlist: execute power node3 on +info 20 node3/crm: status change startup => wait_for_quorum +info 20 node3/lrm: status change startup => wait_for_agent_lock +info 20 node1/crm: got lock 'ha_manager_lock' +info 20 node1/crm: status change wait_for_quorum => master +info 20 node1/crm: node 'node1': state changed from 'unknown' => 'online' +info 20 node1/crm: node 'node2': state changed from 'unknown' => 'online' +info 20 node1/crm: node 'node3': state changed from 'unknown' => 'online' +info 20 node1/crm: adding new service 'vm:101' on node 'node1' +info 20 node1/crm: service 'vm:101': state changed from 'request_start' to 'started' (node = node1) +info 21 node1/lrm: got lock 'ha_agent_node1_lock' +info 21 node1/lrm: status change wait_for_agent_lock => active +info 21 node1/lrm: starting service vm:101 +info 21 node1/lrm: service status vm:101 started +info 22 node2/crm: status change wait_for_quorum => slave +info 24 node3/crm: status change wait_for_quorum => slave +info 120 cmdlist: execute crm node1 enable-node-maintenance +info 121 node1/lrm: status change active => maintenance +info 140 node1/crm: node 'node1': state changed from 'online' => 'maintenance' +info 140 node1/crm: migrate service 'vm:101' to node 'node3' (running) +info 140 node1/crm: service 'vm:101': state changed from 'started' to 'migrate' (node = node1, target = node3) +info 141 node1/lrm: service vm:101 - start migrate to node 'node3' +info 141 node1/lrm: service vm:101 - end migrate to node 'node3' +info 145 node3/lrm: got lock 'ha_agent_node3_lock' +info 145 node3/lrm: status change wait_for_agent_lock => active +info 160 node1/crm: service 'vm:101': state changed from 'migrate' to 'started' (node = node3) +info 165 node3/lrm: starting service vm:101 +info 165 node3/lrm: service status vm:101 started +info 220 cmdlist: execute crm node1 disable-node-maintenance +info 221 node1/lrm: got lock 'ha_agent_node1_lock' +info 221 node1/lrm: status change maintenance => active +info 240 node1/crm: node 'node1': state changed from 'maintenance' => 'online' +info 820 hardware: exit simulation - done diff --git a/src/test/test-node-affinity-maintenance-nonstrict4/manager_status b/src/test/test-node-affinity-maintenance-nonstrict4/manager_status new file mode 100644 index 00000000..0967ef42 --- /dev/null +++ b/src/test/test-node-affinity-maintenance-nonstrict4/manager_status @@ -0,0 +1 @@ +{} diff --git a/src/test/test-node-affinity-maintenance-nonstrict4/rules_config b/src/test/test-node-affinity-maintenance-nonstrict4/rules_config new file mode 100644 index 00000000..f758b512 --- /dev/null +++ b/src/test/test-node-affinity-maintenance-nonstrict4/rules_config @@ -0,0 +1,3 @@ +node-affinity: vm101-should-be-on-node3 + nodes node3 + resources vm:101 diff --git a/src/test/test-node-affinity-maintenance-nonstrict4/service_config b/src/test/test-node-affinity-maintenance-nonstrict4/service_config new file mode 100644 index 00000000..38f6090e --- /dev/null +++ b/src/test/test-node-affinity-maintenance-nonstrict4/service_config @@ -0,0 +1,3 @@ +{ + "vm:101": { "node": "node1", "state": "started", "failback": 0 } +} diff --git a/src/test/test-node-affinity-maintenance-strict1/README b/src/test/test-node-affinity-maintenance-strict1/README new file mode 100644 index 00000000..a31be5db --- /dev/null +++ b/src/test/test-node-affinity-maintenance-strict1/README @@ -0,0 +1,3 @@ +Test whether an HA resource with failback enabled in a strict node affinity +rule with a single node member will stay on the current node even though it is +in maintenance mode, because it cannot find any replacement node. diff --git a/src/test/test-node-affinity-maintenance-strict1/cmdlist b/src/test/test-node-affinity-maintenance-strict1/cmdlist new file mode 100644 index 00000000..7e577b68 --- /dev/null +++ b/src/test/test-node-affinity-maintenance-strict1/cmdlist @@ -0,0 +1,5 @@ +[ + [ "power node1 on", "power node2 on", "power node3 on"], + [ "crm node3 enable-node-maintenance" ], + [ "crm node3 disable-node-maintenance" ] +] diff --git a/src/test/test-node-affinity-maintenance-strict1/hardware_status b/src/test/test-node-affinity-maintenance-strict1/hardware_status new file mode 100644 index 00000000..451beb13 --- /dev/null +++ b/src/test/test-node-affinity-maintenance-strict1/hardware_status @@ -0,0 +1,5 @@ +{ + "node1": { "power": "off", "network": "off" }, + "node2": { "power": "off", "network": "off" }, + "node3": { "power": "off", "network": "off" } +} diff --git a/src/test/test-node-affinity-maintenance-strict1/log.expect b/src/test/test-node-affinity-maintenance-strict1/log.expect new file mode 100644 index 00000000..e8ec162d --- /dev/null +++ b/src/test/test-node-affinity-maintenance-strict1/log.expect @@ -0,0 +1,36 @@ +info 0 hardware: starting simulation +info 20 cmdlist: execute power node1 on +info 20 node1/crm: status change startup => wait_for_quorum +info 20 node1/lrm: status change startup => wait_for_agent_lock +info 20 cmdlist: execute power node2 on +info 20 node2/crm: status change startup => wait_for_quorum +info 20 node2/lrm: status change startup => wait_for_agent_lock +info 20 cmdlist: execute power node3 on +info 20 node3/crm: status change startup => wait_for_quorum +info 20 node3/lrm: status change startup => wait_for_agent_lock +info 20 node1/crm: got lock 'ha_manager_lock' +info 20 node1/crm: status change wait_for_quorum => master +info 20 node1/crm: node 'node1': state changed from 'unknown' => 'online' +info 20 node1/crm: node 'node2': state changed from 'unknown' => 'online' +info 20 node1/crm: node 'node3': state changed from 'unknown' => 'online' +info 20 node1/crm: adding new service 'vm:101' on node 'node3' +info 20 node1/crm: service 'vm:101': state changed from 'request_start' to 'started' (node = node3) +info 22 node2/crm: status change wait_for_quorum => slave +info 24 node3/crm: status change wait_for_quorum => slave +info 25 node3/lrm: got lock 'ha_agent_node3_lock' +info 25 node3/lrm: status change wait_for_agent_lock => active +info 25 node3/lrm: starting service vm:101 +info 25 node3/lrm: service status vm:101 started +info 120 cmdlist: execute crm node3 enable-node-maintenance +info 125 node3/lrm: status change active => maintenance +info 140 node1/crm: node 'node3': state changed from 'online' => 'maintenance' +warn 140 node1/crm: service 'vm:101': cannot find a replacement node while its current node is in maintenance +warn 160 node1/crm: service 'vm:101': cannot find a replacement node while its current node is in maintenance +warn 180 node1/crm: service 'vm:101': cannot find a replacement node while its current node is in maintenance +warn 200 node1/crm: service 'vm:101': cannot find a replacement node while its current node is in maintenance +info 220 cmdlist: execute crm node3 disable-node-maintenance +warn 220 node1/crm: service 'vm:101': cannot find a replacement node while its current node is in maintenance +info 225 node3/lrm: status change maintenance => active +info 240 node1/crm: node 'node3': state changed from 'maintenance' => 'online' +info 240 node1/crm: service 'vm:101': clearing stale maintenance node 'node3' setting (is current node) +info 820 hardware: exit simulation - done diff --git a/src/test/test-node-affinity-maintenance-strict1/manager_status b/src/test/test-node-affinity-maintenance-strict1/manager_status new file mode 100644 index 00000000..0967ef42 --- /dev/null +++ b/src/test/test-node-affinity-maintenance-strict1/manager_status @@ -0,0 +1 @@ +{} diff --git a/src/test/test-node-affinity-maintenance-strict1/rules_config b/src/test/test-node-affinity-maintenance-strict1/rules_config new file mode 100644 index 00000000..25aa655f --- /dev/null +++ b/src/test/test-node-affinity-maintenance-strict1/rules_config @@ -0,0 +1,4 @@ +node-affinity: vm101-must-be-on-node3 + nodes node3 + resources vm:101 + strict 1 diff --git a/src/test/test-node-affinity-maintenance-strict1/service_config b/src/test/test-node-affinity-maintenance-strict1/service_config new file mode 100644 index 00000000..7f0b1bf9 --- /dev/null +++ b/src/test/test-node-affinity-maintenance-strict1/service_config @@ -0,0 +1,3 @@ +{ + "vm:101": { "node": "node3", "state": "started" } +} diff --git a/src/test/test-node-affinity-maintenance-strict2/README b/src/test/test-node-affinity-maintenance-strict2/README new file mode 100644 index 00000000..8a7f768d --- /dev/null +++ b/src/test/test-node-affinity-maintenance-strict2/README @@ -0,0 +1,3 @@ +Test whether an HA resource with failback disabled in a strict node affinity +rule with a single node member will stay on the current node even though it is +in maintenance mode, because it cannot find any replacement node. diff --git a/src/test/test-node-affinity-maintenance-strict2/cmdlist b/src/test/test-node-affinity-maintenance-strict2/cmdlist new file mode 100644 index 00000000..7e577b68 --- /dev/null +++ b/src/test/test-node-affinity-maintenance-strict2/cmdlist @@ -0,0 +1,5 @@ +[ + [ "power node1 on", "power node2 on", "power node3 on"], + [ "crm node3 enable-node-maintenance" ], + [ "crm node3 disable-node-maintenance" ] +] diff --git a/src/test/test-node-affinity-maintenance-strict2/hardware_status b/src/test/test-node-affinity-maintenance-strict2/hardware_status new file mode 100644 index 00000000..451beb13 --- /dev/null +++ b/src/test/test-node-affinity-maintenance-strict2/hardware_status @@ -0,0 +1,5 @@ +{ + "node1": { "power": "off", "network": "off" }, + "node2": { "power": "off", "network": "off" }, + "node3": { "power": "off", "network": "off" } +} diff --git a/src/test/test-node-affinity-maintenance-strict2/log.expect b/src/test/test-node-affinity-maintenance-strict2/log.expect new file mode 100644 index 00000000..e8ec162d --- /dev/null +++ b/src/test/test-node-affinity-maintenance-strict2/log.expect @@ -0,0 +1,36 @@ +info 0 hardware: starting simulation +info 20 cmdlist: execute power node1 on +info 20 node1/crm: status change startup => wait_for_quorum +info 20 node1/lrm: status change startup => wait_for_agent_lock +info 20 cmdlist: execute power node2 on +info 20 node2/crm: status change startup => wait_for_quorum +info 20 node2/lrm: status change startup => wait_for_agent_lock +info 20 cmdlist: execute power node3 on +info 20 node3/crm: status change startup => wait_for_quorum +info 20 node3/lrm: status change startup => wait_for_agent_lock +info 20 node1/crm: got lock 'ha_manager_lock' +info 20 node1/crm: status change wait_for_quorum => master +info 20 node1/crm: node 'node1': state changed from 'unknown' => 'online' +info 20 node1/crm: node 'node2': state changed from 'unknown' => 'online' +info 20 node1/crm: node 'node3': state changed from 'unknown' => 'online' +info 20 node1/crm: adding new service 'vm:101' on node 'node3' +info 20 node1/crm: service 'vm:101': state changed from 'request_start' to 'started' (node = node3) +info 22 node2/crm: status change wait_for_quorum => slave +info 24 node3/crm: status change wait_for_quorum => slave +info 25 node3/lrm: got lock 'ha_agent_node3_lock' +info 25 node3/lrm: status change wait_for_agent_lock => active +info 25 node3/lrm: starting service vm:101 +info 25 node3/lrm: service status vm:101 started +info 120 cmdlist: execute crm node3 enable-node-maintenance +info 125 node3/lrm: status change active => maintenance +info 140 node1/crm: node 'node3': state changed from 'online' => 'maintenance' +warn 140 node1/crm: service 'vm:101': cannot find a replacement node while its current node is in maintenance +warn 160 node1/crm: service 'vm:101': cannot find a replacement node while its current node is in maintenance +warn 180 node1/crm: service 'vm:101': cannot find a replacement node while its current node is in maintenance +warn 200 node1/crm: service 'vm:101': cannot find a replacement node while its current node is in maintenance +info 220 cmdlist: execute crm node3 disable-node-maintenance +warn 220 node1/crm: service 'vm:101': cannot find a replacement node while its current node is in maintenance +info 225 node3/lrm: status change maintenance => active +info 240 node1/crm: node 'node3': state changed from 'maintenance' => 'online' +info 240 node1/crm: service 'vm:101': clearing stale maintenance node 'node3' setting (is current node) +info 820 hardware: exit simulation - done diff --git a/src/test/test-node-affinity-maintenance-strict2/manager_status b/src/test/test-node-affinity-maintenance-strict2/manager_status new file mode 100644 index 00000000..0967ef42 --- /dev/null +++ b/src/test/test-node-affinity-maintenance-strict2/manager_status @@ -0,0 +1 @@ +{} diff --git a/src/test/test-node-affinity-maintenance-strict2/rules_config b/src/test/test-node-affinity-maintenance-strict2/rules_config new file mode 100644 index 00000000..25aa655f --- /dev/null +++ b/src/test/test-node-affinity-maintenance-strict2/rules_config @@ -0,0 +1,4 @@ +node-affinity: vm101-must-be-on-node3 + nodes node3 + resources vm:101 + strict 1 diff --git a/src/test/test-node-affinity-maintenance-strict2/service_config b/src/test/test-node-affinity-maintenance-strict2/service_config new file mode 100644 index 00000000..c7266eec --- /dev/null +++ b/src/test/test-node-affinity-maintenance-strict2/service_config @@ -0,0 +1,3 @@ +{ + "vm:101": { "node": "node3", "state": "started", "failback": 0 } +} diff --git a/src/test/test-node-affinity-maintenance-strict3/README b/src/test/test-node-affinity-maintenance-strict3/README new file mode 100644 index 00000000..b5f5dfbb --- /dev/null +++ b/src/test/test-node-affinity-maintenance-strict3/README @@ -0,0 +1,4 @@ +Test whether an HA resource with failback enabled in a strict node affinity +rule with two differently prioritized node members will move to the +lower-priority node if its current node is in maintenance mode and moves back +to the previous maintenance node as soon as it's available again. diff --git a/src/test/test-node-affinity-maintenance-strict3/cmdlist b/src/test/test-node-affinity-maintenance-strict3/cmdlist new file mode 100644 index 00000000..7e577b68 --- /dev/null +++ b/src/test/test-node-affinity-maintenance-strict3/cmdlist @@ -0,0 +1,5 @@ +[ + [ "power node1 on", "power node2 on", "power node3 on"], + [ "crm node3 enable-node-maintenance" ], + [ "crm node3 disable-node-maintenance" ] +] diff --git a/src/test/test-node-affinity-maintenance-strict3/hardware_status b/src/test/test-node-affinity-maintenance-strict3/hardware_status new file mode 100644 index 00000000..451beb13 --- /dev/null +++ b/src/test/test-node-affinity-maintenance-strict3/hardware_status @@ -0,0 +1,5 @@ +{ + "node1": { "power": "off", "network": "off" }, + "node2": { "power": "off", "network": "off" }, + "node3": { "power": "off", "network": "off" } +} diff --git a/src/test/test-node-affinity-maintenance-strict3/log.expect b/src/test/test-node-affinity-maintenance-strict3/log.expect new file mode 100644 index 00000000..0bdf4fa0 --- /dev/null +++ b/src/test/test-node-affinity-maintenance-strict3/log.expect @@ -0,0 +1,48 @@ +info 0 hardware: starting simulation +info 20 cmdlist: execute power node1 on +info 20 node1/crm: status change startup => wait_for_quorum +info 20 node1/lrm: status change startup => wait_for_agent_lock +info 20 cmdlist: execute power node2 on +info 20 node2/crm: status change startup => wait_for_quorum +info 20 node2/lrm: status change startup => wait_for_agent_lock +info 20 cmdlist: execute power node3 on +info 20 node3/crm: status change startup => wait_for_quorum +info 20 node3/lrm: status change startup => wait_for_agent_lock +info 20 node1/crm: got lock 'ha_manager_lock' +info 20 node1/crm: status change wait_for_quorum => master +info 20 node1/crm: node 'node1': state changed from 'unknown' => 'online' +info 20 node1/crm: node 'node2': state changed from 'unknown' => 'online' +info 20 node1/crm: node 'node3': state changed from 'unknown' => 'online' +info 20 node1/crm: adding new service 'vm:101' on node 'node3' +info 20 node1/crm: service 'vm:101': state changed from 'request_start' to 'started' (node = node3) +info 22 node2/crm: status change wait_for_quorum => slave +info 24 node3/crm: status change wait_for_quorum => slave +info 25 node3/lrm: got lock 'ha_agent_node3_lock' +info 25 node3/lrm: status change wait_for_agent_lock => active +info 25 node3/lrm: starting service vm:101 +info 25 node3/lrm: service status vm:101 started +info 120 cmdlist: execute crm node3 enable-node-maintenance +info 125 node3/lrm: status change active => maintenance +info 140 node1/crm: node 'node3': state changed from 'online' => 'maintenance' +info 140 node1/crm: migrate service 'vm:101' to node 'node2' (running) +info 140 node1/crm: service 'vm:101': state changed from 'started' to 'migrate' (node = node3, target = node2) +info 143 node2/lrm: got lock 'ha_agent_node2_lock' +info 143 node2/lrm: status change wait_for_agent_lock => active +info 145 node3/lrm: service vm:101 - start migrate to node 'node2' +info 145 node3/lrm: service vm:101 - end migrate to node 'node2' +info 160 node1/crm: service 'vm:101': state changed from 'migrate' to 'started' (node = node2) +info 163 node2/lrm: starting service vm:101 +info 163 node2/lrm: service status vm:101 started +info 220 cmdlist: execute crm node3 disable-node-maintenance +info 225 node3/lrm: got lock 'ha_agent_node3_lock' +info 225 node3/lrm: status change maintenance => active +info 240 node1/crm: node 'node3': state changed from 'maintenance' => 'online' +info 240 node1/crm: moving service 'vm:101' back to 'node3', node came back from maintenance. +info 240 node1/crm: migrate service 'vm:101' to node 'node3' (running) +info 240 node1/crm: service 'vm:101': state changed from 'started' to 'migrate' (node = node2, target = node3) +info 243 node2/lrm: service vm:101 - start migrate to node 'node3' +info 243 node2/lrm: service vm:101 - end migrate to node 'node3' +info 260 node1/crm: service 'vm:101': state changed from 'migrate' to 'started' (node = node3) +info 265 node3/lrm: starting service vm:101 +info 265 node3/lrm: service status vm:101 started +info 820 hardware: exit simulation - done diff --git a/src/test/test-node-affinity-maintenance-strict3/manager_status b/src/test/test-node-affinity-maintenance-strict3/manager_status new file mode 100644 index 00000000..0967ef42 --- /dev/null +++ b/src/test/test-node-affinity-maintenance-strict3/manager_status @@ -0,0 +1 @@ +{} diff --git a/src/test/test-node-affinity-maintenance-strict3/rules_config b/src/test/test-node-affinity-maintenance-strict3/rules_config new file mode 100644 index 00000000..12539b76 --- /dev/null +++ b/src/test/test-node-affinity-maintenance-strict3/rules_config @@ -0,0 +1,4 @@ +node-affinity: vm101-must-be-on-node3-or-node2 + nodes node2:1,node3:2 + resources vm:101 + strict 1 diff --git a/src/test/test-node-affinity-maintenance-strict3/service_config b/src/test/test-node-affinity-maintenance-strict3/service_config new file mode 100644 index 00000000..7f0b1bf9 --- /dev/null +++ b/src/test/test-node-affinity-maintenance-strict3/service_config @@ -0,0 +1,3 @@ +{ + "vm:101": { "node": "node3", "state": "started" } +} diff --git a/src/test/test-node-affinity-maintenance-strict4/README b/src/test/test-node-affinity-maintenance-strict4/README new file mode 100644 index 00000000..43c68463 --- /dev/null +++ b/src/test/test-node-affinity-maintenance-strict4/README @@ -0,0 +1,3 @@ +Test whether an HA resource with failback disabled in a strict node affinity +rule with two differently prioritized node members will move to the +lower-priority node if its current node is in maintenance mode. diff --git a/src/test/test-node-affinity-maintenance-strict4/cmdlist b/src/test/test-node-affinity-maintenance-strict4/cmdlist new file mode 100644 index 00000000..7e577b68 --- /dev/null +++ b/src/test/test-node-affinity-maintenance-strict4/cmdlist @@ -0,0 +1,5 @@ +[ + [ "power node1 on", "power node2 on", "power node3 on"], + [ "crm node3 enable-node-maintenance" ], + [ "crm node3 disable-node-maintenance" ] +] diff --git a/src/test/test-node-affinity-maintenance-strict4/hardware_status b/src/test/test-node-affinity-maintenance-strict4/hardware_status new file mode 100644 index 00000000..451beb13 --- /dev/null +++ b/src/test/test-node-affinity-maintenance-strict4/hardware_status @@ -0,0 +1,5 @@ +{ + "node1": { "power": "off", "network": "off" }, + "node2": { "power": "off", "network": "off" }, + "node3": { "power": "off", "network": "off" } +} diff --git a/src/test/test-node-affinity-maintenance-strict4/log.expect b/src/test/test-node-affinity-maintenance-strict4/log.expect new file mode 100644 index 00000000..6f19258c --- /dev/null +++ b/src/test/test-node-affinity-maintenance-strict4/log.expect @@ -0,0 +1,40 @@ +info 0 hardware: starting simulation +info 20 cmdlist: execute power node1 on +info 20 node1/crm: status change startup => wait_for_quorum +info 20 node1/lrm: status change startup => wait_for_agent_lock +info 20 cmdlist: execute power node2 on +info 20 node2/crm: status change startup => wait_for_quorum +info 20 node2/lrm: status change startup => wait_for_agent_lock +info 20 cmdlist: execute power node3 on +info 20 node3/crm: status change startup => wait_for_quorum +info 20 node3/lrm: status change startup => wait_for_agent_lock +info 20 node1/crm: got lock 'ha_manager_lock' +info 20 node1/crm: status change wait_for_quorum => master +info 20 node1/crm: node 'node1': state changed from 'unknown' => 'online' +info 20 node1/crm: node 'node2': state changed from 'unknown' => 'online' +info 20 node1/crm: node 'node3': state changed from 'unknown' => 'online' +info 20 node1/crm: adding new service 'vm:101' on node 'node3' +info 20 node1/crm: service 'vm:101': state changed from 'request_start' to 'started' (node = node3) +info 22 node2/crm: status change wait_for_quorum => slave +info 24 node3/crm: status change wait_for_quorum => slave +info 25 node3/lrm: got lock 'ha_agent_node3_lock' +info 25 node3/lrm: status change wait_for_agent_lock => active +info 25 node3/lrm: starting service vm:101 +info 25 node3/lrm: service status vm:101 started +info 120 cmdlist: execute crm node3 enable-node-maintenance +info 125 node3/lrm: status change active => maintenance +info 140 node1/crm: node 'node3': state changed from 'online' => 'maintenance' +info 140 node1/crm: migrate service 'vm:101' to node 'node2' (running) +info 140 node1/crm: service 'vm:101': state changed from 'started' to 'migrate' (node = node3, target = node2) +info 143 node2/lrm: got lock 'ha_agent_node2_lock' +info 143 node2/lrm: status change wait_for_agent_lock => active +info 145 node3/lrm: service vm:101 - start migrate to node 'node2' +info 145 node3/lrm: service vm:101 - end migrate to node 'node2' +info 160 node1/crm: service 'vm:101': state changed from 'migrate' to 'started' (node = node2) +info 163 node2/lrm: starting service vm:101 +info 163 node2/lrm: service status vm:101 started +info 220 cmdlist: execute crm node3 disable-node-maintenance +info 225 node3/lrm: got lock 'ha_agent_node3_lock' +info 225 node3/lrm: status change maintenance => active +info 240 node1/crm: node 'node3': state changed from 'maintenance' => 'online' +info 820 hardware: exit simulation - done diff --git a/src/test/test-node-affinity-maintenance-strict4/manager_status b/src/test/test-node-affinity-maintenance-strict4/manager_status new file mode 100644 index 00000000..0967ef42 --- /dev/null +++ b/src/test/test-node-affinity-maintenance-strict4/manager_status @@ -0,0 +1 @@ +{} diff --git a/src/test/test-node-affinity-maintenance-strict4/rules_config b/src/test/test-node-affinity-maintenance-strict4/rules_config new file mode 100644 index 00000000..12539b76 --- /dev/null +++ b/src/test/test-node-affinity-maintenance-strict4/rules_config @@ -0,0 +1,4 @@ +node-affinity: vm101-must-be-on-node3-or-node2 + nodes node2:1,node3:2 + resources vm:101 + strict 1 diff --git a/src/test/test-node-affinity-maintenance-strict4/service_config b/src/test/test-node-affinity-maintenance-strict4/service_config new file mode 100644 index 00000000..c7266eec --- /dev/null +++ b/src/test/test-node-affinity-maintenance-strict4/service_config @@ -0,0 +1,3 @@ +{ + "vm:101": { "node": "node3", "state": "started", "failback": 0 } +} -- 2.47.3