From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from firstgate.proxmox.com (firstgate.proxmox.com [212.224.123.68]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits)) (No client certificate requested) by lists.proxmox.com (Postfix) with ESMTPS id 51D1FA781 for ; Wed, 27 Apr 2022 17:34:27 +0200 (CEST) Received: from firstgate.proxmox.com (localhost [127.0.0.1]) by firstgate.proxmox.com (Proxmox) with ESMTP id 4FA08287F7 for ; Wed, 27 Apr 2022 17:33:57 +0200 (CEST) Received: from bastionodiso.odiso.net (bastionodiso.odiso.net [IPv6:2a0a:1580:2000::2d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits)) (No client certificate requested) by firstgate.proxmox.com (Proxmox) with ESMTPS id 0369A287C4 for ; Wed, 27 Apr 2022 17:33:53 +0200 (CEST) Received: from kvmformation3.odiso.net (formationkvm3.odiso.net [10.3.94.12]) by bastionodiso.odiso.net (Postfix) with ESMTP id B5567159B6; Wed, 27 Apr 2022 17:33:52 +0200 (CEST) Received: by kvmformation3.odiso.net (Postfix, from userid 0) id A7C94F94C6; Wed, 27 Apr 2022 17:33:52 +0200 (CEST) From: Alexandre Derumier To: pve-devel@lists.proxmox.com Date: Wed, 27 Apr 2022 17:33:43 +0200 Message-Id: <20220427153351.1773666-1-aderumier@odiso.com> X-Mailer: git-send-email 2.30.2 MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-SPAM-LEVEL: Spam detection results: 0 AWL -0.003 Adjusted score from AWL reputation of From: address BAYES_00 -1.9 Bayes spam probability is 0 to 1% HEADER_FROM_DIFFERENT_DOMAINS 0.248 From and EnvelopeFrom 2nd level mail domains are different KAM_DMARC_STATUS 0.01 Test Rule for DKIM or SPF Failure with Strict Alignment KAM_LAZY_DOMAIN_SECURITY 1 Sending domain does not have any anti-forgery methods NO_DNS_FOR_FROM 0.001 Envelope sender has no MX or A DNS records SPF_HELO_NONE 0.001 SPF: HELO does not publish an SPF Record SPF_NONE 0.001 SPF: sender does not publish an SPF Record Subject: [pve-devel] [PATCH pve-ha-manager 0/8] WIP: ressource aware HA manager + balancer X-BeenThere: pve-devel@lists.proxmox.com X-Mailman-Version: 2.1.29 Precedence: list List-Id: Proxmox VE development discussion List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 27 Apr 2022 15:34:27 -0000 Hi, This is a big rework of my previous patches series. Currently, work in progress, so you don't need to review it for now. (but if you want, comments are still welcome ;) Biggest changes: - This now use a new ranking algorithm: AHP-Topsis. (details are in patch) - Adding a balancer. The main idea is to do something like drs 2.0 on vmware 7. The balancer is vm centric, looking at health of the vms (mainly based on the pressure). (more details in the patch too) - add affifinity/anti affinity vm ha groups. I'm currently working on adding a lot of tests, but current tests are already working fine. It's also need missing vm pressure stats, ksm stats and some other counters. I have tried to split code in differents patch as much as possible Alexandre Alexandre Derumier (8): add AHP && Topsis Math Helpers get services && nodes stats implement ressource aware service recovery add vm loadbalancing sim : hardware: add read stats add resources group add affinity add tests debian/pve-ha-manager.install | 6 + src/PVE/HA/Balancer/AHP.pm | 120 ++++++++++ src/PVE/HA/Balancer/Makefile | 6 + src/PVE/HA/Balancer/Nodes.pm | 219 ++++++++++++++++++ src/PVE/HA/Balancer/Services.pm | 203 ++++++++++++++++ src/PVE/HA/Balancer/Stats.pm | 134 +++++++++++ src/PVE/HA/Balancer/Topsis.pm | 115 +++++++++ src/PVE/HA/Config.pm | 22 ++ src/PVE/HA/Env.pm | 45 ++++ src/PVE/HA/Env/PVE2.pm | 207 +++++++++++++++++ src/PVE/HA/Makefile | 4 +- src/PVE/HA/Manager.pm | 101 +++++++- src/PVE/HA/ResourcesGroups.pm | 90 +++++++ src/PVE/HA/Sim/Env.pm | 8 + src/PVE/HA/Sim/Hardware.pm | 165 +++++++++++++ src/PVE/HA/Sim/TestEnv.pm | 68 +++++- src/PVE/HA/Tools.pm | 6 + src/test/test-basic0-balance-affinity/README | 1 + src/test/test-basic0-balance-affinity/cmdlist | 3 + .../datacenter.cfg | 5 + .../hardware_status | 5 + .../test-basic0-balance-affinity/log.expect | 40 ++++ .../manager_status | 1 + .../test-basic0-balance-affinity/node_stats | 5 + .../resources_groups | 3 + .../service_config | 5 + .../service_stats | 5 + .../test-basic0-balance-cpupressure/README | 1 + .../test-basic0-balance-cpupressure/cmdlist | 3 + .../datacenter.cfg | 5 + .../hardware_status | 5 + .../log.expect | 40 ++++ .../manager_status | 1 + .../node_stats | 5 + .../service_config | 5 + .../service_stats | 5 + src/test/test-basic0-recovery-affinity/README | 1 + .../test-basic0-recovery-affinity/cmdlist | 4 + .../datacenter.cfg | 5 + .../hardware_status | 5 + .../test-basic0-recovery-affinity/log.expect | 53 +++++ .../manager_status | 1 + .../test-basic0-recovery-affinity/node_stats | 5 + .../resources_groups | 3 + .../service_config | 5 + .../service_stats | 5 + .../test-basic0-recovery-antifinity/README | 1 + .../test-basic0-recovery-antifinity/cmdlist | 4 + .../datacenter.cfg | 5 + .../hardware_status | 5 + .../log.expect | 53 +++++ .../manager_status | 1 + .../node_stats | 5 + .../resources_groups | 3 + .../service_config | 5 + .../service_stats | 5 + src/test/test-basic00-recovery-storage/README | 1 + .../test-basic00-recovery-storage/cmdlist | 4 + .../hardware_status | 5 + .../test-basic00-recovery-storage/log.expect | 52 +++++ .../manager_status | 1 + .../service_config | 5 + .../test-basic00-recovery-storage/storecfg | 3 + .../test-basic00-recovery-storage/vm_config | 5 + 64 files changed, 1902 insertions(+), 10 deletions(-) create mode 100644 src/PVE/HA/Balancer/AHP.pm create mode 100644 src/PVE/HA/Balancer/Makefile create mode 100644 src/PVE/HA/Balancer/Nodes.pm create mode 100644 src/PVE/HA/Balancer/Services.pm create mode 100644 src/PVE/HA/Balancer/Stats.pm create mode 100644 src/PVE/HA/Balancer/Topsis.pm create mode 100644 src/PVE/HA/ResourcesGroups.pm create mode 100644 src/test/test-basic0-balance-affinity/README create mode 100644 src/test/test-basic0-balance-affinity/cmdlist create mode 100644 src/test/test-basic0-balance-affinity/datacenter.cfg create mode 100644 src/test/test-basic0-balance-affinity/hardware_status create mode 100644 src/test/test-basic0-balance-affinity/log.expect create mode 100644 src/test/test-basic0-balance-affinity/manager_status create mode 100644 src/test/test-basic0-balance-affinity/node_stats create mode 100644 src/test/test-basic0-balance-affinity/resources_groups create mode 100644 src/test/test-basic0-balance-affinity/service_config create mode 100644 src/test/test-basic0-balance-affinity/service_stats create mode 100644 src/test/test-basic0-balance-cpupressure/README create mode 100644 src/test/test-basic0-balance-cpupressure/cmdlist create mode 100644 src/test/test-basic0-balance-cpupressure/datacenter.cfg create mode 100644 src/test/test-basic0-balance-cpupressure/hardware_status create mode 100644 src/test/test-basic0-balance-cpupressure/log.expect create mode 100644 src/test/test-basic0-balance-cpupressure/manager_status create mode 100644 src/test/test-basic0-balance-cpupressure/node_stats create mode 100644 src/test/test-basic0-balance-cpupressure/service_config create mode 100644 src/test/test-basic0-balance-cpupressure/service_stats create mode 100644 src/test/test-basic0-recovery-affinity/README create mode 100644 src/test/test-basic0-recovery-affinity/cmdlist create mode 100644 src/test/test-basic0-recovery-affinity/datacenter.cfg create mode 100644 src/test/test-basic0-recovery-affinity/hardware_status create mode 100644 src/test/test-basic0-recovery-affinity/log.expect create mode 100644 src/test/test-basic0-recovery-affinity/manager_status create mode 100644 src/test/test-basic0-recovery-affinity/node_stats create mode 100644 src/test/test-basic0-recovery-affinity/resources_groups create mode 100644 src/test/test-basic0-recovery-affinity/service_config create mode 100644 src/test/test-basic0-recovery-affinity/service_stats create mode 100644 src/test/test-basic0-recovery-antifinity/README create mode 100644 src/test/test-basic0-recovery-antifinity/cmdlist create mode 100644 src/test/test-basic0-recovery-antifinity/datacenter.cfg create mode 100644 src/test/test-basic0-recovery-antifinity/hardware_status create mode 100644 src/test/test-basic0-recovery-antifinity/log.expect create mode 100644 src/test/test-basic0-recovery-antifinity/manager_status create mode 100644 src/test/test-basic0-recovery-antifinity/node_stats create mode 100644 src/test/test-basic0-recovery-antifinity/resources_groups create mode 100644 src/test/test-basic0-recovery-antifinity/service_config create mode 100644 src/test/test-basic0-recovery-antifinity/service_stats create mode 100644 src/test/test-basic00-recovery-storage/README create mode 100644 src/test/test-basic00-recovery-storage/cmdlist create mode 100644 src/test/test-basic00-recovery-storage/hardware_status create mode 100644 src/test/test-basic00-recovery-storage/log.expect create mode 100644 src/test/test-basic00-recovery-storage/manager_status create mode 100644 src/test/test-basic00-recovery-storage/service_config create mode 100644 src/test/test-basic00-recovery-storage/storecfg create mode 100644 src/test/test-basic00-recovery-storage/vm_config -- 2.30.2