From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from firstgate.proxmox.com (firstgate.proxmox.com [212.224.123.68]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by lists.proxmox.com (Postfix) with ESMTPS id DF5B4857F8 for ; Mon, 20 Dec 2021 08:42:42 +0100 (CET) Received: from firstgate.proxmox.com (localhost [127.0.0.1]) by firstgate.proxmox.com (Proxmox) with ESMTP id CE6C919C32 for ; Mon, 20 Dec 2021 08:42:42 +0100 (CET) Received: from bastionodiso.odiso.net (bastionodiso.odiso.net [IPv6:2a0a:1580:2000::2d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits)) (No client certificate requested) by firstgate.proxmox.com (Proxmox) with ESMTPS id 2CADE19C1E for ; Mon, 20 Dec 2021 08:42:41 +0100 (CET) Received: from kvmformation3.odiso.net (formationkvm3.odiso.net [10.3.94.12]) by bastionodiso.odiso.net (Postfix) with ESMTP id 5EE799E66; Mon, 20 Dec 2021 08:42:34 +0100 (CET) Received: by kvmformation3.odiso.net (Postfix, from userid 0) id 48E3413EA24; Mon, 20 Dec 2021 08:42:34 +0100 (CET) From: Alexandre Derumier To: pve-devel@lists.proxmox.com Date: Mon, 20 Dec 2021 08:42:30 +0100 Message-Id: <20211220074232.1762131-1-aderumier@odiso.com> X-Mailer: git-send-email 2.30.2 MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-SPAM-LEVEL: Spam detection results: 0 AWL 0.024 Adjusted score from AWL reputation of From: address BAYES_00 -1.9 Bayes spam probability is 0 to 1% HEADER_FROM_DIFFERENT_DOMAINS 0.25 From and EnvelopeFrom 2nd level mail domains are different KAM_DMARC_STATUS 0.01 Test Rule for DKIM or SPF Failure with Strict Alignment KAM_LAZY_DOMAIN_SECURITY 1 Sending domain does not have any anti-forgery methods NO_DNS_FOR_FROM 0.001 Envelope sender has no MX or A DNS records SPF_HELO_NONE 0.001 SPF: HELO does not publish an SPF Record SPF_NONE 0.001 SPF: sender does not publish an SPF Record Subject: [pve-devel] [PATCH V2 pve-ha-manager 0/2] POC/RFC: ressource aware HA manager X-BeenThere: pve-devel@lists.proxmox.com X-Mailman-Version: 2.1.29 Precedence: list List-Id: Proxmox VE development discussion List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 20 Dec 2021 07:42:42 -0000 Hi, this is a proof of concept to implement ressource aware HA. The current implementation is really basic, simply balancing the number of services on each node. I had some real production cases, where a node is failing, and restarted vm impact others nodes because of too much cpu/ram usage. Changelog v2: - merging main code && Sim code in same patch for now. (I'll split them later) - cleanup will all Thomas comments review (thanks again) - add more comments in code - check storage for lxc too - use maxmem for windows vms I still need to add missing storage availability test Alexandre Derumier (2): add ressource awareness manager add test-basic0 src/PVE/HA/Env.pm | 33 ++++ src/PVE/HA/Env/PVE2.pm | 171 ++++++++++++++++++ src/PVE/HA/Manager.pm | 258 ++++++++++++++++++++++++++- src/PVE/HA/Sim/Hardware.pm | 61 +++++++ src/PVE/HA/Sim/TestEnv.pm | 50 +++++- src/test/test-basic0/README | 1 + src/test/test-basic0/cmdlist | 4 + src/test/test-basic0/hardware_status | 5 + src/test/test-basic0/log.expect | 52 ++++++ src/test/test-basic0/manager_status | 1 + src/test/test-basic0/node_stats | 5 + src/test/test-basic0/service_config | 5 + src/test/test-basic0/service_stats | 5 + 13 files changed, 642 insertions(+), 9 deletions(-) create mode 100644 src/test/test-basic0/README create mode 100644 src/test/test-basic0/cmdlist create mode 100644 src/test/test-basic0/hardware_status create mode 100644 src/test/test-basic0/log.expect create mode 100644 src/test/test-basic0/manager_status create mode 100644 src/test/test-basic0/node_stats create mode 100644 src/test/test-basic0/service_config create mode 100644 src/test/test-basic0/service_stats -- 2.30.2