From: Alexandre Derumier <aderumier@odiso.com>
To: pve-devel@lists.proxmox.com
Subject: [pve-devel] [PATCH pve-ha-manager 0/8] WIP: ressource aware HA manager + balancer
Date: Wed, 27 Apr 2022 17:33:43 +0200 [thread overview]
Message-ID: <20220427153351.1773666-1-aderumier@odiso.com> (raw)
Hi,
This is a big rework of my previous patches series.
Currently, work in progress, so you don't need to review it for now.
(but if you want, comments are still welcome ;)
Biggest changes:
- This now use a new ranking algorithm: AHP-Topsis. (details are in patch)
- Adding a balancer. The main idea is to do something like drs 2.0 on vmware 7.
The balancer is vm centric, looking at health of the vms
(mainly based on the pressure). (more details in the patch too)
- add affifinity/anti affinity vm ha groups.
I'm currently working on adding a lot of tests, but current tests are already
working fine.
It's also need missing vm pressure stats, ksm stats and some other counters.
I have tried to split code in differents patch as much as possible
Alexandre
Alexandre Derumier (8):
add AHP && Topsis Math Helpers
get services && nodes stats
implement ressource aware service recovery
add vm loadbalancing
sim : hardware: add read stats
add resources group
add affinity
add tests
debian/pve-ha-manager.install | 6 +
src/PVE/HA/Balancer/AHP.pm | 120 ++++++++++
src/PVE/HA/Balancer/Makefile | 6 +
src/PVE/HA/Balancer/Nodes.pm | 219 ++++++++++++++++++
src/PVE/HA/Balancer/Services.pm | 203 ++++++++++++++++
src/PVE/HA/Balancer/Stats.pm | 134 +++++++++++
src/PVE/HA/Balancer/Topsis.pm | 115 +++++++++
src/PVE/HA/Config.pm | 22 ++
src/PVE/HA/Env.pm | 45 ++++
src/PVE/HA/Env/PVE2.pm | 207 +++++++++++++++++
src/PVE/HA/Makefile | 4 +-
src/PVE/HA/Manager.pm | 101 +++++++-
src/PVE/HA/ResourcesGroups.pm | 90 +++++++
src/PVE/HA/Sim/Env.pm | 8 +
src/PVE/HA/Sim/Hardware.pm | 165 +++++++++++++
src/PVE/HA/Sim/TestEnv.pm | 68 +++++-
src/PVE/HA/Tools.pm | 6 +
src/test/test-basic0-balance-affinity/README | 1 +
src/test/test-basic0-balance-affinity/cmdlist | 3 +
.../datacenter.cfg | 5 +
.../hardware_status | 5 +
.../test-basic0-balance-affinity/log.expect | 40 ++++
.../manager_status | 1 +
.../test-basic0-balance-affinity/node_stats | 5 +
.../resources_groups | 3 +
.../service_config | 5 +
.../service_stats | 5 +
.../test-basic0-balance-cpupressure/README | 1 +
.../test-basic0-balance-cpupressure/cmdlist | 3 +
.../datacenter.cfg | 5 +
.../hardware_status | 5 +
.../log.expect | 40 ++++
.../manager_status | 1 +
.../node_stats | 5 +
.../service_config | 5 +
.../service_stats | 5 +
src/test/test-basic0-recovery-affinity/README | 1 +
.../test-basic0-recovery-affinity/cmdlist | 4 +
.../datacenter.cfg | 5 +
.../hardware_status | 5 +
.../test-basic0-recovery-affinity/log.expect | 53 +++++
.../manager_status | 1 +
.../test-basic0-recovery-affinity/node_stats | 5 +
.../resources_groups | 3 +
.../service_config | 5 +
.../service_stats | 5 +
.../test-basic0-recovery-antifinity/README | 1 +
.../test-basic0-recovery-antifinity/cmdlist | 4 +
.../datacenter.cfg | 5 +
.../hardware_status | 5 +
.../log.expect | 53 +++++
.../manager_status | 1 +
.../node_stats | 5 +
.../resources_groups | 3 +
.../service_config | 5 +
.../service_stats | 5 +
src/test/test-basic00-recovery-storage/README | 1 +
.../test-basic00-recovery-storage/cmdlist | 4 +
.../hardware_status | 5 +
.../test-basic00-recovery-storage/log.expect | 52 +++++
.../manager_status | 1 +
.../service_config | 5 +
.../test-basic00-recovery-storage/storecfg | 3 +
.../test-basic00-recovery-storage/vm_config | 5 +
64 files changed, 1902 insertions(+), 10 deletions(-)
create mode 100644 src/PVE/HA/Balancer/AHP.pm
create mode 100644 src/PVE/HA/Balancer/Makefile
create mode 100644 src/PVE/HA/Balancer/Nodes.pm
create mode 100644 src/PVE/HA/Balancer/Services.pm
create mode 100644 src/PVE/HA/Balancer/Stats.pm
create mode 100644 src/PVE/HA/Balancer/Topsis.pm
create mode 100644 src/PVE/HA/ResourcesGroups.pm
create mode 100644 src/test/test-basic0-balance-affinity/README
create mode 100644 src/test/test-basic0-balance-affinity/cmdlist
create mode 100644 src/test/test-basic0-balance-affinity/datacenter.cfg
create mode 100644 src/test/test-basic0-balance-affinity/hardware_status
create mode 100644 src/test/test-basic0-balance-affinity/log.expect
create mode 100644 src/test/test-basic0-balance-affinity/manager_status
create mode 100644 src/test/test-basic0-balance-affinity/node_stats
create mode 100644 src/test/test-basic0-balance-affinity/resources_groups
create mode 100644 src/test/test-basic0-balance-affinity/service_config
create mode 100644 src/test/test-basic0-balance-affinity/service_stats
create mode 100644 src/test/test-basic0-balance-cpupressure/README
create mode 100644 src/test/test-basic0-balance-cpupressure/cmdlist
create mode 100644 src/test/test-basic0-balance-cpupressure/datacenter.cfg
create mode 100644 src/test/test-basic0-balance-cpupressure/hardware_status
create mode 100644 src/test/test-basic0-balance-cpupressure/log.expect
create mode 100644 src/test/test-basic0-balance-cpupressure/manager_status
create mode 100644 src/test/test-basic0-balance-cpupressure/node_stats
create mode 100644 src/test/test-basic0-balance-cpupressure/service_config
create mode 100644 src/test/test-basic0-balance-cpupressure/service_stats
create mode 100644 src/test/test-basic0-recovery-affinity/README
create mode 100644 src/test/test-basic0-recovery-affinity/cmdlist
create mode 100644 src/test/test-basic0-recovery-affinity/datacenter.cfg
create mode 100644 src/test/test-basic0-recovery-affinity/hardware_status
create mode 100644 src/test/test-basic0-recovery-affinity/log.expect
create mode 100644 src/test/test-basic0-recovery-affinity/manager_status
create mode 100644 src/test/test-basic0-recovery-affinity/node_stats
create mode 100644 src/test/test-basic0-recovery-affinity/resources_groups
create mode 100644 src/test/test-basic0-recovery-affinity/service_config
create mode 100644 src/test/test-basic0-recovery-affinity/service_stats
create mode 100644 src/test/test-basic0-recovery-antifinity/README
create mode 100644 src/test/test-basic0-recovery-antifinity/cmdlist
create mode 100644 src/test/test-basic0-recovery-antifinity/datacenter.cfg
create mode 100644 src/test/test-basic0-recovery-antifinity/hardware_status
create mode 100644 src/test/test-basic0-recovery-antifinity/log.expect
create mode 100644 src/test/test-basic0-recovery-antifinity/manager_status
create mode 100644 src/test/test-basic0-recovery-antifinity/node_stats
create mode 100644 src/test/test-basic0-recovery-antifinity/resources_groups
create mode 100644 src/test/test-basic0-recovery-antifinity/service_config
create mode 100644 src/test/test-basic0-recovery-antifinity/service_stats
create mode 100644 src/test/test-basic00-recovery-storage/README
create mode 100644 src/test/test-basic00-recovery-storage/cmdlist
create mode 100644 src/test/test-basic00-recovery-storage/hardware_status
create mode 100644 src/test/test-basic00-recovery-storage/log.expect
create mode 100644 src/test/test-basic00-recovery-storage/manager_status
create mode 100644 src/test/test-basic00-recovery-storage/service_config
create mode 100644 src/test/test-basic00-recovery-storage/storecfg
create mode 100644 src/test/test-basic00-recovery-storage/vm_config
--
2.30.2
next reply other threads:[~2022-04-27 15:34 UTC|newest]
Thread overview: 9+ messages / expand[flat|nested] mbox.gz Atom feed top
2022-04-27 15:33 Alexandre Derumier [this message]
2022-04-27 15:33 ` [pve-devel] [PATCH pve-ha-manager 1/8] add AHP && Topsis Math Helpers Alexandre Derumier
2022-04-27 15:33 ` [pve-devel] [PATCH pve-ha-manager 2/8] get services && nodes stats Alexandre Derumier
2022-04-27 15:33 ` [pve-devel] [PATCH pve-ha-manager 3/8] implement ressource aware service recovery Alexandre Derumier
2022-04-27 15:33 ` [pve-devel] [PATCH pve-ha-manager 4/8] add vm loadbalancing Alexandre Derumier
2022-04-27 15:33 ` [pve-devel] [PATCH pve-ha-manager 5/8] sim : hardware: add read stats Alexandre Derumier
2022-04-27 15:33 ` [pve-devel] [PATCH pve-ha-manager 6/8] add resources group Alexandre Derumier
2022-04-27 15:33 ` [pve-devel] [PATCH pve-ha-manager 7/8] add affinity Alexandre Derumier
2022-04-27 15:33 ` [pve-devel] [PATCH pve-ha-manager 8/8] add tests Alexandre Derumier
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20220427153351.1773666-1-aderumier@odiso.com \
--to=aderumier@odiso.com \
--cc=pve-devel@lists.proxmox.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox