From: Daniel Kral <d.kral@proxmox.com>
To: pve-devel@lists.proxmox.com
Subject: [PATCH-SERIES cluster/ha-manager/perl-rs/proxmox v3 00/40] dynamic scheduler + load rebalancer
Date: Mon, 30 Mar 2026 16:30:09 +0200 [thread overview]
Message-ID: <20260330144101.668747-1-d.kral@proxmox.com> (raw)
Most of the patches for the v3 are already R-b'd by @Dominik (many
thanks!). A lot less has changed than from v1 -> v2, I've still added
per-patch changelogs to make reviewing the rest more straightforward.
Most changes went into
- #05 - resource-scheduling: implement generic cluster usage
implementation
- #09 - resource-scheduling: implement rebalancing migration selection
- #13 - pve-rs: resource-scheduling: use generic usage implementation
- #19 - datacenter config: add auto rebalancing options
- #30 - usage: use add_service to add service usage to nodes
and the last few ha-manager patches should still get a review before
applying is considered. I'll follow-up with the changes for pve-docs and
pve-manager as soon as these patches are in a final state.
Otherwise, the patches have been tested with building per-patch
build-tests, I'll do some more testing with some Proxmox VE setups
tomorrow and give an update here.
Thank you very much for the feedback, @Dominik, @Thomas, @Maximiliano,
and @Jillian Morgan!
fixes v2 -> v3:
- correctly set running state for HA resources in usage accounting
- fix an error in Usage::add_resource_usage_to_node(), which correctly
handles adding a non-existent node (would still move existing resource
into moving state) and add a test case for that
changes v2 -> v3:
- rebased all repositories on master
- move unset current_node invariant handling from proxmox-perl-rs to
pve-ha-manager
- made logic in (proxmox-resource-scheduling) Usage::add_resource() and
Usage::add_resource_usage_to_node() more explicit by inling the logic
- drop Usage::add_resource_to_nodes()
- drop Usage::remove_resource_from_nodes()
- drop Resource::moving_to() method
- drop Resource::nodenames() and ResourcePlacement::nodenames() methods
- s/to_string/to_owned/ where sensible
- do not use bail!() but use assert!()s instead
- do not compare imbalance score in scheduler tests, but only the order
of the migrations returned by
score_best_balancing_migration_candidates{,_topsis}()
This patch series proposes an implementation for a dynamic scheduler and
manual/automatic static/dynamic load rebalancer by implementing the
following:
- gather dynamic node and service usage information and use it in the
dynamic scheduler, and
- implement a load rebalancer, which actively moves HA resources to
other nodes, to lower the overall cluster node imbalance, while
adhering to the HA rules.
== Model ==
The automatic load rebalancing system checks whether the cluster node
imbalance exceeds some user-defined threshold for some HA Manager rounds
("hold duration"). If it does exceed on consecutive HA Manager rounds,
it will choose the best service migration/relocation to improve the
cluster node imbalance and queue it if it significantly improves it by
some user-defined improvement ("margin").
The best service motion can be selected by either bruteforce or TOPSIS.
This selection method and some other parameters from above can be
tweaked at runtime.
== Tests ==
I've added some test cases to ensure more basic decisions are
documented. The other tests were in virtualized clusters with adding
load dynamically to guests with stress-ng, even though I plan to rely
more on real-world load simulators for the next batch of tests.
== Benchmarks ==
I've also done some theoretical benchmarks with the target of being able
to handle a 48 nodes cluster and 9.999 HA resources / guests and a
worst-case scenario of each HA resource being part of 3 HA rules
(pairwise positive and negative resource affinity rules, where each
positive resource affinity pair has a common node affinity rule).
Generating the migration candidates for the huge cluster with the
worst-case HA ruleset takes 243 +- 9 ms.
Generating the migration candidates for the huge cluster without the
worst-case HA ruleset (to gain the most amount of 459954 migration
candidates) takes 356 +- 6 ms. This is expected, because we need to
evaluate more HA resources' rules as there are no HA resource bundles.
Excluding the generation, the brute force and TOPSIS method for
select_best_balancing_migration() were roughly similar both being in the
range 350 +- 50 ms for the huge cluster without any HA rules (for the
maximum amount of migration candidates) including the serialization
between Perl and Rust.
== Future ideas ==
- include the migration costs in score_best_balancing_migrations(),
e.g., so that VMs with lots of memory are less likely to be migrated
if the link between the nodes is slow, but that would need measuring
and storing the migration network link speeds as a mesh
- apply some filter like moving average window or exponential smoothing
on the usage time series to dampen spikes; triple exponential
smoothing (Holts-Winters) is also already implemented in rrdcached and
allows for exponential smoothing with better time series analysis but
would require changing the rrdcached data structure once more
- score_best_balancing_migrations(...) can already provide a
size-limited list of the best migrations, which could be exposed to
users to allow manual load balancing actions, e.g., from the web
interface, to get some insight in the system
- The current scheduler can only solve bin covering, but it would be
interesting to also allow bin packing if certain criteria are met,
e.g., for energy preservation while the overall cluster load is low
- Allow individual HA resources to be actively excluded from the
automatic rebalancing, e.g., because containers cannot be live
migrated.
- move the migration candidate generation to the rust-side; the
generation on the perl-side was chosen first to reduce code
duplication, but it doesn't seem future proof and right to copy state
to the online_node_usage object twice (medium priority)
== Diffstat ==
proxmox:
Daniel Kral (9):
resource-scheduling: inline add_cpu_usage in
score_nodes_to_start_service
resource-scheduling: move score_nodes_to_start_service to scheduler
crate
resource-scheduling: rename service to resource where appropriate
resource-scheduling: introduce generic scheduler implementation
resource-scheduling: implement generic cluster usage implementation
resource-scheduling: topsis: handle empty criteria without panics
resource-scheduling: compare by nodename in
score_nodes_to_start_resource
resource-scheduling: factor out topsis alternative mapping
resource-scheduling: implement rebalancing migration selection
proxmox-resource-scheduling/src/lib.rs | 9 +
proxmox-resource-scheduling/src/node.rs | 96 +++++
proxmox-resource-scheduling/src/pve_static.rs | 102 ++---
proxmox-resource-scheduling/src/resource.rs | 117 +++++
proxmox-resource-scheduling/src/scheduler.rs | 407 ++++++++++++++++++
proxmox-resource-scheduling/src/topsis.rs | 6 +-
proxmox-resource-scheduling/src/usage.rs | 208 +++++++++
.../tests/scheduler.rs | 379 ++++++++++++++++
proxmox-resource-scheduling/tests/usage.rs | 181 ++++++++
9 files changed, 1437 insertions(+), 68 deletions(-)
create mode 100644 proxmox-resource-scheduling/src/node.rs
create mode 100644 proxmox-resource-scheduling/src/resource.rs
create mode 100644 proxmox-resource-scheduling/src/scheduler.rs
create mode 100644 proxmox-resource-scheduling/src/usage.rs
create mode 100644 proxmox-resource-scheduling/tests/scheduler.rs
create mode 100644 proxmox-resource-scheduling/tests/usage.rs
perl-rs:
Daniel Kral (7):
pve-rs: resource-scheduling: remove pedantic error handling from
remove_node
pve-rs: resource-scheduling: remove pedantic error handling from
remove_service_usage
pve-rs: resource-scheduling: move pve_static into resource_scheduling
module
pve-rs: resource-scheduling: use generic usage implementation
pve-rs: resource-scheduling: static: replace deprecated usage structs
pve-rs: resource-scheduling: implement pve_dynamic bindings
pve-rs: resource-scheduling: expose auto rebalancing methods
pve-rs/Makefile | 1 +
pve-rs/src/bindings/mod.rs | 3 +-
.../src/bindings/resource_scheduling/mod.rs | 10 +
.../resource_scheduling/pve_dynamic.rs | 227 ++++++++++++++++++
.../resource_scheduling/pve_static.rs | 225 +++++++++++++++++
.../bindings/resource_scheduling/resource.rs | 126 ++++++++++
.../src/bindings/resource_scheduling/usage.rs | 81 +++++++
.../bindings/resource_scheduling_static.rs | 215 -----------------
pve-rs/test/resource_scheduling.pl | 1 +
9 files changed, 672 insertions(+), 217 deletions(-)
create mode 100644 pve-rs/src/bindings/resource_scheduling/mod.rs
create mode 100644 pve-rs/src/bindings/resource_scheduling/pve_dynamic.rs
create mode 100644 pve-rs/src/bindings/resource_scheduling/pve_static.rs
create mode 100644 pve-rs/src/bindings/resource_scheduling/resource.rs
create mode 100644 pve-rs/src/bindings/resource_scheduling/usage.rs
delete mode 100644 pve-rs/src/bindings/resource_scheduling_static.rs
cluster:
Daniel Kral (3):
datacenter config: restructure verbose description for the ha crs
option
datacenter config: add dynamic load scheduler option
datacenter config: add auto rebalancing options
src/PVE/DataCenterConfig.pm | 53 ++++++++++++++++++++++++++++++++++---
1 file changed, 49 insertions(+), 4 deletions(-)
ha-manager:
Daniel Kral (15):
env: pve2: implement dynamic node and service stats
usage: pass service data to add_service_usage
usage: pass service data to get_used_service_nodes
add running flag to non-HA cluster service stats
usage: use add_service to add service usage to nodes
usage: add dynamic usage scheduler
test: add dynamic usage scheduler test cases
manager: rename execute_migration to queue_resource_motion
manager: update_crs_scheduler_mode: factor out crs config
implement automatic rebalancing
test: add resource bundle generation test cases
test: add dynamic automatic rebalancing system test cases
test: add static automatic rebalancing system test cases
test: add automatic rebalancing system test cases with TOPSIS method
test: add automatic rebalancing system test cases with affinity rules
Dominik Rusovac (6):
sim: hardware: pass correct types for static stats
sim: hardware: factor out static stats' default values
sim: hardware: fix static stats guard
sim: hardware: handle dynamic service stats
sim: hardware: add set-dynamic-stats command
sim: hardware: add getters for dynamic {node,service} stats
debian/pve-ha-manager.install | 1 +
src/PVE/HA/Env.pm | 12 +
src/PVE/HA/Env/PVE2.pm | 64 +++++
src/PVE/HA/Manager.pm | 220 +++++++++++++++-
src/PVE/HA/Rules/ResourceAffinity.pm | 3 +-
src/PVE/HA/Sim/Env.pm | 12 +
src/PVE/HA/Sim/Hardware.pm | 185 ++++++++++++--
src/PVE/HA/Sim/RTHardware.pm | 4 +-
src/PVE/HA/Usage.pm | 64 +++--
src/PVE/HA/Usage/Basic.pm | 9 +-
src/PVE/HA/Usage/Dynamic.pm | 155 ++++++++++++
src/PVE/HA/Usage/Makefile | 2 +-
src/PVE/HA/Usage/Static.pm | 63 ++++-
src/test/Makefile | 1 +
.../README | 2 +
.../cmdlist | 3 +
.../datacenter.cfg | 8 +
.../dynamic_service_stats | 1 +
.../hardware_status | 5 +
.../log.expect | 11 +
.../manager_status | 1 +
.../service_config | 1 +
.../static_service_stats | 1 +
.../README | 7 +
.../cmdlist | 3 +
.../datacenter.cfg | 8 +
.../dynamic_service_stats | 3 +
.../hardware_status | 5 +
.../log.expect | 25 ++
.../manager_status | 1 +
.../service_config | 3 +
.../static_service_stats | 3 +
.../README | 4 +
.../cmdlist | 3 +
.../datacenter.cfg | 8 +
.../dynamic_service_stats | 6 +
.../hardware_status | 5 +
.../log.expect | 59 +++++
.../manager_status | 1 +
.../service_config | 6 +
.../static_service_stats | 6 +
.../README | 4 +
.../cmdlist | 16 ++
.../datacenter.cfg | 8 +
.../dynamic_service_stats | 9 +
.../hardware_status | 5 +
.../log.expect | 80 ++++++
.../manager_status | 1 +
.../service_config | 9 +
.../static_service_stats | 9 +
.../README | 11 +
.../cmdlist | 13 +
.../datacenter.cfg | 9 +
.../dynamic_service_stats | 9 +
.../hardware_status | 5 +
.../log.expect | 59 +++++
.../manager_status | 1 +
.../service_config | 9 +
.../static_service_stats | 9 +
.../test-crs-dynamic-auto-rebalance0/README | 2 +
.../test-crs-dynamic-auto-rebalance0/cmdlist | 3 +
.../datacenter.cfg | 8 +
.../dynamic_service_stats | 1 +
.../hardware_status | 5 +
.../log.expect | 11 +
.../manager_status | 1 +
.../service_config | 1 +
.../static_service_stats | 1 +
.../test-crs-dynamic-auto-rebalance1/README | 7 +
.../test-crs-dynamic-auto-rebalance1/cmdlist | 3 +
.../datacenter.cfg | 7 +
.../dynamic_service_stats | 3 +
.../hardware_status | 5 +
.../log.expect | 25 ++
.../manager_status | 1 +
.../service_config | 3 +
.../static_service_stats | 3 +
.../test-crs-dynamic-auto-rebalance2/README | 4 +
.../test-crs-dynamic-auto-rebalance2/cmdlist | 3 +
.../datacenter.cfg | 7 +
.../dynamic_service_stats | 6 +
.../hardware_status | 5 +
.../log.expect | 59 +++++
.../manager_status | 1 +
.../service_config | 6 +
.../static_service_stats | 6 +
.../test-crs-dynamic-auto-rebalance3/README | 4 +
.../test-crs-dynamic-auto-rebalance3/cmdlist | 16 ++
.../datacenter.cfg | 7 +
.../dynamic_service_stats | 9 +
.../hardware_status | 5 +
.../log.expect | 80 ++++++
.../manager_status | 1 +
.../service_config | 9 +
.../static_service_stats | 9 +
.../test-crs-dynamic-auto-rebalance4/README | 11 +
.../test-crs-dynamic-auto-rebalance4/cmdlist | 13 +
.../datacenter.cfg | 8 +
.../dynamic_service_stats | 9 +
.../hardware_status | 5 +
.../log.expect | 59 +++++
.../manager_status | 1 +
.../service_config | 9 +
.../static_service_stats | 9 +
.../README | 7 +
.../cmdlist | 8 +
.../datacenter.cfg | 7 +
.../dynamic_service_stats | 5 +
.../hardware_status | 5 +
.../log.expect | 49 ++++
.../manager_status | 1 +
.../rules_config | 4 +
.../service_config | 5 +
.../static_service_stats | 5 +
.../README | 12 +
.../cmdlist | 8 +
.../datacenter.cfg | 7 +
.../dynamic_service_stats | 4 +
.../hardware_status | 5 +
.../log.expect | 53 ++++
.../manager_status | 1 +
.../rules_config | 3 +
.../service_config | 4 +
.../static_service_stats | 4 +
.../README | 14 ++
.../cmdlist | 3 +
.../datacenter.cfg | 8 +
.../dynamic_service_stats | 6 +
.../hardware_status | 5 +
.../log.expect | 59 +++++
.../manager_status | 31 +++
.../rules_config | 3 +
.../service_config | 6 +
.../static_service_stats | 6 +
.../README | 14 ++
.../cmdlist | 3 +
.../datacenter.cfg | 7 +
.../dynamic_service_stats | 6 +
.../hardware_status | 5 +
.../log.expect | 59 +++++
.../manager_status | 1 +
.../rules_config | 7 +
.../service_config | 6 +
.../static_service_stats | 6 +
src/test/test-crs-dynamic-rebalance1/README | 3 +
src/test/test-crs-dynamic-rebalance1/cmdlist | 4 +
.../datacenter.cfg | 7 +
.../dynamic_service_stats | 7 +
.../hardware_status | 5 +
.../test-crs-dynamic-rebalance1/log.expect | 82 ++++++
.../manager_status | 1 +
.../service_config | 7 +
.../static_service_stats | 7 +
src/test/test-crs-dynamic1/README | 4 +
src/test/test-crs-dynamic1/cmdlist | 4 +
src/test/test-crs-dynamic1/datacenter.cfg | 6 +
.../test-crs-dynamic1/dynamic_service_stats | 3 +
src/test/test-crs-dynamic1/hardware_status | 5 +
src/test/test-crs-dynamic1/log.expect | 51 ++++
src/test/test-crs-dynamic1/manager_status | 1 +
src/test/test-crs-dynamic1/service_config | 3 +
.../test-crs-dynamic1/static_service_stats | 3 +
.../test-crs-static-auto-rebalance1/README | 7 +
.../test-crs-static-auto-rebalance1/cmdlist | 3 +
.../datacenter.cfg | 7 +
.../hardware_status | 5 +
.../log.expect | 25 ++
.../manager_status | 1 +
.../service_config | 3 +
.../static_service_stats | 3 +
.../test-crs-static-auto-rebalance2/README | 4 +
.../test-crs-static-auto-rebalance2/cmdlist | 3 +
.../datacenter.cfg | 7 +
.../hardware_status | 5 +
.../log.expect | 59 +++++
.../manager_status | 1 +
.../service_config | 6 +
.../static_service_stats | 6 +
.../test-crs-static-auto-rebalance3/README | 3 +
.../test-crs-static-auto-rebalance3/cmdlist | 15 ++
.../datacenter.cfg | 7 +
.../hardware_status | 5 +
.../log.expect | 79 ++++++
.../manager_status | 1 +
.../service_config | 9 +
.../static_service_stats | 9 +
src/test/test_resource_bundles.pl | 234 ++++++++++++++++++
187 files changed, 2813 insertions(+), 50 deletions(-)
create mode 100644 src/PVE/HA/Usage/Dynamic.pm
create mode 100644 src/test/test-crs-dynamic-auto-rebalance-topsis0/README
create mode 100644 src/test/test-crs-dynamic-auto-rebalance-topsis0/cmdlist
create mode 100644 src/test/test-crs-dynamic-auto-rebalance-topsis0/datacenter.cfg
create mode 100644 src/test/test-crs-dynamic-auto-rebalance-topsis0/dynamic_service_stats
create mode 100644 src/test/test-crs-dynamic-auto-rebalance-topsis0/hardware_status
create mode 100644 src/test/test-crs-dynamic-auto-rebalance-topsis0/log.expect
create mode 100644 src/test/test-crs-dynamic-auto-rebalance-topsis0/manager_status
create mode 100644 src/test/test-crs-dynamic-auto-rebalance-topsis0/service_config
create mode 100644 src/test/test-crs-dynamic-auto-rebalance-topsis0/static_service_stats
create mode 100644 src/test/test-crs-dynamic-auto-rebalance-topsis1/README
create mode 100644 src/test/test-crs-dynamic-auto-rebalance-topsis1/cmdlist
create mode 100644 src/test/test-crs-dynamic-auto-rebalance-topsis1/datacenter.cfg
create mode 100644 src/test/test-crs-dynamic-auto-rebalance-topsis1/dynamic_service_stats
create mode 100644 src/test/test-crs-dynamic-auto-rebalance-topsis1/hardware_status
create mode 100644 src/test/test-crs-dynamic-auto-rebalance-topsis1/log.expect
create mode 100644 src/test/test-crs-dynamic-auto-rebalance-topsis1/manager_status
create mode 100644 src/test/test-crs-dynamic-auto-rebalance-topsis1/service_config
create mode 100644 src/test/test-crs-dynamic-auto-rebalance-topsis1/static_service_stats
create mode 100644 src/test/test-crs-dynamic-auto-rebalance-topsis2/README
create mode 100644 src/test/test-crs-dynamic-auto-rebalance-topsis2/cmdlist
create mode 100644 src/test/test-crs-dynamic-auto-rebalance-topsis2/datacenter.cfg
create mode 100644 src/test/test-crs-dynamic-auto-rebalance-topsis2/dynamic_service_stats
create mode 100644 src/test/test-crs-dynamic-auto-rebalance-topsis2/hardware_status
create mode 100644 src/test/test-crs-dynamic-auto-rebalance-topsis2/log.expect
create mode 100644 src/test/test-crs-dynamic-auto-rebalance-topsis2/manager_status
create mode 100644 src/test/test-crs-dynamic-auto-rebalance-topsis2/service_config
create mode 100644 src/test/test-crs-dynamic-auto-rebalance-topsis2/static_service_stats
create mode 100644 src/test/test-crs-dynamic-auto-rebalance-topsis3/README
create mode 100644 src/test/test-crs-dynamic-auto-rebalance-topsis3/cmdlist
create mode 100644 src/test/test-crs-dynamic-auto-rebalance-topsis3/datacenter.cfg
create mode 100644 src/test/test-crs-dynamic-auto-rebalance-topsis3/dynamic_service_stats
create mode 100644 src/test/test-crs-dynamic-auto-rebalance-topsis3/hardware_status
create mode 100644 src/test/test-crs-dynamic-auto-rebalance-topsis3/log.expect
create mode 100644 src/test/test-crs-dynamic-auto-rebalance-topsis3/manager_status
create mode 100644 src/test/test-crs-dynamic-auto-rebalance-topsis3/service_config
create mode 100644 src/test/test-crs-dynamic-auto-rebalance-topsis3/static_service_stats
create mode 100644 src/test/test-crs-dynamic-auto-rebalance-topsis4/README
create mode 100644 src/test/test-crs-dynamic-auto-rebalance-topsis4/cmdlist
create mode 100644 src/test/test-crs-dynamic-auto-rebalance-topsis4/datacenter.cfg
create mode 100644 src/test/test-crs-dynamic-auto-rebalance-topsis4/dynamic_service_stats
create mode 100644 src/test/test-crs-dynamic-auto-rebalance-topsis4/hardware_status
create mode 100644 src/test/test-crs-dynamic-auto-rebalance-topsis4/log.expect
create mode 100644 src/test/test-crs-dynamic-auto-rebalance-topsis4/manager_status
create mode 100644 src/test/test-crs-dynamic-auto-rebalance-topsis4/service_config
create mode 100644 src/test/test-crs-dynamic-auto-rebalance-topsis4/static_service_stats
create mode 100644 src/test/test-crs-dynamic-auto-rebalance0/README
create mode 100644 src/test/test-crs-dynamic-auto-rebalance0/cmdlist
create mode 100644 src/test/test-crs-dynamic-auto-rebalance0/datacenter.cfg
create mode 100644 src/test/test-crs-dynamic-auto-rebalance0/dynamic_service_stats
create mode 100644 src/test/test-crs-dynamic-auto-rebalance0/hardware_status
create mode 100644 src/test/test-crs-dynamic-auto-rebalance0/log.expect
create mode 100644 src/test/test-crs-dynamic-auto-rebalance0/manager_status
create mode 100644 src/test/test-crs-dynamic-auto-rebalance0/service_config
create mode 100644 src/test/test-crs-dynamic-auto-rebalance0/static_service_stats
create mode 100644 src/test/test-crs-dynamic-auto-rebalance1/README
create mode 100644 src/test/test-crs-dynamic-auto-rebalance1/cmdlist
create mode 100644 src/test/test-crs-dynamic-auto-rebalance1/datacenter.cfg
create mode 100644 src/test/test-crs-dynamic-auto-rebalance1/dynamic_service_stats
create mode 100644 src/test/test-crs-dynamic-auto-rebalance1/hardware_status
create mode 100644 src/test/test-crs-dynamic-auto-rebalance1/log.expect
create mode 100644 src/test/test-crs-dynamic-auto-rebalance1/manager_status
create mode 100644 src/test/test-crs-dynamic-auto-rebalance1/service_config
create mode 100644 src/test/test-crs-dynamic-auto-rebalance1/static_service_stats
create mode 100644 src/test/test-crs-dynamic-auto-rebalance2/README
create mode 100644 src/test/test-crs-dynamic-auto-rebalance2/cmdlist
create mode 100644 src/test/test-crs-dynamic-auto-rebalance2/datacenter.cfg
create mode 100644 src/test/test-crs-dynamic-auto-rebalance2/dynamic_service_stats
create mode 100644 src/test/test-crs-dynamic-auto-rebalance2/hardware_status
create mode 100644 src/test/test-crs-dynamic-auto-rebalance2/log.expect
create mode 100644 src/test/test-crs-dynamic-auto-rebalance2/manager_status
create mode 100644 src/test/test-crs-dynamic-auto-rebalance2/service_config
create mode 100644 src/test/test-crs-dynamic-auto-rebalance2/static_service_stats
create mode 100644 src/test/test-crs-dynamic-auto-rebalance3/README
create mode 100644 src/test/test-crs-dynamic-auto-rebalance3/cmdlist
create mode 100644 src/test/test-crs-dynamic-auto-rebalance3/datacenter.cfg
create mode 100644 src/test/test-crs-dynamic-auto-rebalance3/dynamic_service_stats
create mode 100644 src/test/test-crs-dynamic-auto-rebalance3/hardware_status
create mode 100644 src/test/test-crs-dynamic-auto-rebalance3/log.expect
create mode 100644 src/test/test-crs-dynamic-auto-rebalance3/manager_status
create mode 100644 src/test/test-crs-dynamic-auto-rebalance3/service_config
create mode 100644 src/test/test-crs-dynamic-auto-rebalance3/static_service_stats
create mode 100644 src/test/test-crs-dynamic-auto-rebalance4/README
create mode 100644 src/test/test-crs-dynamic-auto-rebalance4/cmdlist
create mode 100644 src/test/test-crs-dynamic-auto-rebalance4/datacenter.cfg
create mode 100644 src/test/test-crs-dynamic-auto-rebalance4/dynamic_service_stats
create mode 100644 src/test/test-crs-dynamic-auto-rebalance4/hardware_status
create mode 100644 src/test/test-crs-dynamic-auto-rebalance4/log.expect
create mode 100644 src/test/test-crs-dynamic-auto-rebalance4/manager_status
create mode 100644 src/test/test-crs-dynamic-auto-rebalance4/service_config
create mode 100644 src/test/test-crs-dynamic-auto-rebalance4/static_service_stats
create mode 100644 src/test/test-crs-dynamic-constrained-auto-rebalance1/README
create mode 100644 src/test/test-crs-dynamic-constrained-auto-rebalance1/cmdlist
create mode 100644 src/test/test-crs-dynamic-constrained-auto-rebalance1/datacenter.cfg
create mode 100644 src/test/test-crs-dynamic-constrained-auto-rebalance1/dynamic_service_stats
create mode 100644 src/test/test-crs-dynamic-constrained-auto-rebalance1/hardware_status
create mode 100644 src/test/test-crs-dynamic-constrained-auto-rebalance1/log.expect
create mode 100644 src/test/test-crs-dynamic-constrained-auto-rebalance1/manager_status
create mode 100644 src/test/test-crs-dynamic-constrained-auto-rebalance1/rules_config
create mode 100644 src/test/test-crs-dynamic-constrained-auto-rebalance1/service_config
create mode 100644 src/test/test-crs-dynamic-constrained-auto-rebalance1/static_service_stats
create mode 100644 src/test/test-crs-dynamic-constrained-auto-rebalance2/README
create mode 100644 src/test/test-crs-dynamic-constrained-auto-rebalance2/cmdlist
create mode 100644 src/test/test-crs-dynamic-constrained-auto-rebalance2/datacenter.cfg
create mode 100644 src/test/test-crs-dynamic-constrained-auto-rebalance2/dynamic_service_stats
create mode 100644 src/test/test-crs-dynamic-constrained-auto-rebalance2/hardware_status
create mode 100644 src/test/test-crs-dynamic-constrained-auto-rebalance2/log.expect
create mode 100644 src/test/test-crs-dynamic-constrained-auto-rebalance2/manager_status
create mode 100644 src/test/test-crs-dynamic-constrained-auto-rebalance2/rules_config
create mode 100644 src/test/test-crs-dynamic-constrained-auto-rebalance2/service_config
create mode 100644 src/test/test-crs-dynamic-constrained-auto-rebalance2/static_service_stats
create mode 100644 src/test/test-crs-dynamic-constrained-auto-rebalance3/README
create mode 100644 src/test/test-crs-dynamic-constrained-auto-rebalance3/cmdlist
create mode 100644 src/test/test-crs-dynamic-constrained-auto-rebalance3/datacenter.cfg
create mode 100644 src/test/test-crs-dynamic-constrained-auto-rebalance3/dynamic_service_stats
create mode 100644 src/test/test-crs-dynamic-constrained-auto-rebalance3/hardware_status
create mode 100644 src/test/test-crs-dynamic-constrained-auto-rebalance3/log.expect
create mode 100644 src/test/test-crs-dynamic-constrained-auto-rebalance3/manager_status
create mode 100644 src/test/test-crs-dynamic-constrained-auto-rebalance3/rules_config
create mode 100644 src/test/test-crs-dynamic-constrained-auto-rebalance3/service_config
create mode 100644 src/test/test-crs-dynamic-constrained-auto-rebalance3/static_service_stats
create mode 100644 src/test/test-crs-dynamic-constrained-auto-rebalance4/README
create mode 100644 src/test/test-crs-dynamic-constrained-auto-rebalance4/cmdlist
create mode 100644 src/test/test-crs-dynamic-constrained-auto-rebalance4/datacenter.cfg
create mode 100644 src/test/test-crs-dynamic-constrained-auto-rebalance4/dynamic_service_stats
create mode 100644 src/test/test-crs-dynamic-constrained-auto-rebalance4/hardware_status
create mode 100644 src/test/test-crs-dynamic-constrained-auto-rebalance4/log.expect
create mode 100644 src/test/test-crs-dynamic-constrained-auto-rebalance4/manager_status
create mode 100644 src/test/test-crs-dynamic-constrained-auto-rebalance4/rules_config
create mode 100644 src/test/test-crs-dynamic-constrained-auto-rebalance4/service_config
create mode 100644 src/test/test-crs-dynamic-constrained-auto-rebalance4/static_service_stats
create mode 100644 src/test/test-crs-dynamic-rebalance1/README
create mode 100644 src/test/test-crs-dynamic-rebalance1/cmdlist
create mode 100644 src/test/test-crs-dynamic-rebalance1/datacenter.cfg
create mode 100644 src/test/test-crs-dynamic-rebalance1/dynamic_service_stats
create mode 100644 src/test/test-crs-dynamic-rebalance1/hardware_status
create mode 100644 src/test/test-crs-dynamic-rebalance1/log.expect
create mode 100644 src/test/test-crs-dynamic-rebalance1/manager_status
create mode 100644 src/test/test-crs-dynamic-rebalance1/service_config
create mode 100644 src/test/test-crs-dynamic-rebalance1/static_service_stats
create mode 100644 src/test/test-crs-dynamic1/README
create mode 100644 src/test/test-crs-dynamic1/cmdlist
create mode 100644 src/test/test-crs-dynamic1/datacenter.cfg
create mode 100644 src/test/test-crs-dynamic1/dynamic_service_stats
create mode 100644 src/test/test-crs-dynamic1/hardware_status
create mode 100644 src/test/test-crs-dynamic1/log.expect
create mode 100644 src/test/test-crs-dynamic1/manager_status
create mode 100644 src/test/test-crs-dynamic1/service_config
create mode 100644 src/test/test-crs-dynamic1/static_service_stats
create mode 100644 src/test/test-crs-static-auto-rebalance1/README
create mode 100644 src/test/test-crs-static-auto-rebalance1/cmdlist
create mode 100644 src/test/test-crs-static-auto-rebalance1/datacenter.cfg
create mode 100644 src/test/test-crs-static-auto-rebalance1/hardware_status
create mode 100644 src/test/test-crs-static-auto-rebalance1/log.expect
create mode 100644 src/test/test-crs-static-auto-rebalance1/manager_status
create mode 100644 src/test/test-crs-static-auto-rebalance1/service_config
create mode 100644 src/test/test-crs-static-auto-rebalance1/static_service_stats
create mode 100644 src/test/test-crs-static-auto-rebalance2/README
create mode 100644 src/test/test-crs-static-auto-rebalance2/cmdlist
create mode 100644 src/test/test-crs-static-auto-rebalance2/datacenter.cfg
create mode 100644 src/test/test-crs-static-auto-rebalance2/hardware_status
create mode 100644 src/test/test-crs-static-auto-rebalance2/log.expect
create mode 100644 src/test/test-crs-static-auto-rebalance2/manager_status
create mode 100644 src/test/test-crs-static-auto-rebalance2/service_config
create mode 100644 src/test/test-crs-static-auto-rebalance2/static_service_stats
create mode 100644 src/test/test-crs-static-auto-rebalance3/README
create mode 100644 src/test/test-crs-static-auto-rebalance3/cmdlist
create mode 100644 src/test/test-crs-static-auto-rebalance3/datacenter.cfg
create mode 100644 src/test/test-crs-static-auto-rebalance3/hardware_status
create mode 100644 src/test/test-crs-static-auto-rebalance3/log.expect
create mode 100644 src/test/test-crs-static-auto-rebalance3/manager_status
create mode 100644 src/test/test-crs-static-auto-rebalance3/service_config
create mode 100644 src/test/test-crs-static-auto-rebalance3/static_service_stats
create mode 100755 src/test/test_resource_bundles.pl
Summary over all repositories:
206 files changed, 4971 insertions(+), 339 deletions(-)
--
Generated by murpp 0.11.0
next reply other threads:[~2026-03-30 14:46 UTC|newest]
Thread overview: 72+ messages / expand[flat|nested] mbox.gz Atom feed top
2026-03-30 14:30 Daniel Kral [this message]
2026-03-30 14:30 ` [PATCH proxmox v3 01/40] resource-scheduling: inline add_cpu_usage in score_nodes_to_start_service Daniel Kral
2026-03-31 6:01 ` Dominik Rusovac
2026-03-30 14:30 ` [PATCH proxmox v3 02/40] resource-scheduling: move score_nodes_to_start_service to scheduler crate Daniel Kral
2026-03-31 6:01 ` Dominik Rusovac
2026-03-30 14:30 ` [PATCH proxmox v3 03/40] resource-scheduling: rename service to resource where appropriate Daniel Kral
2026-03-31 6:02 ` Dominik Rusovac
2026-03-30 14:30 ` [PATCH proxmox v3 04/40] resource-scheduling: introduce generic scheduler implementation Daniel Kral
2026-03-31 6:11 ` Dominik Rusovac
2026-03-30 14:30 ` [PATCH proxmox v3 05/40] resource-scheduling: implement generic cluster usage implementation Daniel Kral
2026-03-31 7:26 ` Dominik Rusovac
2026-03-30 14:30 ` [PATCH proxmox v3 06/40] resource-scheduling: topsis: handle empty criteria without panics Daniel Kral
2026-03-30 14:30 ` [PATCH proxmox v3 07/40] resource-scheduling: compare by nodename in score_nodes_to_start_resource Daniel Kral
2026-03-30 14:30 ` [PATCH proxmox v3 08/40] resource-scheduling: factor out topsis alternative mapping Daniel Kral
2026-03-30 14:30 ` [PATCH proxmox v3 09/40] resource-scheduling: implement rebalancing migration selection Daniel Kral
2026-03-31 7:33 ` Dominik Rusovac
2026-03-31 12:42 ` Michael Köppl
2026-03-31 13:32 ` Daniel Kral
2026-03-30 14:30 ` [PATCH perl-rs v3 10/40] pve-rs: resource-scheduling: remove pedantic error handling from remove_node Daniel Kral
2026-03-30 14:30 ` [PATCH perl-rs v3 11/40] pve-rs: resource-scheduling: remove pedantic error handling from remove_service_usage Daniel Kral
2026-03-30 14:30 ` [PATCH perl-rs v3 12/40] pve-rs: resource-scheduling: move pve_static into resource_scheduling module Daniel Kral
2026-03-30 14:30 ` [PATCH perl-rs v3 13/40] pve-rs: resource-scheduling: use generic usage implementation Daniel Kral
2026-03-31 7:40 ` Dominik Rusovac
2026-03-30 14:30 ` [PATCH perl-rs v3 14/40] pve-rs: resource-scheduling: static: replace deprecated usage structs Daniel Kral
2026-03-30 14:30 ` [PATCH perl-rs v3 15/40] pve-rs: resource-scheduling: implement pve_dynamic bindings Daniel Kral
2026-03-30 14:30 ` [PATCH perl-rs v3 16/40] pve-rs: resource-scheduling: expose auto rebalancing methods Daniel Kral
2026-03-30 14:30 ` [PATCH cluster v3 17/40] datacenter config: restructure verbose description for the ha crs option Daniel Kral
2026-03-30 14:30 ` [PATCH cluster v3 18/40] datacenter config: add dynamic load scheduler option Daniel Kral
2026-03-30 14:30 ` [PATCH cluster v3 19/40] datacenter config: add auto rebalancing options Daniel Kral
2026-03-31 7:52 ` Dominik Rusovac
2026-03-30 14:30 ` [PATCH ha-manager v3 20/40] env: pve2: implement dynamic node and service stats Daniel Kral
2026-03-31 13:25 ` Daniel Kral
2026-03-30 14:30 ` [PATCH ha-manager v3 21/40] sim: hardware: pass correct types for static stats Daniel Kral
2026-03-30 14:30 ` [PATCH ha-manager v3 22/40] sim: hardware: factor out static stats' default values Daniel Kral
2026-03-30 14:30 ` [PATCH ha-manager v3 23/40] sim: hardware: fix static stats guard Daniel Kral
2026-03-30 14:30 ` [PATCH ha-manager v3 24/40] sim: hardware: handle dynamic service stats Daniel Kral
2026-03-30 14:30 ` [PATCH ha-manager v3 25/40] sim: hardware: add set-dynamic-stats command Daniel Kral
2026-03-30 14:30 ` [PATCH ha-manager v3 26/40] sim: hardware: add getters for dynamic {node,service} stats Daniel Kral
2026-03-30 14:30 ` [PATCH ha-manager v3 27/40] usage: pass service data to add_service_usage Daniel Kral
2026-03-30 14:30 ` [PATCH ha-manager v3 28/40] usage: pass service data to get_used_service_nodes Daniel Kral
2026-03-30 14:30 ` [PATCH ha-manager v3 29/40] add running flag to non-HA cluster service stats Daniel Kral
2026-03-31 7:58 ` Dominik Rusovac
2026-03-30 14:30 ` [PATCH ha-manager v3 30/40] usage: use add_service to add service usage to nodes Daniel Kral
2026-03-31 8:12 ` Dominik Rusovac
2026-03-30 14:30 ` [PATCH ha-manager v3 31/40] usage: add dynamic usage scheduler Daniel Kral
2026-03-31 8:15 ` Dominik Rusovac
2026-03-30 14:30 ` [PATCH ha-manager v3 32/40] test: add dynamic usage scheduler test cases Daniel Kral
2026-03-31 8:20 ` Dominik Rusovac
2026-03-30 14:30 ` [PATCH ha-manager v3 33/40] manager: rename execute_migration to queue_resource_motion Daniel Kral
2026-03-30 14:30 ` [PATCH ha-manager v3 34/40] manager: update_crs_scheduler_mode: factor out crs config Daniel Kral
2026-03-30 14:30 ` [PATCH ha-manager v3 35/40] implement automatic rebalancing Daniel Kral
2026-03-31 9:07 ` Dominik Rusovac
2026-03-31 9:07 ` Michael Köppl
2026-03-31 9:16 ` Dominik Rusovac
2026-03-31 9:32 ` Daniel Kral
2026-03-31 9:39 ` Dominik Rusovac
2026-03-31 13:55 ` Daniel Kral
2026-03-31 9:42 ` Daniel Kral
2026-03-31 11:01 ` Michael Köppl
2026-03-31 13:50 ` Daniel Kral
2026-03-30 14:30 ` [PATCH ha-manager v3 36/40] test: add resource bundle generation test cases Daniel Kral
2026-03-31 9:09 ` Dominik Rusovac
2026-03-30 14:30 ` [PATCH ha-manager v3 37/40] test: add dynamic automatic rebalancing system " Daniel Kral
2026-03-31 9:33 ` Dominik Rusovac
2026-03-30 14:30 ` [PATCH ha-manager v3 38/40] test: add static " Daniel Kral
2026-03-31 9:44 ` Dominik Rusovac
2026-03-30 14:30 ` [PATCH ha-manager v3 39/40] test: add automatic rebalancing system test cases with TOPSIS method Daniel Kral
2026-03-31 9:48 ` Dominik Rusovac
2026-03-30 14:30 ` [PATCH ha-manager v3 40/40] test: add automatic rebalancing system test cases with affinity rules Daniel Kral
2026-03-31 10:06 ` Dominik Rusovac
2026-03-31 20:44 ` partially-applied: [PATCH-SERIES cluster/ha-manager/perl-rs/proxmox v3 00/40] dynamic scheduler + load rebalancer Thomas Lamprecht
2026-04-02 12:55 ` superseded: " Daniel Kral
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20260330144101.668747-1-d.kral@proxmox.com \
--to=d.kral@proxmox.com \
--cc=pve-devel@lists.proxmox.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.