public inbox for pve-devel@lists.proxmox.com
 help / color / mirror / Atom feed
From: Thomas Lamprecht <t.lamprecht@proxmox.com>
To: Dominik Rusovac <d.rusovac@proxmox.com>
Cc: pve-devel@lists.proxmox.com
Subject: Re: [RFC ha-manager 16/21] sim: hardware: add set-dynamic-stats for services
Date: Wed, 18 Mar 2026 23:34:52 +0100	[thread overview]
Message-ID: <42858bd4-6d25-4d38-ba20-b1f2b9c5a208@proxmox.com> (raw)
In-Reply-To: <20260217141437.584852-30-d.kral@proxmox.com>

Am 17.02.26 um 15:17 schrieb Daniel Kral:
> From: Dominik Rusovac <d.rusovac@proxmox.com>
> 
> This adds command set-dynamic-stats, to simulate the cpu load (cpu) and
> memory usage (mem in MiB) of a service, as well as command
> set-static-stats, to configure the number of cores (maxcpu) and RAM
> (maxmem in MiB) of a service. In addition to using the designated
> command, dynamic service stats can be specified beforehand in file
> dynamic_service_stats.
> 
> Upon calling set-dynamic-stats on some service, the dynamic stats of the
> node this very service is running on will be aggregated accordingly.
> 
> Signed-off-by: Dominik Rusovac <d.rusovac@proxmox.com>
> Signed-off-by: Daniel Kral <d.kral@proxmox.com>
> ---
>  src/PVE/HA/Sim/Hardware.pm | 130 +++++++++++++++++++++++++++++++++++++
>  1 file changed, 130 insertions(+)
> 
> diff --git a/src/PVE/HA/Sim/Hardware.pm b/src/PVE/HA/Sim/Hardware.pm
> index ec135e09..910f9718 100644

> @@ -744,6 +796,7 @@ sub get_cfs_state {
>  #   service <sid> lock/unlock [lockname]
>  #   service <sid> add <node> [<request-state=started>] [<running=0>]
>  #   service <sid> set-static-stats  <maxcpu|maxmem> <cpu cores|MiB>
> +#   service <sid> set-dynamic-stats <cpu|mem>       <load in cpu cores|usage in MiB>
>  #   service <sid> delete
>  sub sim_hardware_cmd {
>      my ($self, $cmdstr, $logid) = @_;
> @@ -911,6 +964,24 @@ sub sim_hardware_cmd {
>                  } else {
>                      die "sim_hardware_cmd: unknown target stat '$target' for '$action' command";
>                  }
> +            } elsif ($action eq 'set-dynamic-stats') {
> +                my ($target, $val) = ($params[0], $params[1]);
> +
> +                if (!$target) {
> +                    die "sim_hardware_cmd: missing target stat for '$action' command";
> +                } elsif ($target eq "cpu") {
> +                    die "sim_hardware_cmd: missing value for '$action $target' command"
> +                        if !$val;
> +
> +                    $self->set_dynamic_service_stats($sid, { $target => 0.0 + $val });
> +                } elsif ($target eq "mem") {
> +                    die "sim_hardware_cmd: missing value for '$action $target' command"
> +                        if !$val;
> +
> +                    $self->set_dynamic_service_stats($sid, { $target => $val * 1024**2 });
> +                } else {
> +                    die "sim_hardware_cmd: unknown target stat '$target' for '$action' command";
> +                }
>              } elsif ($action eq 'delete') {
>  
>                  $self->delete_service($sid);
> @@ -1135,6 +1206,27 @@ sub get_static_service_stats {

FWIW, we could avoid some code duplication between dynamic and static set
and reduce the test cmd's needed by applying something like below on top at
this point.

The change below basically leverage's the rather fresh perl 5.40's "for loop
with multiple iteration variables" [0] (which is fine to use for PVE 9, we
won't backport this to PVE 8 - where the perl version would be to old - anyway),
and merging the two branches for set-static-stats and set-dynamic-stats commands
by using a hash for mapping the conversions of the different stats/cmds (could
be written maybe even nicer).

Then such chains like:

info    220      cmdlist: execute service vm:103 set-dynamic-stats cpu 3.9 
info    220      cmdlist: execute service vm:103 set-dynamic-stats mem 6517
info    220      cmdlist: execute service vm:104 set-dynamic-stats cpu 6.7 
info    220      cmdlist: execute service vm:104 set-dynamic-stats mem 8001
info    220      cmdlist: execute service vm:105 set-dynamic-stats cpu 1.8 
info    220      cmdlist: execute service vm:105 set-dynamic-stats mem 1201
info    220      cmdlist: execute service vm:106 set-dynamic-stats cpu 2.1 
info    220      cmdlist: execute service vm:106 set-dynamic-stats mem 1211
info    220      cmdlist: execute service vm:107 set-dynamic-stats cpu 0.9 
info    220      cmdlist: execute service vm:107 set-dynamic-stats mem 1191

could become:

info    220      cmdlist: execute service vm:103 set-dynamic-stats cpu 3.9 mem 6517
info    220      cmdlist: execute service vm:104 set-dynamic-stats cpu 6.7 mem 8001
info    220      cmdlist: execute service vm:105 set-dynamic-stats cpu 1.8 mem 1201
info    220      cmdlist: execute service vm:106 set-dynamic-stats cpu 2.1 mem 1211
info    220      cmdlist: execute service vm:107 set-dynamic-stats cpu 0.9 mem 1191

I.e., get basically cut in half without really loosing expressiveness (IMO).

[0]: https://perldoc.perl.org/perlexperiment#for-loop-with-multiple-iteration-variables

----8<----
diff --git a/src/PVE/HA/Sim/Hardware.pm b/src/PVE/HA/Sim/Hardware.pm
index dc95593..e0a1cce 100644
--- a/src/PVE/HA/Sim/Hardware.pm
+++ b/src/PVE/HA/Sim/Hardware.pm
@@ -795,8 +795,8 @@ sub get_cfs_state {
 #   service <sid> stop <timeout>
 #   service <sid> lock/unlock [lockname]
 #   service <sid> add <node> [<request-state=started>] [<running=0>]
-#   service <sid> set-static-stats  <maxcpu|maxmem> <cpu cores|MiB>
-#   service <sid> set-dynamic-stats <cpu|mem>       <load in cpu cores|usage in MiB>
+#   service <sid> set-static-stats  [maxcpu <cores>] [maxmem <MiB>]
+#   service <sid> set-dynamic-stats [cpu <cores>] [mem <MiB>]
 #   service <sid> delete
 sub sim_hardware_cmd {
     my ($self, $cmdstr, $logid) = @_;
@@ -946,41 +946,29 @@ sub sim_hardware_cmd {
                     $params[2] || 0,
                 );
 
-            } elsif ($action eq 'set-static-stats') {
-                my ($target, $val) = ($params[0], $params[1]);
+            } elsif ($action eq 'set-static-stats' || $action eq 'set-dynamic-stats') {
+                die "sim_hardware_cmd: missing target stat for '$action' command"
+                    if !@params;
 
-                if (!$target) {
-                    die "sim_hardware_cmd: missing target stat for '$action' command";
-                } elsif ($target eq "maxcpu") {
-                    die "sim_hardware_cmd: missing value for '$action $target' command"
-                        if !$val;
+                my $conversions = $action eq 'set-static-stats'
+                    ? { maxcpu => sub { 0.0 + $_[0] }, maxmem => sub { $_[0] * 1024**2 } }
+                    : { cpu => sub { 0.0 + $_[0] }, mem => sub { $_[0] * 1024**2 } };
 
-                    $self->set_static_service_stats($sid, { $target => 0.0 + $val });
-                } elsif ($target eq "maxmem") {
+                my %new_stats;
+                for my ($target, $val) (@params) {
                     die "sim_hardware_cmd: missing value for '$action $target' command"
-                        if !$val;
+                        if !defined($val);
+
+                    my $convert = $conversions->{$target}
+                        or die "sim_hardware_cmd: unknown target stat '$target' for '$action' command";
 
-                    $self->set_static_service_stats($sid, { $target => $val * 1024**2 });
-                } else {
-                    die "sim_hardware_cmd: unknown target stat '$target' for '$action' command";
+                    $new_stats{$target} = $convert->($val);
                 }
-            } elsif ($action eq 'set-dynamic-stats') {
-                my ($target, $val) = ($params[0], $params[1]);
 
-                if (!$target) {
-                    die "sim_hardware_cmd: missing target stat for '$action' command";
-                } elsif ($target eq "cpu") {
-                    die "sim_hardware_cmd: missing value for '$action $target' command"
-                        if !$val;
-
-                    $self->set_dynamic_service_stats($sid, { $target => 0.0 + $val });
-                } elsif ($target eq "mem") {
-                    die "sim_hardware_cmd: missing value for '$action $target' command"
-                        if !$val;
-
-                    $self->set_dynamic_service_stats($sid, { $target => $val * 1024**2 });
+                if ($action eq 'set-static-stats') {
+                    $self->set_static_service_stats($sid, \%new_stats);
                 } else {
-                    die "sim_hardware_cmd: unknown target stat '$target' for '$action' command";
+                    $self->set_dynamic_service_stats($sid, \%new_stats);
                 }
             } elsif ($action eq 'delete') {
 




  parent reply	other threads:[~2026-03-18 22:35 UTC|newest]

Thread overview: 57+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2026-02-17 14:13 [RFC PATCH-SERIES many 00/36] dynamic scheduler + load rebalancer Daniel Kral
2026-02-17 14:13 ` [RFC proxmox 1/5] resource-scheduling: move score_nodes_to_start_service to scheduler crate Daniel Kral
2026-02-17 14:13 ` [RFC proxmox 2/5] resource-scheduling: introduce generic cluster usage implementation Daniel Kral
2026-03-09 13:38   ` Dominik Rusovac
2026-03-10 10:41     ` Daniel Kral
2026-02-17 14:13 ` [RFC proxmox 3/5] resource-scheduling: add dynamic node and service stats Daniel Kral
2026-02-17 14:13 ` [RFC proxmox 4/5] resource-scheduling: implement rebalancing migration selection Daniel Kral
2026-03-09 13:32   ` Dominik Rusovac
2026-03-10 10:40     ` Daniel Kral
2026-03-11  8:21       ` Dominik Rusovac
2026-02-17 14:13 ` [RFC proxmox 5/5] resource-scheduling: implement Add and Default for {Dynamic,Static}ServiceStats Daniel Kral
2026-02-17 14:14 ` [RFC perl-rs 1/6] pve-rs: resource scheduling: use generic cluster usage implementation Daniel Kral
2026-02-17 14:14 ` [RFC perl-rs 2/6] pve-rs: resource scheduling: create service_nodes hashset from array Daniel Kral
2026-02-17 14:14 ` [RFC perl-rs 3/6] pve-rs: resource scheduling: store service stats independently of node Daniel Kral
2026-02-17 14:14 ` [RFC perl-rs 4/6] pve-rs: resource scheduling: expose auto rebalancing methods Daniel Kral
2026-02-17 14:14 ` [RFC perl-rs 5/6] pve-rs: resource scheduling: move pve_static into resource_scheduling module Daniel Kral
2026-02-17 14:14 ` [RFC perl-rs 6/6] pve-rs: resource scheduling: implement pve_dynamic bindings Daniel Kral
2026-02-17 14:14 ` [RFC cluster 1/2] datacenter config: add dynamic load scheduler option Daniel Kral
2026-02-18 11:06   ` Maximiliano Sandoval
2026-02-17 14:14 ` [RFC cluster 2/2] datacenter config: add auto rebalancing options Daniel Kral
2026-02-18 11:15   ` Maximiliano Sandoval
2026-02-17 14:14 ` [RFC ha-manager 01/21] rename static node stats to be consistent with similar interfaces Daniel Kral
2026-02-17 14:14 ` [RFC ha-manager 02/21] resources: remove redundant load_config fallback for static config Daniel Kral
2026-02-17 14:14 ` [RFC ha-manager 03/21] remove redundant service_node and migration_target parameter Daniel Kral
2026-02-17 14:14 ` [RFC ha-manager 04/21] factor out common pve to ha resource type mapping Daniel Kral
2026-02-17 14:14 ` [RFC ha-manager 05/21] derive static service stats while filling the service stats repository Daniel Kral
2026-02-17 14:14 ` [RFC ha-manager 06/21] test: make static service usage explicit for all resources Daniel Kral
2026-02-17 14:14 ` [RFC ha-manager 07/21] make static service stats indexable by sid Daniel Kral
2026-02-17 14:14 ` [RFC ha-manager 08/21] move static service stats repository to PVE::HA::Usage::Static Daniel Kral
2026-02-17 14:14 ` [RFC ha-manager 09/21] usage: augment service stats with node and state information Daniel Kral
2026-03-18 16:54   ` Thomas Lamprecht
2026-02-17 14:14 ` [RFC ha-manager 10/21] include running non-HA resources in the scheduler's accounting Daniel Kral
2026-02-17 14:14 ` [RFC ha-manager 11/21] env, resources: add dynamic node and service stats abstraction Daniel Kral
2026-03-18 16:54   ` Thomas Lamprecht
2026-02-17 14:14 ` [RFC ha-manager 12/21] env: pve2: implement dynamic node and service stats Daniel Kral
2026-03-18 16:54   ` Thomas Lamprecht
2026-02-17 14:14 ` [RFC ha-manager 13/21] sim: hardware: pass correct types for static stats Daniel Kral
2026-02-17 14:14 ` [RFC ha-manager 14/21] sim: hardware: factor out static stats' default values Daniel Kral
2026-02-17 14:14 ` [RFC ha-manager 15/21] sim: hardware: rewrite set-static-stats Daniel Kral
2026-02-17 14:14 ` [RFC ha-manager 16/21] sim: hardware: add set-dynamic-stats for services Daniel Kral
2026-03-18 16:54   ` Thomas Lamprecht
2026-03-19  7:38     ` Dominik Rusovac
2026-03-18 22:34   ` Thomas Lamprecht [this message]
2026-02-17 14:14 ` [RFC ha-manager 17/21] usage: add dynamic usage scheduler Daniel Kral
2026-03-18 16:54   ` Thomas Lamprecht
2026-02-17 14:14 ` [RFC ha-manager 18/21] manager: rename execute_migration to queue_resource_motion Daniel Kral
2026-02-17 14:14 ` [RFC ha-manager 19/21] manager: update_crs_scheduler_mode: factor out crs config Daniel Kral
2026-02-17 14:14 ` [RFC ha-manager 20/21] implement automatic rebalancing Daniel Kral
2026-03-18 16:54   ` Thomas Lamprecht
2026-02-17 14:14 ` [RFC ha-manager 21/21] test: add basic automatic rebalancing system test cases Daniel Kral
2026-03-18 16:54   ` Thomas Lamprecht
2026-02-17 14:14 ` [RFC manager 1/2] ui: dc/options: add dynamic load scheduler option Daniel Kral
2026-02-18 11:10   ` Maximiliano Sandoval
2026-02-17 14:14 ` [RFC manager 2/2] ui: dc/options: add auto rebalancing options Daniel Kral
2026-03-12 16:24 ` [RFC PATCH-SERIES many 00/36] dynamic scheduler + load rebalancer DERUMIER, Alexandre
2026-03-13  9:35   ` Daniel Kral
2026-03-18 16:54 ` Thomas Lamprecht

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=42858bd4-6d25-4d38-ba20-b1f2b9c5a208@proxmox.com \
    --to=t.lamprecht@proxmox.com \
    --cc=d.rusovac@proxmox.com \
    --cc=pve-devel@lists.proxmox.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox
Service provided by Proxmox Server Solutions GmbH | Privacy | Legal