From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from firstgate.proxmox.com (firstgate.proxmox.com [212.224.123.68]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits)) (No client certificate requested) by lists.proxmox.com (Postfix) with ESMTPS id 4DBF474400 for ; Wed, 1 Jun 2022 10:13:04 +0200 (CEST) Received: from firstgate.proxmox.com (localhost [127.0.0.1]) by firstgate.proxmox.com (Proxmox) with ESMTP id 424E81A14B for ; Wed, 1 Jun 2022 10:13:04 +0200 (CEST) Received: from bastionodiso.odiso.net (bastionodiso.odiso.net [IPv6:2a0a:1580:2000::2d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by firstgate.proxmox.com (Proxmox) with ESMTPS id D2AC01A0DE for ; Wed, 1 Jun 2022 10:13:01 +0200 (CEST) Received: from kvmformation3.odiso.net (formationkvm3.odiso.net [10.3.94.12]) by bastionodiso.odiso.net (Postfix) with ESMTP id 4FC8F174D6; Wed, 1 Jun 2022 10:12:55 +0200 (CEST) Received: by kvmformation3.odiso.net (Postfix, from userid 0) id 2FA7E176422; Wed, 1 Jun 2022 10:12:55 +0200 (CEST) From: Alexandre Derumier To: pve-devel@lists.proxmox.com Cc: t.lamprecht@proxmox.com, Alexandre Derumier Date: Wed, 1 Jun 2022 10:12:43 +0200 Message-Id: <20220601081253.2542697-1-aderumier@odiso.com> X-Mailer: git-send-email 2.30.2 MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-SPAM-LEVEL: Spam detection results: 0 AWL 0.001 Adjusted score from AWL reputation of From: address BAYES_00 -1.9 Bayes spam probability is 0 to 1% HEADER_FROM_DIFFERENT_DOMAINS 0.249 From and EnvelopeFrom 2nd level mail domains are different KAM_DMARC_STATUS 0.01 Test Rule for DKIM or SPF Failure with Strict Alignment KAM_LAZY_DOMAIN_SECURITY 1 Sending domain does not have any anti-forgery methods NO_DNS_FOR_FROM 0.001 Envelope sender has no MX or A DNS records SPF_HELO_NONE 0.001 SPF: HELO does not publish an SPF Record SPF_NONE 0.001 SPF: sender does not publish an SPF Record T_SCC_BODY_TEXT_LINE -0.01 - Subject: [pve-devel] [PATCH-SERIES common/qemu-server/lxc/manager] brodcast new metric stats in kvstore X-BeenThere: pve-devel@lists.proxmox.com X-Mailman-Version: 2.1.29 Precedence: list List-Id: Proxmox VE development discussion List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 01 Jun 2022 08:13:04 -0000 Hi, I'm still working on vm balancing/scheduling, and need some new metrics. As suggested by Thomas, instead sending values to new rrd, and then reparse rrd later in balancer, we broadcast: - last minute && last 5 min average cpu/ram of qemu/lxc/node - pressure average of cpu/mem/io for qemu/lxc/node Theses values are broadcast each minute in 1 kvstore key "balancer-stats" Size of broadcasted "balancer-stats" is around : 500bytes * number vms. Size of in memory hash for average values is around : 6k (host+mem) * number vms. (for last minute, we keep each X seconds iteration, for last 5min we keep last 5x1min average) - last ksm value This value is broadcast each iteration is a separate kvstore key "ksm" pve-common: Alexandre Derumier (2): cgroup: get_pressure_stat: use controllers in get_path cgroup: get_pressure_stat: add cpu full pressure src/PVE/CGroup.pm | 6 ++++-- 1 file changed, 4 insertions(+), 2 deletions(-) qemu-server: Alexandre Derumier (3): vmstatus: add hostcpu value vmstatus: add hostmem value vmstatus: add pressure stats PVE/QemuServer.pm | 18 ++++++++++++++++++ 1 file changed, 18 insertions(+) pve-container: Alexandre Derumier (1): vmstatus: add pressure stats src/PVE/LXC.pm | 2 ++ 1 file changed, 2 insertions(+) Alexandre Derumier (4): pvestatd: add broadcast_balancer_stats pvestatd: qemu/lxc/node : add pressure stats pvestatd: qemu/lxc/node : add hostcpu/hostmem average stats pvestatd: node : broadcast ksm value PVE/Service/pvestatd.pm | 154 +++++++++++++++++++++++++++++++++++++++- 1 file changed, 153 insertions(+), 1 deletion(-) -- 2.30.2