From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from gate001.proxmox.com (gate001.proxmox.com [45.144.208.40]) by lore.proxmox.com (Postfix) with ESMTPS id 85E881FF0AD for ; Sun, 20 Sep 2026 17:26:47 +0200 (CEST) Received: from gate001.proxmox.com (localhost.localdomain [127.0.0.1]) by gate001.proxmox.com (Proxmox) with ESMTP id 73DDD214F1; Sun, 20 Sep 2026 17:26:43 +0200 (CEST) ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=Slh7Kt/Oubu11l5UgqFOR1vqxxQ1HDMV9qizhEpqRpuazQTOCxnZJUMD6TOIYR/yk6/D+poznZ31sVM2UsejZ1dm4C2mRLjXQ1Ama6FRyENc2tXMKQDCk5244RfVLn1+U4gBcQRyZIkNfh69d+NZdDrqOdpQbqeA/XwXfYVq6yj1z4FbJ4aPuh/SiUItDjH8DF1Mk76A6rRxspVNZ9GuwwTAlXKWXus3urGoxuAJrpUgURzDTc+6AKHa3jino3zZeduymr1WYAaXdaexoIcSkNxWZMRQ6fUDRwErtD7VGxkmXFX7ZGZEBsJtOaejJEA4mR+wd5c14XIVEVlazaa1RA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=/ZURU7db7m7HiRQ7bKyqmgBmKSPELVqn4yfztEXdv+k=; b=zHyw32MkCV0j1U+Kln7cnGDQz7D0eXgssROj/RdbSJ6QQXok4NgnZUcjAQJahaE9mevcqNqL3/eN9aHAbUbNgwp/dcOsTr5/NAoOYi5z3FLKaI2qVEXHLLQQ+jGr0clMWJK7i1e3E6zK3IJ1+M+vzGtLaQ/kWU5TTOfP2ZhYDy+Cr/hVjd/punM2s371IDWvjx5HbksIHeUsbROb61R0g2eUVwFadnXo5Tf48fwt3l7Bttg9/Mz3d2oXPTP4qc1+6Z6XycDEQXIhuuZsdDkEztk6FOdIJDPijQa+DUOkT8LlAUZW24WFGEyO8jnafNQqyOvpCXC644ON74C1vX3kOQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=ryomherold.dk; dmarc=pass action=none header.from=ryomherold.dk; dkim=pass header.d=ryomherold.dk; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=RyomHerold.dk; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=/ZURU7db7m7HiRQ7bKyqmgBmKSPELVqn4yfztEXdv+k=; b=E+0hjWUKuCF/RLyjYDabJ4CjE8RijzW6PvJIlyb2l9ZiCc6ID8XSQjmjtp+oWpgFkhdc+aNkOCz62PAUUOPu9LI+lJ9pNmxwGc8qFCpimNIz850veXcbXJHfjuSkOMDGoLVT9IKzZP0tS3h+FiV93AJBhjB3RPhjpN1jW/KKDlqxuAzxtETniwBzvPf8kw7gruQyGWqTcY0Nap+XmrUe0Vlu0dPd10gU/W6Uo6dlxdQyg0Bi8Hkeq/9FPWl+RshdUF7scbf+0KU4JdMzJhcnb7e7hwrA7iQbrGJOcG3TKL8UA0bJWCMgycRsOkJPNKihXpQo8aAAae2Nxl4EESGIjA== Authentication-Results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=RyomHerold.dk; From: Michael Ryom To: pve-devel@lists.proxmox.com Subject: Re: [PATCH pve-ha-manager 2/2] fix #7974: env: pve2: set dynamic service mem value to host memory usage Date: Sun, 20 Sep 2026 17:24:39 +0200 Message-ID: <20260920152439.557294-1-Michael@RyomHerold.dk> X-Mailer: git-send-email 2.43.0 In-Reply-To: <20260828123239.1110595-2-d.rusovac@proxmox.com> References: <20260828123239.1110595-1-d.rusovac@proxmox.com> <20260828123239.1110595-2-d.rusovac@proxmox.com> Content-Transfer-Encoding: 8bit Content-Type: text/plain X-ClientProxiedBy: FR5P281CA0008.DEUP281.PROD.OUTLOOK.COM (2603:10a6:d10:f2::10) To AS8PR10MB7231.EURPRD10.PROD.OUTLOOK.COM (2603:10a6:20b:619::17) MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: AS8PR10MB7231:EE_|GVXPR10MB9061:EE_ X-MS-Office365-Filtering-Correlation-Id: cc54c586-e906-4023-1e18-08df172b85ca X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0;ARA:13230040|376014|366016|23010399003|1800799024|6133799003|22082099003|18002099003|4143699003|56012099006|10067099003; X-Microsoft-Antispam-Message-Info: WCouBct2wRO3gQjkM5OIR+09uVuLecPAgXfSWmHr2qEUpbM4pMzXjR1e7K1ldOm/7n/aNxJI+8Mj7JtWjHXoFmcZertI1APwdV0hY38Co7a5qf3B5bJ430ZY7Nz5yhVhqdKX17UYVP9KaFnSItA5e6sn5GFyJpYp+1cjdygFaziyqkqZ6Hgk2ojcwGOYjnlIpNXhvNMyPUB2LfRyiUt57L+/NSs4kvXb4MALeVvQ0ZtgiN5HQzW0F3VIv4ojhG+HE3umqRit11UC0La4FfMi/uc/pwgBD1o96bam2CpnyRsEXy1We+lsE7lzC3zN31qnakt9W2Whw156m97NVXETP3/O3I4uJo9wbV7phvVmWvAOAh8Br7obRrRX+QqphonnBOS1A1DM8cpYH6u+uORTzjYCaxT55XJdOuJlIiC+FIBPM+mHRqKqS2aCHcWhUHe+LwyMnpBRIsirRYTmTxqeGZ+lKnUbSKdIyjAQ3/7lQjJ674QbvG1WAHrJCganUjmx5hxYNEzeh9To3r7NvYNb9yV6zRNNFdQbycpV/T3/aHXp8ie8UqIwHAAyPy4+LJpE3IoGKlzYnIlMt4dyStJAd8KU0lvkqwP/sbRjoXxsimYrj1tvKKaOYvHhbrM8TVsnP0RkjR1V9Qpr2yLAtQIuGsD8jg9fK9+YSJ3ESUyTQIY= X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:AS8PR10MB7231.EURPRD10.PROD.OUTLOOK.COM;PTR:;CAT:NONE;SFS:(13230040)(376014)(366016)(23010399003)(1800799024)(6133799003)(22082099003)(18002099003)(4143699003)(56012099006)(10067099003);DIR:OUT;SFP:1102; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?us-ascii?Q?kwNNYYNlnOf0Cek9rcsQXKnQ/AzC2eEfHYJceKTO0KmgZp1FO29IIIoD5IhU?= =?us-ascii?Q?wHXu+dpues0nWta98NTn9xBRnS10AL1bQnYGBrsllkL8IHrLMvYE2GpWSiRT?= =?us-ascii?Q?9rtnSonThhXes5JNYqM6gxBYVaVGDAzmAsIrLyv8uRTlSnWIfnnx4WT0CSjx?= =?us-ascii?Q?3TJIcM/bOp3BdLNNR0t0qwhdgwrMS792+y8ZhH4FdqTJsbnvrQr7e1nwpG+P?= =?us-ascii?Q?OsYbyBjk4qvJWN9bxK8EOaEsUOiNtewv62A8Tt3gE68qmnskoE8JgpbraR/u?= =?us-ascii?Q?BSAnL/Wz1fZNlbt2f64jzgRUs3MBYCyTavwdCTMwfAefN6RgqbvJRY0fgA1a?= =?us-ascii?Q?FcBaB91yQ7X5MWaRuZwGzj8RxAsyZaxX8gzJzxIqSk/YF/RFf9xJpLlPKo7i?= =?us-ascii?Q?r/oHHuwazsPeoFxepbYkGr/L3eEvCc12S1NBDkiSbhEVbAxnQxlgyDsjWaAz?= =?us-ascii?Q?Z/ElKNPT4c5D2gmT1L8S7yNc3xYTtkHb0AJFQMiwWJzA34UD+VvhqllI3FZ9?= =?us-ascii?Q?lrf+q8BJQxm0KHS5Mlazh3KnRb2kryBdmH6t5/TXr1W5ExSgKKELBy0Dz+Ea?= =?us-ascii?Q?xXx71054bIQe2kJM1fLtUXQ5yrjSIQWGK9cSA8+zp9/JtMvdlowCATyk4KQE?= =?us-ascii?Q?nAQ2PywpCU4+OAckkSKPBObs7qiC/ODkhtg9ndIGELbZpKhchzftXAVxLJd6?= =?us-ascii?Q?POhYU/Snzm7r16AspAsE/eFnUag8TKyBuvUkA0SHrditMUac63sJHS8lXQR6?= =?us-ascii?Q?ICEs2NsPS2gPOrycLwoWIdKrpSPs6jNnvYVnequt4L9nX50NsIFTThU0DkfH?= =?us-ascii?Q?BQOuhfHpJlpH0QoOHo9rn3hfL8YRvGZCMzQHjzzgedFvdXb5oZmm3XRzuDrD?= =?us-ascii?Q?udbdAwfYsAA20e3ZFk6LNG0kxx9OgzLu2gqnqup9NZ06hWgon5ar8NBqZAra?= =?us-ascii?Q?Ameu39w1Dd/QdnZidduSjcf2vTMpMNfsc/4yE8SkqicWmBTRQDqmir/Asxen?= =?us-ascii?Q?11NGvMcdM7qhxA3uNnWBbuRHP7QCO0uTP6KV8y5J9faruwYA7jIt7iWHpe3e?= =?us-ascii?Q?ZvdC3+hTYBdLhYQsRk386gaMTZt4QTynqzAtJR+m7Mu/Y/M6ekA80Loz2B3X?= =?us-ascii?Q?ZzS0LZZ4HhNTaYjRPmAbYXQWU8iSi9LwL+hhLs3T4bnsB+6QiGAk5Pj3Hsk9?= =?us-ascii?Q?5rTeFKRqs8WuyASOi97B0d9h62ugk+O0mPdaOicjQpDOtke+KVE5oln50Pe6?= =?us-ascii?Q?Dvs30qT5UrsXfkTdM5/VzM75sF8FM1qOz0ihglJaVOqAwlfnsEHKUhrBxIgN?= =?us-ascii?Q?SgfzcLjesRKFCr29wyD3XfjNNKMhdho/NDTdYAb3YOuvZVT43ioel2FjzpJc?= =?us-ascii?Q?pCcz3pSCSBraT/DpskiXgiyUjZB0bkyZBpQb9roBkDsooo6firHVplf2nx1y?= =?us-ascii?Q?6n7LJ3pIxPOP7aY1uCPYM1IsLB8bDUhmsw97KriPxxMeXISZ3QQR+1LGOPs5?= =?us-ascii?Q?wIdz9qkb4i/QhbHPcauPc9zATUpUllowLVCz/vj4ohxhW1/35TLLawbOCJGl?= =?us-ascii?Q?PlP8gmdQhC/O2VEpubeLDNERy/ZbdBuLxhLzdn6N2v1P9Lug6XxWwK6rf31K?= =?us-ascii?Q?IsB+Dvf7mN/eGuMXVo6OIvzFyPQ09o0YuhkOEWcq9rsngcDBZ78hwCNAipTM?= =?us-ascii?Q?oDXfgF31RXl3EfBWQlVPLyYt+i0CIKUbIrRtA12SDskGdcuFB2YXu7cC/4q3?= =?us-ascii?Q?HadqerAHUg=3D=3D?= X-OriginatorOrg: RyomHerold.dk X-MS-Exchange-CrossTenant-Network-Message-Id: cc54c586-e906-4023-1e18-08df172b85ca X-MS-Exchange-CrossTenant-AuthSource: AS8PR10MB7231.EURPRD10.PROD.OUTLOOK.COM X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 20 Sep 2026 15:26:20.8066 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 26a2499e-4646-4888-a695-c64736a56807 X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: fUVM+lRjLAcQeJpZ1dh00Au5DoPL8+Y+KwgO+1jKqmzCHcCaRuJAb6AIbif5HjGwtdGcArEPhDrDyL3yTL9x2A== X-MS-Exchange-Transport-CrossTenantHeadersStamped: GVXPR10MB9061 X-SPAM-LEVEL: Spam detection results: 0 DKIM_SIGNED 0.1 Message has a DKIM or DK signature, not necessarily valid DKIM_VALID -0.1 Message has at least one valid DKIM or DK signature DKIM_VALID_AU -0.1 Message has a valid DKIM or DK signature from author's domain DKIM_VALID_EF -0.1 Message has a valid DKIM or DK signature from envelope-from domain DMARC_PASS -0.1 DMARC pass policy RCVD_IN_DNSWL_NONE -0.0001 Sender listed at https://www.dnswl.org/, no trust SPF_HELO_PASS -0.001 SPF: HELO matches SPF record SPF_PASS -0.001 SPF: sender matches SPF record Message-ID-Hash: YJBTRWMRFCSIXAHE5CQMPZS7S4OPOAUV X-Message-ID-Hash: YJBTRWMRFCSIXAHE5CQMPZS7S4OPOAUV X-MailFrom: Michael@RyomHerold.dk X-Mailman-Rule-Misses: dmarc-mitigation; no-senders; approved; loop; banned-address; emergency; member-moderation; nonmember-moderation; administrivia; implicit-dest; max-recipients; max-size; news-moderation; no-subject; digests; suspicious-header CC: Michael Ryom X-Mailman-Version: 3.3.10 Precedence: list List-Id: Proxmox VE development discussion List-Help: List-Owner: List-Post: List-Subscribe: List-Unsubscribe: On 28/08/2026 14:32, Dominik Rusovac wrote: > Make memory accounting in dynamic CRS consistent. > > Atm the imbalance value that triggers rebalancing is derived from the > guests' host memory usage, which corresponds to the respective host-side > cgroup footprints of the guests. However, the scheduler's decision > procedure predicts the changes in imbalance caused by migration > candidates based on memory usage (inside the guests). This discrepancy > can lead to oscillating migrations, as described in detail in [0]. > > For VMs, host memory usage is the relevant stat, as it better describes > the actual cost of running on a node than memory usage. Host memory > usage is not available for containers, so fall back to memory usage for > containers. Ran into the same issue independently while deliberately stress-testing CRS with ha=dynamic on a two-node PVE 9.2.20 cluster (pve-ha-manager 5.2.5): a single dominant VM with an active balloon driver was accounted with mem = 6.94 GiB while its host-side footprint was ~8.15 GiB (QEMU RSS 7,950,016 KiB). The ~1.2 GiB difference is the same order of magnitude as the balancer's trigger condition on a small cluster, and contributed to the VM being migrated back and forth - five moves in 27 minutes on an otherwise idle cluster, matching the oscillation described in the bug report. Tested an equivalent change (memhost with fallback to mem) on the same cluster: the predicted post-migration imbalance now matches the measured state, where it was systematically off by ~1-2 percentage points before. Tested-by: Michael Ryom One note: with the memory accounting fixed, the oscillation shrinks but does not fully disappear here. With a dominant resource on two nodes, sub-percent fluctuations of the node base loads (ZFS ARC, Ceph daemons, the IO of a rebalance migration itself) are still enough to qualify a motion - and, once carried out, its reverse - since the relative margin provides almost no hysteresis in that regime. I am about to send a series addressing that (plus the endless retry of failing rebalance migrations); one patch in it overlaps with this one, which I will note there so whichever lands first wins.