From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from firstgate.proxmox.com (firstgate.proxmox.com [212.224.123.68]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits)) (No client certificate requested) by lists.proxmox.com (Postfix) with ESMTPS id C4316D200 for ; Thu, 14 Apr 2022 13:05:33 +0200 (CEST) Received: from firstgate.proxmox.com (localhost [127.0.0.1]) by firstgate.proxmox.com (Proxmox) with ESMTP id BA7012ADC3 for ; Thu, 14 Apr 2022 13:05:33 +0200 (CEST) Received: from EUR04-VI1-obe.outbound.protection.outlook.com (mail-vi1eur04on0600.outbound.protection.outlook.com [IPv6:2a01:111:f400:fe0e::600]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by firstgate.proxmox.com (Proxmox) with ESMTPS id EA4BD2ADB5 for ; Thu, 14 Apr 2022 13:05:32 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=inett.de; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=T2WivQbeTtvzbePnXb4gEhdjcF1lEm4i/rTrf9Rjaac=; b=Vd+PLE+XThjSWOkhMzYkKOuZsvo5Ndgv8tUZzUnOCaw3Fdxw0+p2yBnbUvWQ3przkpE3vPE2PRWvQpEJ4VQC6rsvZ06a1eEAY0KltG2BK2ihTojHhdRgu0x73c9lRkXsUPaQskMFSMCue3Fa1/gVv7MREBsBVn1iu8NPqIuCPO0= Received: from DU2PR04CA0200.eurprd04.prod.outlook.com (2603:10a6:10:28d::25) by AM5PR0502MB2945.eurprd05.prod.outlook.com (2603:10a6:203:96::7) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5144.30; Thu, 14 Apr 2022 10:50:15 +0000 Received: from DB5EUR03FT038.eop-EUR03.prod.protection.outlook.com (2603:10a6:10:28d:cafe::be) by DU2PR04CA0200.outlook.office365.com (2603:10a6:10:28d::25) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5164.20 via Frontend Transport; Thu, 14 Apr 2022 10:50:15 +0000 X-MS-Exchange-Authentication-Results: spf=pass (sender IP is 13.93.42.39) smtp.mailfrom=inett.de; dkim=pass (signature was verified) header.d=inett.de;dmarc=pass action=none header.from=inett.de; Received-SPF: Pass (protection.outlook.com: domain of inett.de designates 13.93.42.39 as permitted sender) receiver=protection.outlook.com; client-ip=13.93.42.39; helo=westeu12-emailsignatures-cloud.codetwo.com; Received: from westeu12-emailsignatures-cloud.codetwo.com (13.93.42.39) by DB5EUR03FT038.mail.protection.outlook.com (10.152.21.84) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5164.19 via Frontend Transport; Thu, 14 Apr 2022 10:50:15 +0000 Received: from EUR05-VI1-obe.outbound.protection.outlook.com (104.47.17.174) by westeu12-emailsignatures-cloud.codetwo.com with CodeTwo SMTP Server (TLS12) via SMTP; Thu, 14 Apr 2022 10:50:14 +0000 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=k+1V0hb4Sstb7SUwVJEma1SczIcKl4ChNUN/ZvofI/1yzt7CkhGQ4thhOfQ2sIhVMxbFgvWs7hIKiMmQ2wND2BYzvuY20OJOP9Ms6u31exKwDtMBJnxcSlfTA4N0ozoAF2lNDERqpIIPn0ngrBTHZX5vJG74eDRtAeV6Za52NMJfzmBh5R9uSCg8WPfYCnFDWNt23pHxQsvK31jO1qaUeng7xxVfy9hTe1Qjs8ILtRlVv8J1VGVvf6T4hWIgGF+IPSRv60b7rg6CnYIxpI2Tg+to9AYeAR8GrIPGe2++JnyJBWU/mZpohxt4FkH4uMBSnIu0uRmEujl7xSvvno/oSA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=T2WivQbeTtvzbePnXb4gEhdjcF1lEm4i/rTrf9Rjaac=; b=CrfZqgc9t75D59xpryBmWc3T3/fxRyTusY8x7jekcNx+zNByB8l5ZJaekQgTMJbiM5flVvalahJZJY9X22licQl2HfTbqdNdWQ+wMxlCXOx08Yz+ba90yppl5QvO6iPmGCp8tkIYFrqzwneEln5lCLvBbqF6tAYz9v1vNLtE+Of/mECZXkTcmtvJi7JS2+nJXThWJAzK4/I6Gyw6IYdKEB7j9te2RoGYfgc3OW3szRMM1nWsNNdVDWhP8ykHSkabCVlrvnwQ+5Si5qnnlsppQpAZKeag6h/oG6Vn7qQotQ68k96AI22zpDLc3v2eslArhaz8jnqvaZPh/mwABHtTzw== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=inett.de; dmarc=pass action=none header.from=inett.de; dkim=pass header.d=inett.de; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=inett.de; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=T2WivQbeTtvzbePnXb4gEhdjcF1lEm4i/rTrf9Rjaac=; b=Vd+PLE+XThjSWOkhMzYkKOuZsvo5Ndgv8tUZzUnOCaw3Fdxw0+p2yBnbUvWQ3przkpE3vPE2PRWvQpEJ4VQC6rsvZ06a1eEAY0KltG2BK2ihTojHhdRgu0x73c9lRkXsUPaQskMFSMCue3Fa1/gVv7MREBsBVn1iu8NPqIuCPO0= Authentication-Results-Original: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=inett.de; Received: from AM0PR05MB5764.eurprd05.prod.outlook.com (2603:10a6:208:11c::31) by VI1PR0502MB3053.eurprd05.prod.outlook.com (2603:10a6:800:b3::14) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5144.30; Thu, 14 Apr 2022 10:50:12 +0000 Received: from AM0PR05MB5764.eurprd05.prod.outlook.com ([fe80::bdd0:d125:a133:d49]) by AM0PR05MB5764.eurprd05.prod.outlook.com ([fe80::bdd0:d125:a133:d49%3]) with mapi id 15.20.5164.020; Thu, 14 Apr 2022 10:50:12 +0000 Date: Thu, 14 Apr 2022 12:50:09 +0200 From: Maximilian Hill To: Stefan Sterz CC: Proxmox VE user list Message-ID: References: <342bf09c-3113-eddf-1950-6dba41e4b771@proxmox.com> Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="wSbFsarmM63ZWC8H" Content-Disposition: inline In-Reply-To: <342bf09c-3113-eddf-1950-6dba41e4b771@proxmox.com> User-Agent: Mutt/2.2.3 (d9199322) (2022-04-12) X-ClientProxiedBy: AM5PR0601CA0071.eurprd06.prod.outlook.com (2603:10a6:206::36) To AM0PR05MB5764.eurprd05.prod.outlook.com (2603:10a6:208:11c::31) MIME-Version: 1.0 X-MS-Office365-Filtering-Correlation-Id: 4bde9cd2-f302-432b-80a3-08da1e048f13 X-MS-TrafficTypeDiagnostic: VI1PR0502MB3053:EE_|DB5EUR03FT038:EE_|AM5PR0502MB2945:EE_ X-Microsoft-Antispam-PRVS: X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam-Untrusted: BCL:0; X-Microsoft-Antispam-Message-Info-Original: QsLIANc/fQuqbJCDY+SBxT2773f2CymvYwhZTTEgYgO1rU/dpJm+K08JK4brATMIhGS9WsoU5e8VCM9yEsR2bFO5ACWGpCH3o0IF/6KyXPjIyRSLVSof4NB3NhvE1c3gwyctO3CyLx/TqhIEaoczw+V7B7AxiI1mupzTw7O+98qzoErfnYsbzucgGojegWHH1eCvXdPq+MpNhJ3NIvxXP8DMWt8dybVjMmD7dJ8Z1mEbS1898P39iCh3GEy86DrCnfnESK3yyCcsJuufryH71JLrDcGXc9cCYQmTIk4um2ealeSbD0fJeeUtxxnUJMazGr8t6u8SFrfcOBed6c6nUe0SY8ZjxgeqvMX7yQ89Gq9Zu/oYD7mBr3sejy/lS9xR72fyBnEC/IS6c8k1U3i4vy3kmXpi16669wwJ0Zxjf7rBzkGjDBWnqGCfSFxYtdQIK+ZXzsNexJOO02ookKdQiOaJXJqfALYqQXaNMEaDBoPzDLzJZNZI3xuX1zkO51f+bPn0Cdem4Y9jeFwxpR6MJaP5HRxz2wyGq+886J7/bJP1el00Pq1StgwW1VsIm7A4WM8eg1UtRA4PDUlNioYjAX0FyuT2+Z8m5x2LsYcDfK2LN914eotWG+QPjpB4yqb+s++lkoJjXczmNYW7BuebUvRY81Oe2uMQQwFEpVbS4oEt0F2syJrRdlVk2EIfqgKyqbQ0iwUF06kEw2C2lcV0IODZryI2pAQvgwZFabEhe6x9GcLJuWQyvu7jldCgMMjEScq26ihCSoygLC1WnIx8HaYzYcTfsP8z4+fX8e5csk4= X-Forefront-Antispam-Report-Untrusted: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:AM0PR05MB5764.eurprd05.prod.outlook.com; PTR:; CAT:NONE; SFS:(13230001)(346002)(366004)(36756003)(21480400003)(6512007)(2906002)(508600001)(186003)(38100700002)(6506007)(6916009)(83380400001)(2616005)(44144004)(8936002)(52116002)(66476007)(66556008)(4326008)(8676002)(5660300002)(66946007)(966005)(6666004)(86362001)(6486002)(2700100001); DIR:OUT; SFP:1101; X-MS-Exchange-Transport-CrossTenantHeadersStamped: VI1PR0502MB3053 X-CodeTwo-MessageID: 41440ae2-32fa-412e-8944-76fc1be5904c.20220414105014@westeu12-emailsignatures-cloud.codetwo.com X-CodeTwoProcessed: true X-EOPAttributedMessage: 0 X-MS-Exchange-Transport-CrossTenantHeadersStripped: DB5EUR03FT038.eop-EUR03.prod.protection.outlook.com X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id-Prvs: b8bec6bc-2c12-47a4-b273-08da1e048cf7 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: o0LElJEz4YV3It8wbgCPrlkGE3ZOCOiGeWopmXVugQpaCvAkIRzk6m2djj8zUJ+tXVkuTTxCWREV5vR3Cr4MUECOWnIKQ4E52ZCwNaPDPFYNGfnRtMI+VPnXIH04IVIH4uz11QfSFW7I00Jp+XwZ32XDlCNQDIAonDKCQqFfLPN5E/di6lvKI74hWp6w+1bkJi+0/eWb1323r6VVLJqc809ADsKZfQsG2EdpUgMpoRmolfUmQvEYM2IqJGIWDHMKJiiFNzuaKWuMYm3/mE86MHZL25BuUoyPUlnvQ/5GTtegAboKVDyE6HAQHmU+z27PW7j+hXuAEd/C26ucU+ENGWE5oO2LIYgyOO+D1vlGI4goUGBO8tYl2eYZqTTiSgRjgBWUQtd+RTGjVa1VZesVIC+ny1hH7GqoXUCCAcYRNMxeP0r1DM7Yivo0mNf9B3IZ1POKZ3HK7bd/M3KnI/cLktc5ldWQAsrt8voAU6ikV58PUhxfyxBSd+O1htH+DHeXJhnMEkCQPOQ9C6tZl29LhFpXMUPWBeqaiuF0Os/8LsU7Dj3PgITs14/plG89psopEOk62lN2nlCCL/o51IZDBezIzIqVaLG6s+4CEBAvgh3BshAt3V9Zj/H/zccEyxDoqUIezuS/8FKi3EK9Mn9QosRUAL7zU6SI9F4C8WXH6yahdPcvcFa3dyBJGoVq73Coj7Xez35yAF9vFSdhE+L9QYcbHIm6VrMhpTE44aMDXnWnW/EJnofty3enZdhKflcX X-Forefront-Antispam-Report: CIP:13.93.42.39; CTRY:NL; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:westeu12-emailsignatures-cloud.codetwo.com; PTR:westeu12-emailsignatures-cloud.codetwo.com; CAT:NONE; SFS:(13230001)(346002)(36840700001)(46966006)(2906002)(6506007)(8936002)(6916009)(6666004)(26005)(336012)(8676002)(7636003)(70206006)(4326008)(356005)(70586007)(7596003)(82310400005)(86362001)(5660300002)(6512007)(36860700001)(44144004)(186003)(508600001)(6486002)(966005)(36756003)(47076005)(21480400003)(83380400001)(2616005)(2700100001); DIR:OUT; SFP:1101; X-OriginatorOrg: inett.de X-MS-Exchange-CrossTenant-OriginalArrivalTime: 14 Apr 2022 10:50:15.4843 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: 4bde9cd2-f302-432b-80a3-08da1e048f13 X-MS-Exchange-CrossTenant-Id: fbb4c88a-8c06-44c8-b416-5376f93313e0 X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=fbb4c88a-8c06-44c8-b416-5376f93313e0; Ip=[13.93.42.39]; Helo=[westeu12-emailsignatures-cloud.codetwo.com] X-MS-Exchange-CrossTenant-AuthSource: DB5EUR03FT038.eop-EUR03.prod.protection.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Anonymous X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: AM5PR0502MB2945 X-SPAM-LEVEL: Spam detection results: 0 BAYES_00 -1.9 Bayes spam probability is 0 to 1% DKIM_SIGNED 0.1 Message has a DKIM or DK signature, not necessarily valid DKIM_VALID -0.1 Message has at least one valid DKIM or DK signature DKIM_VALID_AU -0.1 Message has a valid DKIM or DK signature from author's domain DKIM_VALID_EF -0.1 Message has a valid DKIM or DK signature from envelope-from domain SPF_HELO_PASS -0.001 SPF: HELO matches SPF record SPF_PASS -0.001 SPF: sender matches SPF record T_SCC_BODY_TEXT_LINE -0.01 - URIBL_BLOCKED 0.001 ADMINISTRATOR NOTICE: The query to URIBL was blocked. See http://wiki.apache.org/spamassassin/DnsBlocklists#dnsbl-block for more information. [inett.de, proxmox.com] Subject: Re: [PVE-User] Migration target node in case of shutdown X-BeenThere: pve-user@lists.proxmox.com X-Mailman-Version: 2.1.29 Precedence: list List-Id: Proxmox VE user list List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 14 Apr 2022 11:05:33 -0000 --wSbFsarmM63ZWC8H Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Hello Stefan, the reason I'm asking, is, that I ran into a case, in which the priorities were all equal (not set), but all VMs were tried to migrate =66rom two nodes to the same node of a 8 node cluster. This by itself wouldn't really be a problem, but qemu managed to allocate all the memory for the VMs, so no migration failed to start. Then the VMs used the memory and the OOM started to kill VMs and other processes. In this special case, we have a temporary workaround in place: - No swap - vm.overcommit_memory =3D 2 - vm.overcommit_ratio =3D 99 This of course is not a nice solution at all. Best regards, Max On Thu, Apr 14, 2022 at 12:40:35PM +0200, Stefan Sterz wrote: > Hello, >=20 > the target node is chosen by the node priority of the HA group that a > VM is in. You can read more about that in the manual [1]. Here is an > example: Assuming you have a three node cluster (node0, node1, node2) > and the HA group has the following priorities: node0:2, node1:1, > node2:0. A VM running on node0 will be moved to node1 and then node2 > if each node fails one after another. If several nodes have the same > priority, VMs will be distributed evenly. >=20 > Best regards, > Stefan >=20 > [1]: > https://pve.proxmox.com/pve-docs/pve-admin-guide.html#ha_manager_groups >=20 >=20 --wSbFsarmM63ZWC8H Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAEBCAAdFiEELOqHt4Dak9juHbCEH09ZFx5HrG8FAmJX/F8ACgkQH09ZFx5H rG93xw/+IlS34L/KDlDVa5LFvVet9i5+hhoV/67lGUSTjmSkbIFwF244VnfjPdI5 oy3uXdbb1g1F3D01IYKk3fZeURwf3xglynW3zx6MRNdNiryXxrjILOSLwMUVcbx8 JRBiNGSVdRbAwwaBgZLlFZUIAQ21zUOZxAmGkyOEIazpX52mjly725t2iBzBkp9R PFklG/gegYGdh5PTw/m7u5jndzPz+tpLeaoHRhgly95KhHm4uKghs522aQGEpdmd IP7nQaecXS6cTJ1ZNiTpqpmqoWbRg1ooGEuDIUyWH2oMR4cF93L+9XgVbL5ByFkl ARHm03XbP3OvY0wtZp5YoWtTUsJzfYf7+7bgVdZYyxZrxAUJOMwmgtxofwv+G/y/ IDrvAapAPVfuKiDHESMVPIYqQ0Mo+eUlwbyJos/Fnt8kfRHVNK8aoPViWH0TYen/ B+PnHX7PeDH/KOSqe2+spTuQk1ElxJYA2Z8ccqwBAi9JrkCuKtHmOx9XVEEeIDEd 37t6UFFkATv1b5K7VBNW+HU88JT6qrQn3rATP5WydJ2spHULw2j+vVS62En3I8TW LVnQOGs4qvLTvCSCO2uiT0JcMJ09DMwjDZDC3NpR4FjHJKE6LXjdVqTfvf0FJFlH qaMRtg/ijdZTz+0fphBARVmrb+YUvndR1ZMuwYhP+avklYN4dy4= =Rphc -----END PGP SIGNATURE----- --wSbFsarmM63ZWC8H--