From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from firstgate.proxmox.com (firstgate.proxmox.com [IPv6:2a01:7e0:0:424::9]) by lore.proxmox.com (Postfix) with ESMTPS id DBB5A1FF15C for ; Wed, 27 Nov 2024 10:39:13 +0100 (CET) Received: from firstgate.proxmox.com (localhost [127.0.0.1]) by firstgate.proxmox.com (Proxmox) with ESMTP id 7ECEB134E0; Wed, 27 Nov 2024 10:39:09 +0100 (CET) Date: Wed, 27 Nov 2024 09:38:59 +0000 To: "Proxmox VE user list" In-Reply-To: References: MIME-Version: 1.0 Message-ID: List-Id: Proxmox VE user list List-Post: From: Alwin Antreich via pve-user Precedence: list Cc: Alwin Antreich X-Mailman-Version: 2.1.29 X-BeenThere: pve-user@lists.proxmox.com List-Subscribe: , List-Unsubscribe: , List-Archive: Reply-To: Proxmox VE user list List-Help: Subject: Re: [PVE-User] VMs With Multiple Interfaces Rebooting Content-Type: multipart/mixed; boundary="===============2215567051870372562==" Errors-To: pve-user-bounces@lists.proxmox.com Sender: "pve-user" --===============2215567051870372562== Content-Type: message/rfc822 Content-Disposition: inline Return-Path: X-Original-To: pve-user@lists.proxmox.com Delivered-To: pve-user@lists.proxmox.com Received: from firstgate.proxmox.com (firstgate.proxmox.com [212.224.123.68]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits)) (No client certificate requested) by lists.proxmox.com (Postfix) with ESMTPS id 5744FCAA54 for ; Wed, 27 Nov 2024 10:39:07 +0100 (CET) Received: from firstgate.proxmox.com (localhost [127.0.0.1]) by firstgate.proxmox.com (Proxmox) with ESMTP id 35F7313495 for ; Wed, 27 Nov 2024 10:39:07 +0100 (CET) Received: from mx.antreich.com (mx.antreich.com [173.249.42.230]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by firstgate.proxmox.com (Proxmox) with ESMTPS for ; Wed, 27 Nov 2024 10:39:06 +0100 (CET) Received: from mail2.antreich.com (unknown [172.16.9.25]) by mx.antreich.com (Postfix) with ESMTPS id 2683B6E2E33 for ; Wed, 27 Nov 2024 10:39:00 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=antreich.com; s=2018; t=1732700340; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=x4LNcgiFskGdUdIQxxFvG+/9/2PA7ZBXd91pUYnF0Dc=; b=XtNeIhpA8TReIyBggwojJ+yKOvnd2ybM0yj1rfrTaV2hMNhkN0KM0Fpj69DG2+8OYHr9Hd fLeEbcRDt9XdxKqFeL9tlf3O8RR/2zOMdz8qNgxCtNhSpOKn3XNzZ5NAnEc5iQle47Lk9h tHLhpxF+sguJ5siWEotaKgR5Nxjfzh7Qvt2MBc34edJj6dFnyFQ3JxcOvXJel4opc1Bz55 m/EMyxps46mIcySCzR5ixGTURzPxwB0QmKw09JbjYcyIdAAnwXpVCFxm0cjcB3dSYEbTQH MrvyeYvRbLid6nZF2NtkmTjzjtQjHlqoLb8j4zKN76jIjhw6Y6zK+WGKMCP9hw== MIME-Version: 1.0 Date: Wed, 27 Nov 2024 09:38:59 +0000 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable From: "Alwin Antreich" Message-ID: <64bc4bad4c8528beaf44558880c9723751431d16@antreich.com> TLS-Required: No Subject: Re: [PVE-User] VMs With Multiple Interfaces Rebooting To: "Proxmox VE user list" In-Reply-To: References: X-SPAM-LEVEL: Spam detection results: 0 AWL 0.105 Adjusted score from AWL reputation of From: address BAYES_00 -1.9 Bayes spam probability is 0 to 1% DKIM_SIGNED 0.1 Message has a DKIM or DK signature, not necessarily valid DKIM_VALID -0.1 Message has at least one valid DKIM or DK signature DKIM_VALID_AU -0.1 Message has a valid DKIM or DK signature from author's domain DKIM_VALID_EF -0.1 Message has a valid DKIM or DK signature from envelope-from domain DMARC_PASS -0.1 DMARC pass policy RCVD_IN_VALIDITY_CERTIFIED_BLOCKED 0.001 ADMINISTRATOR NOTICE: The query to Validity was blocked. See https://knowledge.validity.com/hc/en-us/articles/20961730681243 for more information. RCVD_IN_VALIDITY_RPBL_BLOCKED 0.001 ADMINISTRATOR NOTICE: The query to Validity was blocked. See https://knowledge.validity.com/hc/en-us/articles/20961730681243 for more information. RCVD_IN_VALIDITY_SAFE_BLOCKED 0.001 ADMINISTRATOR NOTICE: The query to Validity was blocked. See https://knowledge.validity.com/hc/en-us/articles/20961730681243 for more information. SPF_HELO_PASS -0.001 SPF: HELO matches SPF record SPF_PASS -0.001 SPF: sender matches SPF record URIBL_BLOCKED 0.001 ADMINISTRATOR NOTICE: The query to URIBL was blocked. See http://wiki.apache.org/spamassassin/DnsBlocklists#dnsbl-block for more information. [antreich.com] Hi JR, November 25, 2024 at 4:08 PM, "JR Richardson" wrote: >=20 >=20>=20 >=20> Super stable environment for many years through software and hardwa= re > > upgrades, few issues to speak of, then without warning one of my > > hypervisors in 3 node group crashed with a memory dimm error, cluster > > HA took over and restarted the VMs on the other two nodes in the grou= p > > as expected. The problem quickly materialized as the VMs started > > rebooting quickly, a lot of network issues and notice of migration > > pending. I could not lockdown exactly what the root cause was. Notabl= e > > This sounds like it wanted to balance the load. Do you have CRS acti= ve and/or static load scheduling? > >=20 >=20CRS option is set to basic, not dynamic. K, basic. And I meant is rebalance active. :) >=20 >=202024-11-21T18:37:38.248094-06:00 vvepve13 pve-ha-lrm[4337]: > end task UPID:vvepve13:000010F2:00007AEA:673FD24A:qmstart:13101:root@pa= m: > OK > 2024-11-21T18:37:38.254144-06:00 vvepve13 pve-ha-lrm[4337]: service > status vm:13101 started > 2024-11-21T18:37:44.256824-06:00 vvepve13 QEMU[3794]: kvm: > ../accel/kvm/kvm-all.c:1836: kvm_irqchip_commit_routes: Assertion `ret > =3D=3D 0' failed. This doesn't look good. I'd assume that this is VM13101, which failed to = start. And was consequently moved to the other remaining node (vice versa= ). But this doesn't explain the WHY. You will need to look further into the = logs to see what else transpired during this time. Cheers, Alwin --===============2215567051870372562== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ pve-user mailing list pve-user@lists.proxmox.com https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-user --===============2215567051870372562==--