From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from firstgate.proxmox.com (firstgate.proxmox.com [IPv6:2a01:7e0:0:424::9]) by lore.proxmox.com (Postfix) with ESMTPS id 8EA141FF164 for ; Fri, 22 Nov 2024 09:24:08 +0100 (CET) Received: from firstgate.proxmox.com (localhost [127.0.0.1]) by firstgate.proxmox.com (Proxmox) with ESMTP id C55FACE09; Fri, 22 Nov 2024 09:23:52 +0100 (CET) Date: Fri, 22 Nov 2024 08:53:29 +0100 References: In-Reply-To: To: pve-user@lists.proxmox.com MIME-Version: 1.0 Message-ID: List-Id: Proxmox VE user list List-Post: From: Mark Schouten via pve-user Precedence: list Cc: Mark Schouten , PVE User List X-Mailman-Version: 2.1.29 X-BeenThere: pve-user@lists.proxmox.com List-Subscribe: , List-Unsubscribe: , List-Archive: Reply-To: Proxmox VE user list List-Help: Subject: Re: [PVE-User] VMs With Multiple Interfaces Rebooting Content-Type: multipart/mixed; boundary="===============8808376754789408521==" Errors-To: pve-user-bounces@lists.proxmox.com Sender: "pve-user" --===============8808376754789408521== Content-Type: message/rfc822 Content-Disposition: inline Return-Path: X-Original-To: pve-user@pve.proxmox.com Delivered-To: pve-user@pve.proxmox.com Received: from firstgate.proxmox.com (firstgate.proxmox.com [212.224.123.68]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits)) (No client certificate requested) by lists.proxmox.com (Postfix) with ESMTPS id D3D41C8618 for ; Fri, 22 Nov 2024 09:23:50 +0100 (CET) Received: from firstgate.proxmox.com (localhost [127.0.0.1]) by firstgate.proxmox.com (Proxmox) with ESMTP id BD152CC9C for ; Fri, 22 Nov 2024 09:23:50 +0100 (CET) Received: from kerio.tuxis.nl (alrami.saas.tuxis.net [31.3.111.57]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by firstgate.proxmox.com (Proxmox) with ESMTPS for ; Fri, 22 Nov 2024 09:23:50 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=tuxis.nl; s=mail; h=from:subject:date:message-id:to:cc:mime-version:content-type: content-transfer-encoding:in-reply-to:references; bh=lTdJVdckdLQYri7sEMyX9OUw/4A7sK8+WANe2CEwFio=; b=SgWyOjkWd8ZP7/MyU7Jel2iTFmeNaJrA4CZq68aVNCxonABvJ7zveY3aQwsX/IndducSl9aGhltDi fUB/W01saharzNKQPPnR63lMtGknNQNoAiLgTsLJK6CvHG8sqZ+SBDnG+GLjyvyVXuSR2SSvors6/o ibBl0CdcLVzzbRWsMCHRPN4OShXDmDWkkQrR5pnoFZTPUG5Wo6KsSsvOLZPM7lA0SWdAitl/e9mZab vPyDUN006ZLqKuKQgql8eVW4wRLR95lBlhBwiNge94jyd9bufezGOE0BibyhM2ptOoymgstA4Kp5Qv YhB28XT0gT/zk+37303pfwj4jbrvhaA== X-Footer: dHV4aXMubmw= Received: from smtpclient.apple ([2a10:3781:383a:1:a0f2:9de2:9c95:475a]) (authenticated user mark@tuxis.nl) by kerio.tuxis.nl (Kerio Connect 10.0.6) with ESMTPSA (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256 bits)); Fri, 22 Nov 2024 08:53:39 +0100 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable From: Mark Schouten Mime-Version: 1.0 (1.0) Subject: Re: [PVE-User] VMs With Multiple Interfaces Rebooting Date: Fri, 22 Nov 2024 08:53:29 +0100 Message-Id: References: Cc: PVE User List In-Reply-To: To: pve-user@lists.proxmox.com X-Mailer: iPhone Mail (22A3370) X-SPAM-LEVEL: Spam detection results: 0 AWL 0.002 Adjusted score from AWL reputation of From: address BAYES_00 -1.9 Bayes spam probability is 0 to 1% DKIM_SIGNED 0.1 Message has a DKIM or DK signature, not necessarily valid DKIM_VALID -0.1 Message has at least one valid DKIM or DK signature DKIM_VALID_AU -0.1 Message has a valid DKIM or DK signature from author's domain DKIM_VALID_EF -0.1 Message has a valid DKIM or DK signature from envelope-from domain DMARC_PASS -0.1 DMARC pass policy SPF_HELO_NONE 0.001 SPF: HELO does not publish an SPF Record SPF_PASS -0.001 SPF: sender matches SPF record Hi JR, What do you mean by =E2=80=98reboot=E2=80=99? Does the vm crash so that it i= s powered down from a HA point of view and started back up? Or does the VM O= S nicely reboot? Mark Schouten > Op 22 nov 2024 om 07:18 heeft JR Richardson het= volgende geschreven: >=20 > =EF=BB=BFHey Folks, >=20 > Just wanted to share an experience I recently had, Cluster parameters: > 7 nodes, 2 HA Groups (3 nodes and 4 nodes), shared storage. > Server Specs: > CPU(s) 40 x Intel(R) Xeon(R) CPU E5-2630 v4 @ 2.20GHz (2 Sockets) > Kernel Version Linux 6.8.12-1-pve (2024-08-05T16:17Z) > Manager Version pve-manager/8.2.4/faa83925c9641325 >=20 > Super stable environment for many years through software and hardware > upgrades, few issues to speak of, then without warning one of my > hypervisors in 3 node group crashed with a memory dimm error, cluster > HA took over and restarted the VMs on the other two nodes in the group > as expected. The problem quickly materialized as the VMs started > rebooting quickly, a lot of network issues and notice of migration > pending. I could not lockdown exactly what the root cause was. Notable > was these particular VMs all have multiple network interfaces. After > several hours of not being able to get the current VMs stable, I tried > spinning up new VMs on to no avail, reboots persisted on the new VMs. > This seemed to only affect the VMs that were on the hypervisor that > failed all other VMs across the cluster were fine. >=20 > I have not installed any third-party monitoring software, found a few > post in the forum about it, but was not my issue. >=20 > In an act of desperation, I performed a dist-upgrade and this solved > the issue straight away. > Kernel Version Linux 6.8.12-4-pve (2024-11-06T15:04Z) > Manager Version pve-manager/8.3.0/c1689ccb1065a83b >=20 > Hope this was helpful and if there are any ideas on why this > happened, I welcome any responses. >=20 > Thanks. >=20 > JR >=20 > _______________________________________________ > pve-user mailing list > pve-user@lists.proxmox.com > https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-user >=20 --===============8808376754789408521== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ pve-user mailing list pve-user@lists.proxmox.com https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-user --===============8808376754789408521==--