From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from firstgate.proxmox.com (firstgate.proxmox.com [212.224.123.68]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits)) (No client certificate requested) by lists.proxmox.com (Postfix) with ESMTPS id 9CCF18995 for ; Tue, 22 Aug 2023 12:57:27 +0200 (CEST) Received: from firstgate.proxmox.com (localhost [127.0.0.1]) by firstgate.proxmox.com (Proxmox) with ESMTP id 7CFEAB49A for ; Tue, 22 Aug 2023 12:57:27 +0200 (CEST) Received: from mx0.konsec.net (hbase53.h.konsec.com [88.99.94.78]) (using TLSv1.2 with cipher DHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by firstgate.proxmox.com (Proxmox) with ESMTPS for ; Tue, 22 Aug 2023 12:57:25 +0200 (CEST) Received: from kolab.konsec.com (unknown [10.21.1.190]) by mx0.konsec.net (Postfix) with ESMTPS id AA36685C0A5 for ; Tue, 22 Aug 2023 12:50:53 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=konsec.com; s=201809; t=1692701453; h=from:from:sender:sender:reply-to:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=sOXpKoV+N4zJ4ywII8woHB9EAPcyigpmLaByx526I70=; b=UHI7wVeb40f67u1NXyURdV1Il5kwYQ4xg4VxsufYdsuygRd4+2QVUlLDQlaAIkXMCwq2bi YZL+sp1mch1bzoLuWB4RwF5JRjPEn5jTdPOhK243K3oEEIzY8FPZujyLB/waCiauIjmPsK XAa9lrL5lmCi+ZGU7RgTodouWfDgIeSiIIMGOA2gLMUgc4xIEXJty+1eoSwPBPw3Wt8+MA 2hmEux14ZKoQjb0idrPNFJNUqHMkLl7XoVzpXZbU8tFP5Jivjb5w1lg5ubtZtPW8q1I3qg 3dwbiSMMz9ILlQfSKwjS9qxX34FGwJU7TsTCCrxB8WdPf8IUBPopl+TPRTWYWw== Sender: martin.konold@konsec.com MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8; format=flowed Date: Tue, 22 Aug 2023 12:50:53 +0200 From: "Konold, Martin" To: Proxmox VE user list Reply-To: martin.konold@konsec.com Message-ID: X-Sender: martin.konold@konsec.com Organization: KONSEC GmbH Content-Transfer-Encoding: quoted-printable X-SPAM-LEVEL: Spam detection results: 0 AWL 0.466 Adjusted score from AWL reputation of From: address BAYES_00 -1.9 Bayes spam probability is 0 to 1% DKIM_SIGNED 0.1 Message has a DKIM or DK signature, not necessarily valid DKIM_VALID -0.1 Message has at least one valid DKIM or DK signature DKIM_VALID_AU -0.1 Message has a valid DKIM or DK signature from author's domain DKIM_VALID_EF -0.1 Message has a valid DKIM or DK signature from envelope-from domain DMARC_PASS -0.1 DMARC pass policy JMQ_SPF_NEUTRAL 0.5 SPF set to ?all SPF_HELO_NONE 0.001 SPF: HELO does not publish an SPF Record SPF_PASS -0.001 SPF: sender matches SPF record URIBL_BLOCKED 0.001 ADMINISTRATOR NOTICE: The query to URIBL was blocked. See http://wiki.apache.org/spamassassin/DnsBlocklists#dnsbl-block for more information. [konsec.com] Subject: [PVE-User] issues with 8.0.4 and Kernel 6.2.16-8-pve X-BeenThere: pve-user@lists.proxmox.com X-Mailman-Version: 2.1.29 Precedence: list List-Id: Proxmox VE user list List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 22 Aug 2023 10:57:27 -0000 Hi, in my test environment running on AMD hardware (Ryzen 9 3900 12-Core) I=20 can reproducibly produce errors messages about segfaults with the most=20 recent PVE kernels including 6.2.16-8-pve. This PVE runs hyperconverged with ceph version 17.2.6 (quincy). The problem is not experienced with kernel pinned to 5.15.108-1-pve. For those interested: "proxmox-boot-tool kernel pin 5.15.108-1-pve" [Mo Aug 21 16:36:06 2023] pverados[140842]: segfault at 5570961acb40 ip=20 000055709525cc36 sp 00007ffdb0a03360 error 7 in=20 perl[557095174000+195000] likely on CPU 19 (core 9, socket 0) [Mo Aug 21 16:36:06 2023] Code: 01 08 49 89 c6 e8 8a b1 02 00 48 8b 85=20 e0 00 00 00 4c 8b 44 24 08 48 8b 40 18 48 85 c0 0f 84 e3 02 00 00 48 8b=20 15 a2 52 21 00 40 20 ff ff ff ff 66 48 0f 6e c8 48 89 50 28 48 8b=20 10 48 8b 12 [Mo Aug 21 16:43:06 2023] pverados[145377]: segfault at 5570961acb40 ip=20 000055709525cc36 sp 00007ffdb0a03360 error 7 in=20 perl[557095174000+195000] likely on CPU 5 (core 6, socket 0) [Mo Aug 21 16:43:06 2023] Code: 01 08 49 89 c6 e8 8a b1 02 00 48 8b 85=20 e0 00 00 00 4c 8b 44 24 08 48 8b 40 18 48 85 c0 0f 84 e3 02 00 00 48 8b=20 15 a2 52 21 00 40 20 ff ff ff ff 66 48 0f 6e c8 48 89 50 28 48 8b=20 10 48 8b 12 [Mo Aug 21 17:39:05 2023] pverados[181472]: segfault at 557098a00140 ip=20 000055709524f09d sp 00007ffdb0a030f0 error 7 in=20 perl[557095174000+195000] likely on CPU 7 (core 9, socket 0) [Mo Aug 21 17:39:05 2023] Code: 0f 95 c2 c1 e2 05 08 55 00 41 83 47 08=20 01 48 8b 53 08 22 42 23 0f b6 c0 66 89 45 02 49 8b 07 8b 78 60 48 8b 70=20 48 44 8d 6f 01 <44> 89 68 60 41 83 fd 01 0f 8f 4d 04 00 00 48 8b 56 08=20 49 63 c5 48 [Mo Aug 21 18:02:06 2023] pverados[196758]: segfault at 557095199ae0 ip=20 0000557095199ae0 sp 00007ffdb0a034f8 error 14 likely on CPU 20 (core 10,=20 socket 0) [Mo Aug 21 18:02:06 2023] Code: Unable to access opcode bytes at=20 0x557095199ab6. [Mo Aug 21 18:45:05 2023] pverados[224840]: segfault at 5570961acb40 ip=20 000055709525cc36 sp 00007ffdb0a03360 error 7 in=20 perl[557095174000+195000] likely on CPU 1 (core 1, socket 0) [Mo Aug 21 18:45:05 2023] Code: 01 08 49 89 c6 e8 8a b1 02 00 48 8b 85=20 e0 00 00 00 4c 8b 44 24 08 48 8b 40 18 48 85 c0 0f 84 e3 02 00 00 48 8b=20 15 a2 52 21 00 40 20 ff ff ff ff 66 48 0f 6e c8 48 89 50 28 48 8b=20 10 48 8b 12 [Mo Aug 21 19:23:35 2023] pverados[249788]: segfault at 5570961acb40 ip=20 000055709525cc36 sp 00007ffdb0a03360 error 7 in=20 perl[557095174000+195000] likely on CPU 0 (core 0, socket 0) [Mo Aug 21 19:23:35 2023] Code: 01 08 49 89 c6 e8 8a b1 02 00 48 8b 85=20 e0 00 00 00 4c 8b 44 24 08 48 8b 40 18 48 85 c0 0f 84 e3 02 00 00 48 8b=20 15 a2 52 21 00 40 20 ff ff ff ff 66 48 0f 6e c8 48 89 50 28 48 8b=20 10 48 8b 12 [Mo Aug 21 20:12:45 2023] pverados[281599]: segfault at 557095199ae0 ip=20 0000557095199ae0 sp 00007ffdb0a034f8 error 14 in=20 perl[557095174000+195000] likely on CPU 19 (core 9, socket 0) [Mo Aug 21 20:12:45 2023] Code: Unable to access opcode bytes at=20 0x557095199ab6. [Mo Aug 21 23:17:46 2023] pverados[401208]: segfault at 5570961acb40 ip=20 000055709525cc36 sp 00007ffdb0a03360 error 7 in=20 perl[557095174000+195000] likely on CPU 7 (core 9, socket 0) [Mo Aug 21 23:17:46 2023] Code: 01 08 49 89 c6 e8 8a b1 02 00 48 8b 85=20 e0 00 00 00 4c 8b 44 24 08 48 8b 40 18 48 85 c0 0f 84 e3 02 00 00 48 8b=20 15 a2 52 21 00 40 20 ff ff ff ff 66 48 0f 6e c8 48 89 50 28 48 8b=20 10 48 8b 12 [Di Aug 22 00:58:06 2023] pverados[465511]: segfault at 557095199ae0 ip=20 0000557095199ae0 sp 00007ffdb0a034f8 error 14 in=20 perl[557095174000+195000] likely on CPU 3 (core 4, socket 0) [Di Aug 22 00:58:06 2023] Code: Unable to access opcode bytes at=20 0x557095199ab6. [Di Aug 22 03:45:16 2023] pverados[572963]: segfault at 557095199ae0 ip=20 0000557095199ae0 sp 00007ffdb0a034f8 error 14 in=20 perl[557095174000+195000] likely on CPU 7 (core 9, socket 0) [Di Aug 22 03:45:16 2023] Code: Unable to access opcode bytes at=20 0x557095199ab6. [Di Aug 22 05:40:06 2023] pverados[647893]: segfault at 557095199ae0 ip=20 0000557095199ae0 sp 00007ffdb0a034f8 error 14 in=20 perl[557095174000+195000] likely on CPU 2 (core 2, socket 0) [Di Aug 22 05:40:06 2023] Code: Unable to access opcode bytes at=20 0x557095199ab6. [Di Aug 22 07:20:07 2023] pverados[713129]: segfault at 557095199ae0 ip=20 0000557095199ae0 sp 00007ffdb0a034f8 error 14 in=20 perl[557095174000+195000] likely on CPU 7 (core 9, socket 0) [Di Aug 22 07:20:07 2023] Code: Unable to access opcode bytes at=20 0x557095199ab6. [Di Aug 22 09:24:36 2023] pverados[793888]: segfault at 557095199ae0 ip=20 0000557095199ae0 sp 00007ffdb0a034f8 error 14 in=20 perl[557095174000+195000] likely on CPU 3 (core 4, socket 0) [Di Aug 22 09:24:36 2023] Code: Unable to access opcode bytes at=20 0x557095199ab6. [Di Aug 22 11:45:56 2023] pverados[887089]: segfault at 557098a00140 ip=20 000055709524f09d sp 00007ffdb0a030f0 error 7 in=20 perl[557095174000+195000] likely on CPU 4 (core 5, socket 0) [Di Aug 22 11:45:56 2023] Code: 0f 95 c2 c1 e2 05 08 55 00 41 83 47 08=20 01 48 8b 53 08 22 42 23 0f b6 c0 66 89 45 02 49 8b 07 8b 78 60 48 8b 70=20 48 44 8d 6f 01 <44> 89 68 60 41 83 fd 01 0f 8f 4d 04 00 00 48 8b 56 08=20 49 63 c5 48 --=20 Kind Regards ppa. Martin Konold -- Martin Konold - Prokurist, CTO KONSEC GmbH -=E2=81=A0 make things real Amtsgericht Stuttgart, HRB 23690 Gesch=C3=A4ftsf=C3=BChrer: Andreas Mack Im K=C3=B6ller 3, 70794 Filderstadt, Germany