From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from firstgate.proxmox.com (firstgate.proxmox.com [IPv6:2a01:7e0:0:424::9]) by lore.proxmox.com (Postfix) with ESMTPS id 0828A1FF166 for ; Wed, 28 Aug 2024 17:24:09 +0200 (CEST) Received: from firstgate.proxmox.com (localhost [127.0.0.1]) by firstgate.proxmox.com (Proxmox) with ESMTP id A5B59D2EF; Wed, 28 Aug 2024 17:24:30 +0200 (CEST) To: "pve-user@lists.proxmox.com" Date: Wed, 28 Aug 2024 14:56:48 +0000 MIME-Version: 1.0 Message-ID: List-Id: Proxmox VE user list List-Post: From: "Knight, Joshua via pve-user" Precedence: list Cc: "Knight, Joshua" X-Mailman-Version: 2.1.29 X-BeenThere: pve-user@lists.proxmox.com List-Subscribe: , List-Unsubscribe: , List-Archive: Reply-To: Proxmox VE user list List-Help: Subject: [PVE-User] QEMU crash with dpdk 22.11 app on Proxmox 8 Content-Type: multipart/mixed; boundary="===============0782192283031361698==" Errors-To: pve-user-bounces@lists.proxmox.com Sender: "pve-user" --===============0782192283031361698== Content-Type: message/rfc822 Content-Disposition: inline Return-Path: X-Original-To: pve-user@lists.proxmox.com Delivered-To: pve-user@lists.proxmox.com Received: from firstgate.proxmox.com (firstgate.proxmox.com [212.224.123.68]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by lists.proxmox.com (Postfix) with ESMTPS id 74F3EC6F7B for ; Wed, 28 Aug 2024 17:24:28 +0200 (CEST) Received: from firstgate.proxmox.com (localhost [127.0.0.1]) by firstgate.proxmox.com (Proxmox) with ESMTP id 4FFC2D244 for ; Wed, 28 Aug 2024 17:23:58 +0200 (CEST) Received: from mx0a-00196b01.pphosted.com (mx0a-00196b01.pphosted.com [67.231.149.170]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by firstgate.proxmox.com (Proxmox) with ESMTPS for ; Wed, 28 Aug 2024 17:23:55 +0200 (CEST) Received: from pps.filterd (m0072398.ppops.net [127.0.0.1]) by mx0a-00196b01.pphosted.com (8.18.1.2/8.18.1.2) with ESMTP id 47SEtVD2022878 for ; Wed, 28 Aug 2024 10:57:13 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=netscout.com; h= content-type:date:from:message-id:mime-version:subject:to; s= netscout.com.09.24.2020; bh=LQcak8jtj6ywzht6LWo02Ct6nz8Ix09hscSo trgX56g=; b=pdaDT4UOVqP66O1/x0rmJDFFWNB8fdGmUzrFqXgBl8X/IyxxeYO7 vAxgkmlB+/iZ/jXq2bK1ZA4KgB69lttDCgWq9sG6LWO6VgfbL/S0mwGb04YoJt70 jAaT8XYkek4Xs9kukVT0gR86yts79NS1onsRKY+BVf8+vwHuUIzb3SKd1W8BvpTf Sp8ntdRQ9/Wb1poRwGjtoZ4v5jTunyOCjXJc1A6QkVWdlBpxhChs14ILWmlkqbSi BsF/lsQded2eKge0Ja2Bx5h2pH9d0Ag2IB45ZePgfNwPgIDqZGKq+jsHXCzbS7vr nX31L63CuSlvsKlAQWWZzvAQJR5IsC+r0g== Received: from nam12-dm6-obe.outbound.protection.outlook.com (mail-dm6nam12lp2169.outbound.protection.outlook.com [104.47.59.169]) by mx0a-00196b01.pphosted.com (PPS) with ESMTPS id 41a5fe0252-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT) for ; Wed, 28 Aug 2024 10:57:13 -0400 (EDT) ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=OAUCr3UxJ6fZkYS+Th/xELtt3+cD7OAEiPYPtpWSx2asI/LPC7PYXN2q5riRASWFrzjK8YWrnylQKbDmlXJTqLqTsLzIAdVUaCfi12QCnTFdtKphlrlvhW/7gfV/AyqnyJ1H09iEtOBTar6jemH0nCgIpCa3CAXZeLV+8SAkTq2PQZ8aKkxtr+uH+d/vunlyO9MQXVEPmh5bgYCnhGc89Y3Cfhj16HfxOyxmI/FC45JcNIPIOPyA6R6jsIXjZaM/vX8km/ZcQYmaJ9lOusCSIun+msYTUoH16CLkTpqR0xdO7UdmpAUJ8AgaedXoEgN81UzQBHiq0aD3XTQJxwSFRw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=LQcak8jtj6ywzht6LWo02Ct6nz8Ix09hscSotrgX56g=; b=ov5zHFvW/ZhwfzufM+BnQ1Bq+ucWhw3BXXszB9nU5b9ysiFr71nhGX1rc0DV0FcWyY/I5vTzFsSA+otUFDei0kDkQQ8W/Qp4xGmNopSjTOqCALNmyF4tVt3oHB2Tth+VLaMFwTjUgys/IFYebgTDFhYjMG0nmNZCzjVVH767jy1WU7+AUNR1yZ2BD9hlp+YLTpDDFuQd8mE6L4tqJVP7Ee8jOxF7yt5IZ9EM5HOyg+YsUnAgAVHuNR52nyDFYhvOmkQrPfeOCj8xBbkexwekEJ625/c3QI4XHe/7Dvxv020imWhAIY3jqq6sS/vivZuiAOqIcLF1Ho/0WhVPgZ9kAw== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=netscout.com; dmarc=pass action=none header.from=netscout.com; dkim=pass header.d=netscout.com; arc=none Received: from PH7PR01MB8496.prod.exchangelabs.com (2603:10b6:510:2f2::15) by SJ0PR01MB7431.prod.exchangelabs.com (2603:10b6:a03:3e0::5) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.7897.27; Wed, 28 Aug 2024 14:57:09 +0000 Received: from PH7PR01MB8496.prod.exchangelabs.com ([fe80::a7e8:cd9:c3bd:f1f1]) by PH7PR01MB8496.prod.exchangelabs.com ([fe80::a7e8:cd9:c3bd:f1f1%6]) with mapi id 15.20.7897.027; Wed, 28 Aug 2024 14:57:09 +0000 From: "Knight, Joshua" To: "pve-user@lists.proxmox.com" Subject: QEMU crash with dpdk 22.11 app on Proxmox 8 Thread-Topic: QEMU crash with dpdk 22.11 app on Proxmox 8 Thread-Index: AQHa+VfnzvAsEws5aU2amKl5tibcIw== Date: Wed, 28 Aug 2024 14:56:48 +0000 Message-ID: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-ms-publictraffictype: Email x-ms-traffictypediagnostic: PH7PR01MB8496:EE_|SJ0PR01MB7431:EE_ x-ms-office365-filtering-correlation-id: 3b160941-d378-4a8a-b1bb-08dcc771b0d2 x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0;ARA:13230040|1800799024|366016|376014|38070700018; x-microsoft-antispam-message-info: =?Windows-1252?Q?iWIodIvsVfnxxsYbG8CunEpWGD9cU8zBuDj6tMtdc7+X5S2tlZUHJ/HM?= =?Windows-1252?Q?LEpA1GGAEkJE8U1mUbw1WZL71fNEFm9IjpaAmDnYWP4QTRFdmvAUtKmK?= =?Windows-1252?Q?bfPfcjp/AvT331losTjCIYVqnKEuicSP1CbHyWbmmBDxOWp+WAjamVr4?= =?Windows-1252?Q?FptEpaWyb+uRYEHsiFGNWXhzb5ru0RJgwVPtVdB1IXHECUKXisZZ7pP1?= =?Windows-1252?Q?6CNtjGHDcgr84CHDv0f6lfsymns0XLhr81ga+Y9chhKmEM2DWMn2gKJl?= =?Windows-1252?Q?kqscJk3PIhsPuOPdGCKXTEfxYGw2PRJOTaiSq6gZIbT3jtrQAa4eGGdE?= =?Windows-1252?Q?LOXXRDFQpXBSEzaUqSojjjFjVjvJHe0HqCEIdUgYB2sKgXEw4cMjKbtt?= =?Windows-1252?Q?X/YOUop801IkgmFYsmBM774y6AoDLDsnyciPeevnfqnrTujdpMiX+pD9?= =?Windows-1252?Q?qNzVVgfeaJhiyHtTmfsVOe9m5R/TtNcb340vCZNZbnefGsabMdrDZ1Dk?= =?Windows-1252?Q?ycLuVl+K1C45Z0oXBrqVK+9HbAiH0KdH4okeU/Orwqpj4VDmjYNLZUn3?= =?Windows-1252?Q?xlkTaGYxqlO5SgnU1HaZeLJzqZSakjOouW4h+XDpGmpDSDiPgbFNIKTq?= =?Windows-1252?Q?1LWsoSf/YJc96dASp+rcScc6vxhgUwKJCRMmRz3YFgnqGiyNw5qNi7GV?= =?Windows-1252?Q?LoNkG4PBwANCxKUxoKdVcY7TlmGvF3OPIvtMogkn+Y/A6CTJTBlYgAag?= =?Windows-1252?Q?JuRvEeOrQXXiMKJqYYJGQWJ1lHBUxp3GdKzMB391KfEM57P4O2FrKcPP?= =?Windows-1252?Q?sgRF2QbInc41u9dQBrsTVWK9PhKzypgaerUeFgeQqU87AQsEbYJvGK1y?= =?Windows-1252?Q?l/TBhlX2rRaY8WyoL1Pt9P3O3v0wtzWoljWP2qjLH9pfPbt7X5+hs8ZP?= =?Windows-1252?Q?o9U2SO1yuPKvRYpkKk4v9Bw9wZWA0bhk0TCxhgnV7QGnSdKPpdJXT1s9?= =?Windows-1252?Q?3vLMUUj9E+DSNbdnPztY3qTU+X3Bz73AaN1uoLEzBzgF/8wmNuDLIdKG?= =?Windows-1252?Q?1ALl1xcfYmnKd8zAAwxPJ4XlDPB9RrFwnzR42XziLz8tGuclrvcG8aJF?= =?Windows-1252?Q?T9P7BzYL0k9ZFCpi0AkAVtylvVgs6h42fRueWVjDl0vjQpiD4SIB4RIR?= =?Windows-1252?Q?MCaz0l4X5Cfg3r5oF4OOp38C7ZJ0+Ct2+B/8Tm53bLlYurzc71rtsHy0?= =?Windows-1252?Q?WZHp/mMyfTGkOl51w5CgJ2eoadLH8FkUoXv8/NLLYOJGvLPGjlS6C4XD?= =?Windows-1252?Q?I301t2O4lP47GThpW/3vXenppj3gv1F8eYLkPZGNDnNhBGqST6S9EIf8?= =?Windows-1252?Q?tUnhI+xlAyU2aW4LOTJZVdibls7H6jgICpPnwejr4y2GZN1OhgDmSsmB?= =?Windows-1252?Q?SkCEzo5aqWNMbqHm1bAjewkiNKc6q/V8ufkVIEoOx6RHKFq9Pj3WOC/E?= =?Windows-1252?Q?L0kjlDYwma5qiycNbdttxFSKBsIsMg=3D=3D?= x-forefront-antispam-report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:PH7PR01MB8496.prod.exchangelabs.com;PTR:;CAT:NONE;SFS:(13230040)(1800799024)(366016)(376014)(38070700018);DIR:OUT;SFP:1102; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?Windows-1252?Q?2wUFZD3ojCIeZ/2odie81vsPb1mhBNQ0oiOPhK5s6xbUsL49oFBC/OIe?= =?Windows-1252?Q?JK7B09UrINBGBJIfIuFpaEtPuGzKDJYB47SQIA/wviH5e0v8zM97aErZ?= =?Windows-1252?Q?MVAwQLV5fFZvPDEqZy9IZ6/0QxNeHn0q2+0hk943AU/0g5TBmaiX4vCJ?= =?Windows-1252?Q?+035Hx8SWky4f4pWNDdvDusFGB1oQR7VC/xhnHRgq0fFcXvc+9XjpJcN?= =?Windows-1252?Q?yGHgWCVvQfpVo4/pl065JN0OKyjhcLjQaIBHEbbXdxdv+osTO6lozk4u?= =?Windows-1252?Q?qJeZaEvIMQqwjD0Pg6VWToJL4570SHMwxXtBnGYHeKZ6bULVImeF46I0?= =?Windows-1252?Q?duMfiyFjwm5yoxmQpwJcQceZwaMPIDwr5RG8lqwn36c3xt5zrxljhQbC?= =?Windows-1252?Q?lRnqz1dKBDSchS1EpOJ5yEprZJqle/EiGl7nGVY+zX8TRDJWmhNrKUQu?= =?Windows-1252?Q?UjX0qFOXYkGhnJ8tIGeoHzOHdZ+7PtKmdKtE406hSwAHmGEAQAKwMd9h?= =?Windows-1252?Q?ZJtaM0CRl7jMie29ZhUVpNXcc5wf4B1Xq/RcRplpqvAqfMx2NrXe3tHy?= =?Windows-1252?Q?mn4E5nzTKlC/J2pZuyy++b/W4uS6sZrXNJvanVrdF/wvu17yXOGMdnKW?= =?Windows-1252?Q?A5Lyu3oDCNKVvWcOumTYgnca2lODe1dsT1zsSkpZWiKQzDYusO4ufOoh?= =?Windows-1252?Q?U17nndSeAG3/Sglmafc47ePta0z3pYACgaJygW88mjdtrUq8AaKTmRHV?= =?Windows-1252?Q?+mgXBKhcJvM2I3vpESuUwu2pq8NOc6TDHIzkB8T42bryOOT2RdMAAaKY?= =?Windows-1252?Q?iPPf8xxQ7dHz+nZaJKLyB9GF937m0Iv1r1U2D/ujfhTK4JPsyRCN1NK5?= =?Windows-1252?Q?/9IjH50lJpFmDc42D+1cRDGQJf8V1ZKe4t0SOFxHgFDH/OQaG1u99pGQ?= =?Windows-1252?Q?q51t9zeNFy2EiqJmwBnZa3HtdpY8Xoua8CG6f20TykpDcUIZ/+IuwGPC?= =?Windows-1252?Q?qM42Ig7HUJ/rtHI+cSHdDFTFQb56mJ+LK32bAlPyubYRWV0Vfs216G3x?= =?Windows-1252?Q?tWQNRR8dF3lNs0ZaEtx/ruKmLssSui18561aoyy1lE7ZXZ6jJjPothH8?= =?Windows-1252?Q?yGWKs6eS+UDm4Oyb1lOR/e2huUVIx5ilHTqeMe0qnrfVjJfP5lsfJWHJ?= =?Windows-1252?Q?V8HV1X8bbBafMkpDK3wcTW7rJn9LJSgys0ULpDmNegc6HADSNxvZTzS3?= =?Windows-1252?Q?kn/4gAVUlZBX2JUfm6oZXi7hKKxMipdvXsG51Z7L0EcXT+E1cEqI35sX?= =?Windows-1252?Q?ZULzf0j8f4qYXV8gu/ZGEMYzafDt5KlxS5f5T2xkswlc0nGNfznZtZuW?= =?Windows-1252?Q?OGHr6xuMucrYHYenkHGlLxjIXD0L3pnTI2gcLAfw6Phf+sC4SGm7/ywp?= =?Windows-1252?Q?jJJlA45S+TJ+6ixiBRgSKfXRH80NiNVbUsRwGWA+py9T5z8vP/fAu5z/?= =?Windows-1252?Q?wZFU6ALukgq2n3Rl1112HTQh1czb1fV6sQdLTNABqSH//0sd7xJUFvft?= =?Windows-1252?Q?k0cl+I54V0LcuxjB/jXBVzXvMQUZiuAZ1m3aj01sInfAJcqZDsq1J98f?= =?Windows-1252?Q?cHbfLe6BPVcohtYbfcelza7uWKYwUHHmkZP43uY39mPd4/zbROigLSSI?= =?Windows-1252?Q?67i8zR9lLh4uT9IQkHV7IHM6z1AUUK0M?= MIME-Version: 1.0 X-MS-Exchange-AntiSpam-ExternalHop-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-ExternalHop-MessageData-0: 1EqBFoHOOQXs9Mi5WvTj1Lc5ZYWS98jrTSt346jTyGqN9jkWK+pFa3LQuAeZtczozLDPWgIKWL8sqVIHe4p2qV9Vrx4ahHZSCCzS++lOl0K16yAofM7gPpRMhVAA5CkgFpf/OpR77VV0Zo347FrMpX+DY8tQKE199O9SWDAErpsfkypQ2KWTgwY2eXJnma0k8w43LauaZwuONxxrutpDTe+UT+q+oZ9wIj01IJTCgtv3wDDAeoJDg5qUsPbOt25Rt4IQXHkwru9d+JBhdfJLj+E2Er73RcdTsgt3sLvoEyRIoeFpJWlCHfGksOB5h6TSPzgZM2eMg4qBNfLDYMRMZSgE4X+FEESWWJsxf7/ArdXDIbMO7N2uOENoRf3luB9rmnZC+JPCANgDzBUtYCrjNwua7GnUeVFyJgoD9VN/PzbbqDn0Yrui1SkpQeCqyVwvlGj6xdKGKX1M58m1DXCO7AOvEDcT+FPjOJsXbGvcehj2Sj0UlvTg2Ucck58lrGNu80VMqppUYr7L7CfkrWl+7Nbotc74LUKf1m0VNGIabE3KU2qWpoyGU4MkCb7S4sG0QIKyhQ8vkeAlv8bxxIUfZQPkKTGeKaGKrb9WFm110eUXUOZNe0P32E/p4rGW2b4c X-OriginatorOrg: netscout.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: PH7PR01MB8496.prod.exchangelabs.com X-MS-Exchange-CrossTenant-Network-Message-Id: 3b160941-d378-4a8a-b1bb-08dcc771b0d2 X-MS-Exchange-CrossTenant-originalarrivaltime: 28 Aug 2024 14:57:09.1444 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 54f11205-d4aa-4809-bd36-0b542199c5b2 X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: 7IAKSc4KviAjmB0eMin8hufSjzYxndLzNO/zTYmUtewkaOmW6xx7ip8AG+DHjv77jns4wQ3H8xKxK5g/lhr3Mw== X-MS-Exchange-Transport-CrossTenantHeadersStamped: SJ0PR01MB7431 X-Proofpoint-ORIG-GUID: 2gwbqAsKaEqP6hcV-xEtjQNjcwO7xUDp X-Proofpoint-GUID: 2gwbqAsKaEqP6hcV-xEtjQNjcwO7xUDp X-Proofpoint-Spam-Details: rule=outbound_policy_notspam policy=outbound_policy score=0 malwarescore=0 priorityscore=1501 bulkscore=0 adultscore=0 spamscore=0 suspectscore=0 mlxlogscore=999 mlxscore=0 phishscore=0 lowpriorityscore=0 clxscore=1011 impostorscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.21.0-2407110000 definitions=main-2408280107 X-SPAM-LEVEL: Spam detection results: 0 ARC_SIGNED 0.001 Message has a ARC signature ARC_VALID 0.001 Message has a valid ARC signature BAYES_00 -1.9 Bayes spam probability is 0 to 1% DKIM_SIGNED 0.1 Message has a DKIM or DK signature, not necessarily valid DKIM_VALID -0.1 Message has at least one valid DKIM or DK signature DKIM_VALID_AU -0.1 Message has a valid DKIM or DK signature from author's domain DKIM_VALID_EF -0.1 Message has a valid DKIM or DK signature from envelope-from domain DMARC_PASS -0.1 DMARC pass policy HTML_MESSAGE 0.001 HTML included in message KAM_NUMSUBJECT 0.5 Subject ends in numbers excluding current years RCVD_IN_DNSWL_LOW -0.7 Sender listed at https://www.dnswl.org/, low trust RCVD_IN_MSPIKE_H4 0.001 Very Good reputation (+4) RCVD_IN_MSPIKE_WL 0.001 Mailspike good senders RCVD_IN_VALIDITY_CERTIFIED_BLOCKED 0.001 ADMINISTRATOR NOTICE: The query to Validity was blocked. See https://knowledge.validity.com/hc/en-us/articles/20961730681243 for more information. RCVD_IN_VALIDITY_RPBL_BLOCKED 0.001 ADMINISTRATOR NOTICE: The query to Validity was blocked. See https://knowledge.validity.com/hc/en-us/articles/20961730681243 for more information. RCVD_IN_VALIDITY_SAFE_BLOCKED 0.001 ADMINISTRATOR NOTICE: The query to Validity was blocked. See https://knowledge.validity.com/hc/en-us/articles/20961730681243 for more information. SPF_HELO_NONE 0.001 SPF: HELO does not publish an SPF Record SPF_PASS -0.001 SPF: sender matches SPF record T_SCC_BODY_TEXT_LINE -0.01 - Content-Type: text/plain; charset="Windows-1252" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.29 We are seeing an issue on Proxmox 8 hosts where the underlying QEMU process= for a guest will crash while starting a DPDK application in the guest. * Proxmox 8.2.4 with QEMU 9.0.2-2 * Guest running Ubuntu 22.04, application is dpdk 22.11 testpmd * Using virtio network interfaces that are up/connected * Binding interfaces with the (legacy) igb_uio driver When starting the application, the VM ssh connection will disconnect and th= e VM will be powered off in the ui. root@karma06:~/dpdk-22.11# python3 /root/dpdk-22.11/res/usr/local/bin/dpdk-= devbind.py --bind=3Digb_uio enp6s20 root@karma06:~/dpdk-22.11# python3 /root/dpdk-22.11/res/usr/local/bin/dpdk-= devbind.py --bind=3Digb_uio enp6s21 root@karma06:~/dpdk-22.11# python3 /root/dpdk-22.11/res/usr/local/bin/dpdk-= devbind.py --bind=3Digb_uio enp6s22 root@karma06:~/dpdk-22.11# python3 /root/dpdk-22.11/res/usr/local/bin/dpdk-= devbind.py --bind=3Digb_uio enp6s23 root@karma06:~/dpdk-22.11# /root/dpdk-22.11/res/usr/local/bin/dpdk-testpmd = -- -i --port-topology=3Dchained --rxq=3D1 --txq=3D1 --rss-ip EAL: Detected CPU lcores: 6 EAL: Detected NUMA nodes: 1 EAL: Detected static linkage of DPDK EAL: Multi-process socket /var/run/dpdk/rte/mp_socket EAL: Selected IOVA mode 'PA' EAL: VFIO support initialized EAL: Probe PCI driver: net_virtio (1af4:1000) device: 0000:06:12.0 (socket = -1) eth_virtio_pci_init(): Failed to init PCI device EAL: Requested device 0000:06:12.0 cannot be used EAL: Probe PCI driver: net_virtio (1af4:1000) device: 0000:06:13.0 (socket = -1) eth_virtio_pci_init(): Failed to init PCI device EAL: Requested device 0000:06:13.0 cannot be used EAL: Probe PCI driver: net_virtio (1af4:1000) device: 0000:06:14.0 (socket = -1) EAL: Probe PCI driver: net_virtio (1af4:1000) device: 0000:06:15.0 (socket = -1) EAL: Probe PCI driver: net_virtio (1af4:1000) device: 0000:06:16.0 (socket = -1) EAL: Probe PCI driver: net_virtio (1af4:1000) device: 0000:06:17.0 (socket = -1) TELEMETRY: No legacy callbacks, legacy socket not created Interactive-mode selected Warning: NUMA should be configured manually by using --port-numa-config and= --ring-numa-config parameters along with --numa. testpmd: create a new mbuf pool : n=3D187456, size=3D2176, socke= t=3D0 testpmd: preferred mempool ops selected: ring_mp_mc Configuring Port 0 (socket 0) client_loop: send disconnect: Broken pipe A QEMU assertion is seen in the host=92s system log. Using GDB we can see t= hat QEMU is aborted. karma QEMU[27334]: kvm: ../accel/kvm/kvm-all.c:1836: kvm_irqchip_commit_rou= tes: Assertion `ret =3D=3D 0' failed. Thread 10 "CPU 0/KVM" received signal SIGABRT, Aborted. [Switching to Thread 0x7d999cc006c0 (LWP 36256)] __pthread_kill_implementation (threadid=3D, signo=3Dsigno@en= try=3D6, no_tid=3Dno_tid@entry=3D0) at ./nptl/pthread_kill.c:44 44 ./nptl/pthread_kill.c: No such file or directory. (gdb) bt #0 __pthread_kill_implementation (threadid=3D, signo=3Dsign= o@entry=3D6, no_tid=3Dno_tid@entry=3D0) at ./nptl/pthread_kill.c:44 #1 0x00007d99a10a9e8f in __pthread_kill_internal (signo=3D6, threadid=3D) at ./nptl/pthread_kill.c:78 #2 0x00007d99a105afb2 in __GI_raise (sig=3Dsig@entry=3D6) at ../sysdeps/po= six/raise.c:26 #3 0x00007d99a1045472 in __GI_abort () at ./stdlib/abort.c:79 #4 0x00007d99a1045395 in __assert_fail_base (fmt=3D0x7d99a11b9a90 "%s%s%s:= %u: %s%sAssertion `%s' failed.\n%n", assertion=3Dassertion@entry=3D0x5a9eb5a20f5e "ret =3D=3D 0", file=3Dfil= e@entry=3D0x5a9eb5a021a5 "../accel/kvm/kvm-all.c", line=3Dline@entry=3D1836= , function=3Dfunction@entry=3D0x5a9eb5a03ca0 <__PRETTY_FUNCTION__.23> "kv= m_irqchip_commit_routes") at ./assert/assert.c:92 #5 0x00007d99a1053eb2 in __GI___assert_fail (assertion=3Dassertion@entry= =3D0x5a9eb5a20f5e "ret =3D=3D 0", file=3Dfile@entry=3D0x5a9eb5a021a5 "../accel/kvm/kvm-all.c", line=3Dlin= e@entry=3D1836, function=3Dfunction@entry=3D0x5a9eb5a03ca0 <__PRETTY_FUNCTION__.23> "kv= m_irqchip_commit_routes") at ./assert/assert.c:101 #6 0x00005a9eb566248c in kvm_irqchip_commit_routes (s=3D0x5a9eb79eed10) at= ../accel/kvm/kvm-all.c:1836 #7 kvm_irqchip_commit_routes (s=3D0x5a9eb79eed10) at ../accel/kvm/kvm-all.= c:1821 #8 0x00005a9eb540bed2 in virtio_pci_one_vector_unmask (proxy=3Dproxy@entry= =3D0x5a9eb9f5ada0, queue_no=3Dqueue_no@entry=3D4294967295, vector=3Dvector@entry=3D0, msg=3D..., n=3D0x5a9eb9f63368) at ../hw/virt= io/virtio-pci.c:991 #9 0x00005a9eb540c09c in virtio_pci_vector_unmask (dev=3D0x5a9eb9f5ada0, v= ector=3D0, msg=3D...) at ../hw/virtio/virtio-pci.c:1056 #10 0x00005a9eb536ff62 in msix_fire_vector_notifier (is_masked=3Dfalse, vec= tor=3D0, dev=3D0x5a9eb9f5ada0) at ../hw/pci/msix.c:120 #11 msix_handle_mask_update (dev=3D0x5a9eb9f5ada0, vector=3D0, was_masked= =3D) at ../hw/pci/msix.c:140 #12 0x00005a9eb5602260 in memory_region_write_accessor (mr=3D0x5a9eb9f5b3e0= , addr=3D12, value=3D, size=3D4, shift=3D, mask=3D, attrs=3D...) at ../system/memory.c:497 #13 0x00005a9eb5602f4e in access_with_adjusted_size (addr=3Daddr@entry=3D12= , value=3Dvalue@entry=3D0x7d999cbfae58, size=3Dsize@entry=3D4, access_size_min=3D, access_size_max=3D, a= ccess_fn=3D0x5a9eb56021e0 , mr=3D, attrs=3D...) at ../system/memory.c:573 #14 0x00005a9eb560403c in memory_region_dispatch_write (mr=3Dmr@entry=3D0x5= a9eb9f5b3e0, addr=3Daddr@entry=3D12, data=3D, op=3D, attrs=3Dattrs@entry=3D...) at ../system/memory.c:= 1528 #15 0x00005a9eb560b95f in flatview_write_continue_step (attrs=3Dattrs@entry= =3D..., buf=3Dbuf@entry=3D0x7d99a3433028 "", mr_addr=3D12, l=3Dl@entry=3D0x7d999cbfaf80, mr=3D0x5a9eb9f5b3e0, len=3D4) at ../syste= m/physmem.c:2713 #16 0x00005a9eb560bbed in flatview_write_continue (mr=3D, l= =3D, mr_addr=3D, len=3D4, ptr=3D0xfdf8500c, attrs=3D..., addr=3D4260909068, fv=3D0x7d8d6c0796b0) at ../system/physm= em.c:2743 #17 flatview_write (fv=3D0x7d8d6c0796b0, addr=3Daddr@entry=3D4260909068, at= trs=3Dattrs@entry=3D..., buf=3Dbuf@entry=3D0x7d99a3433028, len=3Dlen@entry= =3D4) at ../system/physmem.c:2774 #18 0x00005a9eb560f251 in address_space_write (len=3D4, buf=3D0x7d99a343302= 8, attrs=3D..., addr=3D4260909068, as=3D0x5a9eb66f1f20 ) at ../system/physmem.c:2894 #19 address_space_rw (as=3D0x5a9eb66f1f20 , addr=3D42= 60909068, attrs=3Dattrs@entry=3D..., buf=3Dbuf@entry=3D0x7d99a3433028, len= =3D4, is_write=3D) at ../system/physmem.c:2904 #20 0x00005a9eb56660e8 in kvm_cpu_exec (cpu=3Dcpu@entry=3D0x5a9eb81e6890) a= t ../accel/kvm/kvm-all.c:2917 #21 0x00005a9eb56676d5 in kvm_vcpu_thread_fn (arg=3Darg@entry=3D0x5a9eb81e6= 890) at ../accel/kvm/kvm-accel-ops.c:50 #22 0x00005a9eb581dfe8 in qemu_thread_start (args=3D0x5a9eb81ee390) at ../u= til/qemu-thread-posix.c:541 #23 0x00007d99a10a8134 in start_thread (arg=3D) at ./nptl/pt= hread_create.c:442 #24 0x00007d99a11287dc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/cl= one3.S:81 One thing that=92s interesting about this backtrace is it seems to exactly = match an existing issue in QEMU that claims to be patched, and that patch s= hould be present in QEMU 9.0.2, the version running on this Proxmox host. https://gitlab.com/qemu-project/qemu/-/issues/1928 We=92ve found a workaround by switching from the deprecated igb_uio driver = to the vfio-pci driver when binding the interfaces for dpdk. In this case t= he VM does not crash. But I=92m wondering if anyone has hit this before or = if it=92s a known issue. I would certainly not expect any operation in the= guest to cause QEMU to crash. It=92s also odd that the crash seen claims t= o be patched in 9.0.2. We=92ve been able to reproduce this on Proxmox 8.0, 8.1, 8.2 on both AMD an= d Intel processors. The crash does not occur on earlier releases such as Pr= oxmox 6.4, and does not occur with earlier dpdk versions such as 20.08. Thanks, Josh --===============0782192283031361698== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ pve-user mailing list pve-user@lists.proxmox.com https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-user --===============0782192283031361698==--