From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from firstgate.proxmox.com (firstgate.proxmox.com [212.224.123.68]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits)) (No client certificate requested) by lists.proxmox.com (Postfix) with ESMTPS id 53D7691505 for ; Wed, 14 Feb 2024 16:16:05 +0100 (CET) Received: from firstgate.proxmox.com (localhost [127.0.0.1]) by firstgate.proxmox.com (Proxmox) with ESMTP id 3543C6B32 for ; Wed, 14 Feb 2024 16:15:35 +0100 (CET) Received: from gmmr-2.centrum.cz (gmmr-2.centrum.cz [IPv6:2a00:da80:1:502::7]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by firstgate.proxmox.com (Proxmox) with ESMTPS for ; Wed, 14 Feb 2024 16:15:31 +0100 (CET) Received: from gmmr-1.centrum.cz (envoy-stl.cent [10.32.56.18]) by gmmr-2.centrum.cz (Postfix) with ESMTP id 01D582007966 for ; Wed, 14 Feb 2024 16:15:25 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=volny.cz; s=mail; t=1707923725; bh=FLgLTGAAsbyGemhFgyC4lskmxpXO0r+pznmxV+6mL8Y=; h=From:Subject:Date:To:From; b=MQQPIB3XiSCX3RVSK61JL4OqmD3t+toqHpZJItBatFXvkQzNtRVWtP5m2e4uo/WyP jXdomY14v/jW45CARWaGFcAEjttsuKbtKOrSVWAfYCsNR33Wfq384tlndz7f95OuYE UFeIBaDcN3uu50bdlN/fDNvjw6OZedAT9XjS5Gts= Received: from gmmr-1.centrum.cz (localhost [127.0.0.1]) by gmmr-1.centrum.cz (Postfix) with ESMTP id EFE2E1B7 for ; Wed, 14 Feb 2024 16:15:24 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=volny.cz; s=mail; t=1707923724; bh=FLgLTGAAsbyGemhFgyC4lskmxpXO0r+pznmxV+6mL8Y=; h=From:Subject:Date:To:From; b=ZA/KpESbvJkKnxI4T11hp8KUpR829x1xOWHPHE+/vnaAW06ybvzaIrJdgAjfc5iUz sL2mxF7hK3oMgRK/jfH5VZLM5dbNESz1PYtjseG2dqJxhvJSzVDZjTUEaqP26qtZc7 5332iJGMrL0c/U5ZmwQO0norsxz+tacLGddiEX7c= Received: from antispam102.centrum.cz (antispam102.cent [10.30.208.102]) by gmmr-1.centrum.cz (Postfix) with ESMTP id EC9101A4 for ; Wed, 14 Feb 2024 16:15:24 +0100 (CET) X-IPAS-Result: =?us-ascii?q?A2EvAADE18xl/0vj/y5aHQEBAQEJARIBBQUBQAmBMggBC?= =?us-ascii?q?wGDNIFfA4xtiUmEPo1mhRSGUYElAxg+DwEBAQEBAQEBAQk0EAQBAQMEjF0nN?= =?us-ascii?q?AkOAQIEAQEBAQMCAwEBAQEBAQgBAQYBAQEBAQEGBgECgRmFLz0NglwBgR5RD?= =?us-ascii?q?QMCAgMDAzgBAQEBAQEBAQEBAQEBAQEBAQEBAQEBAQEBAQEBAQEBAQEBAQEFA?= =?us-ascii?q?g0zKQEjgRoIAYEVgxMBgl8UBAKxR4E0GgJlg2lBTa4ZH4FkBoFIAYglAYFSi?= =?us-ascii?q?RuCDYEVJwsQgjeDMhIMAQEBgVCEI4IvBIIUgxIpmSVKcRIjA30IaxsQHjcRE?= =?us-ascii?q?BMNAwhuHQIxOgMFAwQyChIMCx8FEQFCA0MGSQsDAhoFAwMEgTAFDRoCECwmA?= =?us-ascii?q?wMSSQIQFAM4AwMGAwoxMFVBDFADZx8aGAk8DwwaAhsbDSQjAixAAxEQAhYDH?= =?us-ascii?q?RYEMhEJCyYDKgY2AhIMBgYGXSMWCQQlAwgEA1QDIXQRAwQKAxMHCwd4g0YEE?= =?us-ascii?q?0QDEIE0iixbAwkDBwUsHUADCxgNSBEsNRQbBj5vB5xfdwIBgk5iLit7cSkXF?= =?us-ascii?q?gaTQwGyDoQbBYFcgmiHP5UyBC+EBZNVAxiSLZhYjW+VT1oBhF6BY4IWTTg7K?= =?us-ascii?q?gGCPD8TGY47FhaDQoUUimZ3AgsuAgcLAQEDCYhwMoFGAQE?= IronPort-PHdr: A9a23:adN0IxAQLpiz2LypjVNAUyQUIkQY04WdBeb1wqQuh78GSKm/5ZOqZ BWZua88ygaWFtqBo7Ic0qyK6fCmATRBqb+681k8M7V0FCU5wf0MmAIhBMPXQWbaF9XNKxIAI cJZSVV+9Gu6O0UGUOz3ZlnVv2HgpWVKQka3OgV6PPn6FZDPhMqrye+y54fTYwJVjzahfL9+N hq7oRvVu8UMnIdvKKk9xxnXrnBVf+ha2X5kKUickhri5cq85oJv/zhVt/k868NOTKL2crg3Q rBfEDkoKWc56tH1uxLeVwWP/HwcUmsXkhpMHQfI6QzxU4nyvCXnqOdzwTGWMsLqQ786XzSi9 LprRwTziCgbLT458XrYhdJ2galGvR+uvR1/w4rTYIGIKPpze77WcN0GSWZdWMtaSjdMCZ2gY YQRE+UBPP5Yr4jjqFsIsRu+HhSnCOf2xjNVmnP6wag23uI8Gg/EwQMgBcoDvnTIo9r6KakcU u67wrfPwzjYdfxaxTL95ZLIchw9v/2BW697f8rLyUkoEgPIllGeppbjPziI2esNt3KU4PZgV emyjGMnqRt+oj6yxsc3kYTJmIUVylTC9SR52oo6Ody5RVd9bNW5H5ReqzuUOJFqQsM+XW5oo iA6x6UbtJC7ciYHyooqyh3BZ/KJboSF/BbuWeiQLDl4mH9ofLayiRi8/EW81uHxVsu53EpKo ydYkdTCuXAA2RLc58WJTPZ240mv2TGK1w/J6+FEJ1g5laTBK5E/3LE/jYETvlnZEi/xgkX2g 7eadlw69eit9uTreLLmpoWTN4NskgH+KKMum8O6AeQ/PQkCRXSU+eO51LH74UL5Qa5KgeExk qXDrJ/aIsEbq6ikCAFWyoYu8xmyAja83NgGnXQKLEhJdAyZg4XrIV3DIvD1APGiiFmylDdr2 uvGPqH/DZXXM3bDkbbgcqhl5kJAzgc40MpR6IhOCr4bJfL+QkrxtNvFARAnKwG02OPnCMll1 oMZRGKPHreVMKPMvl+M4eIiO+aMZIoMtDbmLvgl++bugWIllVMHYaamw50XaGyiHvR7JkWVe 2bjg9YZHWcLuAoxUvDqhUWNXDNSfXq+QaIx6zEhBI64E4vORJqhjb6B0SujG51ZfGFGClSCE XfycIWEXu8BaCCILc9njzwETqOsS5Em1RGqsg/7y6BrIfbV+yEAs5Lsz8B65/fPmhEq6Tx0E 8Od3nmQQ21shGMHWyc23LxjoUx60lqDybZ4jOJBGdxO/PNGTB06OIXYz+x7ENDyRhnBcs2RS Fa8RdWnDjQxTtU+wtMUf0l9HNCi3Vj/2H+SGbgFkrubTKIZur/H0mK5I8dm1z6SzLcsykQ9T 9FnMWy9mrU57xLUF4vOgwOSkKP8JooG2yuY1m6FhVSKtUpYGFpyWKPYRlgBYU/QvJLy9BWRH PeVFb07P14Zmoa5IaxQZ4is1A0eLMo= IronPort-Data: A9a23:gcskOqmV4kZAnzaqNV2Vwy7o5gwiJERdPkR7XQ2eYbSJt1+Wr1Gzt xJLWm2FbKuLM2aket9/bo61oRkPvsTRmtFkGQVorX02FFtH+JHPbTi7wuYcHM8wwunrFh8PA xA2M4GYRCwMZiaA4E3ra9ANlFEkvYmQXL3wFeXYDS54QA5gWU8JhAlq8wIDqtcAbeORXUXV5 7sen+WFYAX5g2QtbjpNg06+gEoHUMra6W5wUmMWOqgjUG/2zxE9EJ8ZLKetGHr0KqE88jmSG o4vZJnglo/o109F5uGNy94XQWVWKlLmBjViv1INM0SUqkMb+nFtiPZT2M00Mi+7gx3R9zx4J U4kWZaYEW/FNYWU8AgRvoUx/4iT8sSq9ZeeSUVTv/B/wGX+SFrPxvI0C30LNJIWpv97J39fq /gxfWVlghCr34pawZq0T6x3g9g7dZGtN44Zpmt9yHfSH57KQ7ifHeOQuIIehm1vwJ8TdRrdT 5NxhT5Hbh3GfgZnJFATDoN4l/XAanzXLmMD+ArP+fZfD2777SV02p3qH/PuIPukSPcOzkmZo 2jF8DGsav0dHJnFodafyVq0mOKKgDj2QqoWFaak7bhymlqDw2sDThYRUDOGTeKR1hD4AY8Cb RZOpWxx8MDe6XCWczU0ZDXgyFbsg/LWc4M4/zESgO1V9pfp3g== IronPort-HdrOrdr: A9a23:vAp3uqFjTKQHqwDCpLqE88eALOsnbusQ8zAXPidKKSC9E/b4qy nAppsmPHPP5Qr5O0tLpTnjAtjifZq0z/ccirX5VY3SPjUO01HHEGgN1+ff/wE= X-Talos-CUID: 9a23:usokaWD5nhuubUf6ExFc1W0RHZoiTkDU03mMOkOeF3c3TJTAHA== X-Talos-MUID: =?us-ascii?q?9a23=3AWNL9Sw+L6bulDsoY2RXHuQaQf+ZB5q6LD28kqs8?= =?us-ascii?q?hlcS2bnx/OjKXjzviFw=3D=3D?= X-IronPort-Anti-Spam-Filtered: true X-IronPort-AV: E=Sophos;i="6.06,159,1705359600"; d="scan'208,217";a="56380244" Received: from unknown (HELO gm-smtp10.centrum.cz) ([46.255.227.75]) by antispam102.centrum.cz with ESMTP; 14 Feb 2024 16:15:24 +0100 Received: from smtpclient.apple (unknown [10.128.64.68]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by gm-smtp10.centrum.cz (Postfix) with ESMTPSA id 78CD91683D2 for ; Wed, 14 Feb 2024 16:15:24 +0100 (CET) From: Jan Vlach Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3696.120.41.1.8\)) Message-Id: <3A1AB2AD-9A83-4405-B7C7-263A0830F4B7@volny.cz> Date: Wed, 14 Feb 2024 16:15:23 +0100 To: Proxmox VE user list X-Mailer: Apple Mail (2.3696.120.41.1.8) X-SPAM-LEVEL: Spam detection results: 0 AWL 0.074 Adjusted score from AWL reputation of From: address BAYES_00 -1.9 Bayes spam probability is 0 to 1% DKIM_SIGNED 0.1 Message has a DKIM or DK signature, not necessarily valid DKIM_VALID -0.1 Message has at least one valid DKIM or DK signature DKIM_VALID_AU -0.1 Message has a valid DKIM or DK signature from author's domain DKIM_VALID_EF -0.1 Message has a valid DKIM or DK signature from envelope-from domain DMARC_PASS -0.1 DMARC pass policy HTML_MESSAGE 0.001 HTML included in message RCVD_IN_DNSWL_NONE -0.0001 Sender listed at https://www.dnswl.org/, no trust SPF_HELO_NONE 0.001 SPF: HELO does not publish an SPF Record SPF_PASS -0.001 SPF: sender matches SPF record T_SCC_BODY_TEXT_LINE -0.01 - URIBL_BLOCKED 0.001 ADMINISTRATOR NOTICE: The query to URIBL was blocked. See http://wiki.apache.org/spamassassin/DnsBlocklists#dnsbl-block for more information. [cisco.com, proxmox.com, qemu.org, volny.cz] Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.29 Subject: [PVE-User] Cisco ironport appliances on proxmox 8.1 not booting after upgrade (solved, FYI) X-BeenThere: pve-user@lists.proxmox.com X-Mailman-Version: 2.1.29 Precedence: list List-Id: Proxmox VE user list List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 14 Feb 2024 15:16:05 -0000 Hi proxmox user list,=20 we're running Cisco Ironport antispam appliances versions 14.x = (FreeBSD11-based) and 15.x (FreeBSD13-based) on multiple proxmox = clusters.=20 In previous weeks, I've upgraded to latest 8.1.4, live migrated machines = around. This worked flawlessly this time between 6.2.x and 6.5.x kernel.=20= Today colleague needed to bump up RAM from 8G to 16G on an appliance and = after shutdown and fresh start, appliance wouldn't come up with various = errors - detecting raid device that's not there, missing python files, = not bringing up networking.=20 Same behavior was observed on old 14.x appliance, just shutdown and = boot. No other changes. After some digging around and reading changelog for qemu 8.1, the only = real change logged for x86 is "Default to SMBIOS 3.0 information".=20 Turns out this means that now default SMBIOS record size is 64bits vs = 32bits and this causes problems. Changing Hardware version for q35 to 8.0 from "latest" makse the = appliance boot correctly, have networking, but even though UUID stays = the same, the appliance generates new serial and games with cisco = licensing ensue. Trying to use HW version 7.2 from time of installation = doesn't help with keeping serials either. Seems like FreeBSD can read 64bit SMBIOS entries since version 14. Just a heads up so the next guy doesn't need to jump in head first and = can prepare a bit. JV RELATED LINKS: https://reviews.freebsd.org/rGee97f198b42d50437f87aa4111d478eca2a5be16 https://wiki.qemu.org/ChangeLog/8.1 = = https://forum.proxmox.com/threads/uuid-lost-after-changing-machine-type.13= 6942/ = = https://www.cisco.com/c/dam/en/us/td/docs/security/content_security/virtua= l_appliances/Cisco_Content_Security_Virtual_Appliance_Install_Guide.pdf