From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from firstgate.proxmox.com (firstgate.proxmox.com [IPv6:2a01:7e0:0:424::9]) by lore.proxmox.com (Postfix) with ESMTPS id BCDC81FF173 for ; Sun, 6 Jul 2025 16:14:10 +0200 (CEST) Received: from firstgate.proxmox.com (localhost [127.0.0.1]) by firstgate.proxmox.com (Proxmox) with ESMTP id B620713FEE; Sun, 6 Jul 2025 16:14:50 +0200 (CEST) ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=Z2vpVrvjJFWbP9znEs8n+5w2F0LYSofUhDZEa6UtIr3Q6p65UQtPixJls3XjyYghy8Hhghwoc0q7KsZrbgXJBZ614SinhzRy1H1j9Xddp41qE2vzHyZ3q7xsFe0HyrVxv2XXmeM1p4B/IuvHFmvMRfz21jf/9px91U5Qvg9YVONzz1lgkK6Or0+/uMjWHCRKJ+63UdallO/HeHs477VKcfQAKMRwd0jqg1z4kYJ9fRdsbmhyvlcsDEVlrf+NiFF8QAygG3zQVfuvhLvZgAJxl487fCWougny8Pm6lvUWvZlEiFW1z1ojOtKdxw9iwXEe+lokLnx+DQ80fbDV8UDmew== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=giTgbkENyJ9T0XAW4Tepqe0ueQohSjRxnQfrMkcIcNQ=; b=BTiCcLwX5RZ6FzPj4M7cfG8bzN5NRVscdThIn7VofjhS24jR2hsZZv3PvFWccJFg3QGp92mQzo4vRRHgOKH8yR61hxNsNoe6bcmREHGCRr6QcO6s99MlBSSWe0MdgRXzgY/+t8g7ak+N3XsGKiCQZr7ClDu3SlV02QVQfMkXV9nVMlUWCo+gEikjL0KfPs6UInjIIIWHarnmJkcbhehh9KbsOTrgF91MYR82MoAPOvnS+fYpq94mvTFxcC0rsNYrbbHWV728mYpzVnZUObXCAWwuP/CgdQ/ujQha8enl527A5mKLmyqcaqG7ZpFX5IawFNBj6GcrEQzZaO+WqUtNfw== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=libvirt.dev; dmarc=pass action=none header.from=libvirt.dev; dkim=pass header.d=libvirt.dev; arc=none From: Stelios Vailakakis To: Friedrich Weber , Proxmox VE development discussion Thread-Topic: [pve-devel] [PATCH] iscsi: fix excessive connection test spam on storage monitoring Thread-Index: AQHb4VgTVRFMrgyZJUSkTYPKBcLgJLQQbeuAgBTGHoA= Date: Sun, 6 Jul 2025 14:14:34 +0000 Message-ID: References: In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: msip_labels: authentication-results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=libvirt.dev; x-ms-publictraffictype: Email x-ms-traffictypediagnostic: BYAPR06MB4358:EE_|SA3PR06MB9187:EE_ x-ms-office365-filtering-correlation-id: e107c68a-bb87-42da-4b8d-08ddbc976ed6 x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; ARA:13230040|586017|376014|366016|1800799024|38070700018|13003099007|8096899003|7055299006; x-microsoft-antispam-message-info: =?iso-8859-1?Q?yeYJCPPRa30A0nm6XasJ4D+mpQEmn20JrCQHAvS3GLzqzZtzxp3KLfPOYL?= =?iso-8859-1?Q?R74wvRidd0jqPGdPcNAw4xKUGu7qhsPxbgDTZclDvE86QAqdqWSFOnSGcA?= =?iso-8859-1?Q?ohiOk7NjhswA2/X0oX5e+dK0HIkKH8CzlwfgsQ8BMXTc00rITss/EfRdKY?= =?iso-8859-1?Q?37IOxbisCVGomcxi4hley0/zTA0fum3Gd9ZsCAfh+U88ihC1Bg/ATTPpyG?= =?iso-8859-1?Q?FPKmx+7FG+LhiyZcDvMkfjN36nUgsErit+QsWu/cMA0F97iME/bk2dAu+A?= =?iso-8859-1?Q?KKBlGLVulwz/xOxAADNyjs8jv5PhlVvMFHObqTCmfHufJHIHPYB6hlfAKE?= =?iso-8859-1?Q?Ijoge0lEnzetCVSnDODF/PyjQb70ba9nqZnKx+k76m1Ngm2D9ogoL9Y0lN?= =?iso-8859-1?Q?RkNLBvahnMwg2xCkXTd0CILe4RGr8G1DbtGLtGfFJOu2IUiuALOXSzRiKV?= =?iso-8859-1?Q?+Js1srjfQ03GUILsh6zVT3RtNh8/Zk8F7jLhO2tj+apw2E+/rbxLq9fqEZ?= =?iso-8859-1?Q?gfryNbaAEBkPRkp7Xp8X6KTOzjsuKV79D+soqwSvCED8U4cPhGT8AJlo/A?= =?iso-8859-1?Q?7d2lFv+FcdNUlreIcbwBW50WEAfTGLGCGGwH5XrYjv1hmewOezayj0lBFp?= =?iso-8859-1?Q?6tKsMLRy31Uj7Cx1i5J76cRplhRsTzvwFW8EOlQ30173H0vPM3vI4GD301?= =?iso-8859-1?Q?oExc0506r0xnemV93Hjz1w0SaiJ6qvKQNypYBGAx6WkVmv7Wwihq+n/IKE?= =?iso-8859-1?Q?jUscYfKbArwEqXl099tZowkqXrpSL9Ia1DuUMe9Tq/vQQdCPB8OgeZueFk?= =?iso-8859-1?Q?P1hr/K/8Tw+rcCvzZo9zpMGsEA6LoRJiUD1yur3j2tO8IFnGAEJw1Vn2Og?= =?iso-8859-1?Q?61QZUC4K/9Tb+JGTQos+phs+F8vyBPWq5i0UyMGfPKbVjZiFk+AFnZYOJ4?= =?iso-8859-1?Q?RwJZT/SE9DnzWjbs5qJJepWYBP9PciqiQmPhdJEJlAYz4fCfAj/4ObeVMj?= =?iso-8859-1?Q?wUqxkCti2HIMfKXQM08Gl0TRzG9/vPRBXfh1974xc3FNpEWqfQdpgKW/L6?= =?iso-8859-1?Q?OKqX9W9giZz+YmHAuhOEnJ2K2fFLmpb0ZRuwiMff9y/Oq2Va3L/8Nf/b0Q?= =?iso-8859-1?Q?ubXVBudNLMjumIbWkPVh/ph7HNHWp/wJiveJ1fVxD2yH80W1Sc4XpsNQjK?= =?iso-8859-1?Q?J/I/vCX0A8MCNP3jBEdTSBr0W46OypRNs9NzZrp6sumaVwDydzZ7ybxYfS?= =?iso-8859-1?Q?8HLlz05ilbgidcBErmZa/eg5vXxK2y9VWglg1KBvcijcmIi+C1LsVf7ebe?= =?iso-8859-1?Q?4at1JfBIYI6nh9+D45dg2K8794c6PFe+L44D/c7WLAPbBz5UiONFlaOP/I?= =?iso-8859-1?Q?X3ObzgFBMVL3Jvb5pMKRIY3nLIApXydZ+ZMMjeUmOI47/5F60Js9MiGvLH?= =?iso-8859-1?Q?RvZPw8/K0+WE35A/NSAPKCqq/T4yGU9dQupvFjR3pILAIyVB0b5wyruIRu?= =?iso-8859-1?Q?NOn8nIwrgwuX3DkQeFwc+l?= x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:BYAPR06MB4358.namprd06.prod.outlook.com; PTR:; CAT:NONE; SFS:(13230040)(586017)(376014)(366016)(1800799024)(38070700018)(13003099007)(8096899003)(7055299006); DIR:OUT; SFP:1102; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?iso-8859-1?Q?CwrPqsH6cAMSpOwMP1LkBdoGk7JI2hb5fCpge1QfgvbTkupAUmt05F8Pt7?= =?iso-8859-1?Q?1bnyN0DRVBnUqwpmUwUXfVWh9/KsfeR/pqt/BmvAnXDpoD5M/KkpEEJ1iO?= =?iso-8859-1?Q?1k5O9e2z1y4GHF3qerugAE9MZfaQd92gsSerdTsbzGkQoAz/SILlB9lCfR?= =?iso-8859-1?Q?MSZbTNBuPmyUSS9ZSnhoRG37J0BB7OSo/eXnxOPPzca4A5BBxVZiqjqKfN?= =?iso-8859-1?Q?djwwsq9W0RtIgLo5IpkdBjoCsEKPBtTTDfzafK7/vATwtIGmnvcfGewYyI?= =?iso-8859-1?Q?Ho6P4Dor3NhApSyjE7dV97mlDTBioD3WYmKFYYux3zoxA18xHG/X5SypPz?= =?iso-8859-1?Q?Q+IsOGf4sVzapp+Ht6G2akLWS3olkovbMB3eSSzDVTpry/Kk46sU8vMDNf?= =?iso-8859-1?Q?2wRWg4wVYSYnbmyshjm836trumoMaCsVH5WWQvpcLAFOhB90r7ja6gLH5m?= =?iso-8859-1?Q?FsLXV26/mCy8vSbH6ciZl3VES+2zSeMAeGni6dEZ4/a5Y8/k4WJJ9aphfF?= =?iso-8859-1?Q?PZ1hZUmR18/CwY1/1jIhw4+9AY/8q1WzFt/WJ8tv/rUQKRKuO7aN1Ts5SK?= =?iso-8859-1?Q?QB3nsTs6ZJMcre1Rm7nSspV/BE5BFWlfchG1lJ/OE+HigQkoS3N/CAI3Qe?= =?iso-8859-1?Q?dgw47sHGJM01jjoh9hsHuqIosfH0dlocvoqlJS6U3wF2ejylzoH5jCcuZw?= =?iso-8859-1?Q?tQAh6w4iu8sMPxA/kF2EAnOj+csNFXPX4JrTX4dNC3nAKT/LMiTDTbEhd7?= =?iso-8859-1?Q?QYVDkcdXrEZH3JQ2VCa19YPjUSq2gUtiWYi07tpiZn3yRTyUWPmh2KECTn?= =?iso-8859-1?Q?fZnTZA+rrGNAjHwuW4t5q17DPD44NGqwQb7s86bnm8x6EThdJ6CxmRAFBv?= =?iso-8859-1?Q?wBd9Z7za7ossqhplS18IBWzfEPmnfK9smQv0HYWnTfvxpuuKV6YcPL0YQW?= =?iso-8859-1?Q?1SswJHZ9LvRKvbjqYI4yHWbFs/8JVqL2wSPAaZ6CqILC5Rpk9DopURufMX?= =?iso-8859-1?Q?TJ8sYeMxyw2LAu7CFbWoxzKW+OPSKlWQf+TVJzLgw3G0w5V/f6LpLryeB9?= =?iso-8859-1?Q?hdPwxsNnbmrSoawuYdXghJcLVhs+JV7SCKP2CW78ynnQmoJI9KngMIfCoC?= =?iso-8859-1?Q?6e2pXE79QfVLWVXMYX3PaDLo/KTm9ywkRhChYwo0VmXEdUWCV1Y2NtKV+5?= =?iso-8859-1?Q?UzbdxtPcW4QeJGiIEKoTV0Y/EC8sswbMRtcNxhfP38Q91MYugwFICrd2Gm?= =?iso-8859-1?Q?UH/PKcv/vtQN1+p4aQYXbGE1zUus5vTQxMei/KuJmhFKpMNgl5fQ35Qpdz?= =?iso-8859-1?Q?ZloExr+8+4jeI3uUR+omJNcIHIvTqfs6UGZlf5TthcSOwV0+EdigWwu/+w?= =?iso-8859-1?Q?qJFawTjxy1N1DpAbvJcalTZgf7lrjHTYTxm4AOA85GPmEFyt/UU8OkgI1B?= =?iso-8859-1?Q?FWOFYZ8mg3U+9EhmoGNpyce8cPDfVvfmkuC0lFwqxWqgPQOhcu+WPpgELX?= =?iso-8859-1?Q?k1rD63mY8CAy3MWXBz9Bq22n1mTZl61Tc85szZtPwuHIUvJiioZHc4CuvX?= =?iso-8859-1?Q?cvbAhUlm4ESCh3VgyTGIKQO4THKQF/NMFUslTyiQXitAZKJyngAyHtXetz?= =?iso-8859-1?Q?QnMG31o1iBJKU=3D?= MIME-Version: 1.0 X-OriginatorOrg: libvirt.dev X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: BYAPR06MB4358.namprd06.prod.outlook.com X-MS-Exchange-CrossTenant-Network-Message-Id: e107c68a-bb87-42da-4b8d-08ddbc976ed6 X-MS-Exchange-CrossTenant-originalarrivaltime: 06 Jul 2025 14:14:34.1653 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: ae52e033-9978-468d-bec0-1b48967ffa38 X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: vqZWuC5FN2Bd0sj6b4fuMR1XgcTFquubE/qqANlMxChpndOu93fFrW43/q7almCACIE5PKtxsj0hCIFPUBgBIg== X-MS-Exchange-Transport-CrossTenantHeadersStamped: SA3PR06MB9187 X-SPAM-LEVEL: Spam detection results: 0 ARC_SIGNED 0.001 Message has a ARC signature ARC_VALID 0.001 Message has a valid ARC signature AWL 0.091 Adjusted score from AWL reputation of From: address BAYES_00 -1.9 Bayes spam probability is 0 to 1% DMARC_MISSING 0.1 Missing DMARC policy FROM_FMBLA_NEWDOM28 0.001 From domain was registered in last 14-28 days HTML_MESSAGE 0.001 HTML included in message KAM_DMARC_STATUS 0.01 Test Rule for DKIM or SPF Failure with Strict Alignment KAM_LOTSOFHASH 0.25 Emails with lots of hash-like gibberish SPF_HELO_PASS -0.001 SPF: HELO matches SPF record SPF_PASS -0.001 SPF: sender matches SPF record URIBL_BLOCKED 0.001 ADMINISTRATOR NOTICE: The query to URIBL was blocked. See http://wiki.apache.org/spamassassin/DnsBlocklists#dnsbl-block for more information. [truenas.com, proxmox.com, githubusercontent.com, iscsiplugin.pm] URIBL_SBL_A 0.1 Contains URL's A record listed in the Spamhaus SBL blocklist [185.199.110.133, 185.199.109.133, 185.199.111.133] X-Content-Filtered-By: Mailman/MimeDel 2.1.29 Subject: Re: [pve-devel] [PATCH] iscsi: fix excessive connection test spam on storage monitoring X-BeenThere: pve-devel@lists.proxmox.com X-Mailman-Version: 2.1.29 Precedence: list List-Id: Proxmox VE development discussion List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Reply-To: Proxmox VE development discussion Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Errors-To: pve-devel-bounces@lists.proxmox.com Sender: "pve-devel" Hi Friedrich, Thank you for the warm welcome! > This seems like an unrelated change that should be in its own patch, > could you please re-send it separately? I submitted a separate patch in the format requested at https://lists.proxmox.com/pipermail/pve-devel/2025-June/071942.html > This sounds like #957 [1]. A patch [2] with similar objective was merged > [3] and included in Proxmox VE 8.4. Can you check whether your patch is > still needed on Proxmox VE 8.4? On 8.4.1 with the sole Proxmox node that was hosting the TrueNAS instance (proxmox5), I continued to get below errors as well as the errors on the TrueNAS syslog after doing a full pveupgrade. - proxmox5 does list the hostname instead of the IP address under iscsiadm -m session, while 1-4 list the IP address. Forcing this behavior on proxmox1 did not cause errors to appear (reverted back to IP Address after testing). - By utilizing my patch above that includes only hostname support, the error continued on proxmox5 - By reverting back to my patched version which included both fixes (excessive connection attempts + hostname support) the errors went away from automated checking - pvesm status no longer reports the error code 15 when run manually - This patch is working from an older version of ISCSIPlugin.pm and I haven't checked to see why it's only an issue on this proxmox5 node. Jul 06 08:30:55 proxmox5 pvestatd[490256]: command '/usr/bin/iscsiadm --mode node --targetname iqn.aaaa-bb.com.redacted.ssd-vm-stor --login' failed: exit code 15 Jul 06 08:30:55 proxmox5 pvestatd[490256]: command '/usr/bin/iscsiadm --mode node --targetname iqn.xxxx-yy.com.redacted.vm-stor --login' failed: exit code 15 root@proxmox1:~# pdsh -g pve pveversion 2>/dev/null | dshbak -c ---------------- proxmox[1-2,4-5] ---------------- pve-manager/8.4.1/2a5fa54a8503f96d (running kernel: 6.8.12-11-pve) root@proxmox1:~# pdsh -g pve 'pvesm status | grep vm-stor' 2>/dev/null | dshbak -c ---------------- proxmox[1-2,4-5] ---------------- lvm-nas-ssd-vm-stor lvm active 6442442752 723525632 5718917120 11.23% lvm-nas-vm-stor lvm active 2684346368 1006669824 1677676544 37.50% nas-ssd-vm-stor iscsi active 0 0 0 0.00% nas-vm-stor iscsi active 0 0 0 0.00% root@proxmox1:~# pdsh -g pve 'ls -l /usr/share/perl5/PVE/Storage/ISCSIPlugin.pm' 2>/dev/null | dshbak -c ---------------- proxmox[1-2,4] ---------------- -rw-r--r-- 1 root root 16849 Apr 7 15:18 /usr/share/perl5/PVE/Storage/ISCSIPlugin.pm ---------------- proxmox5 ---------------- -rw-r--r-- 1 root root 19767 Jul 6 08:33 /usr/share/perl5/PVE/Storage/ISCSIPlugin.pm Regards, Stelios Vailakakis ________________________________ From: Friedrich Weber Sent: Monday, June 23, 2025 3:24 AM To: Proxmox VE development discussion ; Stelios Vailakakis Subject: Re: [pve-devel] [PATCH] iscsi: fix excessive connection test spam on storage monitoring Hi, Thanks for getting involved! On 20/06/2025 02:44, Stelios Vailakakis wrote: > Hi all, > > This patch addresses excessive "connection lost" and "connection reset" log > spam on iSCSI targets caused by Proxmox storage monitoring performing TCP > connection tests every 10 seconds, even when iSCSI sessions are active. > > The issue appears as continuous log entries on iSCSI targets: > "ctld[PID]: 192.168.1.XX: read: connection lost" every 10 seconds on each node. > > Others have experienced this, as seen in forum posts: > iSCSI Reconnecting every 10 seconds to FreeNAS solution | Proxmox Support Forum > freenas ctld: read: connection lost | TrueNAS Community This sounds like #957 [1]. A patch [2] with similar objective was merged [3] and included in Proxmox VE 8.4. Can you check whether your patch is still needed on Proxmox VE 8.4? > Changes: > - Support hostnames in portal addresses (not just IP addresses) by updating > ISCSI_TARGET_RE and session parsing regex This seems like an unrelated change that should be in its own patch, could you please re-send it separately? If you do, please review our developer docs [4], especially with regards to the CLA requirement and instructions how to use git format-patch/send-mail to submit patches (AFAICT it wasn't used here). > - Skip TCP connection tests in check_connection when active sessions exist > - Skip storage activation when sessions are already established > > This reduces iSCSI target log spam from continuous entries to only > legitimate connection issues, while maintaining monitoring functionality. Best wishes, Friedrich [1] https://bugzilla.proxmox.com/show_bug.cgi?id=957 [2] https://lore.proxmox.com/pve-devel/mailman.14.1742481496.359.pve-devel@lists.proxmox.com/ [3] https://git.proxmox.com/?p=pve-storage.git;a=commit;h=32e482a6170b3a882dc332263281b7f449066a8d [4] https://pve.proxmox.com/wiki/Developer_Documentation#Preparing_Patches > > Tested with: > - IPv4 and IPv6 portals > - Hostname based portals (like nas.example.com) > - Multiple Proxmox nodes in cluster 8.2.4 + 8.3.0 (Requires latest ISCSIPlugin.pm. taken from raw.githubusercontent.com/proxmox/pve-storage/823707a7ac99eafe345d9131d10837ebefbb9078/src/PVE/Storage/ISCSIPlugin.pm) > - TrueNAS and Linux iSCSI targets > - Can apply from /usr/share/perl5/PVE/Storage# patch -p0 < /path/to/iscsifix.patch > > --- > PVE/Storage/ISCSIPlugin.pm | 13 +++++++++++-- > 1 file changed, 11 insertions(+), 2 deletions(-) > > --- ISCSIPlugin.pm.new-upstream 2025-06-19 16:24:09.220675514 -0500 > +++ ISCSIPlugin.pm 2025-06-19 16:24:42.265694074 -0500 > @@ -33,7 +33,7 @@ > } > > # Example: 192.168.122.252:3260,1 iqn.2003-01.org.linux-iscsi.proxmox-nfs.x8664:sn.00567885ba8f > -my $ISCSI_TARGET_RE = qr/^((?:$IPV4RE|\[$IPV6RE\]):\d+)\,\S+\s+(\S+)\s*$/; > +my $ISCSI_TARGET_RE = qr/^(\S+:\d+)\,\S+\s+(\S+)\s*$/; > > sub iscsi_session_list { > assert_iscsi_support(); > @@ -49,7 +49,7 @@ > my $line = shift; > # example: tcp: [1] 192.168.122.252:3260,1 iqn.2003-01.org.linux-iscsi.proxmox-nfs.x8664:sn.00567885ba8f (non-flash) > if ($line =~ > - m/^tcp:\s+\[(\S+)\]\s+((?:$IPV4RE|\[$IPV6RE\]):\d+)\,\S+\s+(\S+)\s+\S+?\s*$/ > + m/^tcp:\s+\[(\S+)\]\s+(\S+:\d+)\,\S+\s+(\S+)\s+\S+?\s*$/ > ) { > my ($session_id, $portal, $target) = ($1, $2, $3); > # there can be several sessions per target (multipath) > @@ -480,6 +480,10 @@ > sub activate_storage { > my ($class, $storeid, $scfg, $cache) = @_; > > + # Skip if session already exists > + my $existing_sessions = iscsi_session($cache, $scfg->{target}); > + return 1 if defined($existing_sessions) && scalar(@$existing_sessions) > 0; > + > return if !assert_iscsi_support(1); > > my $sessions = iscsi_session($cache, $scfg->{target}); > @@ -618,6 +622,11 @@ > sub check_connection { > my ($class, $storeid, $scfg) = @_; > my $cache = {}; > + # Check for active session first > + my $sessions = iscsi_session_list(); > + return 1 if defined($sessions->{$scfg->{target}}); > + > + # Only check portals if no active session > my $portals = iscsi_portals($scfg->{target}, $scfg->{portal}); > > for my $portal (@$portals) { > > --- > > > Regards, > Stelios Vailakakis > _______________________________________________ > pve-devel mailing list > pve-devel@lists.proxmox.com > https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-devel > > _______________________________________________ pve-devel mailing list pve-devel@lists.proxmox.com https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-devel