From mboxrd@z Thu Jan  1 00:00:00 1970
Return-Path: <piviul@riminilug.it>
Received: from firstgate.proxmox.com (firstgate.proxmox.com [212.224.123.68])
 (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
 key-exchange X25519 server-signature RSA-PSS (2048 bits))
 (No client certificate requested)
 by lists.proxmox.com (Postfix) with ESMTPS id 97FF072D4A
 for <pve-user@lists.proxmox.com>; Wed, 14 Apr 2021 09:45:37 +0200 (CEST)
Received: from firstgate.proxmox.com (localhost [127.0.0.1])
 by firstgate.proxmox.com (Proxmox) with ESMTP id 8736FB16F
 for <pve-user@lists.proxmox.com>; Wed, 14 Apr 2021 09:45:37 +0200 (CEST)
Received: from 2.mo68.mail-out.ovh.net (2.mo68.mail-out.ovh.net
 [46.105.52.162])
 (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits))
 (No client certificate requested)
 by firstgate.proxmox.com (Proxmox) with ESMTPS id E0CC5B149
 for <pve-user@lists.proxmox.com>; Wed, 14 Apr 2021 09:45:35 +0200 (CEST)
Received: from player761.ha.ovh.net (unknown [10.109.156.73])
 by mo68.mail-out.ovh.net (Postfix) with ESMTP id 7675F195D2E
 for <pve-user@lists.proxmox.com>; Wed, 14 Apr 2021 09:37:47 +0200 (CEST)
Received: from riminilug.it (host-79-7-69-158.business.telecomitalia.it
 [79.7.69.158]) (Authenticated sender: piviul@riminilug.it)
 by player761.ha.ovh.net (Postfix) with ESMTPSA id A9AEF1D1580F9
 for <pve-user@lists.proxmox.com>; Wed, 14 Apr 2021 07:37:46 +0000 (UTC)
Authentication-Results: garm.ovh; auth=pass
 (GARM-99G003353f064a-fb00-42f3-8036-3b9939ae2a9e,
 57A833B494C22FF767B1D2CBAF8D09E1359A807A) smtp.auth=piviul@riminilug.it
X-OVh-ClientIp: 79.7.69.158
To: pve-user@lists.proxmox.com
References: <d9bce6e0-d6ba-7492-d335-30a49950e06a@riminilug.it>
 <b8bd884e-b3f3-f08f-cbaa-5a1b043d13b2@c2n.upsaclay.fr>
From: Piviul <piviul@riminilug.it>
Message-ID: <5c3d06aa-1bf8-ca1b-e826-3d2615685b9d@riminilug.it>
Date: Wed, 14 Apr 2021 09:37:45 +0200
User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:78.0) Gecko/20100101
 Thunderbird/78.9.0
MIME-Version: 1.0
In-Reply-To: <b8bd884e-b3f3-f08f-cbaa-5a1b043d13b2@c2n.upsaclay.fr>
Content-Type: multipart/mixed; boundary="------------82CC6D84B60DEBF4A3399BD9"
Content-Language: en-US
X-Ovh-Tracer-Id: 11225785023011410974
X-VR-SPAMSTATE: OK
X-VR-SPAMSCORE: 0
X-VR-SPAMCAUSE: gggruggvucftvghtrhhoucdtuddrgeduledrudeltddguddvvdcutefuodetggdotefrodftvfcurfhrohhfihhlvgemucfqggfjpdevjffgvefmvefgnecuuegrihhlohhuthemucehtddtnecunecujfgurhepuffvfhfhkffffgggjggtsehmtderredtfeelnecuhfhrohhmpefrihhvihhulhcuoehpihhvihhulhesrhhimhhinhhilhhughdrihhtqeenucggtffrrghtthgvrhhnpefgheeiieejffeifedtgfetteekteehieeigfffteejleetvdeivedtteeggeekkeenucfkpheptddrtddrtddrtddpjeelrdejrdeiledrudehkeenucevlhhushhtvghrufhiiigvpedtnecurfgrrhgrmhepmhhouggvpehsmhhtphdqohhuthdphhgvlhhopehplhgrhigvrhejiedurdhhrgdrohhvhhdrnhgvthdpihhnvghtpedtrddtrddtrddtpdhmrghilhhfrhhomhepphhivhhiuhhlsehrihhmihhnihhluhhgrdhithdprhgtphhtthhopehpvhgvqdhushgvrheslhhishhtshdrphhrohigmhhogidrtghomh
X-SPAM-LEVEL: Spam detection results:  0
 AWL 0.325 Adjusted score from AWL reputation of From: address
 KAM_DMARC_STATUS 0.01 Test Rule for DKIM or SPF Failure with Strict Alignment
 NICE_REPLY_A           -0.001 Looks like a legit reply (A)
 RCVD_IN_DNSWL_NONE     -0.0001 Sender listed at https://www.dnswl.org/,
 no trust RCVD_IN_MSPIKE_H3       0.001 Good reputation (+3)
 RCVD_IN_MSPIKE_WL       0.001 Mailspike good senders
 SPF_HELO_NONE           0.001 SPF: HELO does not publish an SPF Record
 SPF_PASS               -0.001 SPF: sender matches SPF record
Subject: Re: [PVE-User] Edit: Boot Order mask
X-BeenThere: pve-user@lists.proxmox.com
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Proxmox VE user list <pve-user.lists.proxmox.com>
List-Unsubscribe: <https://lists.proxmox.com/cgi-bin/mailman/options/pve-user>, 
 <mailto:pve-user-request@lists.proxmox.com?subject=unsubscribe>
List-Archive: <http://lists.proxmox.com/pipermail/pve-user/>
List-Post: <mailto:pve-user@lists.proxmox.com>
List-Help: <mailto:pve-user-request@lists.proxmox.com?subject=help>
List-Subscribe: <https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-user>, 
 <mailto:pve-user-request@lists.proxmox.com?subject=subscribe>
X-List-Received-Date: Wed, 14 Apr 2021 07:45:37 -0000

This is a multi-part message in MIME format.
--------------82CC6D84B60DEBF4A3399BD9
Content-Type: text/plain; charset=iso-8859-15; format=flowed
Content-Transfer-Encoding: 8bit

Il 13/04/21 10:57, Alain P�an ha scritto:
> Hi Piviul,
>
> My guess would be that your nodes would have different versions of 
> Proxmox packages. And not the same proxmox interface on each...
>
> The best thing would be to have the complete version of each package 
> wich 'pveversion -v', but a shorter first information is to display, 
> and copy paste just version here ?
> # pveversion
>
> Thanks

I Alain, first of all thank you very much indeed to you and to all 
people answered this thread. I reply your message but the infos here 
should answer even the infos asked from Alwin...

I send directly the output differences from the command pveversion with 
-v flag because all three nodes show the same 
"pve-manager/6.3-6/2184247e (running kernel: 5.4.106-1-pve)" version.

So I have launched the following command in all three nodes:

# pveversion -v > pveversion.$(hostname)

obtaining 3 differents files and I've done the diff between the first 
two files (referring to pve01 and pve02) and as expected there is no 
difference:

$ diff pveversion.pve0{1,2}

Then I have done the diff between the first and the third node and this 
is the result:

$ diff pveversion.pve0{1,3}
5d4
< pve-kernel-5.3: 6.1-6
8,9c7
< pve-kernel-5.3.18-3-pve: 5.3.18-3
< pve-kernel-5.3.10-1-pve: 5.3.10-1
---
 > pve-kernel-5.4.34-1-pve: 5.4.34-2

there are some little differences yes but in kernel that are not in use 
any more (in all 3 nodes uname -r shows 5.4.106-1-pve)...

Attached you can find all three files hoping the system doesn't cut them.

Please can I ask you if you have a 6.3 node in your installations that 
was previously in 6.2 version (i.e. not installed directly in 6.3 
version)? Can you tell me if the "Boot order" musk is the one with only 
combo boxes or the more evoluted drag and drop musk?

Thank you very much

Piviul



--------------82CC6D84B60DEBF4A3399BD9
Content-Type: text/plain; charset=UTF-8;
 name="pveversion.pve01"
Content-Transfer-Encoding: 7bit
Content-Disposition: attachment;
 filename="pveversion.pve01"

proxmox-ve: 6.3-1 (running kernel: 5.4.106-1-pve)
pve-manager: 6.3-6 (running version: 6.3-6/2184247e)
pve-kernel-5.4: 6.3-8
pve-kernel-helper: 6.3-8
pve-kernel-5.3: 6.1-6
pve-kernel-5.4.106-1-pve: 5.4.106-1
pve-kernel-5.4.103-1-pve: 5.4.103-1
pve-kernel-5.3.18-3-pve: 5.3.18-3
pve-kernel-5.3.10-1-pve: 5.3.10-1
ceph: 14.2.19-pve1
ceph-fuse: 14.2.19-pve1
corosync: 3.1.0-pve1
criu: 3.11-3
glusterfs-client: 5.5-3
ifupdown: residual config
ifupdown2: 3.0.0-1+pve3
ksm-control-daemon: 1.3-1
libjs-extjs: 6.0.1-10
libknet1: 1.20-pve1
libproxmox-acme-perl: 1.0.8
libproxmox-backup-qemu0: 1.0.3-1
libpve-access-control: 6.1-3
libpve-apiclient-perl: 3.1-3
libpve-common-perl: 6.3-5
libpve-guest-common-perl: 3.1-5
libpve-http-server-perl: 3.1-1
libpve-storage-perl: 6.3-8
libqb0: 1.0.5-1
libspice-server1: 0.14.2-4~pve6+1
lvm2: 2.03.02-pve4
lxc-pve: 4.0.6-2
lxcfs: 4.0.6-pve1
novnc-pve: 1.1.0-1
proxmox-backup-client: 1.0.13-1
proxmox-mini-journalreader: 1.1-1
proxmox-widget-toolkit: 2.4-9
pve-cluster: 6.2-1
pve-container: 3.3-4
pve-docs: 6.3-1
pve-edk2-firmware: 2.20200531-1
pve-firewall: 4.1-3
pve-firmware: 3.2-2
pve-ha-manager: 3.1-1
pve-i18n: 2.3-1
pve-qemu-kvm: 5.2.0-5
pve-xtermjs: 4.7.0-3
qemu-server: 6.3-10
smartmontools: 7.2-pve2
spiceterm: 3.1-1
vncterm: 1.6-2
zfsutils-linux: 2.0.4-pve1

--------------82CC6D84B60DEBF4A3399BD9
Content-Type: text/plain; charset=UTF-8;
 name="pveversion.pve02"
Content-Transfer-Encoding: 7bit
Content-Disposition: attachment;
 filename="pveversion.pve02"

proxmox-ve: 6.3-1 (running kernel: 5.4.106-1-pve)
pve-manager: 6.3-6 (running version: 6.3-6/2184247e)
pve-kernel-5.4: 6.3-8
pve-kernel-helper: 6.3-8
pve-kernel-5.3: 6.1-6
pve-kernel-5.4.106-1-pve: 5.4.106-1
pve-kernel-5.4.103-1-pve: 5.4.103-1
pve-kernel-5.3.18-3-pve: 5.3.18-3
pve-kernel-5.3.10-1-pve: 5.3.10-1
ceph: 14.2.19-pve1
ceph-fuse: 14.2.19-pve1
corosync: 3.1.0-pve1
criu: 3.11-3
glusterfs-client: 5.5-3
ifupdown: residual config
ifupdown2: 3.0.0-1+pve3
ksm-control-daemon: 1.3-1
libjs-extjs: 6.0.1-10
libknet1: 1.20-pve1
libproxmox-acme-perl: 1.0.8
libproxmox-backup-qemu0: 1.0.3-1
libpve-access-control: 6.1-3
libpve-apiclient-perl: 3.1-3
libpve-common-perl: 6.3-5
libpve-guest-common-perl: 3.1-5
libpve-http-server-perl: 3.1-1
libpve-storage-perl: 6.3-8
libqb0: 1.0.5-1
libspice-server1: 0.14.2-4~pve6+1
lvm2: 2.03.02-pve4
lxc-pve: 4.0.6-2
lxcfs: 4.0.6-pve1
novnc-pve: 1.1.0-1
proxmox-backup-client: 1.0.13-1
proxmox-mini-journalreader: 1.1-1
proxmox-widget-toolkit: 2.4-9
pve-cluster: 6.2-1
pve-container: 3.3-4
pve-docs: 6.3-1
pve-edk2-firmware: 2.20200531-1
pve-firewall: 4.1-3
pve-firmware: 3.2-2
pve-ha-manager: 3.1-1
pve-i18n: 2.3-1
pve-qemu-kvm: 5.2.0-5
pve-xtermjs: 4.7.0-3
qemu-server: 6.3-10
smartmontools: 7.2-pve2
spiceterm: 3.1-1
vncterm: 1.6-2
zfsutils-linux: 2.0.4-pve1

--------------82CC6D84B60DEBF4A3399BD9
Content-Type: text/plain; charset=UTF-8;
 name="pveversion.pve03"
Content-Transfer-Encoding: 7bit
Content-Disposition: attachment;
 filename="pveversion.pve03"

proxmox-ve: 6.3-1 (running kernel: 5.4.106-1-pve)
pve-manager: 6.3-6 (running version: 6.3-6/2184247e)
pve-kernel-5.4: 6.3-8
pve-kernel-helper: 6.3-8
pve-kernel-5.4.106-1-pve: 5.4.106-1
pve-kernel-5.4.103-1-pve: 5.4.103-1
pve-kernel-5.4.34-1-pve: 5.4.34-2
ceph: 14.2.19-pve1
ceph-fuse: 14.2.19-pve1
corosync: 3.1.0-pve1
criu: 3.11-3
glusterfs-client: 5.5-3
ifupdown: residual config
ifupdown2: 3.0.0-1+pve3
ksm-control-daemon: 1.3-1
libjs-extjs: 6.0.1-10
libknet1: 1.20-pve1
libproxmox-acme-perl: 1.0.8
libproxmox-backup-qemu0: 1.0.3-1
libpve-access-control: 6.1-3
libpve-apiclient-perl: 3.1-3
libpve-common-perl: 6.3-5
libpve-guest-common-perl: 3.1-5
libpve-http-server-perl: 3.1-1
libpve-storage-perl: 6.3-8
libqb0: 1.0.5-1
libspice-server1: 0.14.2-4~pve6+1
lvm2: 2.03.02-pve4
lxc-pve: 4.0.6-2
lxcfs: 4.0.6-pve1
novnc-pve: 1.1.0-1
proxmox-backup-client: 1.0.13-1
proxmox-mini-journalreader: 1.1-1
proxmox-widget-toolkit: 2.4-9
pve-cluster: 6.2-1
pve-container: 3.3-4
pve-docs: 6.3-1
pve-edk2-firmware: 2.20200531-1
pve-firewall: 4.1-3
pve-firmware: 3.2-2
pve-ha-manager: 3.1-1
pve-i18n: 2.3-1
pve-qemu-kvm: 5.2.0-5
pve-xtermjs: 4.7.0-3
qemu-server: 6.3-10
smartmontools: 7.2-pve2
spiceterm: 3.1-1
vncterm: 1.6-2
zfsutils-linux: 2.0.4-pve1

--------------82CC6D84B60DEBF4A3399BD9--