* [PVE-User] SDN issues in 6.4
@ 2021-04-28 12:10 Daniel Berteaud
2021-04-28 12:14 ` Daniel Berteaud
2021-04-28 12:39 ` Daniel Berteaud
0 siblings, 2 replies; 6+ messages in thread
From: Daniel Berteaud @ 2021-04-28 12:10 UTC (permalink / raw)
To: Proxmox VE user list
Hi.
Just upgraded a small 3 nodes cluster to 6.4 today. This cluster used the SDN feature with a single VLAN zone, and a few vnets (each one of the vnets using a VLAN tag, and not VLAN-aware themself).
I see several issues regarding SDN since the upgrade :
* The biggest issue is that in Datacenter -> SDN I only see a single node (with the status "available"). The other two do not appear anymore. Without paying attention, I clicked on the "Apply" button. This wiped the /etc/network/interfaces.d/sdn file on the 2 nodes which do not appear anymore, and reloaded their network stack. Needless to say it was a complete failure as all the VM attached to one of those vnets lost network connectivity. I've manually copied this /etc/network/interfaces.d/sdn file from the only working node to the other two for now, but I can't make any change from the GUI now or it'll do the same again
* In Datacenter -> SDN -> Zones, my single zone didn't appear anymore. No Zone were displayed at all. But the Vnets correctly showed they were attached to my zone. /etc/pve/sdn/zones.cfg correctly had my zone defined here. I tried adding it again from the GUI, which seemed to work. The only change it made to /etc/pve/sdn/zones.cfg is the new "ipam: pve" option added to the existing zone
Anyone know what could be wrong ? Why would 2 (out of 3) nodes not showing up in the SDN status anymore ?
The 3 nodes are fully up to date using the no-subscription repo, here's the complete pveversion :
pve-manager/6.4-4/337d6701 (running kernel: 5.4.106-1-pve)
root@pvo5:~# pveversion -v
proxmox-ve: 6.4-1 (running kernel: 5.4.106-1-pve)
pve-manager: 6.4-4 (running version: 6.4-4/337d6701)
pve-kernel-5.4: 6.4-1
pve-kernel-helper: 6.4-1
pve-kernel-5.4.106-1-pve: 5.4.106-1
pve-kernel-5.4.103-1-pve: 5.4.103-1
pve-kernel-5.4.73-1-pve: 5.4.73-1
ceph-fuse: 12.2.11+dfsg1-2.1+b1
corosync: 3.1.2-pve1
criu: 3.11-3
glusterfs-client: 5.5-3
ifupdown: residual config
ifupdown2: 3.0.0-1+pve3
ksm-control-daemon: 1.3-1
libjs-extjs: 6.0.1-10
libknet1: 1.20-pve1
libproxmox-acme-perl: 1.0.8
libproxmox-backup-qemu0: 1.0.3-1
libpve-access-control: 6.4-1
libpve-apiclient-perl: 3.1-3
libpve-common-perl: 6.4-2
libpve-guest-common-perl: 3.1-5
libpve-http-server-perl: 3.2-1
libpve-network-perl: 0.5-1
libpve-storage-perl: 6.4-1
libqb0: 1.0.5-1
libspice-server1: 0.14.2-4~pve6+1
lvm2: 2.03.02-pve4
lxc-pve: 4.0.6-2
lxcfs: 4.0.6-pve1
novnc-pve: 1.1.0-1
openvswitch-switch: 2.12.3-1
proxmox-backup-client: 1.1.5-1
proxmox-mini-journalreader: 1.1-1
proxmox-widget-toolkit: 2.5-3
pve-cluster: 6.4-1
pve-container: 3.3-5
pve-docs: 6.4-1
pve-edk2-firmware: 2.20200531-1
pve-firewall: 4.1-3
pve-firmware: 3.2-2
pve-ha-manager: 3.1-1
pve-i18n: 2.3-1
pve-qemu-kvm: 5.2.0-6
pve-xtermjs: 4.7.0-3
qemu-server: 6.4-1
smartmontools: 7.2-pve2
spiceterm: 3.1-1
vncterm: 1.6-2
zfsutils-linux: 2.0.4-pve1
root@pvo5:~#
--
[ https://www.firewall-services.com/ ]
Daniel Berteaud
FIREWALL-SERVICES SAS, La sécurité des réseaux
Société de Services en Logiciels Libres
Tél : +33.5 56 64 15 32
Matrix: @dani:fws.fr
[ https://www.firewall-services.com/ | https://www.firewall-services.com ]
^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: [PVE-User] SDN issues in 6.4
2021-04-28 12:10 [PVE-User] SDN issues in 6.4 Daniel Berteaud
@ 2021-04-28 12:14 ` Daniel Berteaud
2021-04-28 12:39 ` Daniel Berteaud
1 sibling, 0 replies; 6+ messages in thread
From: Daniel Berteaud @ 2021-04-28 12:14 UTC (permalink / raw)
To: Proxmox VE user list
----- Le 28 Avr 21, à 14:10, Daniel Berteaud <daniel@firewall-services.com> a écrit :
> Hi.
> Just upgraded a small 3 nodes cluster to 6.4 today. This cluster used the SDN
> feature with a single VLAN zone, and a few vnets (each one of the vnets using a
> VLAN tag, and not VLAN-aware themself).
> I see several issues regarding SDN since the upgrade :
> * The biggest issue is that in Datacenter -> SDN I only see a single node (with
> the status "available"). The other two do not appear anymore. Without paying
> attention, I clicked on the "Apply" button. This wiped the
> /etc/network/interfaces.d/sdn file on the 2 nodes which do not appear anymore,
> and reloaded their network stack. Needless to say it was a complete failure as
> all the VM attached to one of those vnets lost network connectivity. I've
> manually copied this /etc/network/interfaces.d/sdn file from the only working
> node to the other two for now, but I can't make any change from the GUI now or
> it'll do the same again
> * In Datacenter -> SDN -> Zones, my single zone didn't appear anymore. No Zone
> were displayed at all. But the Vnets correctly showed they were attached to my
> zone. /etc/pve/sdn/zones.cfg correctly had my zone defined here. I tried adding
> it again from the GUI, which seemed to work. The only change it made to
> /etc/pve/sdn/zones.cfg is the new "ipam: pve" option added to the existing zone
Also, I have a lot of errors like this now :
Apr 28 13:14:16 pvo6 pvestatd[2624]: sdn status update error: cannot lookup undefined type! at /usr/share/perl5/PVE/Network/SDN/Zones.pm line 260.
Apr 28 13:14:25 pvo6 pvestatd[2624]: sdn status update error: cannot lookup undefined type! at /usr/share/perl5/PVE/Network/SDN/Zones.pm line 260.
Apr 28 13:14:35 pvo6 pvestatd[2624]: sdn status update error: cannot lookup undefined type! at /usr/share/perl5/PVE/Network/SDN/Zones.pm line 260.
Apr 28 13:14:46 pvo6 pvestatd[2624]: sdn status update error: cannot lookup undefined type! at /usr/share/perl5/PVE/Network/SDN/Zones.pm line 260.
Apr 28 13:14:55 pvo6 pvestatd[2624]: sdn status update error: cannot lookup undefined type! at /usr/share/perl5/PVE/Network/SDN/Zones.pm line 260.
On all the 3 nodes (even the one which still appears in the SDN Status page on the GUI)
--
[ https://www.firewall-services.com/ ]
Daniel Berteaud
FIREWALL-SERVICES SAS, La sécurité des réseaux
Société de Services en Logiciels Libres
Tél : +33.5 56 64 15 32
Matrix: @dani:fws.fr
[ https://www.firewall-services.com/ | https://www.firewall-services.com ]
^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: [PVE-User] SDN issues in 6.4
2021-04-28 12:10 [PVE-User] SDN issues in 6.4 Daniel Berteaud
2021-04-28 12:14 ` Daniel Berteaud
@ 2021-04-28 12:39 ` Daniel Berteaud
2021-04-28 12:50 ` Gilberto Ferreira
1 sibling, 1 reply; 6+ messages in thread
From: Daniel Berteaud @ 2021-04-28 12:39 UTC (permalink / raw)
To: Proxmox VE user list
----- Le 28 Avr 21, à 14:10, Daniel Berteaud daniel@firewall-services.com a écrit :
> Hi.
>
> Just upgraded a small 3 nodes cluster to 6.4 today. This cluster used the SDN
> feature with a single VLAN zone, and a few vnets (each one of the vnets using a
> VLAN tag, and not VLAN-aware themself).
> I see several issues regarding SDN since the upgrade :
>
>
>
> * The biggest issue is that in Datacenter -> SDN I only see a single node (with
> the status "available"). The other two do not appear anymore. Without paying
> attention, I clicked on the "Apply" button. This wiped the
> /etc/network/interfaces.d/sdn file on the 2 nodes which do not appear anymore,
> and reloaded their network stack. Needless to say it was a complete failure as
> all the VM attached to one of those vnets lost network connectivity. I've
> manually copied this /etc/network/interfaces.d/sdn file from the only working
> node to the other two for now, but I can't make any change from the GUI now or
> it'll do the same again
> * In Datacenter -> SDN -> Zones, my single zone didn't appear anymore. No Zone
> were displayed at all. But the Vnets correctly showed they were attached to my
> zone. /etc/pve/sdn/zones.cfg correctly had my zone defined here. I tried adding
> it again from the GUI, which seemed to work. The only change it made to
> /etc/pve/sdn/zones.cfg is the new "ipam: pve" option added to the existing zone
>
>
I just opened https://bugzilla.proxmox.com/show_bug.cgi?id=3403
I checked another single node (no cluster) PVE install, which have the exact same issue, so it's not something specific on my setup, but a more general (and critical) bug
Cheers,
Daniel
--
[ https://www.firewall-services.com/ ]
Daniel Berteaud
FIREWALL-SERVICES SAS, La sécurité des réseaux
Société de Services en Logiciels Libres
Tél : +33.5 56 64 15 32
Matrix: @dani:fws.fr
[ https://www.firewall-services.com/ | https://www.firewall-services.com ]
^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: [PVE-User] SDN issues in 6.4
2021-04-28 12:39 ` Daniel Berteaud
@ 2021-04-28 12:50 ` Gilberto Ferreira
2021-04-28 12:57 ` Daniel Berteaud
0 siblings, 1 reply; 6+ messages in thread
From: Gilberto Ferreira @ 2021-04-28 12:50 UTC (permalink / raw)
To: Proxmox VE user list
Just curious: did you restart the upgraded nodes?
---
Gilberto Nunes Ferreira
(47) 99676-7530 - Whatsapp / Telegram
Em qua., 28 de abr. de 2021 às 09:39, Daniel Berteaud
<daniel@firewall-services.com> escreveu:
>
> ----- Le 28 Avr 21, à 14:10, Daniel Berteaud daniel@firewall-services.com a écrit :
>
> > Hi.
> >
> > Just upgraded a small 3 nodes cluster to 6.4 today. This cluster used the SDN
> > feature with a single VLAN zone, and a few vnets (each one of the vnets using a
> > VLAN tag, and not VLAN-aware themself).
> > I see several issues regarding SDN since the upgrade :
> >
> >
> >
> > * The biggest issue is that in Datacenter -> SDN I only see a single node (with
> > the status "available"). The other two do not appear anymore. Without paying
> > attention, I clicked on the "Apply" button. This wiped the
> > /etc/network/interfaces.d/sdn file on the 2 nodes which do not appear anymore,
> > and reloaded their network stack. Needless to say it was a complete failure as
> > all the VM attached to one of those vnets lost network connectivity. I've
> > manually copied this /etc/network/interfaces.d/sdn file from the only working
> > node to the other two for now, but I can't make any change from the GUI now or
> > it'll do the same again
> > * In Datacenter -> SDN -> Zones, my single zone didn't appear anymore. No Zone
> > were displayed at all. But the Vnets correctly showed they were attached to my
> > zone. /etc/pve/sdn/zones.cfg correctly had my zone defined here. I tried adding
> > it again from the GUI, which seemed to work. The only change it made to
> > /etc/pve/sdn/zones.cfg is the new "ipam: pve" option added to the existing zone
> >
> >
>
> I just opened https://bugzilla.proxmox.com/show_bug.cgi?id=3403
> I checked another single node (no cluster) PVE install, which have the exact same issue, so it's not something specific on my setup, but a more general (and critical) bug
>
> Cheers,
> Daniel
>
>
> --
> [ https://www.firewall-services.com/ ]
> Daniel Berteaud
> FIREWALL-SERVICES SAS, La sécurité des réseaux
> Société de Services en Logiciels Libres
> Tél : +33.5 56 64 15 32
> Matrix: @dani:fws.fr
> [ https://www.firewall-services.com/ | https://www.firewall-services.com ]
>
>
> _______________________________________________
> pve-user mailing list
> pve-user@lists.proxmox.com
> https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-user
^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: [PVE-User] SDN issues in 6.4
2021-04-28 12:50 ` Gilberto Ferreira
@ 2021-04-28 12:57 ` Daniel Berteaud
2021-04-28 13:04 ` Gilberto Ferreira
0 siblings, 1 reply; 6+ messages in thread
From: Daniel Berteaud @ 2021-04-28 12:57 UTC (permalink / raw)
To: Proxmox VE user list
----- Le 28 Avr 21, à 14:50, Gilberto Ferreira gilberto.nunes32@gmail.com a écrit :
> Just curious: did you restart the upgraded nodes?
Yes, of course ;-)
--
[ https://www.firewall-services.com/ ]
Daniel Berteaud
FIREWALL-SERVICES SAS, La sécurité des réseaux
Société de Services en Logiciels Libres
Tél : +33.5 56 64 15 32
Matrix: @dani:fws.fr
[ https://www.firewall-services.com/ | https://www.firewall-services.com ]
^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: [PVE-User] SDN issues in 6.4
2021-04-28 12:57 ` Daniel Berteaud
@ 2021-04-28 13:04 ` Gilberto Ferreira
0 siblings, 0 replies; 6+ messages in thread
From: Gilberto Ferreira @ 2021-04-28 13:04 UTC (permalink / raw)
To: Proxmox VE user list
Ok! Just checking. 😂
---
Gilberto Nunes Ferreira
(47) 99676-7530 - Whatsapp / Telegram
---
Gilberto Nunes Ferreira
(47) 99676-7530 - Whatsapp / Telegram
Em qua., 28 de abr. de 2021 às 09:58, Daniel Berteaud <
daniel@firewall-services.com> escreveu:
> ----- Le 28 Avr 21, à 14:50, Gilberto Ferreira gilberto.nunes32@gmail.com
> a écrit :
>
> > Just curious: did you restart the upgraded nodes?
>
> Yes, of course ;-)
>
> --
> [ https://www.firewall-services.com/ ]
> Daniel Berteaud
> FIREWALL-SERVICES SAS, La sécurité des réseaux
> Société de Services en Logiciels Libres
> Tél : +33.5 56 64 15 32
> Matrix: @dani:fws.fr
> [ https://www.firewall-services.com/ | https://www.firewall-services.com ]
>
>
> _______________________________________________
> pve-user mailing list
> pve-user@lists.proxmox.com
> https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-user
>
^ permalink raw reply [flat|nested] 6+ messages in thread
end of thread, other threads:[~2021-04-28 13:05 UTC | newest]
Thread overview: 6+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2021-04-28 12:10 [PVE-User] SDN issues in 6.4 Daniel Berteaud
2021-04-28 12:14 ` Daniel Berteaud
2021-04-28 12:39 ` Daniel Berteaud
2021-04-28 12:50 ` Gilberto Ferreira
2021-04-28 12:57 ` Daniel Berteaud
2021-04-28 13:04 ` Gilberto Ferreira
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.
Service provided by Proxmox Server Solutions GmbH | Privacy | Legal