* [PVE-User] openvswitch + bond0 + 2 Fiber interfaces. @ 2022-01-21 11:10 Сергей Цаболов 2022-01-21 12:03 ` Dimitri Alexandris 0 siblings, 1 reply; 4+ messages in thread From: Сергей Цаболов @ 2022-01-21 11:10 UTC (permalink / raw) To: pve-user Hello, I have PVE cluster and I thinking to install on the pve-7 openvswitch for can move and add VM from other networks and Proxmox Cluster With base Linux bridge all work well without problem with 2 interface 10GB ens1f0np0 ens1f12np0 I install openvswitch with manual https://pve.proxmox.com/wiki/Open_vSwitch I want use Fiber 10GB interfaces ens1f0np0 ens1f12np0 with Bond I think. I try some settings but is not working. My setup in interfaces: auto lo iface lo inet loopback auto ens1f12np0 iface ens1f12np0 inet manual #Fiber iface idrac inet manual iface eno2 inet manual iface eno3 inet manual iface eno4 inet manual auto ens1f0np0 iface ens1f0np0 inet manual iface eno1 inet manual auto inband iface inband inet static address 10.10.29.10/24 gateway 10.10.29.250 ovs_type OVSIntPort ovs_bridge vmbr0 #Proxmox Web Access auto vlan10 iface vlan10 inet manual ovs_type OVSIntPort ovs_bridge vmbr0 ovs_options tag=10 #Network 10 auto bond0 iface bond0 inet manual ovs_bonds ens1f0np0 ens1f12np0 ovs_type OVSBond ovs_bridge vmbr0 ovs_mtu 9000 ovs_options bond_mode=active-backup auto vmbr0 iface vmbr0 inet manual ovs_type OVSBridge ovs_ports bond0 inband vlan10 ovs_mtu 9000 #inband Can some one help me if I set all correctly or not? If someone have setup openvswitch with Bond interfaces 10GB share with me configuration. Thank at lot. Sergey TS The best Regard _______________________________________________ pve-user mailing list pve-user@lists.proxmox.com https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-user ^ permalink raw reply [flat|nested] 4+ messages in thread
* Re: [PVE-User] openvswitch + bond0 + 2 Fiber interfaces. 2022-01-21 11:10 [PVE-User] openvswitch + bond0 + 2 Fiber interfaces Сергей Цаболов @ 2022-01-21 12:03 ` Dimitri Alexandris 2022-01-21 12:28 ` Сергей Цаболов 0 siblings, 1 reply; 4+ messages in thread From: Dimitri Alexandris @ 2022-01-21 12:03 UTC (permalink / raw) To: Proxmox VE user list I have Openvswitch bonds working fine for years now, but in older versions of Proxmox (6.4-4 and 5.3-5): -------------- auto eno2 iface eno2 inet manual auto eno1 iface eno1 inet manual allow-vmbr0 ath iface ath inet static address 10.NN.NN.38/26 gateway 10.NN.NN.1 ovs_type OVSIntPort ovs_bridge vmbr0 ovs_options tag=100 . . allow-vmbr0 bond0 iface bond0 inet manual ovs_bonds eno1 eno2 ovs_type OVSBond ovs_bridge vmbr0 ovs_options bond_mode=balance-slb lacp=active allow-ovs vmbr0 iface vmbr0 inet manual ovs_type OVSBridge ovs_ports bond0 ath lan dmz_vod ampr -------- I think now, "allow-vmbr0" and "allow-ovs" are replaced with "auto". This bond works fine with HP, 3COM, HUAWEI, and MIKROTIK switches. Several OVSIntPort VLANS are attached to it. I also had 10G bonds (Intel, Supermicro inter-server links), with the same result. I see the only difference with your setup is the bond_mode. Switch setup is also very important to match this. On Fri, Jan 21, 2022 at 1:23 PM Сергей Цаболов <tsabolov@t8.ru> wrote: > Hello, > > I have PVE cluster and I thinking to install on the pve-7 openvswitch > for can move and add VM from other networks and Proxmox Cluster > > With base Linux bridge all work well without problem with 2 interface > 10GB ens1f0np0 ens1f12np0 > > I install openvswitch with manual > https://pve.proxmox.com/wiki/Open_vSwitch > > I want use Fiber 10GB interfaces ens1f0np0 ens1f12np0 with Bond I think. > > I try some settings but is not working. > > My setup in interfaces: > > auto lo > iface lo inet loopback > > auto ens1f12np0 > iface ens1f12np0 inet manual > #Fiber > > iface idrac inet manual > > iface eno2 inet manual > > iface eno3 inet manual > > iface eno4 inet manual > > auto ens1f0np0 > iface ens1f0np0 inet manual > > iface eno1 inet manual > > auto inband > iface inband inet static > address 10.10.29.10/24 > gateway 10.10.29.250 > ovs_type OVSIntPort > ovs_bridge vmbr0 > #Proxmox Web Access > > auto vlan10 > iface vlan10 inet manual > ovs_type OVSIntPort > ovs_bridge vmbr0 > ovs_options tag=10 > #Network 10 > > auto bond0 > iface bond0 inet manual > ovs_bonds ens1f0np0 ens1f12np0 > ovs_type OVSBond > ovs_bridge vmbr0 > ovs_mtu 9000 > ovs_options bond_mode=active-backup > > auto vmbr0 > iface vmbr0 inet manual > ovs_type OVSBridge > ovs_ports bond0 inband vlan10 > ovs_mtu 9000 > #inband > > > Can some one help me if I set all correctly or not? > > If someone have setup openvswitch with Bond interfaces 10GB share with > me configuration. > > Thank at lot. > > > Sergey TS > The best Regard > > _______________________________________________ > pve-user mailing list > pve-user@lists.proxmox.com > https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-user > > _______________________________________________ > pve-user mailing list > pve-user@lists.proxmox.com > https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-user > ^ permalink raw reply [flat|nested] 4+ messages in thread
* Re: [PVE-User] openvswitch + bond0 + 2 Fiber interfaces. 2022-01-21 12:03 ` Dimitri Alexandris @ 2022-01-21 12:28 ` Сергей Цаболов 2022-01-27 8:53 ` Сергей Цаболов 0 siblings, 1 reply; 4+ messages in thread From: Сергей Цаболов @ 2022-01-21 12:28 UTC (permalink / raw) To: Proxmox VE user list, Dimitri Alexandris Dimitri, hello Thank you with you share My Proxmox is proxmox-ve: 6.4-1 (running kernel: 5.4.143-1-pve) I try change allow-vmbr0 with auto. I found the link https://metadata.ftp-master.debian.org/changelogs/main/o/openvswitch/testing_openvswitch-switch.README.Debian In section ex 9: Bond + Bridge + VLAN + MTU allow is used. But nothing wrong I try allow and auto, just comment one line. Dimitri, thanks again for you share. 21.01.2022 15:03, Dimitri Alexandris пишет: > I have Openvswitch bonds working fine for years now, but in older versions > of Proxmox (6.4-4 and 5.3-5): > > -------------- > auto eno2 > iface eno2 inet manual > > auto eno1 > iface eno1 inet manual > > allow-vmbr0 ath > iface ath inet static > address 10.NN.NN.38/26 > gateway 10.NN.NN.1 > ovs_type OVSIntPort > ovs_bridge vmbr0 > ovs_options tag=100 > . > . > allow-vmbr0 bond0 > iface bond0 inet manual > ovs_bonds eno1 eno2 > ovs_type OVSBond > ovs_bridge vmbr0 > ovs_options bond_mode=balance-slb lacp=active > allow-ovs vmbr0 > iface vmbr0 inet manual > ovs_type OVSBridge > ovs_ports bond0 ath lan dmz_vod ampr > -------- > > I think now, "allow-vmbr0" and "allow-ovs" are replaced with "auto". > > This bond works fine with HP, 3COM, HUAWEI, and MIKROTIK switches. > Several OVSIntPort VLANS are attached to it. > I also had 10G bonds (Intel, Supermicro inter-server links), with the same > result. > > I see the only difference with your setup is the bond_mode. Switch setup > is also very important to match this. > > > > > > On Fri, Jan 21, 2022 at 1:23 PM Сергей Цаболов<tsabolov@t8.ru> wrote: > >> Hello, >> >> I have PVE cluster and I thinking to install on the pve-7 openvswitch >> for can move and add VM from other networks and Proxmox Cluster >> >> With base Linux bridge all work well without problem with 2 interface >> 10GB ens1f0np0 ens1f12np0 >> >> I install openvswitch with manual >> https://pve.proxmox.com/wiki/Open_vSwitch >> >> I want use Fiber 10GB interfaces ens1f0np0 ens1f12np0 with Bond I think. >> >> I try some settings but is not working. >> >> My setup in interfaces: >> >> auto lo >> iface lo inet loopback >> >> auto ens1f12np0 >> iface ens1f12np0 inet manual >> #Fiber >> >> iface idrac inet manual >> >> iface eno2 inet manual >> >> iface eno3 inet manual >> >> iface eno4 inet manual >> >> auto ens1f0np0 >> iface ens1f0np0 inet manual >> >> iface eno1 inet manual >> >> auto inband >> iface inband inet static >> address 10.10.29.10/24 >> gateway 10.10.29.250 >> ovs_type OVSIntPort >> ovs_bridge vmbr0 >> #Proxmox Web Access >> >> auto vlan10 >> iface vlan10 inet manual >> ovs_type OVSIntPort >> ovs_bridge vmbr0 >> ovs_options tag=10 >> #Network 10 >> >> auto bond0 >> iface bond0 inet manual >> ovs_bonds ens1f0np0 ens1f12np0 >> ovs_type OVSBond >> ovs_bridge vmbr0 >> ovs_mtu 9000 >> ovs_options bond_mode=active-backup >> >> auto vmbr0 >> iface vmbr0 inet manual >> ovs_type OVSBridge >> ovs_ports bond0 inband vlan10 >> ovs_mtu 9000 >> #inband >> >> >> Can some one help me if I set all correctly or not? >> >> If someone have setup openvswitch with Bond interfaces 10GB share with >> me configuration. >> >> Thank at lot. >> >> >> Sergey TS >> The best Regard >> >> _______________________________________________ >> pve-user mailing list >> pve-user@lists.proxmox.com >> https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-user >> >> _______________________________________________ >> pve-user mailing list >> pve-user@lists.proxmox.com >> https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-user >> > _______________________________________________ > pve-user mailing list > pve-user@lists.proxmox.com > https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-user Sergey TS The best Regard _______________________________________________ pve-user mailing list pve-user@lists.proxmox.com https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-user ^ permalink raw reply [flat|nested] 4+ messages in thread
* Re: [PVE-User] openvswitch + bond0 + 2 Fiber interfaces. 2022-01-21 12:28 ` Сергей Цаболов @ 2022-01-27 8:53 ` Сергей Цаболов 0 siblings, 0 replies; 4+ messages in thread From: Сергей Цаболов @ 2022-01-27 8:53 UTC (permalink / raw) To: Proxmox VE user list, Dimitri Alexandris Hello, I have before 30 min this problem. I complete the interfaces edit by cli. But I have problem when I try to edit from GUI something like add comment or add new OVS Bridge or new OVS IntPort (new lan) GUI answer something like # OVS bond 'bond0' - wrong interface type on slave 'ens1f0np0' ('' != 'eth') (500) # OVS bond 'bond1' - wrong interface type on slave 'eno1' ('' != 'eth') (500) Below my Interfaces : auto lo iface lo inet loopback auto ens1f0np0 iface ens1f0np0 inet manual ovs_type OVSPort ovs_mtu 9000 #Fiber auto ens1f12np0 iface ens1f12np0 inet manual ovs_type OVSPort ovs_mtu 9000 #Fiber auto eno1 iface eno1 inet manual ovs_type OVSPort auto eno2 iface eno2 inet manual ovs_type OVSPort auto vlan10 iface vlan10 inet static address 10.10.29.10/24 gateway 10.10.29.250 ovs_type OVSIntPort ovs_bridge vmbr0 ovs_mtu 9000 ovs_options tag=10 ovs_extra set interface ${IFACE} external-ids:iface-id=$(hostname -s)-${IFACE}-vif auto vlan29 iface vlan29 inet static address 192.168.29.96/24 ovs_type OVSIntPort ovs_bridge vmbr1 ovs_mtu 1500 ovs_options tag=29 ovs_extra set interface ${IFACE} external-ids:iface-id=$(hostname -s)-${IFACE}-vif auto vlan250 iface vlan250 inet static address 192.168.250.100/24 ovs_type OVSIntPort ovs_bridge vmbr0 ovs_mtu 9000 ovs_options tag=250 ovs_extra set interface ${IFACE} external-ids:iface-id=$(hostname -s)-${IFACE}-vif auto bond0 iface bond0 inet manual ovs_type OVSBond ovs_bridge vmbr0 ovs_bonds ens1f0np0 ens1f12np0 ovs_options trunks=10,29,250 bond_mode=active-backup ovs_mtu 9000 #Fiber auto bond1 iface bond1 inet manual ovs_type OVSBond ovs_bridge vmbr1 ovs_bonds eno1 eno2 ovs_options bond_mode=active-backup ovs_mtu 1500 auto vmbr0 iface vmbr0 inet manual ovs_type OVSBridge ovs_ports bond0 vlan10 vlan250 ovs_mtu 9000 auto vmbr1 iface vmbr1 inet manual ovs_type OVSBridge ovs_ports bond1 vlan29 ovs_mtu 1500 ---------------------------------------------------------------------------- Now I found solution : In interfaces wrong is ovs_type OVSPort if we comment it out or remove the GUI worked fine. auto ens1f0np0 iface ens1f0np0 inet manual # ovs_type OVSPort # ovs_mtu 9000 #Fiber auto ens1f12np0 iface ens1f12np0 inet manual # ovs_type OVSPort # ovs_mtu 9000 #Fiber auto eno1 iface eno1 inet manual # ovs_type OVSPort auto eno2 iface eno2 inet manual # ovs_type OVSPort 21.01.2022 15:28, Сергей Цаболов пишет: > Dimitri, hello > > Thank you with you share > > My Proxmox is proxmox-ve: 6.4-1 (running kernel: 5.4.143-1-pve) > > I try change allow-vmbr0 with auto. > > I found the link > https://metadata.ftp-master.debian.org/changelogs/main/o/openvswitch/testing_openvswitch-switch.README.Debian > > > In section ex 9: Bond + Bridge + VLAN + MTU allow is used. > > But nothing wrong I try allow and auto, just comment one line. > > > Dimitri, thanks again for you share. > > > > > 21.01.2022 15:03, Dimitri Alexandris пишет: >> I have Openvswitch bonds working fine for years now, but in older >> versions >> of Proxmox (6.4-4 and 5.3-5): >> >> -------------- >> auto eno2 >> iface eno2 inet manual >> >> auto eno1 >> iface eno1 inet manual >> >> allow-vmbr0 ath >> iface ath inet static >> address 10.NN.NN.38/26 >> gateway 10.NN.NN.1 >> ovs_type OVSIntPort >> ovs_bridge vmbr0 >> ovs_options tag=100 >> . >> . >> allow-vmbr0 bond0 >> iface bond0 inet manual >> ovs_bonds eno1 eno2 >> ovs_type OVSBond >> ovs_bridge vmbr0 >> ovs_options bond_mode=balance-slb lacp=active >> allow-ovs vmbr0 >> iface vmbr0 inet manual >> ovs_type OVSBridge >> ovs_ports bond0 ath lan dmz_vod ampr >> -------- >> >> I think now, "allow-vmbr0" and "allow-ovs" are replaced with "auto". >> >> This bond works fine with HP, 3COM, HUAWEI, and MIKROTIK switches. >> Several OVSIntPort VLANS are attached to it. >> I also had 10G bonds (Intel, Supermicro inter-server links), with the >> same >> result. >> >> I see the only difference with your setup is the bond_mode. Switch setup >> is also very important to match this. >> >> >> >> >> >> On Fri, Jan 21, 2022 at 1:23 PM Сергей Цаболов<tsabolov@t8.ru> wrote: >> >>> Hello, >>> >>> I have PVE cluster and I thinking to install on the pve-7 openvswitch >>> for can move and add VM from other networks and Proxmox Cluster >>> >>> With base Linux bridge all work well without problem with 2 interface >>> 10GB ens1f0np0 ens1f12np0 >>> >>> I install openvswitch with manual >>> https://pve.proxmox.com/wiki/Open_vSwitch >>> >>> I want use Fiber 10GB interfaces ens1f0np0 ens1f12np0 with Bond I >>> think. >>> >>> I try some settings but is not working. >>> >>> My setup in interfaces: >>> >>> auto lo >>> iface lo inet loopback >>> >>> auto ens1f12np0 >>> iface ens1f12np0 inet manual >>> #Fiber >>> >>> iface idrac inet manual >>> >>> iface eno2 inet manual >>> >>> iface eno3 inet manual >>> >>> iface eno4 inet manual >>> >>> auto ens1f0np0 >>> iface ens1f0np0 inet manual >>> >>> iface eno1 inet manual >>> >>> auto inband >>> iface inband inet static >>> address 10.10.29.10/24 >>> gateway 10.10.29.250 >>> ovs_type OVSIntPort >>> ovs_bridge vmbr0 >>> #Proxmox Web Access >>> >>> auto vlan10 >>> iface vlan10 inet manual >>> ovs_type OVSIntPort >>> ovs_bridge vmbr0 >>> ovs_options tag=10 >>> #Network 10 >>> >>> auto bond0 >>> iface bond0 inet manual >>> ovs_bonds ens1f0np0 ens1f12np0 >>> ovs_type OVSBond >>> ovs_bridge vmbr0 >>> ovs_mtu 9000 >>> ovs_options bond_mode=active-backup >>> >>> auto vmbr0 >>> iface vmbr0 inet manual >>> ovs_type OVSBridge >>> ovs_ports bond0 inband vlan10 >>> ovs_mtu 9000 >>> #inband >>> >>> >>> Can some one help me if I set all correctly or not? >>> >>> If someone have setup openvswitch with Bond interfaces 10GB share with >>> me configuration. >>> >>> Thank at lot. >>> >>> >>> Sergey TS >>> The best Regard >>> >>> _______________________________________________ >>> pve-user mailing list >>> pve-user@lists.proxmox.com >>> https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-user >>> >>> _______________________________________________ >>> pve-user mailing list >>> pve-user@lists.proxmox.com >>> https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-user >>> >> _______________________________________________ >> pve-user mailing list >> pve-user@lists.proxmox.com >> https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-user > > Sergey TS > The best Regard > > _______________________________________________ > pve-user mailing list > pve-user@lists.proxmox.com > https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-user > _______________________________________________ > pve-user mailing list > pve-user@lists.proxmox.com > https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-user Sergey TS The best Regard _______________________________________________ pve-user mailing list pve-user@lists.proxmox.com https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-user ^ permalink raw reply [flat|nested] 4+ messages in thread
end of thread, other threads:[~2022-01-27 8:54 UTC | newest] Thread overview: 4+ messages (download: mbox.gz / follow: Atom feed) -- links below jump to the message on this page -- 2022-01-21 11:10 [PVE-User] openvswitch + bond0 + 2 Fiber interfaces Сергей Цаболов 2022-01-21 12:03 ` Dimitri Alexandris 2022-01-21 12:28 ` Сергей Цаболов 2022-01-27 8:53 ` Сергей Цаболов
This is a public inbox, see mirroring instructions for how to clone and mirror all data and code used for this inbox