[PVE-User] 2 host cluster, direct link: best configuration?

[PVE-User] 2 host cluster, direct link: best configuration?

[Marco Gaiarin]

We have to setup a little 2 node cluster, with symmetrical nodes, using
replication.

For that, we have added a 10G interface, and setup a direct link between the
two server.

But how is better to setup the link? Some ideas:

1) another network, different from LAN

  pro: simple
  cons: replica happen only on cluster/corosync interface? So i have to
    setup corosync on direct link addresses?


2) ip override; eg LAN interfaces are 10.37.5.21/21 and 10.37.5.22/21;
 direct link interfaces are 10.37.5.21/32 and 10.37.5.22/32, and an
 explicitly route to  other host

 pro: if direct link go down, we can simple tear down interfaces
 cons: no auto, interfaces have to tear down manually


3) setup a bridge around LAN and direct link cable, setup STP and leave the
 switches all the work.

 This config suggested, more or less, by:
	https://pve.proxmox.com/wiki/Full_Mesh_Network_for_Ceph_Server


Thanks.

-- 
  Io chiedo quando sara` che l'uomo potra` imparare
  a vivere senza ammazzare e il vento si posera`	(F. Guccini)

Re: [PVE-User] 2 host cluster, direct link: best configuration?

[GM]

I'd personally use option 1, dedicated nic(s) or vlans for LAN and Corosync
network.Then I'd use the dedicated 10G link only for storage replication.
All 3 networks would be setup on different network subnets. Storage
replication uses "migration network" for the replication, so you could
setup that on the dedicated 10G link, so that it does not interfere with
the corosync/lan traffic. Migration network can be setup either via the
datacenter.cfg or via the web gui (Datacenter -> Options -> Migration
settings).

On Sat, 19 Feb 2022 at 16:10, Marco Gaiarin <gaio@lilliput.linux.it> wrote:

>
> We have to setup a little 2 node cluster, with symmetrical nodes, using
> replication.
>
> For that, we have added a 10G interface, and setup a direct link between
> the
> two server.
>
> But how is better to setup the link? Some ideas:
>
> 1) another network, different from LAN
>
>   pro: simple
>   cons: replica happen only on cluster/corosync interface? So i have to
>     setup corosync on direct link addresses?
>
>
> 2) ip override; eg LAN interfaces are 10.37.5.21/21 and 10.37.5.22/21;
>  direct link interfaces are 10.37.5.21/32 and 10.37.5.22/32, and an
>  explicitly route to  other host
>
>  pro: if direct link go down, we can simple tear down interfaces
>  cons: no auto, interfaces have to tear down manually
>
>
> 3) setup a bridge around LAN and direct link cable, setup STP and leave the
>  switches all the work.
>
>  This config suggested, more or less, by:
>         https://pve.proxmox.com/wiki/Full_Mesh_Network_for_Ceph_Server
>
>
> Thanks.
>
> --
>   Io chiedo quando sara` che l'uomo potra` imparare
>   a vivere senza ammazzare e il vento si posera`        (F. Guccini)
>
>
>
> _______________________________________________
> pve-user mailing list
> pve-user@lists.proxmox.com
> https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-user
>
>

Re: [PVE-User] 2 host cluster, direct link: best configuration?

[Marco Gaiarin]

Mandi! GM
  In chel di` si favelave...

> I'd personally use option 1, dedicated nic(s) or vlans for LAN and Corosync
> network.Then I'd use the dedicated 10G link only for storage replication.
> All 3 networks would be setup on different network subnets. Storage
> replication uses "migration network" for the replication, so you could
> setup that on the dedicated 10G link, so that it does not interfere with
> the corosync/lan traffic. Migration network can be setup either via the
> datacenter.cfg or via the web gui (Datacenter -> Options -> Migration
> settings).

Cool! Thanks for the hint!

-- 
  Non sara` il canto delle sirene che ci innamorera`
  noi lo conosciamo bene, l'abbiamo sentito gia`	(F. De Gregori)