[PVE-User] CEPH migration from cephadm or keep cephadm?

[PVE-User] CEPH migration from cephadm or keep cephadm?

[Peter Eisch via pve-user]

[-- Attachment #1: Type: message/rfc822, Size: 3812 bytes --]

From: "Peter Eisch" <peter@boku.net>
To: pve-user@lists.proxmox.com
Subject: CEPH migration from cephadm or keep cephadm?
Date: Sun, 30 Jun 2024 15:08:31 +0000
Message-ID: <a43ba0d16c4b56acb1017d06304ad428@mail.boku.net>

Hi,
I have a CEPH cluster where I’ve been doing hyperconverged with Linux KVM.  I have had no problem migrating the VMs to PVE running on compute-only nodes.  No instances remain on the storage nodes.
Back to converged with:

- CEPH 18.2.2

  - cephadm orchestration

- 6 hosts with 16 OSDs each

  - 4 hosts rocky linux

  - 1 host PVE 8.2.2, deployed OSDs with cephadm

  - 1 host out of the cluster, pending options

- 4 hosts running PVE/RBD
Is there a way to convert a cephadm CEPH cluster to PVE’s CEPH?  Is it better to keep cephadm?
Thank you for your thoughts,
peter

[-- Attachment #2: Type: text/plain, Size: 157 bytes --]

_______________________________________________
pve-user mailing list
pve-user@lists.proxmox.com
https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-user

Re: [PVE-User] CEPH migration from cephadm or keep cephadm?

[Gilberto Ferreira]

Hi there
If it's works, keep it just like that.





Em dom., 30 de jun. de 2024 às 12:08, Peter Eisch via pve-user <
pve-user@lists.proxmox.com> escreveu:

>
>
>
> ---------- Forwarded message ----------
> From: Peter Eisch <peter@boku.net>
> To: pve-user@lists.proxmox.com
> Cc:
> Bcc:
> Date: Sun, 30 Jun 2024 15:08:31 +0000
> Subject: CEPH migration from cephadm or keep cephadm?
> Hi,
> I have a CEPH cluster where I’ve been doing hyperconverged with Linux
> KVM.  I have had no problem migrating the VMs to PVE running on
> compute-only nodes.  No instances remain on the storage nodes.
> Back to converged with:
>
> - CEPH 18.2.2
>
>   - cephadm orchestration
>
> - 6 hosts with 16 OSDs each
>
>   - 4 hosts rocky linux
>
>   - 1 host PVE 8.2.2, deployed OSDs with cephadm
>
>   - 1 host out of the cluster, pending options
>
> - 4 hosts running PVE/RBD
> Is there a way to convert a cephadm CEPH cluster to PVE’s CEPH?  Is it
> better to keep cephadm?
> Thank you for your thoughts,
> peter
>
>
>
> ---------- Forwarded message ----------
> From: Peter Eisch via pve-user <pve-user@lists.proxmox.com>
> To: pve-user@lists.proxmox.com
> Cc: Peter Eisch <peter@boku.net>
> Bcc:
> Date: Sun, 30 Jun 2024 15:08:31 +0000
> Subject: [PVE-User] CEPH migration from cephadm or keep cephadm?
> _______________________________________________
> pve-user mailing list
> pve-user@lists.proxmox.com
> https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-user
>
_______________________________________________
pve-user mailing list
pve-user@lists.proxmox.com
https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-user

Re: [PVE-User] CEPH migration from cephadm or keep cephadm?

[Peter Eisch via pve-user]

[-- Attachment #1: Type: message/rfc822, Size: 5886 bytes --]

From: "Peter Eisch" <peter@boku.net>
To: "Proxmox VE user list" <pve-user@lists.proxmox.com>
Subject: Re[2]: [PVE-User] CEPH migration from cephadm or keep cephadm?
Date: Sun, 30 Jun 2024 18:44:03 +0000
Message-ID: <b2162682b42137edb315f307645a10f4@mail.boku.net>

It largely works.  At some point this issue crept in:
root@node3:/# ceph-volume inventory
  stderr: Unknown device "/dev/pve/data_tmeta": No such device
  stderr: Unknown device "/dev/pve/data_tdata": No such device
  stderr: Unknown device "/dev/pve-data/tpool": No such device
  stderr: Unknown device "/dev/pve/data": No such device
 -->  KeyError: 'TYPE'
 root@node3:/# 
which seems to be tied to lvmthin.  This thread https://www.spinics.net/lists/ceph-users/msg79647.html (https://www.spinics.net/lists/ceph-users/msg79647.html) had solution to this but not a PVE issue.
Thanks for the confirmation.

On Sun, Jun 30, 2024 at 10:41 AM, Gilberto Ferreira  wrote: 
Hi there
If it's works, keep it just like that.
Em dom., 30 de jun. de 2024 às 12:08, Peter Eisch via pve-user  escreveu:
---------- Forwarded message ----------
From: Peter Eisch 
To: pve-user@lists.proxmox.com (mailto:pve-user@lists.proxmox.com)
Cc: 
Bcc: 
Date: Sun, 30 Jun 2024 15:08:31 +0000
Subject: CEPH migration from cephadm or keep cephadm?
Hi,
 I have a CEPH cluster where I’ve been doing hyperconverged with Linux KVM.  I have had no problem migrating the VMs to PVE running on compute-only nodes.  No instances remain on the storage nodes.
 Back to converged with:

 - CEPH 18.2.2

   - cephadm orchestration

 - 6 hosts with 16 OSDs each

   - 4 hosts rocky linux

   - 1 host PVE 8.2.2, deployed OSDs with cephadm

   - 1 host out of the cluster, pending options

 - 4 hosts running PVE/RBD
 Is there a way to convert a cephadm CEPH cluster to PVE’s CEPH?  Is it better to keep cephadm?
 Thank you for your thoughts,
 peter
---------- Forwarded message ----------
From: Peter Eisch via pve-user 
To: pve-user@lists.proxmox.com (mailto:pve-user@lists.proxmox.com)
Cc: Peter Eisch 
Bcc: 
Date: Sun, 30 Jun 2024 15:08:31 +0000
Subject: [PVE-User] CEPH migration from cephadm or keep cephadm?
_______________________________________________
 pve-user mailing list
pve-user@lists.proxmox.com (mailto:pve-user@lists.proxmox.com)
https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-user (https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-user)

[-- Attachment #2: Type: text/plain, Size: 157 bytes --]

_______________________________________________
pve-user mailing list
pve-user@lists.proxmox.com
https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-user

Re: [PVE-User] CEPH migration from cephadm or keep cephadm?

[Alwin Antreich via pve-user]

[-- Attachment #1: Type: message/rfc822, Size: 3885 bytes --]

From: Alwin Antreich <alwin@antreich.com>
To: Proxmox VE user list <pve-user@lists.proxmox.com>
Subject: Re: [PVE-User] CEPH migration from cephadm or keep cephadm?
Date: Mon, 01 Jul 2024 20:53:48 +0200
Message-ID: <B0632604-F3F7-4926-8127-D0EDDF091B94@antreich.com>

On June 30, 2024 5:08:31 PM GMT+02:00, Peter Eisch via pve-user <pve-user@lists.proxmox.com> wrote:
>_______________________________________________
>pve-user mailing list
>pve-user@lists.proxmox.com
>https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-user

Hi Peter,

it depends on what you would like to achieve. If all nodes will become PVEs then it is easier to use the management and upgrade process of Proxmox.

As long as you stick to the same Ceph version then you should be able to migrate. OSDs may just start up, MONs are best re-created (easier). As well as the other services, like MGR/MDS.

Reinstallation of the whole node is of course the other path. 

Cheers,
Alwin


[-- Attachment #2: Type: text/plain, Size: 157 bytes --]

_______________________________________________
pve-user mailing list
pve-user@lists.proxmox.com
https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-user