Re: [PVE-User] proxmox ceph osd option to move wal to a new device

Re: [PVE-User] proxmox ceph osd option to move wal to a new device

[Marco Witte]

Appreciated. Will testdrive this.

Opinion: What we need is:
pveceph changewal OSD-ID -wal_dev /dev/sdx
if NEW-WAL-DEVICE is a plain device /dev/sdx, it should work similar to:
pveceph osd create /dev/sdf -wal_dev /dev/sdx

Any git / issue tracker where I can put such a request?



On 14.01.22 09:34, Eneko Lacunza via pve-user wrote:
> _______________________________________________
> pve-user mailing list
> pve-user@lists.proxmox.com
> https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-user

-- 
—

Marco "Max" Witte
- Senior Linux Systemadministrator -

neusta GmbH | Ein team neusta Unternehmen

Konsul-Smidt-Straße 24
28217 Bremen
Fon:  +49(0)421.20696-0
Fax:  +49(0)421.20696-99
l.seinschedt@neusta.de
www.neusta.de | www.team-neusta.de

www.facebook.com/teamneusta
www.twitter.com/teamneusta

Geschäftsführende Gesellschafter: Fabian Gutsche, Uwe Scheja, Dirk Schwampe, Lars Seinschedt
Registergericht: Amtsgericht Bremen
Handelsregister: HRB 14039

[PVE-User] proxmox ceph osd option to move wal to a new device

[Marco Witte]

One wal drive was failing. So I replaced it with:
pveceph osd destroy 17 --cleanup 1
pveceph osd destroy 18 --cleanup 1
pveceph osd destroy 19 --cleanup 1

This removed the three disks and removed the osd-wal.

The Drive sdf is the replacement for the failed wal device that above 
three osds ( sdb, sdc,sdd ) used:
pveceph osd create /dev/sdb -wal_dev /dev/sdf
pveceph osd create /dev/sdc -wal_dev /dev/sdf
pveceph osd create /dev/sdd -wal_dev /dev/sdf

This approach worked fine, but took a lot of time.

So I figured it would be better to change the wal for the existing osd:
At this state /dev/sdf is completly empty (has no lvm/wiped) and all 
three osd still use the failing wal device /dev/sdh.

ceph-volume lvm new-wal --osd-id 17 --osd-fsid 
01234567-1234-1234-123456789012 --target /dev/sdf

Which obviously fails, because the target should be --target vgname/new_wal

Question part:
What would be the fast way to make the new device /dev/sdf the wal 
device, without destroying the osds 17 18 19?

Versions:
pve-manager/7.1-8/5b267f33 (running kernel: 5.13.19-2-pve)
ceph version 16.2.7 (f9aa029788115b5df5eeee328f584156565ee5b7) pacific 
(stable)

Thank you