Re: [PVE-User] DeviceMapper devices get filtered by Proxmox

[Uwe Sauter <uwe.sauter.de@gmail.com>]

Good morning Alwin,

>> Well, if the documentation is to be trusted, there is multipath support since Octupus.
>> My use-case is not hyper-converged virtualization; I simply am using Proxmox due to its good UI and
>> integration of Ceph (and because it does not rely on containers to deploy Ceph).
> I understand, though cephadm isn't that horrible and there are still other ceph solutions out there. ;)

If you have air-gapped systems and no containers in your environment, using cephadm would require a
whole lot of effort just to make the containers available. On the other hand Proxmox provides this
very nice tool to mirror repositories… just saying.

>> I am aware that HDDs will need some amount of flash but I do have a couple of SAS-SSDs at hand that
>> I can put into the JBODs. And currently all this is just a proof of concept.
> Yeah but the ratio is 4 DB/WAL to 1 SSD, opposed to 12:1 for an NVMe.
> To add, you will need 512 GB RAM for OSDs (60 x 8GB) alone and at least a 32C/64T CPU. Probably some 2x 25 GbE NIC too, depending on the use-case.

For a PoC SSDs and smaller RAM size should be ok. The servers do have 40 cores and 2x 25GbE so that
isn't the problem. And once we see if Ceph fits to the rest of our environment we would invest in
properly sized hardware.

> Just saying, there are certain expectations with that many disks in one node.
>  
>> Thanks for the link though I have to support the arguments of the forum members that multipath is
>> an
>> enterprise feature that should be supported by an enterprise-class virtualization solution.
> Well, multipath is supported. Just not in combination with Ceph. And PVE is not a storage product (yet).

I need to disagree on that one. The WebUI disk overview does not show the multipath devices, only
the member disks. Yes, there is a comment stating that a device is a multipath member but no way to
select the multipath device itself. So, from a users point of view, PVE does not support multipath,
it just recognizes multipath members.
And the Create ZFS and Create LVM Volume Group setup pop-ups show neither multipath members nor
multipath devices.

Thanks

	Uwe