Re: [pve-devel] Strange Behavior – ZFS (and other) Storage Configuration in PVE (plain text)

Re: [pve-devel] Strange Behavior – ZFS (and other) Storage Configuration in PVE (plain text)

[Fiona Ebner]

Hi,

Am 02.07.24 um 10:48 schrieb Rovshan Pashayev:
> Dear Proxmox Developers,
>  
> We would like to report a strange behavior that we have encountered in Proxmox, version 8.2.2. The issue is as follows:
> We noticed that ZFS storage configuration is missing mountpoint line randomly. And workaround is manually adding missing line.

does the option get lost for already existing storages or does it affect
newly added ones? How do you edit/add the ZFS storages, via GUI or CLI,
please share the exact commands in the latter case. Please also note
that the storage configuration 'mountpoint' is optional. If it is not
set, it will be assumed to be the default mount point, i.e. the 'pool'
configuration option prepended by '/'.

>  
> We also can see same behavior was reported in your forum:
> NFS: [SOLVED] - Proxmox 3.1 Lost Mount Point in Cluster | Proxmox Support Forum (https://forum.proxmox.com/threads/proxmox-3-1-lost-mount-point-in-cluster.16664/)

I don't see how this is related. There is no 'mountpoint' storage config
option for NFS storages, just a 'path'. The issue here seems to have
been wrong mount options.

> ZFS: mountpoint missing after restoring a backup | Proxmox Support Forum (https://forum.proxmox.com/threads/mountpoint-missing-after-restoring-a-backup.110012/)

The issue here is about a missing container mount point volume after
restoring a backup (which Fabian pointed out is not restored for
unprivileged users). So again, I don't see how this is related.

>  
> We kindly request clarification on whether this behavior is expected and if you are already aware of this issue.
> We are interested to know if there are plans to address and resolve this in future updates of Proxmox.
>  
> If you require any further information or clarification, please do not hesitate to ask.
> Thank you for your prompt attention to this matter. I look forward to hearing from you soon.
> 
> Best Regards,
> Rovshan Pashayev
> Analyst
> Veeam Agent for Linux, Mac, AIX & Solaris
> 

Best Regards,
Fiona


_______________________________________________
pve-devel mailing list
pve-devel@lists.proxmox.com
https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-devel

Re: [pve-devel] Strange Behavior – ZFS (and other) Storage Configuration in PVE (plain text)

[Fiona Ebner]

Hi,

Am 02.07.24 um 12:37 schrieb Rovshan Pashayev:
> Hi Fiaona and Fabian,
> 
> I am merging your questions and answering them in this one reply (I got reply from both of you at the same time :) )
> 
>> We would like to report a strange behavior that we have encountered in Proxmox, version 8.2.2. The issue is as follows:
>> We noticed that ZFS storage configuration is missing mountpoint line randomly. And workaround is manually adding missing line.
> 
> Fabina G ====
> what exactly do you mean by this? the entry in /etc/pve/storage.cfg?
> that one should only change if you call the corresponding API endpoint
> (or CLI command). please double-check the logs that no such invocation
> is happening.
> 
> if you mean something else, please clearly describe how your system is
> configured and what the unexpected thing that is happening is.
> 
> VEEAM's REPLY ====
> We have requested info about storage using the next command: # pvesh get storage/{storageName} --output json
> As we understand, this command just parse /etc/pve/storage.cfg and return results.
> So yes, field path and mountpoint are missed in the response of mentioned command and in the file.
> But all VM’s that have disks on this storage are working normally and can be re-started.
> 

There is no 'path' property for ZFS storages in Proxmox VE. There are
'pool' and optionally 'mountpoint', see [0].

> Fiona E ====
> 
> does the option get lost for already existing storages or does it affect
> newly added ones? How do you edit/add the ZFS storages, via GUI or CLI,
> please share the exact commands in the latter case. Please also note
> that the storage configuration 'mountpoint' is optional. If it is not
> set, it will be assumed to be the default mount point, i.e. the 'pool'
> configuration option prepended by '/'.
> 
> VEEAM's REPLY =====
> Could you please confirm that if ‘mountpoint’ is missing in configuration it implicitly means that mountpoint is “/{pool_name}”?
> 

Yes, see the code below (from [1]). If the 'mountpoint' option is not
set, the pool 'option' with a prepended '/' will be used as a fallback,
as that is the default mountpoint for a ZFS dataset:

sub path {
    my ($class, $scfg, $volname, $storeid, $snapname) = @_;

    my ($vtype, $name, $vmid) = $class->parse_volname($volname);

    my $path = '';
    my $mountpoint = $scfg->{mountpoint} // "/$scfg->{pool}";


[0]:
https://git.proxmox.com/?p=pve-storage.git;a=blob;f=src/PVE/Storage/ZFSPoolPlugin.pm;h=3669fe152b62df7ebeda572cdf56ef19be872d56;hb=13a81873ba22f37ecc0613de3f3ef994b064e3b9#l45
[1]:
https://git.proxmox.com/?p=pve-storage.git;a=blob;f=src/PVE/Storage/ZFSPoolPlugin.pm;h=3669fe152b62df7ebeda572cdf56ef19be872d56;hb=13a81873ba22f37ecc0613de3f3ef994b064e3b9#l141

Best Regards,
Fiona


_______________________________________________
pve-devel mailing list
pve-devel@lists.proxmox.com
https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-devel

Re: [pve-devel] Strange Behavior – ZFS (and other) Storage Configuration in PVE (plain text)

[Rovshan Pashayev via pve-devel]

[-- Attachment #1: Type: message/rfc822, Size: 14950 bytes --]

From: Rovshan Pashayev <Rovshan.Pashayev@veeam.com>
To: Fiona Ebner <f.ebner@proxmox.com>, "pve-devel@lists.proxmox.com" <pve-devel@lists.proxmox.com>, "f.gruenbichler@proxmox.com" <f.gruenbichler@proxmox.com>
Cc: Pavel Tide <Pavel.TIde@veeam.com>
Subject: Re: Strange Behavior – ZFS (and other) Storage Configuration in PVE (plain text)
Date: Tue, 2 Jul 2024 11:55:24 +0000
Message-ID: <PH0PR14MB4735BDD87E995850A472711A9FDC2@PH0PR14MB4735.namprd14.prod.outlook.com>

Hello Fiona,

Thank you for replies, they are very helpful.
I will update thread if anything needed more.

________________________________________
From: Fiona Ebner <f.ebner@proxmox.com>
Sent: Tuesday, July 2, 2024 13:13
To: Rovshan Pashayev <Rovshan.Pashayev@veeam.com>; pve-devel@lists.proxmox.com <pve-devel@lists.proxmox.com>; f.gruenbichler@proxmox.com <f.gruenbichler@proxmox.com>
Cc: Pavel Tide <Pavel.TIde@veeam.com>
Subject: Re: Strange Behavior – ZFS (and other) Storage Configuration in PVE (plain text)

Hi,

Am 02.07.24 um 12:37 schrieb Rovshan Pashayev:
> Hi Fiaona and Fabian,
>
> I am merging your questions and answering them in this one reply (I got reply from both of you at the same time :) )
>
>> We would like to report a strange behavior that we have encountered in Proxmox, version 8.2.2. The issue is as follows:
>> We noticed that ZFS storage configuration is missing mountpoint line randomly. And workaround is manually adding missing line.
>
> Fabina G ====
> what exactly do you mean by this? the entry in /etc/pve/storage.cfg?
> that one should only change if you call the corresponding API endpoint
> (or CLI command). please double-check the logs that no such invocation
> is happening.
>
> if you mean something else, please clearly describe how your system is
> configured and what the unexpected thing that is happening is.
>
> VEEAM's REPLY ====
> We have requested info about storage using the next command: # pvesh get storage/{storageName} --output json
> As we understand, this command just parse /etc/pve/storage.cfg and return results.
> So yes, field path and mountpoint are missed in the response of mentioned command and in the file.
> But all VM’s that have disks on this storage are working normally and can be re-started.
>

There is no 'path' property for ZFS storages in Proxmox VE. There are
'pool' and optionally 'mountpoint', see [0].

> Fiona E ====
>
> does the option get lost for already existing storages or does it affect
> newly added ones? How do you edit/add the ZFS storages, via GUI or CLI,
> please share the exact commands in the latter case. Please also note
> that the storage configuration 'mountpoint' is optional. If it is not
> set, it will be assumed to be the default mount point, i.e. the 'pool'
> configuration option prepended by '/'.
>
> VEEAM's REPLY =====
> Could you please confirm that if ‘mountpoint’ is missing in configuration it implicitly means that mountpoint is “/{pool_name}”?
>

Yes, see the code below (from [1]). If the 'mountpoint' option is not
set, the pool 'option' with a prepended '/' will be used as a fallback,
as that is the default mountpoint for a ZFS dataset:

sub path {
    my ($class, $scfg, $volname, $storeid, $snapname) = @_;

    my ($vtype, $name, $vmid) = $class->parse_volname($volname);

    my $path = '';
    my $mountpoint = $scfg->{mountpoint} // "/$scfg->{pool}";


[0]:
https://git.proxmox.com/?p=pve-storage.git;a=blob;f=src/PVE/Storage/ZFSPoolPlugin.pm;h=3669fe152b62df7ebeda572cdf56ef19be872d56;hb=13a81873ba22f37ecc0613de3f3ef994b064e3b9#l45
[1]:
https://git.proxmox.com/?p=pve-storage.git;a=blob;f=src/PVE/Storage/ZFSPoolPlugin.pm;h=3669fe152b62df7ebeda572cdf56ef19be872d56;hb=13a81873ba22f37ecc0613de3f3ef994b064e3b9#l141

Best Regards,
Fiona


[-- Attachment #2: Type: text/plain, Size: 160 bytes --]

_______________________________________________
pve-devel mailing list
pve-devel@lists.proxmox.com
https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-devel

Re: [pve-devel] Strange Behavior – ZFS (and other) Storage Configuration in PVE (plain text)

[Rovshan Pashayev via pve-devel]

[-- Attachment #1: Type: message/rfc822, Size: 15718 bytes --]

From: Rovshan Pashayev <Rovshan.Pashayev@veeam.com>
To: Fiona Ebner <f.ebner@proxmox.com>, "pve-devel@lists.proxmox.com" <pve-devel@lists.proxmox.com>, "f.gruenbichler@proxmox.com" <f.gruenbichler@proxmox.com>
Cc: Pavel Tide <Pavel.TIde@veeam.com>
Subject: Re: Strange Behavior – ZFS (and other) Storage Configuration in PVE (plain text)
Date: Tue, 2 Jul 2024 10:37:41 +0000
Message-ID: <PH0PR14MB4735C14F3625AED36EA9D0589FDC2@PH0PR14MB4735.namprd14.prod.outlook.com>

Hi Fiaona and Fabian,

I am merging your questions and answering them in this one reply (I got reply from both of you at the same time :) )

> We would like to report a strange behavior that we have encountered in Proxmox, version 8.2.2. The issue is as follows:
> We noticed that ZFS storage configuration is missing mountpoint line randomly. And workaround is manually adding missing line.

Fabina G ====
what exactly do you mean by this? the entry in /etc/pve/storage.cfg?
that one should only change if you call the corresponding API endpoint
(or CLI command). please double-check the logs that no such invocation
is happening.

if you mean something else, please clearly describe how your system is
configured and what the unexpected thing that is happening is.

VEEAM's REPLY ====
We have requested info about storage using the next command: # pvesh get storage/{storageName} --output json
As we understand, this command just parse /etc/pve/storage.cfg and return results.
So yes, field path and mountpoint are missed in the response of mentioned command and in the file.
But all VM’s that have disks on this storage are working normally and can be re-started.

Fiona E ====

does the option get lost for already existing storages or does it affect
newly added ones? How do you edit/add the ZFS storages, via GUI or CLI,
please share the exact commands in the latter case. Please also note
that the storage configuration 'mountpoint' is optional. If it is not
set, it will be assumed to be the default mount point, i.e. the 'pool'
configuration option prepended by '/'.

VEEAM's REPLY =====
Could you please confirm that if ‘mountpoint’ is missing in configuration it implicitly means that mountpoint is “/{pool_name}”?

Best Regards,
Rovshan Pashayev, Analyst, Veeam Agent for Linux, Mac, AIX & Solaris

________________________________________
From: Fiona Ebner <f.ebner@proxmox.com>
Sent: Tuesday, July 2, 2024 11:00
To: Rovshan Pashayev <Rovshan.Pashayev@veeam.com>; pve-devel@lists.proxmox.com <pve-devel@lists.proxmox.com>
Cc: Pavel Tide <Pavel.TIde@veeam.com>
Subject: Re: Strange Behavior – ZFS (and other) Storage Configuration in PVE (plain text)



Hi,

Am 02.07.24 um 10:48 schrieb Rovshan Pashayev:
> Dear Proxmox Developers,
>
> We would like to report a strange behavior that we have encountered in Proxmox, version 8.2.2. The issue is as follows:
> We noticed that ZFS storage configuration is missing mountpoint line randomly. And workaround is manually adding missing line.

does the option get lost for already existing storages or does it affect
newly added ones? How do you edit/add the ZFS storages, via GUI or CLI,
please share the exact commands in the latter case. Please also note
that the storage configuration 'mountpoint' is optional. If it is not
set, it will be assumed to be the default mount point, i.e. the 'pool'
configuration option prepended by '/'.

>
> We also can see same behavior was reported in your forum:
> NFS: [SOLVED] - Proxmox 3.1 Lost Mount Point in Cluster | Proxmox Support Forum (https://forum.proxmox.com/threads/proxmox-3-1-lost-mount-point-in-cluster.16664/)

I don't see how this is related. There is no 'mountpoint' storage config
option for NFS storages, just a 'path'. The issue here seems to have
been wrong mount options.

> ZFS: mountpoint missing after restoring a backup | Proxmox Support Forum (https://forum.proxmox.com/threads/mountpoint-missing-after-restoring-a-backup.110012/)

The issue here is about a missing container mount point volume after
restoring a backup (which Fabian pointed out is not restored for
unprivileged users). So again, I don't see how this is related.

>
> We kindly request clarification on whether this behavior is expected and if you are already aware of this issue.
> We are interested to know if there are plans to address and resolve this in future updates of Proxmox.
>
> If you require any further information or clarification, please do not hesitate to ask.
> Thank you for your prompt attention to this matter. I look forward to hearing from you soon.
>
> Best Regards,
> Rovshan Pashayev
> Analyst
> Veeam Agent for Linux, Mac, AIX & Solaris
>

Best Regards,
Fiona


[-- Attachment #2: Type: text/plain, Size: 160 bytes --]

_______________________________________________
pve-devel mailing list
pve-devel@lists.proxmox.com
https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-devel

[pve-devel] Strange Behavior – ZFS (and other) Storage Configuration in PVE (plain text)

[Rovshan Pashayev via pve-devel]

[-- Attachment #1: Type: message/rfc822, Size: 12436 bytes --]

From: Rovshan Pashayev <Rovshan.Pashayev@veeam.com>
To: "pve-devel@lists.proxmox.com" <pve-devel@lists.proxmox.com>
Cc: Pavel Tide <Pavel.TIde@veeam.com>
Subject: Strange Behavior – ZFS (and other) Storage Configuration in PVE (plain text)
Date: Tue, 2 Jul 2024 08:48:38 +0000
Message-ID: <PH0PR14MB473575CF68BA7648A63F70BC9FDC2@PH0PR14MB4735.namprd14.prod.outlook.com>

Dear Proxmox Developers,
 
We would like to report a strange behavior that we have encountered in Proxmox, version 8.2.2. The issue is as follows:
We noticed that ZFS storage configuration is missing mountpoint line randomly. And workaround is manually adding missing line.
 
We also can see same behavior was reported in your forum:
NFS: [SOLVED] - Proxmox 3.1 Lost Mount Point in Cluster | Proxmox Support Forum (https://forum.proxmox.com/threads/proxmox-3-1-lost-mount-point-in-cluster.16664/)
ZFS: mountpoint missing after restoring a backup | Proxmox Support Forum (https://forum.proxmox.com/threads/mountpoint-missing-after-restoring-a-backup.110012/)
 
We kindly request clarification on whether this behavior is expected and if you are already aware of this issue.
We are interested to know if there are plans to address and resolve this in future updates of Proxmox.
 
If you require any further information or clarification, please do not hesitate to ask.
Thank you for your prompt attention to this matter. I look forward to hearing from you soon.

Best Regards,
Rovshan Pashayev
Analyst
Veeam Agent for Linux, Mac, AIX & Solaris


[-- Attachment #2: Type: text/plain, Size: 160 bytes --]

_______________________________________________
pve-devel mailing list
pve-devel@lists.proxmox.com
https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-devel

Re: [pve-devel] Strange Behavior – ZFS (and other) Storage Configuration in PVE (plain text)

[Fabian Grünbichler]

On July 2, 2024 10:48 am, Rovshan Pashayev via pve-devel wrote:
> We would like to report a strange behavior that we have encountered in Proxmox, version 8.2.2. The issue is as follows:
> We noticed that ZFS storage configuration is missing mountpoint line randomly. And workaround is manually adding missing line.

what exactly do you mean by this? the entry in /etc/pve/storage.cfg?
that one should only change if you call the corresponding API endpoint
(or CLI command). please double-check the logs that no such invocation
is happening.

if you mean something else, please clearly describe how your system is
configured and what the unexpected thing that is happening is.

> We also can see same behavior was reported in your forum:
> NFS: [SOLVED] - Proxmox 3.1 Lost Mount Point in Cluster | Proxmox Support Forum (https://forum.proxmox.com/threads/proxmox-3-1-lost-mount-point-in-cluster.16664/)

this is about a mount not working because of a misconfiguration

> ZFS: mountpoint missing after restoring a backup | Proxmox Support Forum (https://forum.proxmox.com/threads/mountpoint-missing-after-restoring-a-backup.110012/)

this is about a container mountpoint that cannot be restored unless the
restoring user is root@pam.

so two very different things, and both seem to also be something
completely different from the issue you describe, but maybe I
misunderstood that part ;)


_______________________________________________
pve-devel mailing list
pve-devel@lists.proxmox.com
https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-devel