public inbox for pve-devel@lists.proxmox.com
 help / color / mirror / Atom feed
From: "Max R. Carrara" <m.carrara@proxmox.com>
To: "Wolfgang Bumiller" <w.bumiller@proxmox.com>
Cc: pve-devel@lists.proxmox.com
Subject: Re: [PATCH pve-storage v1 38/54] test: list volumes: document behavior wrt. undeclared content types
Date: Tue, 28 Jul 2026 15:50:58 +0200	[thread overview]
Message-ID: <DKA94H3058HT.2HCVSLGN29ZI7@proxmox.com> (raw)
In-Reply-To: <fgno5lzql7h2jrnyfcmn2usahi5e2chteiwfw543ak7mahglvq@ph2sigxrk2ty>

On Thu Jul 2, 2026 at 2:46 PM CEST, Wolfgang Bumiller wrote:
> On Wed, Apr 22, 2026 at 01:13:04PM +0200, Max R. Carrara wrote:
> > Any content types / volume types that are passed to
> > `PVE::Storage::Plugin->list_volumes()` are still taken into account by
> > the method, even if the passed storage config does not declare them in
> > its `content` key. In other words, the `content` property is ignored
> > when listing volumes through `list_volumes()`.
> >
> > Or to express this more explicitly, consider a directory storage with
> > `path` set to `/mnt/example` and `content` set to `iso,vztmpl`. Now,
> > if there are files in `/mnt/example/snippets` for some reason and the
> > `list_volumes()` method is called with `['snippets']` for the volume
> > type list parameter, then the volume info hashes for the files in
> > `/mnt/example/snippets` are included in the output.
> >
> > Document this through a test case.
>
> Did you find any rationale for this? Because I think the better solution
> here would be for list_volumes() to just either return nothing or die in
> this case (but dying could have some unwanted effects in the rest of the
> code base, so an empty list is safer).

I have not really found any use case, no. I wasn't really sure whether
changing this behaviour would cause any breakage or not, henve why I
decided to just document it.

I'm also in favour of returning an empty list in such a case though;
will check this in more detail in v2.

>
> >
> > Signed-off-by: Max R. Carrara <m.carrara@proxmox.com>
> > ---
> >  src/test/list_volumes_test.pm | 109 ++++++++++++++++++++++++++++++++++
> >  1 file changed, 109 insertions(+)
> >
> > diff --git a/src/test/list_volumes_test.pm b/src/test/list_volumes_test.pm
> > index ca3bbac7..455fb227 100644
> > --- a/src/test/list_volumes_test.pm
> > +++ b/src/test/list_volumes_test.pm
> > @@ -909,6 +909,115 @@ my $test_param_list = [
> >              },
> >          ],
> >      },
> > +    {
> > +        description =>
> > +            "VMID: none, volume info is still returned for content types that are not declared",
> > +        storeid => $DEFAULT_STOREID,
> > +        scfg => {
> > +            type => 'dir',
> > +            path => $DEFAULT_STORAGE_PATH,
> > +            shared => 0,
> > +            content => {}, # note how no content types are declared here
> > +        },
> > +        vmid => undef,
> > +        vtypes => ['images', 'rootdir', 'vztmpl', 'iso', 'backup', 'snippets', 'import'],
> > +        cases => [
> > +            {
> > +                file => "$DEFAULT_STORAGE_PATH/images/16110/vm-16110-disk-0.qcow2",
> > +                expected => {
> > +                    content => 'images',
> > +                    ctime => $DEFAULT_CTIME,
> > +                    format => 'qcow2',
> > +                    parent => undef,
> > +                    size => $DEFAULT_SIZE,
> > +                    used => $DEFAULT_USED,
> > +                    vmid => '16110',
> > +                    volid => 'local:16110/vm-16110-disk-0.qcow2',
> > +                },
> > +            },
> > +            {
> > +                file => "$DEFAULT_STORAGE_PATH/images/1234/vm-1234-disk-0.qcow2",
> > +                parent => '../ssss/base-4321-disk-0.qcow2',
> > +                expected => {
> > +                    content => 'images',
> > +                    ctime => $DEFAULT_CTIME,
> > +                    format => 'qcow2',
> > +                    parent => '../ssss/base-4321-disk-0.qcow2',
> > +                    size => $DEFAULT_SIZE,
> > +                    used => $DEFAULT_USED,
> > +                    vmid => '1234',
> > +                    volid => 'local:1234/vm-1234-disk-0.qcow2',
> > +                },
> > +            },
> > +            {
> > +                file => "$DEFAULT_STORAGE_PATH/images/16112/vm-16112-disk-0.raw",
> > +                expected => {
> > +                    content => 'rootdir',
> > +                    ctime => $DEFAULT_CTIME,
> > +                    format => 'raw',
> > +                    parent => undef,
> > +                    size => $DEFAULT_SIZE,
> > +                    used => $DEFAULT_USED,
> > +                    vmid => '16112',
> > +                    volid => 'local:16112/vm-16112-disk-0.raw',
> > +                },
> > +            },
> > +            {
> > +                file =>
> > +                    "$DEFAULT_STORAGE_PATH/template/cache/alpine-3.10-default_20190626_amd64.tar.xz",
> > +                expected => {
> > +                    content => 'vztmpl',
> > +                    ctime => $DEFAULT_CTIME,
> > +                    format => 'txz',
> > +                    size => $DEFAULT_SIZE,
> > +                    volid => 'local:vztmpl/alpine-3.10-default_20190626_amd64.tar.xz',
> > +                },
> > +            },
> > +            {
> > +                file => "$DEFAULT_STORAGE_PATH/template/iso/archlinux-2020.02.01-x86_64.iso",
> > +                expected => {
> > +                    content => 'iso',
> > +                    ctime => $DEFAULT_CTIME,
> > +                    format => 'iso',
> > +                    size => $DEFAULT_SIZE,
> > +                    volid => 'local:iso/archlinux-2020.02.01-x86_64.iso',
> > +                },
> > +            },
> > +            {
> > +                file =>
> > +                    "$DEFAULT_STORAGE_PATH/dump/vzdump-lxc-16112-2020_03_30-21_39_30.tar.lzo",
> > +                expected => {
> > +                    content => 'backup',
> > +                    ctime => 1585604370,
> > +                    format => 'tar.lzo',
> > +                    size => $DEFAULT_SIZE,
> > +                    subtype => 'lxc',
> > +                    vmid => '16112',
> > +                    volid => 'local:backup/vzdump-lxc-16112-2020_03_30-21_39_30.tar.lzo',
> > +                },
> > +            },
> > +            {
> > +                file => "$DEFAULT_STORAGE_PATH/snippets/hookscript.pl",
> > +                expected => {
> > +                    content => 'snippets',
> > +                    ctime => $DEFAULT_CTIME,
> > +                    format => 'snippet',
> > +                    size => $DEFAULT_SIZE,
> > +                    volid => 'local:snippets/hookscript.pl',
> > +                },
> > +            },
> > +            {
> > +                file => "$DEFAULT_STORAGE_PATH/import/import.ova",
> > +                expected => {
> > +                    content => 'import',
> > +                    ctime => $DEFAULT_CTIME,
> > +                    format => 'ova',
> > +                    size => $DEFAULT_SIZE,
> > +                    volid => 'local:import/import.ova',
> > +                },
> > +            },
> > +        ],
> > +    },
> >  ];
> >
> >  # provide static vmlist for tests
> > --
> > 2.47.3
> >
> >
> >
> >
> >





  reply	other threads:[~2026-07-28 13:51 UTC|newest]

Thread overview: 74+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2026-04-22 11:12 [PATCH pve-storage, pve-manager v1 00/54] Fix #2884: Implement Subdirectory Scanning for Dir-Based Storage Types Max R. Carrara
2026-04-22 11:12 ` [PATCH pve-storage v1 01/54] test: plugin tests: run tests with at most 4 jobs Max R. Carrara
2026-04-22 11:12 ` [PATCH pve-storage v1 02/54] plugin, common: remove superfluous use of =pod command paragraph Max R. Carrara
2026-04-22 11:12 ` [PATCH pve-storage v1 03/54] common: add POD headings for groups of helpers Max R. Carrara
2026-04-22 11:12 ` [PATCH pve-storage v1 04/54] common: use Exporter module for PVE::Storage::Common Max R. Carrara
2026-04-22 11:12 ` [PATCH pve-storage v1 05/54] plugin: make get_subdir_files a proper subroutine and update style Max R. Carrara
2026-04-22 11:12 ` [PATCH pve-storage v1 06/54] plugin api: replace helpers w/ standalone subs, bump API version & age Max R. Carrara
2026-04-28 15:01   ` Wolfgang Bumiller
2026-04-22 11:12 ` [PATCH pve-storage v1 07/54] common: prevent autovivification in plugin_get_vtype_subdir helper Max R. Carrara
2026-04-28 15:02   ` Wolfgang Bumiller
2026-04-22 11:12 ` [PATCH pve-storage v1 08/54] plugin: break up needless if-elsif chain into separate if-blocks Max R. Carrara
2026-04-28 15:04   ` Wolfgang Bumiller
2026-04-22 11:12 ` [PATCH pve-storage v1 09/54] plugin: adapt get_subdir_files helper of list_volumes API method Max R. Carrara
2026-04-28 15:07   ` Wolfgang Bumiller
2026-04-22 11:12 ` [PATCH pve-storage v1 10/54] plugin: update code style of list_volumes plugin " Max R. Carrara
2026-04-22 11:12 ` [PATCH pve-storage v1 11/54] plugin: use closure for obtaining raw volume data in list_volumes Max R. Carrara
2026-04-22 11:12 ` [PATCH pve-storage v1 12/54] plugin: use closure for inner loop logic " Max R. Carrara
2026-04-22 11:12 ` [PATCH pve-storage v1 13/54] storage: update code style in function path_to_volume_id Max R. Carrara
2026-04-22 11:12 ` [PATCH pve-storage v1 14/54] storage: break up needless if-elsif chain in path_to_volume_id Max R. Carrara
2026-04-22 11:12 ` [PATCH pve-storage v1 15/54] storage: heave vtype file path parsing logic inside loop into helper Max R. Carrara
2026-04-22 11:12 ` [PATCH pve-storage v1 16/54] storage: clean up code that was moved into helper in path_to_volume_id Max R. Carrara
2026-04-28 15:08   ` Wolfgang Bumiller
2026-04-22 11:12 ` [PATCH pve-storage v1 17/54] api: status: move content type assert for up-/downloads into helper Max R. Carrara
2026-04-28 15:10   ` Wolfgang Bumiller
2026-07-29 10:46     ` Max R. Carrara
2026-04-22 11:12 ` [PATCH pve-storage v1 18/54] api: status: use helper from common module to get content directory Max R. Carrara
2026-04-22 11:12 ` [PATCH pve-storage v1 19/54] api: status: move up-/download file path parsing code into helper Max R. Carrara
2026-04-22 11:12 ` [PATCH pve-storage v1 20/54] api: status: simplify file content assertion logic for up-/download Max R. Carrara
2026-04-22 11:12 ` [PATCH pve-storage v1 21/54] test: guest import: add tests for PVE::GuestImport Max R. Carrara
2026-04-22 11:12 ` [PATCH pve-storage v1 22/54] tree-wide: introduce parsing module and replace usages of ISO_EXT_RE_0 Max R. Carrara
2026-04-28 15:20   ` Wolfgang Bumiller
2026-07-29 11:05     ` Max R. Carrara
2026-04-22 11:12 ` [PATCH pve-storage v1 23/54] common: test: set up parser testing code, add tests for 'iso' vtype Max R. Carrara
2026-04-22 11:12 ` [PATCH pve-storage v1 24/54] tree-wide: replace usages of VZTMPL_EXT_RE_1 with parsing functions Max R. Carrara
2026-04-22 11:12 ` [PATCH pve-storage v1 25/54] tree-wide: replace usages of BACKUP_EXT_RE_2 " Max R. Carrara
2026-06-30 14:06   ` Wolfgang Bumiller
2026-07-29 13:02     ` Max R. Carrara
2026-04-22 11:12 ` [PATCH pve-storage v1 26/54] tree-wide: replace usages of inline regexes for snippets with parsers Max R. Carrara
2026-04-22 11:12 ` [PATCH pve-storage v1 27/54] tree-wide: partially replace usages of regexes for 'import' vtype Max R. Carrara
2026-06-30 14:19   ` Wolfgang Bumiller
2026-06-30 14:44     ` Wolfgang Bumiller
2026-06-30 14:28   ` Wolfgang Bumiller
2026-07-29  9:27     ` Max R. Carrara
2026-04-22 11:12 ` [PATCH pve-storage v1 28/54] tree-wide: replace remaining " Max R. Carrara
2026-04-22 11:12 ` [PATCH pve-storage v1 29/54] plugin: simplify recently refactored logic in parse_volname method Max R. Carrara
2026-04-22 11:12 ` [PATCH pve-storage v1 30/54] plugin: simplify recently refactored logic in get_subdir_files helper Max R. Carrara
2026-04-22 11:12 ` [PATCH pve-storage v1 31/54] storage: simplify recently refactored logic in path_to_volume_id sub Max R. Carrara
2026-04-22 11:12 ` [PATCH pve-storage v1 32/54] api: status: simplify recently added parsing helper for file transfers Max R. Carrara
2026-04-22 11:12 ` [PATCH pve-storage v1 33/54] plugin: use parsing helper in parse_volume_id sub Max R. Carrara
2026-04-22 11:13 ` [PATCH pve-storage v1 34/54] test: list volumes: reorganize and modernize test running code Max R. Carrara
2026-04-22 11:13 ` [PATCH pve-storage v1 35/54] test: list volumes: fix broken test checking for vmlist modifications Max R. Carrara
2026-04-22 11:13 ` [PATCH pve-storage v1 36/54] test: list volumes: introduce new format for test cases Max R. Carrara
2026-04-22 11:13 ` [PATCH pve-storage v1 37/54] test: list volumes: remove legacy code and migrate cases to new format Max R. Carrara
2026-04-22 11:13 ` [PATCH pve-storage v1 38/54] test: list volumes: document behavior wrt. undeclared content types Max R. Carrara
2026-07-02 12:46   ` Wolfgang Bumiller
2026-07-28 13:50     ` Max R. Carrara [this message]
2026-04-22 11:13 ` [PATCH pve-storage v1 39/54] plugin: correct comment in get_subdir_files helper Max R. Carrara
2026-04-22 11:13 ` [PATCH pve-storage v1 40/54] test: parse volname: modernize code Max R. Carrara
2026-04-22 11:13 ` [PATCH pve-storage v1 41/54] test: parse volname: adapt tests regarding 'import' volume type Max R. Carrara
2026-04-22 11:13 ` [PATCH pve-storage v1 42/54] test: parse volname: move VM disk test creation into separate block Max R. Carrara
2026-04-22 11:13 ` [PATCH pve-storage v1 43/54] test: parse volname: move backup file test creation into sep. block Max R. Carrara
2026-04-22 11:13 ` [PATCH pve-storage v1 44/54] test: parse volname: parameterize test case creation for some vtypes Max R. Carrara
2026-04-22 11:13 ` [PATCH pve-storage v1 45/54] test: volume id: modernize code Max R. Carrara
2026-04-22 11:13 ` [PATCH pve-storage v1 46/54] test: volume id: rename 'volname' test case parameter to 'file' Max R. Carrara
2026-04-22 11:13 ` [PATCH pve-storage v1 47/54] test: filesystem path: modernize code Max R. Carrara
2026-04-22 11:13 ` [PATCH pve-storage v1 48/54] fix #2884: implement nested subdir scanning and support 'iso' vtype Max R. Carrara
2026-07-02 14:55   ` Wolfgang Bumiller
2026-04-22 11:13 ` [PATCH pve-storage v1 49/54] fix #2884: support nested subdir scanning for 'vztmpl' volume type Max R. Carrara
2026-04-22 11:13 ` [PATCH pve-storage v1 50/54] fix #2884: support nested subdir scanning for 'snippets' vtype Max R. Carrara
2026-04-22 11:13 ` [PATCH pve-storage v1 51/54] test: add more tests for 'import' vtype & guard against nested subdirs Max R. Carrara
2026-04-22 11:13 ` [PATCH pve-storage v1 52/54] test: add tests guarding against subdir scanning for vtypes Max R. Carrara
2026-04-22 11:13 ` [PATCH pve-storage v1 53/54] storage api: mark old public regexes for removal, bump APIVER & APIAGE Max R. Carrara
2026-04-28 15:22   ` Wolfgang Bumiller
2026-04-22 11:13 ` [PATCH pve-manager v1 54/54] fix #2884: ui: storage: add field for 'max-scan-depth' property Max R. Carrara

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=DKA94H3058HT.2HCVSLGN29ZI7@proxmox.com \
    --to=m.carrara@proxmox.com \
    --cc=pve-devel@lists.proxmox.com \
    --cc=w.bumiller@proxmox.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox
Service provided by Proxmox Server Solutions GmbH | Privacy | Legal