public inbox for pbs-devel@lists.proxmox.com
 help / color / mirror / Atom feed
From: "Lukas Wagner" <l.wagner@proxmox.com>
To: "Robert Obkircher" <r.obkircher@proxmox.com>,
	"Lukas Wagner" <l.wagner@proxmox.com>,
	<pbs-devel@lists.proxmox.com>
Subject: Re: [PATCH v5 proxmox-backup 03/16] datastore: add TempTestDir that is automatically deleted on drop
Date: Mon, 02 Feb 2026 11:56:22 +0100	[thread overview]
Message-ID: <DG4F6WPZ0KSB.8WT8BYFCB07S@proxmox.com> (raw)
In-Reply-To: <f18d236b-3e64-49be-b1ef-0c75bd104ae4@proxmox.com>

On Mon Feb 2, 2026 at 11:12 AM CET, Robert Obkircher wrote:
>
> On 2/2/26 09:30, Lukas Wagner wrote:
>> On Fri Jan 30, 2026 at 5:45 PM CET, Robert Obkircher wrote:
>>> This will be used to test the FixedIndexWriter and chunk store
>>> creation.
>>>
>>> Signed-off-by: Robert Obkircher <r.obkircher@proxmox.com>
>>> ---
>>>  pbs-datastore/src/lib.rs           |  4 ++++
>>>  pbs-datastore/src/temp_test_dir.rs | 33 ++++++++++++++++++++++++++++++
>>>  2 files changed, 37 insertions(+)
>>>  create mode 100644 pbs-datastore/src/temp_test_dir.rs
>>>
>>> diff --git a/pbs-datastore/src/lib.rs b/pbs-datastore/src/lib.rs
>>> index 1f7c54ae..b48ec93c 100644
>>> --- a/pbs-datastore/src/lib.rs
>>> +++ b/pbs-datastore/src/lib.rs
>>> @@ -233,3 +233,7 @@ pub use local_chunk_reader::LocalChunkReader;
>>>  
>>>  mod local_datastore_lru_cache;
>>>  pub use local_datastore_lru_cache::LocalDatastoreLruCache;
>>> +
>>> +#[cfg(test)]
>>> +mod temp_test_dir;
>>> +
>>> diff --git a/pbs-datastore/src/temp_test_dir.rs b/pbs-datastore/src/temp_test_dir.rs
>>> new file mode 100644
>>> index 00000000..13e16c91
>>> --- /dev/null
>>> +++ b/pbs-datastore/src/temp_test_dir.rs
>>> @@ -0,0 +1,33 @@
>>> +use std::convert::From;
>>> +use std::env;
>>> +use std::path::{Path, PathBuf};
>>> +
>>> +/// A temporary directory for tests that is removed on drop.
>>> +/// Deletion is best-effort and errors are silently ignored.
>>> +pub struct TempTestDir(PathBuf);
>>> +
>>> +impl TempTestDir {
>>> +    /// Create an empty directory.
>>> +    pub fn new() -> Self {
>>> +        Self(proxmox_sys::fs::make_tmp_dir(env::temp_dir(), None).unwrap())
>>> +    }
>>> +}
>>> +
>>> +impl std::ops::Deref for TempTestDir {
>>> +    type Target = Path;
>>> +    fn deref(&self) -> &Self::Target {
>>> +        &self.0
>>> +    }
>>> +}
>>> +
>>> +impl Drop for TempTestDir {
>>> +    fn drop(&mut self) {
>>> +        let _ = std::fs::remove_dir_all(&self.0);
>>> +    }
>>> +}
>>> +
>>> +impl<'a> From<&'a TempTestDir> for PathBuf {
>>> +    fn from(temp: &'a TempTestDir) -> Self {
>>> +        temp.0.clone()
>>> +    }
>>> +}
>>
>> Hey Robert,
>>
>> We do already have a very similar helper in the PDM repository [1].
>> Maybe it would sense move either this or the PDM version (or some hybrid)
>> into a shared crate in proxmox.git?
>>
>> I would suggest creating a new crate for commonly used test-only
>> helpers (proxmox-test-support, proxmox-test-helpers, proxmox-test-util,
>> maybe you have a better suggestion?)
>>
>> What do you think?
> I've noticed this as well when I skimmed your RFC.
>
> I'm not sure if combining unrelated things into a -test
> crate is a good idea. Maybe a (proxmox-)tempfile crate
> that is added to [dev-dependencies] would be slightly
> nicer?

Also okay to me. Then I would make sure that this helper is
'production-ready' - so maybe log the error in case `drop` could not
clean up the directory, add support for `CreateOptions`, and also maybe
add a method that allows one to clean up manually, so that any potential
error can be handle by the application if needed (TmpDir from the
tempfile crate has a `close` method, something like that).

Maybe it could also make sense to move the tmpfile helpers from
proxmox-sys there, if possible (IIRC proxmox-sys uses the tempfile
helpers internally).

>
> I've also considered adding it to proxmox_sys::fs::dir,
> but it does seem a little out of place there.

Yeah, I wouldn't do that. proxmox-sys is pretty huge already and should
rather be broken apart into meaningful smaller crates than made bigger.

>
>>
>> [1] https://git.proxmox.com/?p=proxmox-datacenter-manager.git;a=blob;f=server/src/test_support/temp.rs;h=a93c914d9efcc60de3bb40bc79610abc98571b7f;hb=HEAD





  reply	other threads:[~2026-02-02 10:55 UTC|newest]

Thread overview: 44+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2026-01-30 16:45 [PATCH v5 proxmox-backup 00/16] fix: #3847 pipe from STDIN to proxmox-backup-client Robert Obkircher
2026-01-30 16:45 ` [PATCH v5 proxmox-backup 01/16] datastore: remove Arc<ChunkStore> from FixedIndexWriter Robert Obkircher
2026-02-02 10:02   ` Christian Ebner
2026-01-30 16:45 ` [PATCH v5 proxmox-backup 02/16] datastore: remove Arc<ChunkStore> from DynamicIndexWriter Robert Obkircher
2026-02-02 10:03   ` Christian Ebner
2026-01-30 16:45 ` [PATCH v5 proxmox-backup 03/16] datastore: add TempTestDir that is automatically deleted on drop Robert Obkircher
2026-02-02  8:32   ` Lukas Wagner
2026-02-02 10:12     ` Robert Obkircher
2026-02-02 10:56       ` Lukas Wagner [this message]
2026-02-02 10:03   ` Christian Ebner
2026-02-02 10:17   ` Christian Ebner
2026-02-02 10:50     ` Robert Obkircher
2026-02-02 11:13       ` Christian Ebner
2026-02-02 11:21         ` Robert Obkircher
2026-01-30 16:45 ` [PATCH v5 proxmox-backup 04/16] datastore: use temporary directory for chunk store test Robert Obkircher
2026-02-02 10:16   ` Christian Ebner
2026-01-30 16:45 ` [PATCH v5 proxmox-backup 05/16] datastore: support writing fidx files of unknown size Robert Obkircher
2026-02-02 10:43   ` Christian Ebner
2026-01-30 16:45 ` [PATCH v5 proxmox-backup 06/16] datastore: test FixedIndexWriter Robert Obkircher
2026-02-02 11:11   ` Christian Ebner
2026-01-30 16:45 ` [PATCH v5 proxmox-backup 07/16] api: backup: make fixed index file size optional Robert Obkircher
2026-02-02 11:39   ` Christian Ebner
2026-02-02 13:20     ` Robert Obkircher
2026-02-02 13:57       ` Christian Ebner
2026-02-09 11:48         ` Robert Obkircher
2026-02-09 12:12           ` Christian Ebner
2026-01-30 16:45 ` [PATCH v5 proxmox-backup 08/16] api: verify fixed index writer size on close Robert Obkircher
2026-02-02 11:48   ` Christian Ebner
2026-01-30 16:45 ` [PATCH v5 proxmox-backup 09/16] fix #3847: client: support fifo pipe inputs for images Robert Obkircher
2026-02-02 12:09   ` Christian Ebner
2026-01-30 16:45 ` [PATCH v5 proxmox-backup 10/16] client: treat minus sign as stdin Robert Obkircher
2026-02-02 12:15   ` Christian Ebner
2026-02-04 14:02     ` Robert Obkircher
2026-02-04 14:43       ` Christian Ebner
2026-02-05 13:40         ` Robert Obkircher
2026-02-05 14:45           ` Christian Ebner
2026-01-30 16:45 ` [PATCH v5 proxmox-backup 11/16] datastore: combine public FixedIndexWriter methods into add_chunk Robert Obkircher
2026-02-02 12:32   ` Christian Ebner
2026-01-30 16:45 ` [PATCH v5 proxmox-backup 12/16] datastore: use u64 instead of usize for fidx writer content size Robert Obkircher
2026-02-02 12:48   ` Christian Ebner
2026-01-30 16:45 ` [PATCH v5 proxmox-backup 13/16] datastore: compute fidx file size with overflow checks Robert Obkircher
2026-01-30 16:45 ` [PATCH v5 proxmox-backup 14/16] datastore: support writing fidx files on systems with larger page size Robert Obkircher
2026-01-30 16:45 ` [PATCH v5 proxmox-backup 15/16] datastore: FixedIndexWriter: switch public chunk_size to u32 Robert Obkircher
2026-01-30 16:45 ` [PATCH v5 proxmox-backup 16/16] datastore: FixedIndexWriter: switch internal " Robert Obkircher

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=DG4F6WPZ0KSB.8WT8BYFCB07S@proxmox.com \
    --to=l.wagner@proxmox.com \
    --cc=pbs-devel@lists.proxmox.com \
    --cc=r.obkircher@proxmox.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox
Service provided by Proxmox Server Solutions GmbH | Privacy | Legal