public inbox for pdm-devel@lists.proxmox.com
 help / color / mirror / Atom feed
From: Dominik Csapak <d.csapak@proxmox.com>
To: Lukas Wagner <l.wagner@proxmox.com>, pdm-devel@lists.proxmox.com
Subject: Re: [PATCH datacenter-manager 09/15] task cache: include archive file path in error log messages
Date: Fri, 10 Jul 2026 13:36:01 +0200	[thread overview]
Message-ID: <1b6799bf-dc77-44bf-914a-93cd9b9d78d1@proxmox.com> (raw)
In-Reply-To: <20260702092258.174740-10-l.wagner@proxmox.com>

one nit inline

On 7/2/26 11:23 AM, Lukas Wagner wrote:
> This should make any kind of troubleshooting much simpler.
> 
> Signed-off-by: Lukas Wagner <l.wagner@proxmox.com>
> ---
>   server/src/remote_tasks/task_cache.rs | 26 ++++++++++++++++++++++----
>   1 file changed, 22 insertions(+), 4 deletions(-)
> 
> diff --git a/server/src/remote_tasks/task_cache.rs b/server/src/remote_tasks/task_cache.rs
> index 02be9ca1..c7057786 100644
> --- a/server/src/remote_tasks/task_cache.rs
> +++ b/server/src/remote_tasks/task_cache.rs
> @@ -1065,8 +1065,10 @@ impl Iterator for TaskArchiveIterator<'_> {
>   struct InnerTaskArchiveIterator {
>       /// Archive files to read.
>       files: Vec<ArchiveFile>,
> -    /// Archive iterator we are currently using, if any
> +    /// Archive iterator we are currently using, if any.
>       current: Option<ArchiveIterator>,
> +    /// Archive file that is currently being iterated over, if any.
> +    current_file: Option<ArchiveFile>,
>   }
>   
>   impl InnerTaskArchiveIterator {
> @@ -1075,6 +1077,7 @@ impl InnerTaskArchiveIterator {
>           Self {
>               files,
>               current: None,
> +            current_file: None,
>           }
>       }
>   }
> @@ -1088,9 +1091,22 @@ impl Iterator for InnerTaskArchiveIterator {
>                   Some(current) => {
>                       let next = current.next();
>                       if next.is_some() {
> -                        return next;
> +                        return next.map(|res| {
> +                            res.with_context(|| {
> +                                format!(
> +                                    "failed to read from {file}",
> +                                    file = self
> +                                        .current_file
> +                                        .as_ref()
> +                                        .expect("self.current and self.current_file are both Some")

i guess we could prevent this expect here if `current` is changed to an
`Option<(ArchiveIterator, ArchiveFile)>`

so that both must be either Some or None?

> +                                        .path
> +                                        .display()
> +                                )
> +                            })
> +                        });
>                       } else {
>                           self.current = None;
> +                        self.current_file = None;
>                       }
>                   }
>                   None => 'inner: loop {
> @@ -1100,6 +1116,7 @@ impl Iterator for InnerTaskArchiveIterator {
>                       match next_file.iter() {
>                           Ok(Some(iter)) => {
>                               self.current = Some(iter);
> +                            self.current_file = Some(next_file);
>                               break 'inner;
>                           }
>                           Ok(None) => {
> @@ -1107,7 +1124,8 @@ impl Iterator for InnerTaskArchiveIterator {
>                           }
>                           Err(err) => {
>                               log::error!(
> -                                "could not create archive iterator while iteration over task archive files, skipping: {err:#}"
> +                                "could not create task archive iterator for {file}, skipping: {err:#}",
> +                                file = next_file.path.display()
>                               )
>                           }
>                       }
> @@ -1292,7 +1310,7 @@ impl JournalIterator {
>               .flat_map(|task| match task {
>                   Ok(task) => Some(task),
>                   Err(err) => {
> -                    log::error!("could not read task while iterating over archive file: {err:#}");
> +                    log::error!("could not read task while iterating over journal file: {err:#}");
>                       None
>                   }
>               })





  reply	other threads:[~2026-07-10 11:36 UTC|newest]

Thread overview: 30+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2026-07-02  9:22 [PATCH datacenter-manager/proxmox 00/15] task cache improvements (archive corruption handling, error handling) Lukas Wagner
2026-07-02  9:22 ` [PATCH proxmox 01/15] sys: fs: don't replace file extension make_tmp_file Lukas Wagner
2026-07-02  9:29   ` Lukas Wagner
2026-07-02  9:22 ` [PATCH datacenter-manager 02/15] task cache: fix missing cutoff state for PBS remotes Lukas Wagner
2026-07-02  9:22 ` [PATCH datacenter-manager 03/15] task cache: refresh task: don't apply journal if the archive was rotated Lukas Wagner
2026-07-02  9:22 ` [PATCH datacenter-manager 04/15] task cache: rotate: align timestamp for new files to UTC midnight Lukas Wagner
2026-07-10 11:36   ` Dominik Csapak
2026-07-10 12:02     ` Lukas Wagner
2026-07-02  9:22 ` [PATCH datacenter-manager 05/15] task cache: add test case for task cache rotation Lukas Wagner
2026-07-10 11:35   ` Dominik Csapak
2026-07-10 12:13     ` Lukas Wagner
2026-07-02  9:22 ` [PATCH datacenter-manager 06/15] task cache: pre-compute static paths during initialization Lukas Wagner
2026-07-02  9:22 ` [PATCH datacenter-manager 07/15] task cache: only initialize `TaskCache` struct once Lukas Wagner
2026-07-02  9:22 ` [PATCH datacenter-manager 08/15] task cache: archive iterator: don't yield more items if reading from file failed Lukas Wagner
2026-07-10 11:36   ` Dominik Csapak
2026-07-10 12:36     ` Lukas Wagner
2026-07-02  9:22 ` [PATCH datacenter-manager 09/15] task cache: include archive file path in error log messages Lukas Wagner
2026-07-10 11:36   ` Dominik Csapak [this message]
2026-07-10 12:53     ` Lukas Wagner
2026-07-02  9:22 ` [PATCH datacenter-manager 10/15] task cache: introduce ArchiveFileWriter Lukas Wagner
2026-07-10 11:36   ` Dominik Csapak
2026-07-02  9:22 ` [PATCH datacenter-manager 11/15] task cache: use ArchiveFileWriter when creating new archive files Lukas Wagner
2026-07-02  9:22 ` [PATCH datacenter-manager 12/15] task cache: trigger repair of corruption when applying journal Lukas Wagner
2026-07-02  9:22 ` [PATCH datacenter-manager 13/15] task cache: trigger repair of corruption when compressing archive files Lukas Wagner
2026-07-10 11:36   ` Dominik Csapak
2026-07-02  9:22 ` [PATCH datacenter-manager 14/15] task cache: trigger repair of corruption after read-accesses Lukas Wagner
2026-07-10 11:36   ` Dominik Csapak
2026-07-02  9:22 ` [PATCH datacenter-manager 15/15] task cache: handle potentially duplicated archive files after 'compress_archive_file' Lukas Wagner
2026-07-10 11:36   ` Dominik Csapak
2026-07-10 11:36 ` [PATCH datacenter-manager/proxmox 00/15] task cache improvements (archive corruption handling, error handling) Dominik Csapak

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=1b6799bf-dc77-44bf-914a-93cd9b9d78d1@proxmox.com \
    --to=d.csapak@proxmox.com \
    --cc=l.wagner@proxmox.com \
    --cc=pdm-devel@lists.proxmox.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox
Service provided by Proxmox Server Solutions GmbH | Privacy | Legal