public inbox for pve-devel@lists.proxmox.com
 help / color / mirror / Atom feed
From: Filip Schauer <f.schauer@proxmox.com>
To: pve-devel@lists.proxmox.com
Subject: [pve-devel] [PATCH storage v8 7/9] storage: introduce decompress_archive_into_pipe helper
Date: Tue, 16 Sep 2025 14:32:52 +0200	[thread overview]
Message-ID: <20250916123257.107491-8-f.schauer@proxmox.com> (raw)
In-Reply-To: <20250916123257.107491-1-f.schauer@proxmox.com>

Extract the file decompression code into its own reusable subroutine.

Signed-off-by: Filip Schauer <f.schauer@proxmox.com>
Reviewed-by: Fiona Ebner <f.ebner@proxmox.com>
---
 src/PVE/Storage.pm | 68 +++++++++++++++++++++++++++-------------------
 1 file changed, 40 insertions(+), 28 deletions(-)

diff --git a/src/PVE/Storage.pm b/src/PVE/Storage.pm
index d380160..5071475 100755
--- a/src/PVE/Storage.pm
+++ b/src/PVE/Storage.pm
@@ -1887,6 +1887,45 @@ sub extract_vzdump_config_tar {
     return wantarray ? ($raw, $file) : $raw;
 }
 
+sub decompress_archive_into_pipe {
+    my ($archive, $cmd, $outfunc) = @_;
+
+    my $info = archive_info($archive);
+    die "archive is not compressed\n" if !$info->{compression};
+    my $decompressor = $info->{decompressor};
+    my $full_cmd = [[@$decompressor, $archive], $cmd];
+
+    # lzop/zcat exits with 1 when the pipe is closed early,
+    # detect this and ignore the exit code later
+    my $broken_pipe;
+    my $errstring;
+    my $err = sub {
+        my $output = shift;
+        if (
+            $output =~ m/lzop: Broken pipe: <stdout>/
+            || $output =~ m/gzip: stdout: Broken pipe/
+            || $output =~ m/zstd: error 70 : Write error.*Broken pipe/
+        ) {
+            $broken_pipe = 1;
+        } elsif (!defined($errstring) && $output !~ m/^\s*$/) {
+            $errstring = "failed to decompress archive: $output\n";
+        }
+    };
+
+    my $rc = eval { run_command($full_cmd, outfunc => $outfunc, errfunc => $err, noerr => 1) };
+    my $rerr = $@;
+
+    $broken_pipe ||= $rc == 141; # broken pipe from cmd POV
+
+    if (!$errstring && !$broken_pipe && $rc != 0) {
+        die "$rerr\n" if $rerr;
+        die "archive decompression failed with exit code $rc\n";
+    }
+    die "$errstring\n" if $errstring;
+
+    return;
+}
+
 sub extract_vzdump_config_vma {
     my ($archive, $comp) = @_;
 
@@ -1898,34 +1937,7 @@ sub extract_vzdump_config_vma {
     my $decompressor = $info->{decompressor};
 
     if ($comp) {
-        my $cmd = [[@$decompressor, $archive], ["vma", "config", "-"]];
-
-        # lzop/zcat exits with 1 when the pipe is closed early by vma, detect this and ignore the exit code later
-        my $broken_pipe;
-        my $errstring;
-        my $err = sub {
-            my $output = shift;
-            if (
-                $output =~ m/lzop: Broken pipe: <stdout>/
-                || $output =~ m/gzip: stdout: Broken pipe/
-                || $output =~ m/zstd: error 70 : Write error.*Broken pipe/
-            ) {
-                $broken_pipe = 1;
-            } elsif (!defined($errstring) && $output !~ m/^\s*$/) {
-                $errstring = "Failed to extract config from VMA archive: $output\n";
-            }
-        };
-
-        my $rc = eval { run_command($cmd, outfunc => $out, errfunc => $err, noerr => 1) };
-        my $rerr = $@;
-
-        $broken_pipe ||= $rc == 141; # broken pipe from vma POV
-
-        if (!$errstring && !$broken_pipe && $rc != 0) {
-            die "$rerr\n" if $rerr;
-            die "config extraction failed with exit code $rc\n";
-        }
-        die "$errstring\n" if $errstring;
+        decompress_archive_into_pipe($archive, ["vma", "config", "-"], $out);
     } else {
         run_command(["vma", "config", $archive], outfunc => $out);
     }
-- 
2.47.3



_______________________________________________
pve-devel mailing list
pve-devel@lists.proxmox.com
https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-devel


  parent reply	other threads:[~2025-09-16 12:37 UTC|newest]

Thread overview: 10+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2025-09-16 12:32 [pve-devel] [PATCH storage v8 0/9] support copying volumes between storages Filip Schauer
2025-09-16 12:32 ` [pve-devel] [PATCH storage v8 1/9] storage migrate: remove remnant from rsync-based migration Filip Schauer
2025-09-16 12:32 ` [pve-devel] [PATCH storage v8 2/9] storage migrate: avoid ssh when moving a volume locally Filip Schauer
2025-09-16 12:32 ` [pve-devel] [PATCH storage v8 3/9] plugin: allow volume import of iso, snippets, vztmpl and import Filip Schauer
2025-09-16 12:32 ` [pve-devel] [PATCH storage v8 4/9] api: content: implement copying volumes between storages Filip Schauer
2025-09-16 12:32 ` [pve-devel] [PATCH storage v8 5/9] introduce $vtype+meta export formats Filip Schauer
2025-09-16 12:32 ` [pve-devel] [PATCH storage v8 6/9] api: content: support copying backups between path based storages Filip Schauer
2025-09-16 12:32 ` Filip Schauer [this message]
2025-09-16 12:32 ` [pve-devel] [PATCH storage v8 8/9] support copying VMA backups to PBS Filip Schauer
2025-09-16 12:32 ` [pve-devel] [PATCH storage v8 9/9] pvesm: add a copy-volume command Filip Schauer

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20250916123257.107491-8-f.schauer@proxmox.com \
    --to=f.schauer@proxmox.com \
    --cc=pve-devel@lists.proxmox.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox
Service provided by Proxmox Server Solutions GmbH | Privacy | Legal