From: Thomas Lamprecht <t.lamprecht@proxmox.com>
To: Oguz Bektas <o.bektas@proxmox.com>,
Proxmox VE development discussion <pve-devel@lists.proxmox.com>,
Lorenz Stechauner <l.stechauner@proxmox.com>
Subject: Re: [pve-devel] [PATCH v4 common 2/7] tools: add download_file_from_url
Date: Thu, 6 May 2021 14:15:59 +0200 [thread overview]
Message-ID: <e11298a3-8355-b48e-4788-9c6de04a125e@proxmox.com> (raw)
In-Reply-To: <20210506100443.GA12590@gaia.proxmox.com>
thanks for the review, something on top inline.
On 06.05.21 12:04, Oguz Bektas wrote:
> On Thu, May 06, 2021 at 11:11:00AM +0200, Lorenz Stechauner wrote:
>> +
>> + my @cmd = ('/usr/bin/wget', '--progress=dot:mega', '-O', $tmpdest, $url);
>> +
>> + local %ENV;
>> + if ($opts->{http_proxy}) {
>> + $ENV{http_proxy} = $opts->{http_proxy};
>
> might be worth it to also add https_proxy here
True, but would be a separate series out of scope here, needs to gain
support in datacenter.cfg
https://pve.proxmox.com/pve-docs/datacenter.cfg.5.html#_options
May be relevant to talk with Dietmar about the upcomming possibilities in PBS,
he checked out HTTP proxies quite closely recently.
> [snip]
>> +
>> +sub check_file_hash {
>> + my ($checksums, $filename, $noerr) = @_;
>> +
>> + my $digest;
>> + my $expected;
>> +
>> + eval {
>> + open(my $fh, '<', $filename) or die "Can't open '$filename': $!";
as already mentioned in a previous review, add the trailing new line "\n" to
die statements, else they will get ugly by adding internal information!
>> + binmode($fh);
>> + if (defined($checksums->{sha512sum})) {
>> + $expected = $checksums->{sha512sum};
>> + $digest = Digest::SHA->new(512)->addfile($fh)->hexdigest;
>> + } elsif (defined($checksums->{sha384sum})) {
>> + $expected = $checksums->{sha384sum};
>> + $digest = Digest::SHA->new(384)->addfile($fh)->hexdigest;
>> + } elsif (defined($checksums->{sha256sum})) {
>> + $expected = $checksums->{sha256sum};
>> + $digest = Digest::SHA->new(256)->addfile($fh)->hexdigest;
>> + } elsif (defined($checksums->{sha224sum})) {
>> + $expected = $checksums->{sha224sum};
>> + $digest = Digest::SHA->new(224)->addfile($fh)->hexdigest;
>> + } elsif (defined($checksums->{sha1sum})) {
>> + $expected = $checksums->{sha1sum};
>> + $digest = Digest::SHA->new(1)->addfile($fh)->hexdigest;
>> + } elsif (defined($checksums->{md5sum})) {
>> + $expected = $checksums->{md5sum};
>> + $digest = Digest::MD5->new->addfile($fh)->hexdigest;
>
> hmm not necessary but maybe you could also do something like this (not
> tested):
>
> ...
> my $sha_algorithms = ('1', '224', '256', '384', '512');
> foreach my $algorithm (@$sha_algorithms) {
use for over foreach, and a list can be used directly, no need for a useless
intermediate variable:
for my $foo ('a', 'b', 'c') {
...
> if (defined($checksums->{"sha$algorithm"})) {
> $expected = $checksums->{"sha$algorithm"};
> $digest = Digest::SHA->new($algorithm)->addfile($fh)->hexdigest;
You can also use strings as module in perl:
$digest = "Digest::$algorithm"->new->addfile...
> }
> }
>
> to avoid having a lot of if/elsif clauses (md5 would probably have another
> clause but 2 is better than 5-6).
with < 10 elements that can be fine, but here the whole method is weird in UX
IMO and could be improved in general by:
1. pass alogrirhm and expected hash string directly
2. use a map for the different modules
3. let the caller handle the error (albeit no hard feelings here)
sub check_file_hash
my ($algorithm, $expected, $file) = @_;
my $algorithm_map = {
'sha256' => sub { Digest::SHA->new(512) },
'sha512' => sub { Digest::SHA->new(512) },
# etc...
};
my $digester = $algorithm_map->{$algorithm}->() or die "unknown algorithm '$algorithm'\n";
open(my $fh, '<', $filename) or die "cannot open file '$file': $!\n";
my $got = $digester->addfile($fh)->hexdigest;
close($fh);
return lc($digest) eq lc($expected);
}
IMO much simpler/shorter and still easy to grasp.
>
>
>> + } else {
>> + die "no expected checksum defined";
>> + }
>> + close($fh);
>> + };
>> +
>> + die "checking hash failed - $@\n" if $@ && !$noerr;
>> +
>> + return (($digest ? lc($digest) eq lc($expected) : 0), $digest, $expected);
>> +}
>> +
>> 1;
>> --
>> 2.20.1
next prev parent reply other threads:[~2021-05-06 12:16 UTC|newest]
Thread overview: 21+ messages / expand[flat|nested] mbox.gz Atom feed top
2021-05-03 10:20 [pve-devel] [PATCH-SERIES v2 manager/storage 0/2] fix #1710: add retrieve method for Lorenz Stechauner
2021-05-03 10:20 ` [pve-devel] [PATCH v2 storage 1/2] fix #1710: add retrieve method for storage Lorenz Stechauner
2021-05-03 10:21 ` [pve-devel] [PATCH v2 manager 2/2] fix #1710: add retrieve from url button " Lorenz Stechauner
2021-05-04 8:55 ` [pve-devel] [PATCH-SERIES v3 manager/storage 0/2] " Lorenz Stechauner
2021-05-04 8:56 ` [pve-devel] [PATCH v3 storage 1/2] fix #1710: add retrieve method " Lorenz Stechauner
2021-05-04 9:31 ` Thomas Lamprecht
2021-05-04 8:57 ` [pve-devel] [PATCH v3 manager 2/2] fix #1710: add retrieve from url button " Lorenz Stechauner
2021-05-04 9:47 ` Thomas Lamprecht
2021-05-06 9:10 ` [pve-devel] [PATCH-SERIES v4 manager/common/storage 0/7] fix #1710: add download from url button Lorenz Stechauner
2021-05-06 9:10 ` [pve-devel] [PATCH v4 manager 1/7] api: nodes: add query_url_metadata method Lorenz Stechauner
2021-05-06 9:11 ` [pve-devel] [PATCH v4 common 2/7] tools: add download_file_from_url Lorenz Stechauner
2021-05-06 10:04 ` Oguz Bektas
2021-05-06 12:15 ` Thomas Lamprecht [this message]
2021-05-06 12:17 ` Thomas Lamprecht
2021-05-06 9:11 ` [pve-devel] [PATCH v4 manager 3/7] api: nodes: refactor aplinfo to use common download function Lorenz Stechauner
2021-05-06 9:11 ` [pve-devel] [PATCH v4 storage 4/7] status: add download_url method Lorenz Stechauner
2021-05-06 9:23 ` [pve-devel] [PATCH v5 storage] " Lorenz Stechauner
2021-05-06 9:11 ` [pve-devel] [PATCH v4 manager 5/7] ui: add HashAlgorithmSelector Lorenz Stechauner
2021-05-06 9:11 ` [pve-devel] [PATCH v4 manager 6/7] ui: Utils: change download task format Lorenz Stechauner
2021-05-06 9:11 ` [pve-devel] [PATCH v4 manager 7/7] fix #1710: ui: storage: add download from url button Lorenz Stechauner
2021-05-06 13:15 ` [pve-devel] [PATCH v4 manager 1/7] api: nodes: add query_url_metadata method Dominik Csapak
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=e11298a3-8355-b48e-4788-9c6de04a125e@proxmox.com \
--to=t.lamprecht@proxmox.com \
--cc=l.stechauner@proxmox.com \
--cc=o.bektas@proxmox.com \
--cc=pve-devel@lists.proxmox.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox