From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from firstgate.proxmox.com (firstgate.proxmox.com [212.224.123.68]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by lists.proxmox.com (Postfix) with ESMTPS id 0030B6D79B for ; Mon, 16 Aug 2021 13:53:08 +0200 (CEST) Received: from firstgate.proxmox.com (localhost [127.0.0.1]) by firstgate.proxmox.com (Proxmox) with ESMTP id E4C1118494 for ; Mon, 16 Aug 2021 13:53:08 +0200 (CEST) Received: from proxmox-new.maurer-it.com (proxmox-new.maurer-it.com [94.136.29.106]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits)) (No client certificate requested) by firstgate.proxmox.com (Proxmox) with ESMTPS id 3F41D18483 for ; Mon, 16 Aug 2021 13:53:04 +0200 (CEST) Received: from proxmox-new.maurer-it.com (localhost.localdomain [127.0.0.1]) by proxmox-new.maurer-it.com (Proxmox) with ESMTP id 6F42F433AF for ; Mon, 16 Aug 2021 13:46:22 +0200 (CEST) To: pve-devel@lists.proxmox.com References: <20210812191749.2055-1-proxmox8914@herold.me> From: Mira Limbeck Message-ID: Date: Mon, 16 Aug 2021 13:46:21 +0200 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:78.0) Gecko/20100101 Thunderbird/78.13.0 MIME-Version: 1.0 In-Reply-To: <20210812191749.2055-1-proxmox8914@herold.me> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit Content-Language: en-US X-SPAM-LEVEL: Spam detection results: 0 AWL 1.681 Adjusted score from AWL reputation of From: address BAYES_00 -1.9 Bayes spam probability is 0 to 1% KAM_DMARC_STATUS 0.01 Test Rule for DKIM or SPF Failure with Strict Alignment NICE_REPLY_A -2.147 Looks like a legit reply (A) SPF_HELO_NONE 0.001 SPF: HELO does not publish an SPF Record SPF_PASS -0.001 SPF: sender matches SPF record Subject: Re: [pve-devel] [PATCH qemu-server] fix #2429: allow to specify cloud-init vendor snippet via cicustom X-BeenThere: pve-devel@lists.proxmox.com X-Mailman-Version: 2.1.29 Precedence: list List-Id: Proxmox VE development discussion List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 16 Aug 2021 11:53:09 -0000 Thank you for the patch. Sorry that I missed that on friday. Which distributions and cloud-init versions did you test this on? The patch looks good to me. One addition I'd make, as we have a hard limit of 4MiB currently for the generated ISO, inline. On 8/12/21 9:17 PM, Constantin Herold wrote: > Signed-off-by: Constantin Herold > --- > PVE/QemuServer.pm | 8 ++++++++ > PVE/QemuServer/Cloudinit.pm | 18 +++++++++++++----- > 2 files changed, 21 insertions(+), 5 deletions(-) > > diff --git a/PVE/QemuServer.pm b/PVE/QemuServer.pm > index cc73af8..90a4496 100644 > --- a/PVE/QemuServer.pm > +++ b/PVE/QemuServer.pm > @@ -713,6 +713,14 @@ my $cicustom_fmt = { > format => 'pve-volume-id', > format_description => 'volume', > }, > + vendor => { > + type => 'string', > + optional => 1, > + description => 'Specify a custom file containing all vendor data passed to the VM via' > + .' cloud-init.', > + format => 'pve-volume-id', > + format_description => 'volume', > + }, > }; > PVE::JSONSchema::register_format('pve-qm-cicustom', $cicustom_fmt); > > diff --git a/PVE/QemuServer/Cloudinit.pm b/PVE/QemuServer/Cloudinit.pm > index a5474d3..ab5d358 100644 > --- a/PVE/QemuServer/Cloudinit.pm > +++ b/PVE/QemuServer/Cloudinit.pm > @@ -227,7 +227,7 @@ EOF > sub generate_configdrive2 { > my ($conf, $vmid, $drive, $volname, $storeid) = @_; > > - my ($user_data, $network_data, $meta_data) = get_custom_cloudinit_files($conf); > + my ($user_data, $network_data, $meta_data, $vendor_data) = get_custom_cloudinit_files($conf); > $user_data = cloudinit_userdata($conf, $vmid) if !defined($user_data); > $network_data = configdrive2_network($conf) if !defined($network_data); > > @@ -237,7 +237,8 @@ sub generate_configdrive2 { Add a size check for the total amount of bytes to never exceed 3MiB here. e.g. + # we always allocate a 4MiB disk for cloudinit and with the overhead of the ISO + # make sure we always stay below it by keeping the sum of all files below 3 MiB + my $sum = length($user_data) + length($vendor_data) + length($network_data) + length($meta_data); + die "Cloud-Init sum of snippets too big (> 3 MiB)\n" if $sum > (3 * 1024 * 1024); This is taken from my patch sent previously [0]. > my $files = { > '/openstack/latest/user_data' => $user_data, > '/openstack/content/0000' => $network_data, > - '/openstack/latest/meta_data.json' => $meta_data > + '/openstack/latest/meta_data.json' => $meta_data, > + '/openstack/latest/vendor_data.json' => $vendor_data > }; > commit_cloudinit_disk($conf, $vmid, $drive, $volname, $storeid, $files, 'config-2'); > } > @@ -493,7 +494,7 @@ sub nocloud_gen_metadata { > sub generate_nocloud { > my ($conf, $vmid, $drive, $volname, $storeid) = @_; > > - my ($user_data, $network_data, $meta_data) = get_custom_cloudinit_files($conf); > + my ($user_data, $network_data, $meta_data, $vendor_data) = get_custom_cloudinit_files($conf); > $user_data = cloudinit_userdata($conf, $vmid) if !defined($user_data); > $network_data = nocloud_network($conf) if !defined($network_data); > > @@ -504,7 +505,8 @@ sub generate_nocloud { > my $files = { > '/user-data' => $user_data, > '/network-config' => $network_data, > - '/meta-data' => $meta_data > + '/meta-data' => $meta_data, > + '/vendor-data' => $vendor_data > }; > commit_cloudinit_disk($conf, $vmid, $drive, $volname, $storeid, $files, 'cidata'); > } > @@ -518,6 +520,7 @@ sub get_custom_cloudinit_files { > my $network_volid = $files->{network}; > my $user_volid = $files->{user}; > my $meta_volid = $files->{meta}; > + my $vendor_volid = $files->{vendor}; > > my $storage_conf = PVE::Storage::config(); > > @@ -536,7 +539,12 @@ sub get_custom_cloudinit_files { > $meta_data = read_cloudinit_snippets_file($storage_conf, $meta_volid); > } > > - return ($user_data, $network_data, $meta_data); > + my $vendor_data; > + if ($vendor_volid) { > + $vendor_data = read_cloudinit_snippets_file($storage_conf, $vendor_volid); > + } > + > + return ($user_data, $network_data, $meta_data, $vendor_data); > } > > sub read_cloudinit_snippets_file { [0] https://lists.proxmox.com/pipermail/pve-devel/2021-June/049025.html