From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from firstgate.proxmox.com (firstgate.proxmox.com [212.224.123.68]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits)) (No client certificate requested) by lists.proxmox.com (Postfix) with ESMTPS id D213B743B1 for ; Mon, 21 Jun 2021 11:38:02 +0200 (CEST) Received: from firstgate.proxmox.com (localhost [127.0.0.1]) by firstgate.proxmox.com (Proxmox) with ESMTP id C257A1A86D for ; Mon, 21 Jun 2021 11:38:02 +0200 (CEST) Received: from proxmox-new.maurer-it.com (proxmox-new.maurer-it.com [94.136.29.106]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits)) (No client certificate requested) by firstgate.proxmox.com (Proxmox) with ESMTPS id EB6851A862 for ; Mon, 21 Jun 2021 11:38:01 +0200 (CEST) Received: from proxmox-new.maurer-it.com (localhost.localdomain [127.0.0.1]) by proxmox-new.maurer-it.com (Proxmox) with ESMTP id B755440A67 for ; Mon, 21 Jun 2021 11:38:01 +0200 (CEST) To: Thomas Lamprecht , Proxmox VE development discussion , Dominik Csapak References: <20210610073719.26504-1-d.csapak@proxmox.com> <7c83fc86-6c20-b9bd-e72b-b7d2d2a8c216@proxmox.com> <5c144071-bc03-3a27-3240-d2160dae60c4@proxmox.com> <6b5d8361-89fb-33e6-8c44-168fbace44e8@proxmox.com> From: Stefan Reiter Message-ID: <6cac5940-32e1-0982-2faf-ecb797066794@proxmox.com> Date: Mon, 21 Jun 2021 11:38:00 +0200 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:60.0) Gecko/20100101 Thunderbird/60.9.0 MIME-Version: 1.0 In-Reply-To: <6b5d8361-89fb-33e6-8c44-168fbace44e8@proxmox.com> Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 8bit X-SPAM-LEVEL: Spam detection results: 0 AWL 0.757 Adjusted score from AWL reputation of From: address BAYES_00 -1.9 Bayes spam probability is 0 to 1% KAM_DMARC_STATUS 0.01 Test Rule for DKIM or SPF Failure with Strict Alignment NICE_REPLY_A -0.001 Looks like a legit reply (A) SPF_HELO_NONE 0.001 SPF: HELO does not publish an SPF Record SPF_PASS -0.001 SPF: sender matches SPF record Subject: Re: [pve-devel] [PATCH manager] ui: file-restore: start the file-restore on the selected node X-BeenThere: pve-devel@lists.proxmox.com X-Mailman-Version: 2.1.29 Precedence: list List-Id: Proxmox VE development discussion List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 21 Jun 2021 09:38:02 -0000 On 6/18/21 5:17 PM, Thomas Lamprecht wrote: > On 10.06.21 13:28, Dominik Csapak wrote: >> On 6/10/21 11:29, Stefan Reiter wrote: >>> On 6/10/21 10:40 AM, Dominik Csapak wrote: >>>> On 6/10/21 10:23, Stefan Reiter wrote: >>>>> On 6/10/21 9:37 AM, Dominik Csapak wrote: >>>>>> and not the node where the browser connects. >>>>>> there are at least two good reasons for this: >>>>>> * it is confusing, since the user would expect it to start where >>>>>>    the ui is pointint to >>>>>> * the storage may not be available on the node the browser connects >>>>>>    to, but it must be available on the node selected in the ui >>>>>> >>>>>> Signed-off-by: Dominik Csapak  >>>>>> --- >>>>> >>>>> Does this work with the proxying code for downloading files? I believe my original reasoning behind this was because my implementation for quickly forwarding data between the unprivileged and privileged daemons uses a local Unix socket. Thus forwarding between nodes (as I understand this will do?) would be subject to caching the data at the node being contacted, before sending it to the browser. >>>> >>>> well it does work, since i sucessfully downloaded some files from a backup >>>> >>>> what exactly do you mean with >>>>  > would be subject to caching the data at the node being >>>>  > contacted, before sending it to the browser. >>>> >>> >>> Try downloading a larger file (multiple GB) - is it streamed directly to the browser or first transferred to node1 (from your example below), cached in memory there, and only once it's fully in RAM transferred to the client? I believe with this patch, the second variant will happen. >>> >>> This whole idea was the reason for these shenanigans: >>> https://git.proxmox.com/?p=pve-http-server.git;a=commitdiff;h=51841e98fa5d4ad4d5b5250523c45f88769c577f >>> >> >> from a short test it seem you're right >> (have a pveproxy worker that sits at 2GiB RES atm) >> >> but the solution here is probably to drop the 'proxyto' >> in the api call, and do the same as we do for >> vnc proxying? ssh tunnel and starting the file >> restore on the target node > > @Stefan Any feedback regarding that proposal (or alternative fix)? > > I mean, in the gui it may still make sense to use the local node if the storage is > available there, as it normally means less total traffic produced, but if it's not > configured as available there that's just not an option. > I talked with Dominik and we agreed that his idea is the right one. We left it at "one of us will implement it", since we deemed it not that big of an issue for right now, but I can take a look sooner as well if needed.