From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from firstgate.proxmox.com (firstgate.proxmox.com [212.224.123.68]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits)) (No client certificate requested) by lists.proxmox.com (Postfix) with ESMTPS id 625DD7362D for ; Thu, 15 Apr 2021 16:05:39 +0200 (CEST) Received: from firstgate.proxmox.com (localhost [127.0.0.1]) by firstgate.proxmox.com (Proxmox) with ESMTP id 51B6B1AD3B for ; Thu, 15 Apr 2021 16:05:09 +0200 (CEST) Received: from mail-wm1-x335.google.com (mail-wm1-x335.google.com [IPv6:2a00:1450:4864:20::335]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by firstgate.proxmox.com (Proxmox) with ESMTPS id 7127B1AD31 for ; Thu, 15 Apr 2021 16:05:08 +0200 (CEST) Received: by mail-wm1-x335.google.com with SMTP id u20so8000756wmj.0 for ; Thu, 15 Apr 2021 07:05:08 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=odiso-com.20150623.gappssmtp.com; s=20150623; h=subject:to:references:from:message-id:date:user-agent:mime-version :in-reply-to:content-transfer-encoding:content-language; bh=GNOnRr7I0ZO5bZnmPucuP1xTq8rcqZ2UDpTfKDlMVOk=; b=NMGlWGNt/pwopXgh09Elv1J+fAbV6EOfESMp6xwEkcMCjnaZzuTLQ86x3yRA4RDset 6ZIc8jPGT/rhyQ6wXNoiCuyNps/3TZGER3fv97RBhH9T+iaw44Clo6450W4LwUKc95LI P7PdpPhT1Hm+v9v9dtG7nfFrZVcOpNhCI8ifvvz4UoPHd46woivG9ZyDoM32n/reXIOA wSQYRkCbZ8xJ8OLOjpkZTULhzTqouusKCf2cGvuw7meMZ44XKUIFyBU8gyVJ0LqXrkDL I6/Ktq8C+qt4rG5iFucDGSIzfFZR71PCgKSytVFM9PiyfHTguPbVQIkRsUz8GEzO39ol du5Q== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:to:references:from:message-id:date :user-agent:mime-version:in-reply-to:content-transfer-encoding :content-language; bh=GNOnRr7I0ZO5bZnmPucuP1xTq8rcqZ2UDpTfKDlMVOk=; b=nUf6VA2yYfS27BXChAEB4/rcwQYF/R7xcwhUtl/kiBh4SwNnMyCgr0gpF7eVIKYovO tYfgV00enHgQkKFF4sQgOKLYDzti3yOs84gmUhlHifDp5gfOqCxs2nUaOp0MIs2vYVOI c9PlzcXSBi4oYdkT1+PUk03qzdDVN1aiDUdBrq+kswAWCtxXxNbsM8OwXwsP80fe/z4m IoAtffVgDdm8a15w1n4xRjyBeKa+7LOfrXfCK7bTfUFFgspnp8pXuIjAoQDW5+i9mPBz TrRjkpiTEQdsL/FJe5muDPG6+3Tbu9kSDFrF1jlAtpywUkWEnw3ga48B9SR1j+UrRgPd 8SKA== X-Gm-Message-State: AOAM530V00fIK+GL5bKsBs7Xy+unuOM13ikyhZ9irX/kC4QvoZgPebSE aIbUZtdz4T+q1rY1ZMwuhAFeEXg3avzGpw== X-Google-Smtp-Source: ABdhPJw3bV4U2D+Uskutg7p/4MypBIE3ZhrfhgkmloV9o6RvLfwK9l1CwR9c0S3EMhQl9B6OcbZtlg== X-Received: by 2002:a05:600c:35d2:: with SMTP id r18mr2714099wmq.29.1618495500860; Thu, 15 Apr 2021 07:05:00 -0700 (PDT) Received: from [192.168.178.50] ([79.132.252.54]) by smtp.gmail.com with ESMTPSA id r8sm3533069wrp.34.2021.04.15.07.05.00 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Thu, 15 Apr 2021 07:05:00 -0700 (PDT) To: Proxmox VE development discussion , =?UTF-8?Q?Fabian_Gr=c3=bcnbichler?= References: <20210413121640.3602975-1-f.gruenbichler@proxmox.com> From: alexandre derumier Message-ID: Date: Thu, 15 Apr 2021 16:04:56 +0200 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:78.0) Gecko/20100101 Thunderbird/78.9.0 MIME-Version: 1.0 In-Reply-To: <20210413121640.3602975-1-f.gruenbichler@proxmox.com> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit Content-Language: en-US X-SPAM-LEVEL: Spam detection results: 0 AWL 0.134 Adjusted score from AWL reputation of From: address DKIM_SIGNED 0.1 Message has a DKIM or DK signature, not necessarily valid DKIM_VALID -0.1 Message has at least one valid DKIM or DK signature NICE_REPLY_A -0.001 Looks like a legit reply (A) RCVD_IN_DNSWL_NONE -0.0001 Sender listed at https://www.dnswl.org/, no trust SPF_HELO_NONE 0.001 SPF: HELO does not publish an SPF Record SPF_PASS -0.001 SPF: sender matches SPF record URIBL_BLOCKED 0.001 ADMINISTRATOR NOTICE: The query to URIBL was blocked. See http://wiki.apache.org/spamassassin/DnsBlocklists#dnsbl-block for more information. [proxmox.com] Subject: Re: [pve-devel] [RFC qemu-server++ 0/22] remote migration X-BeenThere: pve-devel@lists.proxmox.com X-Mailman-Version: 2.1.29 Precedence: list List-Id: Proxmox VE development discussion List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 15 Apr 2021 14:05:39 -0000 Hi, thanks for working on this ! I'll be able to test it soon as I'll need to migrate 200-300 vms between 2 datacenter soon. I think it could be great to add optionnal "tag" option to targetbridge, as it could be different on target cluster. Also, we should transfert vm firewall config. On 13/04/2021 14:16, Fabian Grünbichler wrote: > this series adds remote migration for VMs. there's still plenty of > TODOs/FIXMEs/stuff that requires discussion, hence the RFC. live > migration with NBD and storage-migrated disks should work already. > > the performance bottle neck (~190MB/s on loopback) for the websocket > connection seems to be in pveproxy at the moment - the rust code should > manage about 700MB/s. > > overview over affected repos and changes, see individual patches for > more details. > > proxmox: > > some compatible changes to make websocket code usable for client-side > connections, required by proxmox-websocket-tunnel > > proxmox-websocket-tunnel: > > new tunnel helper tool for forwarding commands and data over websocket > connections, required by qemu-server on source side > TODO: better error handling > TODO: fingerprint checking/valid certs/.. > TODO: WS key generation > TODO: decide on mask? > TODO: investigate performance bottlenecks once PVE api server gets > faster > > pve-access-control: > > new ticket type, required by qemu-server on target side > > pve-cluster: > > new remote.cfg and related helpers, required by qemu-server on source > side > TODO: ACLs, CLI, API for managing config > TODO: handling of discovered nodes with valid certificates > TODO: add additional information like default bwlimits, storage/bridge > mappings > > pve-common: > > bridgepair format akin to storage pair, pve-bridge-id option, required > by qemu-server > TODO: adapt pve-container > > pve-guest-common: > > handle remote migration (no SSH) in AbstractMigrate, > required by qemu-server > > pve-manager: > > new 'addr' endpoint for retrieving remote node IPs, required on target > node > > pve-storage: > > extend 'pvesm import' to allow import from UNIX socket, required on > target node by qemu-server > > qemu-server: > > some refactoring, new mtunnel endpoints, new remote_migration endpoints > TODO: check remote ACLs > TODO: handle pending changes and snapshots > TODO: CLI for remote migration > potential TODO: expose remote info via additional endpoints (resources? vmids? > permissions? ...) > > as usual, some of the patches are best viewed with '-w', especially in > qemu-server.. > > > _______________________________________________ > pve-devel mailing list > pve-devel@lists.proxmox.com > https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-devel >