From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from firstgate.proxmox.com (firstgate.proxmox.com [212.224.123.68]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits)) (No client certificate requested) by lists.proxmox.com (Postfix) with ESMTPS id B8A8860E1B for ; Thu, 3 Feb 2022 13:42:22 +0100 (CET) Received: from firstgate.proxmox.com (localhost [127.0.0.1]) by firstgate.proxmox.com (Proxmox) with ESMTP id AA27426630 for ; Thu, 3 Feb 2022 13:41:52 +0100 (CET) Received: from proxmox-new.maurer-it.com (proxmox-new.maurer-it.com [94.136.29.106]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by firstgate.proxmox.com (Proxmox) with ESMTPS id 7C1E926625 for ; Thu, 3 Feb 2022 13:41:51 +0100 (CET) Received: from proxmox-new.maurer-it.com (localhost.localdomain [127.0.0.1]) by proxmox-new.maurer-it.com (Proxmox) with ESMTP id 53A5B44857 for ; Thu, 3 Feb 2022 13:41:51 +0100 (CET) From: =?UTF-8?q?Fabian=20Gr=C3=BCnbichler?= To: pve-devel@lists.proxmox.com Date: Thu, 3 Feb 2022 13:41:21 +0100 Message-Id: <20220203124143.1931377-1-f.gruenbichler@proxmox.com> X-Mailer: git-send-email 2.30.2 MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit X-SPAM-LEVEL: Spam detection results: 0 AWL 0.217 Adjusted score from AWL reputation of From: address BAYES_00 -1.9 Bayes spam probability is 0 to 1% KAM_DMARC_STATUS 0.01 Test Rule for DKIM or SPF Failure with Strict Alignment SPF_HELO_NONE 0.001 SPF: HELO does not publish an SPF Record SPF_PASS -0.001 SPF: sender matches SPF record T_SCC_BODY_TEXT_LINE -0.01 - Subject: [pve-devel] [PATCH v4 guest-common 0/22] remote migration X-BeenThere: pve-devel@lists.proxmox.com X-Mailman-Version: 2.1.29 Precedence: list List-Id: Proxmox VE development discussion List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 03 Feb 2022 12:42:22 -0000 this series adds remote migration for VMs. both live and offline migration including NBD and storage-migrated disks should work. groundwork for extending to pve-container and pvesr already laid. new in v4: lots of small fixes, improved bwlimit handling, `qm` command (thanks Fabian Ebner and Dominik Csapak for the feedback on v3!) new in v3: lots of refactoring and edge-case handling new in v2: dropped parts already applied, incorporated Fabian's and Dominik's feedback (thanks!) new in v1: explicit remote endpoint specified as part of API call instead of remote.cfg overview over affected repos and changes, see individual patches for more details. proxmox-websocket-tunnel: new tunnel helper tool for forwarding commands and data over websocket connections, required by pve-guest-common on source side pve-guest-common: new/refactored generic WS/SSH tunnel fork/read/.. helpers new storage migration over WS tunnel helpers pve-storage: refactor storage_migrate to make code-reuse possible qemu-server: some refactoring, new mtunnel endpoints, new remote_migration endpoints, new `qm` command TODO: handle pending changes and snapshots TODO: improve handling of C^c TODO: strict parser for FW config as well? as usual, some of the patches are best viewed with '-w', especially in qemu-server.. required dependencies are noted, patch overview follows.. pve-guest-common: migrate: handle migration_network with remote migration add tunnel helper module add storage tunnel module proxmox-websocket-tunnel: initial commit add tunnel implementation add fingerprint validation add packaging qemu-server: refactor map_storage to map_id schema: use pve-bridge-id parse_config: optional strict mode update_vm: allow simultaneous setting of boot-order and dev nbd alloc helper: allow passing in explicit format migrate: move tunnel-helpers to pve-guest-common mtunnel: add API endpoints migrate: refactor remote VM/tunnel start migrate: add remote migration handling api: add remote migrate endpoint qm: add remote_migrate command pve-storage: volname_for_storage: parse volname before calling storage_migrate: pull out snapshot decision storage_migrate: pull out import/export_prepare add volume_import/export_start helpers