From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: <pve-devel-bounces@lists.proxmox.com> Received: from firstgate.proxmox.com (firstgate.proxmox.com [IPv6:2a01:7e0:0:424::9]) by lore.proxmox.com (Postfix) with ESMTPS id 0065A1FF173 for <inbox@lore.proxmox.com>; Mon, 27 Jan 2025 12:29:42 +0100 (CET) Received: from firstgate.proxmox.com (localhost [127.0.0.1]) by firstgate.proxmox.com (Proxmox) with ESMTP id CA7002846D; Mon, 27 Jan 2025 12:29:31 +0100 (CET) From: Fiona Ebner <f.ebner@proxmox.com> To: pve-devel@lists.proxmox.com Date: Mon, 27 Jan 2025 12:29:07 +0100 Message-Id: <20250127112923.31703-1-f.ebner@proxmox.com> X-Mailer: git-send-email 2.39.5 MIME-Version: 1.0 X-SPAM-LEVEL: Spam detection results: 0 AWL -0.045 Adjusted score from AWL reputation of From: address BAYES_00 -1.9 Bayes spam probability is 0 to 1% DMARC_MISSING 0.1 Missing DMARC policy KAM_DMARC_STATUS 0.01 Test Rule for DKIM or SPF Failure with Strict Alignment RCVD_IN_VALIDITY_CERTIFIED_BLOCKED 0.001 ADMINISTRATOR NOTICE: The query to Validity was blocked. See https://knowledge.validity.com/hc/en-us/articles/20961730681243 for more information. RCVD_IN_VALIDITY_RPBL_BLOCKED 0.001 ADMINISTRATOR NOTICE: The query to Validity was blocked. See https://knowledge.validity.com/hc/en-us/articles/20961730681243 for more information. RCVD_IN_VALIDITY_SAFE_BLOCKED 0.001 ADMINISTRATOR NOTICE: The query to Validity was blocked. See https://knowledge.validity.com/hc/en-us/articles/20961730681243 for more information. SPF_HELO_NONE 0.001 SPF: HELO does not publish an SPF Record SPF_PASS -0.001 SPF: sender matches SPF record T_SCC_BODY_TEXT_LINE -0.01 - Subject: [pve-devel] [PATCH-SERIES qemu-server v5 00/16] more robust handling of fleecing images X-BeenThere: pve-devel@lists.proxmox.com X-Mailman-Version: 2.1.29 Precedence: list List-Id: Proxmox VE development discussion <pve-devel.lists.proxmox.com> List-Unsubscribe: <https://lists.proxmox.com/cgi-bin/mailman/options/pve-devel>, <mailto:pve-devel-request@lists.proxmox.com?subject=unsubscribe> List-Archive: <http://lists.proxmox.com/pipermail/pve-devel/> List-Post: <mailto:pve-devel@lists.proxmox.com> List-Help: <mailto:pve-devel-request@lists.proxmox.com?subject=help> List-Subscribe: <https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-devel>, <mailto:pve-devel-request@lists.proxmox.com?subject=subscribe> Reply-To: Proxmox VE development discussion <pve-devel@lists.proxmox.com> Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Errors-To: pve-devel-bounces@lists.proxmox.com Sender: "pve-devel" <pve-devel-bounces@lists.proxmox.com> Changes in v5: * everything new in v5 except the last 3 patches * new approach, use special config section instead of config key * add tests and some fixes for configuration handling * make special section handling more generic * also check for and cancel left-over running backup job before detaching the fleecing images to prevent a deadlock in some scenarios Record the created fleecing images in the VM configuration to be able to remove left-overs after hard failures. Adds a new special configuration section 'fleecing', making special section handling more generic as preparation, as well as fixing some corner cases in configuration parsing and adding tests. Fiona Ebner (16): migration: remove unused variable test: avoid duplicate mock module in restore config test test: add parse config tests parse config: be precise about section type checks test: add test case exposing issue with unknown sections parse config: skip unknown sections and warn about their presence vzdump: anchor matches for pending and special sections vzdump: skip all special sections config: make special section handling generic test: parse config: test config with duplicate sections parse config: warn about duplicate sections check type: require schema as an argument config: add fleecing section fix #5440: vzdump: better cleanup fleecing images after hard errors migration: attempt to clean up potential left-over fleecing images destroy vm: clean up potential left-over fleecing images PVE/API2/Qemu.pm | 22 +- PVE/QemuConfig.pm | 84 +++++++- PVE/QemuMigrate.pm | 8 +- PVE/QemuServer.pm | 97 ++++++--- PVE/QemuServer/Cloudinit.pm | 8 +- PVE/VZDump/QemuServer.pm | 50 ++++- test/Makefile | 7 +- .../cloudinit-snapshot.conf | 40 ++++ .../cloudinit-snapshot.conf.strict.error | 1 + .../duplicate-sections.conf | 43 ++++ .../duplicate-sections.conf.strict.error | 1 + .../unknown-sections.conf | 44 ++++ .../unknown-sections.conf.strict.error | 1 + .../verify-snapshot.conf | 36 ++++ .../verify-snapshot.conf.strict.error | 1 + .../cloudinit-snapshot.conf | 41 ++++ .../duplicate-sections.conf | 68 +++++++ test/parse-config-input/fleecing-section.conf | 20 ++ test/parse-config-input/locked.conf | 16 ++ test/parse-config-input/plain.conf | 15 ++ test/parse-config-input/regular-vm-efi.conf | 16 ++ test/parse-config-input/sections.conf | 44 ++++ test/parse-config-input/snapshots.conf | 189 ++++++++++++++++++ test/parse-config-input/unknown-sections.conf | 57 ++++++ test/parse-config-input/verify-snapshot.conf | 37 ++++ test/run_parse_config_tests.pl | 92 +++++++++ test/run_qemu_restore_config_tests.pl | 12 +- 27 files changed, 992 insertions(+), 58 deletions(-) create mode 100644 test/parse-config-expected/cloudinit-snapshot.conf create mode 100644 test/parse-config-expected/cloudinit-snapshot.conf.strict.error create mode 100644 test/parse-config-expected/duplicate-sections.conf create mode 100644 test/parse-config-expected/duplicate-sections.conf.strict.error create mode 100644 test/parse-config-expected/unknown-sections.conf create mode 100644 test/parse-config-expected/unknown-sections.conf.strict.error create mode 100644 test/parse-config-expected/verify-snapshot.conf create mode 100644 test/parse-config-expected/verify-snapshot.conf.strict.error create mode 100644 test/parse-config-input/cloudinit-snapshot.conf create mode 100644 test/parse-config-input/duplicate-sections.conf create mode 100644 test/parse-config-input/fleecing-section.conf create mode 100644 test/parse-config-input/locked.conf create mode 100644 test/parse-config-input/plain.conf create mode 100644 test/parse-config-input/regular-vm-efi.conf create mode 100644 test/parse-config-input/sections.conf create mode 100644 test/parse-config-input/snapshots.conf create mode 100644 test/parse-config-input/unknown-sections.conf create mode 100644 test/parse-config-input/verify-snapshot.conf create mode 100755 test/run_parse_config_tests.pl -- 2.39.5 _______________________________________________ pve-devel mailing list pve-devel@lists.proxmox.com https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-devel