all lists on lists.proxmox.com
 help / color / mirror / Atom feed
From: "Fabian Grünbichler" <f.gruenbichler@proxmox.com>
To: Proxmox VE development discussion <pve-devel@lists.proxmox.com>
Subject: [pve-devel] partially-applied: [PATCH-SERIES common/qemu-server v2 00/32] preparation for switch to blockdev
Date: Fri, 20 Jun 2025 15:03:52 +0200	[thread overview]
Message-ID: <1750424504.srziah3ia8.astroid@yuna.none> (raw)
In-Reply-To: <20250618130209.90649-1-f.ebner@proxmox.com>


applied most of the patches, except for 6, 28/29 and 31/32.

6 is dropped altogether, the other 4 can be included in the switch to
blockdev to avoid affecting the block graph before that happens.

folded in a small fixup for 7/8, and committed the changed expected
output for tests.

thanks a lot for driving this forward!

On June 18, 2025 3:01 pm, Fiona Ebner wrote:
> Changes in v2 (I hope I remembered everything, because of the
> indentation changes, I couldn't use my usual git range-diff O:)):
> 
> * Rebase + tidy all patches (this is not noted on individual patches).
> * Indicate that version guards are for the switch to -blockdev via
>   comments.
> * Fix deleting throttle group, ID string was wrongly quoted.
> * For backup restore, only skip dropped keys when parsing drive
>   property string, rather than allowing all additional properties.
> * Order Perl file names in Makefile.
> * Add patch to drop superfluous fallack for migration type.
> * For templates, keep using minimized config for timeout calculation.
> * Also support unix socket NBD paths.
> * Coerce some more strings by quoting for JSON, just to be sure.
> * Introduce json_bool() helper.
> The following (i.e. patches 19/32 to 24/32) are orthogonal:
> * Add patches for PCI module improvements.
> * Never reserve PCI usage for 'qm showcmd', add dedicated test for
>   checking that reservation is respected.
> 
> This is a preparatory series for the switch to -blockdev with Proxmox
> VE 9, QEMU machine version 10.0, based in part on Alexandre's series
> here [0].
> 
> While the last patch actually does the switch, many operations are not
> yet supported. It is included to show what changes I made there. It
> should not yet be applied and supporting everything is the goal for a
> following series based on the rest of Alexandre's patches. It was time
> to send this however, as it's already gotten large enough (but most
> patches are quite small, so don't worry reviewers ;)).
> 
> There are mostly cleanups, moving and defining helpers, as well as
> doing non-intrusive preparation for the switch with machine version
> 10.0. Quite a large chunk of the series is for having
> activate_volumes() be called before config_to_command() with proper
> cleanup handling.
> 
> A breaking change is the removal of the gone-since-QEMU-3.1 drive
> geometry options. It was not possible to even start or backup a VM
> with those options set since then. Still, restore of old backups with
> such an option is made explicitly supported.
> 
> NOTE: Dependency bump qemu-server -> libpve-common-perl needed.
> 
> [0]: https://lore.proxmox.com/pve-devel/mailman.347.1749728041.395.pve-devel@lists.proxmox.com/T/
> 
> 
> common:
> 
> Fiona Ebner (2):
>   schema: parse property string: support skipping keys
>   json schema: add helper to convert to JSON boolean
> 
>  src/PVE/JSONSchema.pm | 11 ++++++++++-
>  1 file changed, 10 insertions(+), 1 deletion(-)
> 
> 
> qemu-server:
> 
> Alexandre Derumier via pve-devel (1):
>   vm devices list: prepare querying block device names for -blockdev
> 
> Fiona Ebner (29):
>   buildsys: order Perl source files in QemuServer/Makefile
>   drive: code cleanup: drop unused $vmid parameter from
>     get_path_and_format()
>   cfg2cmd: require at least QEMU binary version 6.0
>   drive: parse: use hash argument for optional parameters
>   drive: parse: properly handle dropped properties for restore
>   drive: remove geometry options gone since QEMU 3.1
>   clone disk: io uring check: fix call to determine cache direct
>   drive: move storage_allows_io_uring_default() and
>     drive_uses_cache_direct() helpers to drive module
>   drive: introduce aio_cmdline_option() helper
>   drive: introduce detect_zeroes_cmdline_option() helper
>   vm start: assert that migration type is set for 'tcp' migration
>   introduce StateFile module for state file related helpers
>   vm start: move state file handling to dedicated module
>   vm start: move config_to_command() call further down
>   vm start/commandline: also clean up pci reservation when
>     config_to_command() fails
>   vm start/commandline: activate volumes before config_to_command()
>   pci: add missing includes
>   test: add tests for PCI reservations
>   cfg2cmd: print vga: fix call to print_pcie_addr()
>   pci: code cleanup: remove superfluous machine type paramater from
>     print_pci_addr
>   cfg2cmd: collect optional parameters as a hash
>   qm: showcmd: never reserve PCI devices
>   print drive device: explicitly set write-cache starting with machine
>     version 10.0
>   print drive device: set {r,w}error front-end properties starting with
>     machine version 10.0
>   print drive device: don't reference any drive for 'none' starting with
>     machine version 10.0
>   drive: create a throttle group for each drive starting with machine
>     version 10.0
>   blockdev: add helpers to generate blockdev commandline
>   blockdev: add support for NBD paths
>   command line: switch to blockdev starting with machine version 10.0
> 
>  src/PVE/API2/Qemu.pm                          |  15 +-
>  src/PVE/QemuServer.pm                         | 605 +++++++++---------
>  src/PVE/QemuServer/Blockdev.pm                | 234 +++++++
>  src/PVE/QemuServer/Drive.pm                   | 108 +++-
>  src/PVE/QemuServer/Makefile                   |  26 +-
>  src/PVE/QemuServer/PCI.pm                     |  30 +-
>  src/PVE/QemuServer/RNG.pm                     |   4 +-
>  src/PVE/QemuServer/StateFile.pm               |  79 +++
>  src/PVE/QemuServer/USB.pm                     |   8 +-
>  src/test/Makefile                             |   5 +-
>  src/test/cfg2cmd/aio.conf.cmd                 |  16 +-
>  src/test/cfg2cmd/old-qemu.conf                |   4 +-
>  .../q35-linux-hostpci-mapping.conf.cmd        |   2 +-
>  src/test/run_config2command_tests.pl          |  24 +-
>  src/test/run_pci_reservation_tests.pl         | 175 +++++
>  15 files changed, 950 insertions(+), 385 deletions(-)
>  create mode 100644 src/PVE/QemuServer/Blockdev.pm
>  create mode 100644 src/PVE/QemuServer/StateFile.pm
>  create mode 100755 src/test/run_pci_reservation_tests.pl
> 
> 
> Summary over all repositories:
>   16 files changed, 960 insertions(+), 386 deletions(-)
> 
> -- 
> Generated by git-murpp 0.5.0
> 
> 
> _______________________________________________
> pve-devel mailing list
> pve-devel@lists.proxmox.com
> https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-devel
> 
> 
> 


_______________________________________________
pve-devel mailing list
pve-devel@lists.proxmox.com
https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-devel


      parent reply	other threads:[~2025-06-20 13:04 UTC|newest]

Thread overview: 42+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2025-06-18 13:01 [pve-devel] " Fiona Ebner
2025-06-18 13:01 ` [pve-devel] [PATCH common v2 01/32] schema: parse property string: support skipping keys Fiona Ebner
2025-06-20 11:00   ` Fabian Grünbichler
2025-06-18 13:01 ` [pve-devel] [PATCH common v2 02/32] json schema: add helper to convert to JSON boolean Fiona Ebner
2025-06-18 13:01 ` [pve-devel] [PATCH qemu-server v2 03/32] buildsys: order Perl source files in QemuServer/Makefile Fiona Ebner
2025-06-18 13:01 ` [pve-devel] [PATCH qemu-server v2 04/32] drive: code cleanup: drop unused $vmid parameter from get_path_and_format() Fiona Ebner
2025-06-18 13:01 ` [pve-devel] [PATCH qemu-server v2 05/32] cfg2cmd: require at least QEMU binary version 6.0 Fiona Ebner
2025-06-18 13:01 ` [pve-devel] [PATCH qemu-server v2 06/32] drive: parse: use hash argument for optional parameters Fiona Ebner
2025-06-18 13:01 ` [pve-devel] [PATCH qemu-server v2 07/32] drive: parse: properly handle dropped properties for restore Fiona Ebner
2025-06-18 13:01 ` [pve-devel] [PATCH qemu-server v2 08/32] drive: remove geometry options gone since QEMU 3.1 Fiona Ebner
2025-06-20 11:03   ` Fabian Grünbichler
2025-06-20 11:20     ` Fiona Ebner
2025-06-18 13:01 ` [pve-devel] [PATCH qemu-server v2 09/32] clone disk: io uring check: fix call to determine cache direct Fiona Ebner
2025-06-18 13:01 ` [pve-devel] [PATCH qemu-server v2 10/32] drive: move storage_allows_io_uring_default() and drive_uses_cache_direct() helpers to drive module Fiona Ebner
2025-06-18 13:01 ` [pve-devel] [PATCH qemu-server v2 11/32] drive: introduce aio_cmdline_option() helper Fiona Ebner
2025-06-18 13:01 ` [pve-devel] [PATCH qemu-server v2 12/32] drive: introduce detect_zeroes_cmdline_option() helper Fiona Ebner
2025-06-18 13:01 ` [pve-devel] [PATCH qemu-server v2 13/32] vm start: assert that migration type is set for 'tcp' migration Fiona Ebner
2025-06-18 13:01 ` [pve-devel] [PATCH qemu-server v2 14/32] introduce StateFile module for state file related helpers Fiona Ebner
2025-06-18 13:01 ` [pve-devel] [PATCH qemu-server v2 15/32] vm start: move state file handling to dedicated module Fiona Ebner
2025-06-18 13:01 ` [pve-devel] [PATCH qemu-server v2 16/32] vm start: move config_to_command() call further down Fiona Ebner
2025-06-18 13:01 ` [pve-devel] [PATCH qemu-server v2 17/32] vm start/commandline: also clean up pci reservation when config_to_command() fails Fiona Ebner
2025-06-18 13:01 ` [pve-devel] [PATCH qemu-server v2 18/32] vm start/commandline: activate volumes before config_to_command() Fiona Ebner
2025-06-20 11:33   ` Fabian Grünbichler
2025-06-18 13:01 ` [pve-devel] [PATCH qemu-server v2 19/32] pci: add missing includes Fiona Ebner
2025-06-18 13:01 ` [pve-devel] [PATCH qemu-server v2 20/32] test: add tests for PCI reservations Fiona Ebner
2025-06-18 13:01 ` [pve-devel] [PATCH qemu-server v2 21/32] cfg2cmd: print vga: fix call to print_pcie_addr() Fiona Ebner
2025-06-18 13:01 ` [pve-devel] [PATCH qemu-server v2 22/32] pci: code cleanup: remove superfluous machine type paramater from print_pci_addr Fiona Ebner
2025-06-18 15:19   ` Fiona Ebner
2025-06-18 13:02 ` [pve-devel] [PATCH qemu-server v2 23/32] cfg2cmd: collect optional parameters as a hash Fiona Ebner
2025-06-18 13:02 ` [pve-devel] [PATCH qemu-server v2 24/32] qm: showcmd: never reserve PCI devices Fiona Ebner
2025-06-18 13:02 ` [pve-devel] [PATCH qemu-server v2 25/32] vm devices list: prepare querying block device names for -blockdev Fiona Ebner
2025-06-18 13:02 ` [pve-devel] [PATCH qemu-server v2 26/32] print drive device: explicitly set write-cache starting with machine version 10.0 Fiona Ebner
2025-06-18 13:02 ` [pve-devel] [PATCH qemu-server v2 27/32] print drive device: set {r, w}error front-end properties " Fiona Ebner
2025-06-18 13:02 ` [pve-devel] [PATCH qemu-server v2 28/32] print drive device: don't reference any drive for 'none' " Fiona Ebner
2025-06-18 13:02 ` [pve-devel] [PATCH qemu-server v2 29/32] drive: create a throttle group for each drive " Fiona Ebner
2025-06-18 13:02 ` [pve-devel] [PATCH qemu-server v2 30/32] blockdev: add helpers to generate blockdev commandline Fiona Ebner
2025-06-18 13:02 ` [pve-devel] [RFC qemu-server v2 31/32] blockdev: add support for NBD paths Fiona Ebner
2025-06-18 13:02 ` [pve-devel] [RFC qemu-server v2 32/32] command line: switch to blockdev starting with machine version 10.0 Fiona Ebner
2025-06-23  9:12   ` DERUMIER, Alexandre via pve-devel
2025-06-23  9:31     ` Fiona Ebner
2025-06-23 13:06       ` DERUMIER, Alexandre via pve-devel
2025-06-20 13:03 ` Fabian Grünbichler [this message]

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=1750424504.srziah3ia8.astroid@yuna.none \
    --to=f.gruenbichler@proxmox.com \
    --cc=pve-devel@lists.proxmox.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.
Service provided by Proxmox Server Solutions GmbH | Privacy | Legal