public inbox for pve-devel@lists.proxmox.com
 help / color / mirror / Atom feed
From: Fiona Ebner <f.ebner@proxmox.com>
To: pve-devel@lists.proxmox.com
Subject: [pve-devel] [PATCH-SERIES common/qemu-server v2 00/32] preparation for switch to blockdev
Date: Wed, 18 Jun 2025 15:01:37 +0200	[thread overview]
Message-ID: <20250618130209.90649-1-f.ebner@proxmox.com> (raw)

Changes in v2 (I hope I remembered everything, because of the
indentation changes, I couldn't use my usual git range-diff O:)):

* Rebase + tidy all patches (this is not noted on individual patches).
* Indicate that version guards are for the switch to -blockdev via
  comments.
* Fix deleting throttle group, ID string was wrongly quoted.
* For backup restore, only skip dropped keys when parsing drive
  property string, rather than allowing all additional properties.
* Order Perl file names in Makefile.
* Add patch to drop superfluous fallack for migration type.
* For templates, keep using minimized config for timeout calculation.
* Also support unix socket NBD paths.
* Coerce some more strings by quoting for JSON, just to be sure.
* Introduce json_bool() helper.
The following (i.e. patches 19/32 to 24/32) are orthogonal:
* Add patches for PCI module improvements.
* Never reserve PCI usage for 'qm showcmd', add dedicated test for
  checking that reservation is respected.

This is a preparatory series for the switch to -blockdev with Proxmox
VE 9, QEMU machine version 10.0, based in part on Alexandre's series
here [0].

While the last patch actually does the switch, many operations are not
yet supported. It is included to show what changes I made there. It
should not yet be applied and supporting everything is the goal for a
following series based on the rest of Alexandre's patches. It was time
to send this however, as it's already gotten large enough (but most
patches are quite small, so don't worry reviewers ;)).

There are mostly cleanups, moving and defining helpers, as well as
doing non-intrusive preparation for the switch with machine version
10.0. Quite a large chunk of the series is for having
activate_volumes() be called before config_to_command() with proper
cleanup handling.

A breaking change is the removal of the gone-since-QEMU-3.1 drive
geometry options. It was not possible to even start or backup a VM
with those options set since then. Still, restore of old backups with
such an option is made explicitly supported.

NOTE: Dependency bump qemu-server -> libpve-common-perl needed.

[0]: https://lore.proxmox.com/pve-devel/mailman.347.1749728041.395.pve-devel@lists.proxmox.com/T/


common:

Fiona Ebner (2):
  schema: parse property string: support skipping keys
  json schema: add helper to convert to JSON boolean

 src/PVE/JSONSchema.pm | 11 ++++++++++-
 1 file changed, 10 insertions(+), 1 deletion(-)


qemu-server:

Alexandre Derumier via pve-devel (1):
  vm devices list: prepare querying block device names for -blockdev

Fiona Ebner (29):
  buildsys: order Perl source files in QemuServer/Makefile
  drive: code cleanup: drop unused $vmid parameter from
    get_path_and_format()
  cfg2cmd: require at least QEMU binary version 6.0
  drive: parse: use hash argument for optional parameters
  drive: parse: properly handle dropped properties for restore
  drive: remove geometry options gone since QEMU 3.1
  clone disk: io uring check: fix call to determine cache direct
  drive: move storage_allows_io_uring_default() and
    drive_uses_cache_direct() helpers to drive module
  drive: introduce aio_cmdline_option() helper
  drive: introduce detect_zeroes_cmdline_option() helper
  vm start: assert that migration type is set for 'tcp' migration
  introduce StateFile module for state file related helpers
  vm start: move state file handling to dedicated module
  vm start: move config_to_command() call further down
  vm start/commandline: also clean up pci reservation when
    config_to_command() fails
  vm start/commandline: activate volumes before config_to_command()
  pci: add missing includes
  test: add tests for PCI reservations
  cfg2cmd: print vga: fix call to print_pcie_addr()
  pci: code cleanup: remove superfluous machine type paramater from
    print_pci_addr
  cfg2cmd: collect optional parameters as a hash
  qm: showcmd: never reserve PCI devices
  print drive device: explicitly set write-cache starting with machine
    version 10.0
  print drive device: set {r,w}error front-end properties starting with
    machine version 10.0
  print drive device: don't reference any drive for 'none' starting with
    machine version 10.0
  drive: create a throttle group for each drive starting with machine
    version 10.0
  blockdev: add helpers to generate blockdev commandline
  blockdev: add support for NBD paths
  command line: switch to blockdev starting with machine version 10.0

 src/PVE/API2/Qemu.pm                          |  15 +-
 src/PVE/QemuServer.pm                         | 605 +++++++++---------
 src/PVE/QemuServer/Blockdev.pm                | 234 +++++++
 src/PVE/QemuServer/Drive.pm                   | 108 +++-
 src/PVE/QemuServer/Makefile                   |  26 +-
 src/PVE/QemuServer/PCI.pm                     |  30 +-
 src/PVE/QemuServer/RNG.pm                     |   4 +-
 src/PVE/QemuServer/StateFile.pm               |  79 +++
 src/PVE/QemuServer/USB.pm                     |   8 +-
 src/test/Makefile                             |   5 +-
 src/test/cfg2cmd/aio.conf.cmd                 |  16 +-
 src/test/cfg2cmd/old-qemu.conf                |   4 +-
 .../q35-linux-hostpci-mapping.conf.cmd        |   2 +-
 src/test/run_config2command_tests.pl          |  24 +-
 src/test/run_pci_reservation_tests.pl         | 175 +++++
 15 files changed, 950 insertions(+), 385 deletions(-)
 create mode 100644 src/PVE/QemuServer/Blockdev.pm
 create mode 100644 src/PVE/QemuServer/StateFile.pm
 create mode 100755 src/test/run_pci_reservation_tests.pl


Summary over all repositories:
  16 files changed, 960 insertions(+), 386 deletions(-)

-- 
Generated by git-murpp 0.5.0


_______________________________________________
pve-devel mailing list
pve-devel@lists.proxmox.com
https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-devel


             reply	other threads:[~2025-06-18 13:04 UTC|newest]

Thread overview: 42+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2025-06-18 13:01 Fiona Ebner [this message]
2025-06-18 13:01 ` [pve-devel] [PATCH common v2 01/32] schema: parse property string: support skipping keys Fiona Ebner
2025-06-20 11:00   ` Fabian Grünbichler
2025-06-18 13:01 ` [pve-devel] [PATCH common v2 02/32] json schema: add helper to convert to JSON boolean Fiona Ebner
2025-06-18 13:01 ` [pve-devel] [PATCH qemu-server v2 03/32] buildsys: order Perl source files in QemuServer/Makefile Fiona Ebner
2025-06-18 13:01 ` [pve-devel] [PATCH qemu-server v2 04/32] drive: code cleanup: drop unused $vmid parameter from get_path_and_format() Fiona Ebner
2025-06-18 13:01 ` [pve-devel] [PATCH qemu-server v2 05/32] cfg2cmd: require at least QEMU binary version 6.0 Fiona Ebner
2025-06-18 13:01 ` [pve-devel] [PATCH qemu-server v2 06/32] drive: parse: use hash argument for optional parameters Fiona Ebner
2025-06-18 13:01 ` [pve-devel] [PATCH qemu-server v2 07/32] drive: parse: properly handle dropped properties for restore Fiona Ebner
2025-06-18 13:01 ` [pve-devel] [PATCH qemu-server v2 08/32] drive: remove geometry options gone since QEMU 3.1 Fiona Ebner
2025-06-20 11:03   ` Fabian Grünbichler
2025-06-20 11:20     ` Fiona Ebner
2025-06-18 13:01 ` [pve-devel] [PATCH qemu-server v2 09/32] clone disk: io uring check: fix call to determine cache direct Fiona Ebner
2025-06-18 13:01 ` [pve-devel] [PATCH qemu-server v2 10/32] drive: move storage_allows_io_uring_default() and drive_uses_cache_direct() helpers to drive module Fiona Ebner
2025-06-18 13:01 ` [pve-devel] [PATCH qemu-server v2 11/32] drive: introduce aio_cmdline_option() helper Fiona Ebner
2025-06-18 13:01 ` [pve-devel] [PATCH qemu-server v2 12/32] drive: introduce detect_zeroes_cmdline_option() helper Fiona Ebner
2025-06-18 13:01 ` [pve-devel] [PATCH qemu-server v2 13/32] vm start: assert that migration type is set for 'tcp' migration Fiona Ebner
2025-06-18 13:01 ` [pve-devel] [PATCH qemu-server v2 14/32] introduce StateFile module for state file related helpers Fiona Ebner
2025-06-18 13:01 ` [pve-devel] [PATCH qemu-server v2 15/32] vm start: move state file handling to dedicated module Fiona Ebner
2025-06-18 13:01 ` [pve-devel] [PATCH qemu-server v2 16/32] vm start: move config_to_command() call further down Fiona Ebner
2025-06-18 13:01 ` [pve-devel] [PATCH qemu-server v2 17/32] vm start/commandline: also clean up pci reservation when config_to_command() fails Fiona Ebner
2025-06-18 13:01 ` [pve-devel] [PATCH qemu-server v2 18/32] vm start/commandline: activate volumes before config_to_command() Fiona Ebner
2025-06-20 11:33   ` Fabian Grünbichler
2025-06-18 13:01 ` [pve-devel] [PATCH qemu-server v2 19/32] pci: add missing includes Fiona Ebner
2025-06-18 13:01 ` [pve-devel] [PATCH qemu-server v2 20/32] test: add tests for PCI reservations Fiona Ebner
2025-06-18 13:01 ` [pve-devel] [PATCH qemu-server v2 21/32] cfg2cmd: print vga: fix call to print_pcie_addr() Fiona Ebner
2025-06-18 13:01 ` [pve-devel] [PATCH qemu-server v2 22/32] pci: code cleanup: remove superfluous machine type paramater from print_pci_addr Fiona Ebner
2025-06-18 15:19   ` Fiona Ebner
2025-06-18 13:02 ` [pve-devel] [PATCH qemu-server v2 23/32] cfg2cmd: collect optional parameters as a hash Fiona Ebner
2025-06-18 13:02 ` [pve-devel] [PATCH qemu-server v2 24/32] qm: showcmd: never reserve PCI devices Fiona Ebner
2025-06-18 13:02 ` [pve-devel] [PATCH qemu-server v2 25/32] vm devices list: prepare querying block device names for -blockdev Fiona Ebner
2025-06-18 13:02 ` [pve-devel] [PATCH qemu-server v2 26/32] print drive device: explicitly set write-cache starting with machine version 10.0 Fiona Ebner
2025-06-18 13:02 ` [pve-devel] [PATCH qemu-server v2 27/32] print drive device: set {r, w}error front-end properties " Fiona Ebner
2025-06-18 13:02 ` [pve-devel] [PATCH qemu-server v2 28/32] print drive device: don't reference any drive for 'none' " Fiona Ebner
2025-06-18 13:02 ` [pve-devel] [PATCH qemu-server v2 29/32] drive: create a throttle group for each drive " Fiona Ebner
2025-06-18 13:02 ` [pve-devel] [PATCH qemu-server v2 30/32] blockdev: add helpers to generate blockdev commandline Fiona Ebner
2025-06-18 13:02 ` [pve-devel] [RFC qemu-server v2 31/32] blockdev: add support for NBD paths Fiona Ebner
2025-06-18 13:02 ` [pve-devel] [RFC qemu-server v2 32/32] command line: switch to blockdev starting with machine version 10.0 Fiona Ebner
2025-06-23  9:12   ` DERUMIER, Alexandre via pve-devel
2025-06-23  9:31     ` Fiona Ebner
2025-06-23 13:06       ` DERUMIER, Alexandre via pve-devel
2025-06-20 13:03 ` [pve-devel] partially-applied: [PATCH-SERIES common/qemu-server v2 00/32] preparation for switch to blockdev Fabian Grünbichler

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20250618130209.90649-1-f.ebner@proxmox.com \
    --to=f.ebner@proxmox.com \
    --cc=pve-devel@lists.proxmox.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox
Service provided by Proxmox Server Solutions GmbH | Privacy | Legal