From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from firstgate.proxmox.com (firstgate.proxmox.com [212.224.123.68]) by lore.proxmox.com (Postfix) with ESMTPS id BC38B1FF183 for ; Wed, 16 Jul 2025 18:33:34 +0200 (CEST) Received: from firstgate.proxmox.com (localhost [127.0.0.1]) by firstgate.proxmox.com (Proxmox) with ESMTP id 37CFF17466; Wed, 16 Jul 2025 18:34:24 +0200 (CEST) To: pve-devel@lists.proxmox.com Date: Wed, 16 Jul 2025 18:34:05 +0200 MIME-Version: 1.0 Message-ID: List-Id: Proxmox VE development discussion List-Post: From: Alexandre Derumier via pve-devel Precedence: list Cc: Alexandre Derumier X-Mailman-Version: 2.1.29 X-BeenThere: pve-devel@lists.proxmox.com List-Subscribe: , List-Unsubscribe: , List-Archive: Reply-To: Proxmox VE development discussion List-Help: Subject: [pve-devel] [PATCH v2 qemu-server 00/10] convert drivedevice to json format && implement multiple iothreads Content-Type: multipart/mixed; boundary="===============0192979391586330649==" Errors-To: pve-devel-bounces@lists.proxmox.com Sender: "pve-devel" --===============0192979391586330649== Content-Type: message/rfc822 Content-Disposition: inline Return-Path: X-Original-To: pve-devel@lists.proxmox.com Delivered-To: pve-devel@lists.proxmox.com Received: from firstgate.proxmox.com (firstgate.proxmox.com [212.224.123.68]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits)) (No client certificate requested) by lists.proxmox.com (Postfix) with ESMTPS id 228B4C9126 for ; Wed, 16 Jul 2025 18:34:21 +0200 (CEST) Received: from firstgate.proxmox.com (localhost [127.0.0.1]) by firstgate.proxmox.com (Proxmox) with ESMTP id EEBA7173ED for ; Wed, 16 Jul 2025 18:34:20 +0200 (CEST) Received: from bastiontest.odiso.net (unknown [IPv6:2a0a:1580:2000:6700::14]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by firstgate.proxmox.com (Proxmox) with ESMTPS for ; Wed, 16 Jul 2025 18:34:19 +0200 (CEST) Received: from formationkvm1.odiso.net (unknown [10.11.201.57]) by bastiontest.odiso.net (Postfix) with ESMTP id EE43D860F13; Wed, 16 Jul 2025 18:34:17 +0200 (CEST) Received: by formationkvm1.odiso.net (Postfix, from userid 0) id DDF8C11F6B0C; Wed, 16 Jul 2025 18:34:17 +0200 (CEST) From: Alexandre Derumier To: pve-devel@lists.proxmox.com Subject: [PATCH v2 qemu-server 00/10] convert drivedevice to json format && implement multiple iothreads Date: Wed, 16 Jul 2025 18:34:05 +0200 Message-Id: <20250716163415.1837210-1-alexandre.derumier@groupe-cyllene.com> X-Mailer: git-send-email 2.39.5 MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-SPAM-LEVEL: Spam detection results: 0 AWL 0.158 Adjusted score from AWL reputation of From: address BAYES_00 -1.9 Bayes spam probability is 0 to 1% DMARC_NONE 0.1 DMARC none policy HEADER_FROM_DIFFERENT_DOMAINS 0.001 From and EnvelopeFrom 2nd level mail domains are different KAM_DMARC_NONE 0.25 DKIM has Failed or SPF has failed on the message and the domain has no DMARC policy KAM_DMARC_STATUS 0.01 Test Rule for DKIM or SPF Failure with Strict Alignment KAM_LAZY_DOMAIN_SECURITY 1 Sending domain does not have any anti-forgery methods RDNS_NONE 0.793 Delivered to internal network by a host with no rDNS SPF_HELO_NONE 0.001 SPF: HELO does not publish an SPF Record SPF_NONE 0.001 SPF: sender does not publish an SPF Record Hi, This patch serie apply on top of last fiona patch series. (not related to blockdev, so this can apply to any machine version) patch 1-3: add Drivedevice module and move current code patch 4-9: convert drive devices && iothreads to json format patch 10: implement multiple iothreads The json format is needed to be able to map a list of multiples iothreads for each disk. iothreads are defined globally in a static number at vm start. (no hotplug|unplug of iothreads here) iothreads are shared between all disks(where iothread is enabled), and could be pinned to specific host cores. (not implemented yet, as it need something more powerfull than current taskset,as ideally we want to pin iothreads on differents host cores than vm cpus pinning) Some redhat doc: https://developers.redhat.com/articles/2024/09/05/scaling-virtio-blk-disk-io-iothread-virtqueue-mapping https://vmsplice.net/~stefan/stefanha-kvm-forum-2024.pdf Changelog v2: - rebase on last git - tidy the patches Alexandre Derumier (10): introduce DriveDevice module add print_drivedevice_controller && print_drivedevice_iothread hotplug: drive controller : use print_drivedevice_iothread && print_drivedevice_controller pci: add get_pci_addr qmphelpers: add qmp_deviceadd && qmp_devicedel convert drive device to json format convert iothread to json convert disk controller device to json format tests: cfg2cmd: convert drive devices to json format RFC: add multiple iothreads support src/PVE/QemuServer.pm | 273 +++------------ src/PVE/QemuServer/DriveDevice.pm | 314 ++++++++++++++++++ src/PVE/QemuServer/Makefile | 1 + src/PVE/QemuServer/PCI.pm | 17 +- src/PVE/QemuServer/QMPHelpers.pm | 16 + src/test/cfg2cmd/aio.conf.cmd | 32 +- src/test/cfg2cmd/bootorder-empty.conf.cmd | 14 +- src/test/cfg2cmd/bootorder-legacy.conf.cmd | 14 +- src/test/cfg2cmd/bootorder.conf.cmd | 14 +- ...putype-icelake-client-deprecation.conf.cmd | 6 +- src/test/cfg2cmd/ide.conf.cmd | 12 +- src/test/cfg2cmd/iothreads.conf | 7 + src/test/cfg2cmd/iothreads.conf.cmd | 45 +++ .../cfg2cmd/pinned-version-pxe-pve.conf.cmd | 6 +- src/test/cfg2cmd/pinned-version-pxe.conf.cmd | 6 +- src/test/cfg2cmd/pinned-version.conf.cmd | 6 +- src/test/cfg2cmd/q35-ide.conf.cmd | 12 +- .../q35-linux-hostpci-template.conf.cmd | 4 +- src/test/cfg2cmd/seabios_serial.conf.cmd | 6 +- src/test/cfg2cmd/simple-backingchain.conf.cmd | 6 +- ...imple-balloon-free-page-reporting.conf.cmd | 6 +- src/test/cfg2cmd/simple-btrfs.conf.cmd | 12 +- src/test/cfg2cmd/simple-cifs.conf.cmd | 12 +- .../cfg2cmd/simple-disk-passthrough.conf.cmd | 8 +- src/test/cfg2cmd/simple-lvm.conf.cmd | 10 +- src/test/cfg2cmd/simple-lvmthin.conf.cmd | 10 +- src/test/cfg2cmd/simple-rbd.conf.cmd | 20 +- src/test/cfg2cmd/simple-virtio-blk.conf.cmd | 6 +- .../cfg2cmd/simple-zfs-over-iscsi.conf.cmd | 12 +- src/test/cfg2cmd/simple1-template.conf.cmd | 10 +- src/test/cfg2cmd/simple1.conf.cmd | 6 +- 31 files changed, 571 insertions(+), 352 deletions(-) create mode 100644 src/PVE/QemuServer/DriveDevice.pm create mode 100644 src/test/cfg2cmd/iothreads.conf create mode 100644 src/test/cfg2cmd/iothreads.conf.cmd -- 2.39.5 --===============0192979391586330649== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ pve-devel mailing list pve-devel@lists.proxmox.com https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-devel --===============0192979391586330649==--