From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from firstgate.proxmox.com (firstgate.proxmox.com [IPv6:2a01:7e0:0:424::9]) by lore.proxmox.com (Postfix) with ESMTPS id B155B1FF183 for ; Wed, 2 Jul 2025 16:49:36 +0200 (CEST) Received: from firstgate.proxmox.com (localhost [127.0.0.1]) by firstgate.proxmox.com (Proxmox) with ESMTP id 29C711DE78; Wed, 2 Jul 2025 16:49:43 +0200 (CEST) To: pve-devel@lists.proxmox.com Date: Wed, 2 Jul 2025 16:48:50 +0200 MIME-Version: 1.0 Message-ID: List-Id: Proxmox VE development discussion List-Post: From: Alexandre Derumier via pve-devel Precedence: list Cc: Alexandre Derumier X-Mailman-Version: 2.1.29 X-BeenThere: pve-devel@lists.proxmox.com List-Subscribe: , List-Unsubscribe: , List-Archive: Reply-To: Proxmox VE development discussion List-Help: Subject: [pve-devel] [PATCH qemu-server 00/10] convert drivedevice to json format && implement multiple iothreads Content-Type: multipart/mixed; boundary="===============4302674224562719512==" Errors-To: pve-devel-bounces@lists.proxmox.com Sender: "pve-devel" --===============4302674224562719512== Content-Type: message/rfc822 Content-Disposition: inline Return-Path: X-Original-To: pve-devel@lists.proxmox.com Delivered-To: pve-devel@lists.proxmox.com Received: from firstgate.proxmox.com (firstgate.proxmox.com [212.224.123.68]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits)) (No client certificate requested) by lists.proxmox.com (Postfix) with ESMTPS id 2016FD3D43 for ; Wed, 2 Jul 2025 16:49:41 +0200 (CEST) Received: from firstgate.proxmox.com (localhost [127.0.0.1]) by firstgate.proxmox.com (Proxmox) with ESMTP id E53B71D9D3 for ; Wed, 2 Jul 2025 16:49:10 +0200 (CEST) Received: from bastiontest.odiso.net (unknown [185.151.190.228]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by firstgate.proxmox.com (Proxmox) with ESMTPS for ; Wed, 2 Jul 2025 16:49:08 +0200 (CEST) Received: from formationkvm1.odiso.net (unknown [10.11.201.57]) by bastiontest.odiso.net (Postfix) with ESMTP id 59E47860F12; Wed, 2 Jul 2025 16:49:01 +0200 (CEST) Received: by formationkvm1.odiso.net (Postfix, from userid 0) id 47FCB112B90F; Wed, 2 Jul 2025 16:49:01 +0200 (CEST) From: Alexandre Derumier To: pve-devel@lists.proxmox.com Subject: [PATCH qemu-server 00/10] convert drivedevice to json format && implement multiple iothreads Date: Wed, 2 Jul 2025 16:48:50 +0200 Message-Id: <20250702144900.3963405-1-alexandre.derumier@groupe-cyllene.com> X-Mailer: git-send-email 2.39.5 MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-SPAM-LEVEL: Spam detection results: 0 AWL -0.097 Adjusted score from AWL reputation of From: address BAYES_00 -1.9 Bayes spam probability is 0 to 1% DMARC_NONE 0.1 DMARC none policy HEADER_FROM_DIFFERENT_DOMAINS 0.017 From and EnvelopeFrom 2nd level mail domains are different KAM_DMARC_NONE 0.25 DKIM has Failed or SPF has failed on the message and the domain has no DMARC policy KAM_DMARC_STATUS 0.01 Test Rule for DKIM or SPF Failure with Strict Alignment KAM_LAZY_DOMAIN_SECURITY 1 Sending domain does not have any anti-forgery methods RCVD_IN_VALIDITY_CERTIFIED_BLOCKED 0.232 ADMINISTRATOR NOTICE: The query to Validity was blocked. See https://knowledge.validity.com/hc/en-us/articles/20961730681243 for more information. RCVD_IN_VALIDITY_RPBL_BLOCKED 0.001 ADMINISTRATOR NOTICE: The query to Validity was blocked. See https://knowledge.validity.com/hc/en-us/articles/20961730681243 for more information. RCVD_IN_VALIDITY_SAFE_BLOCKED 0.001 ADMINISTRATOR NOTICE: The query to Validity was blocked. See https://knowledge.validity.com/hc/en-us/articles/20961730681243 for more information. RDNS_NONE 0.793 Delivered to internal network by a host with no rDNS SPF_HELO_NONE 0.001 SPF: HELO does not publish an SPF Record SPF_NONE 0.001 SPF: sender does not publish an SPF Record URIBL_BLOCKED 0.001 ADMINISTRATOR NOTICE: The query to URIBL was blocked. See http://wiki.apache.org/spamassassin/DnsBlocklists#dnsbl-block for more information. [qmphelpers.pm,vmsplice.net,qemuserver.pm,drivedevice.pm,pci.pm] Hi, This patch serie apply on top of last fiona patch series. (not related to blockdev, so this can apply to any machine version) patch 1-3: add Drivedevice module and move current code patch 4-9: convert drive devices && iothreads to json format patch 10: implement multiple iothreads The json format is needed to be able to map a list of multiples iothreads for each disk. iothreads are defined globally in a static number at vm start. (no hotplug|unplug of iothreads here) iothreads are shared between all disks(where iothread is enabled), and could be pinned to specific host cores. (not implemented yet, as it need something more powerfull than current taskset,as ideally we want to pin iothreads on differents host cores than vm cpus pinning) Some redhat doc: https://developers.redhat.com/articles/2024/09/05/scaling-virtio-blk-disk-io-iothread-virtqueue-mapping https://vmsplice.net/~stefan/stefanha-kvm-forum-2024.pdf Alexandre Derumier (10): introduce DriveDevice module add print_drivedevice_controller && print_drivedevice_iothread hotplug: drive controller : use print_drivedevice_iothread && print_drivedevice_controller pci: add get_pci_addr qmphelpers: add qmp_deviceadd && qmp_devicedel convert drive device to json format convert iothread to json convert disk controller device to json format tests: cfg2cmd: convert drive devices to json format RFC: add multiple iothreads support src/PVE/QemuServer.pm | 266 +++------------- src/PVE/QemuServer/DriveDevice.pm | 296 ++++++++++++++++++ src/PVE/QemuServer/Makefile | 1 + src/PVE/QemuServer/PCI.pm | 22 +- src/PVE/QemuServer/QMPHelpers.pm | 16 + src/test/cfg2cmd/aio.conf.cmd | 32 +- src/test/cfg2cmd/bootorder-empty.conf.cmd | 14 +- src/test/cfg2cmd/bootorder-legacy.conf.cmd | 14 +- src/test/cfg2cmd/bootorder.conf.cmd | 14 +- ...putype-icelake-client-deprecation.conf.cmd | 6 +- src/test/cfg2cmd/ide.conf.cmd | 12 +- src/test/cfg2cmd/iothreads.conf | 7 + src/test/cfg2cmd/iothreads.conf.cmd | 45 +++ .../cfg2cmd/pinned-version-pxe-pve.conf.cmd | 6 +- src/test/cfg2cmd/pinned-version-pxe.conf.cmd | 6 +- src/test/cfg2cmd/pinned-version.conf.cmd | 6 +- src/test/cfg2cmd/q35-ide.conf.cmd | 12 +- .../q35-linux-hostpci-template.conf.cmd | 4 +- src/test/cfg2cmd/seabios_serial.conf.cmd | 6 +- ...imple-balloon-free-page-reporting.conf.cmd | 6 +- src/test/cfg2cmd/simple-btrfs.conf.cmd | 12 +- src/test/cfg2cmd/simple-cifs.conf.cmd | 12 +- .../cfg2cmd/simple-disk-passthrough.conf.cmd | 8 +- src/test/cfg2cmd/simple-lvm.conf.cmd | 10 +- src/test/cfg2cmd/simple-lvmthin.conf.cmd | 10 +- src/test/cfg2cmd/simple-rbd.conf.cmd | 20 +- src/test/cfg2cmd/simple-virtio-blk.conf.cmd | 6 +- .../cfg2cmd/simple-zfs-over-iscsi.conf.cmd | 12 +- src/test/cfg2cmd/simple1-template.conf.cmd | 10 +- src/test/cfg2cmd/simple1.conf.cmd | 6 +- 30 files changed, 546 insertions(+), 351 deletions(-) create mode 100644 src/PVE/QemuServer/DriveDevice.pm create mode 100644 src/test/cfg2cmd/iothreads.conf create mode 100644 src/test/cfg2cmd/iothreads.conf.cmd -- 2.39.5 --===============4302674224562719512== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ pve-devel mailing list pve-devel@lists.proxmox.com https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-devel --===============4302674224562719512==--