From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from firstgate.proxmox.com (firstgate.proxmox.com [212.224.123.68]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits)) (No client certificate requested) by lists.proxmox.com (Postfix) with ESMTPS id BE0E999DDA for ; Mon, 15 May 2023 15:40:04 +0200 (CEST) Received: from firstgate.proxmox.com (localhost [127.0.0.1]) by firstgate.proxmox.com (Proxmox) with ESMTP id 881C6B26D for ; Mon, 15 May 2023 15:40:04 +0200 (CEST) Received: from proxmox-new.maurer-it.com (proxmox-new.maurer-it.com [94.136.29.106]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits)) (No client certificate requested) by firstgate.proxmox.com (Proxmox) with ESMTPS for ; Mon, 15 May 2023 15:40:02 +0200 (CEST) Received: from proxmox-new.maurer-it.com (localhost.localdomain [127.0.0.1]) by proxmox-new.maurer-it.com (Proxmox) with ESMTP id 08E0E44079 for ; Mon, 15 May 2023 15:40:02 +0200 (CEST) From: Fiona Ebner To: pve-devel@lists.proxmox.com Date: Mon, 15 May 2023 15:39:49 +0200 Message-Id: <20230515133956.112292-1-f.ebner@proxmox.com> X-Mailer: git-send-email 2.39.2 MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit X-SPAM-LEVEL: Spam detection results: 0 AWL -0.297 Adjusted score from AWL reputation of From: address BAYES_00 -1.9 Bayes spam probability is 0 to 1% DMARC_MISSING 0.1 Missing DMARC policy KAM_DMARC_STATUS 0.01 Test Rule for DKIM or SPF Failure with Strict Alignment KAM_NUMSUBJECT 0.5 Subject ends in numbers excluding current years SPF_HELO_NONE 0.001 SPF: HELO does not publish an SPF Record SPF_PASS -0.001 SPF: sender matches SPF record T_SCC_BODY_TEXT_LINE -0.01 - Subject: [pve-devel] [PATCH-SERIES v2 qemu] update to QEMU 8.0 X-BeenThere: pve-devel@lists.proxmox.com X-Mailman-Version: 2.1.29 Precedence: list List-Id: Proxmox VE development discussion List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 15 May 2023 13:40:04 -0000 After weeks and weeks of (sometimes painful) debugging, it's finally here. And got a load of stable fixes on top already. More testing is always appreciated, especially backup, PBS live restore and snapshots, which needed quite a few changes! Changes from v1: * Add fix for lintian overrides. * Add patch squashing related changes (not required for 8.0 but will make life easier going forward). Fiona Ebner (7): d/rules: drop virtiofsd switch d/rules: set job flag for make based on DEB_BUILD_OPTIONS buildsys: fix lintian overrides update submodule and patches to QEMU 8.0.0 add stable patches for 8.0.0 PVE backup: don't call no_co_wrapper function from coroutine squash related patches ...d-support-for-sync-bitmap-mode-never.patch | 95 +- ...-support-for-conditional-and-always-.patch | 10 +- ...check-for-bitmap-mode-without-bitmap.patch | 6 +- ...-to-bdrv_dirty_bitmap_merge_internal.patch | 6 +- .../0006-mirror-move-some-checks-to-qmp.patch | 14 +- ...race-with-clients-disconnecting-earl.patch | 6 +- ...monize-defuse-PID-file-resolve-error.patch | 42 - ...memory-prevent-dma-reentracy-issues.patch} | 4 +- ...s-Internal-cdbs-have-16-byte-length.patch} | 0 ...he-bitmap-index-of-the-section-offse.patch | 44 - ...al-deadlock-when-draining-during-tr.patch} | 10 +- ...he-iterator-variable-in-a-vmem-rdl_l.patch | 36 - ...sabling-re-entrancy-checking-per-MR.patch} | 6 +- ...ty-bitmap-syncing-when-vIOMMU-is-ena.patch | 141 -- ...e-reentrancy-detection-for-script-R.patch} | 2 +- ...pci-fix-migration-compat-for-vectors.patch | 42 - ...-zeroes-with-BDRV_REQ_REGISTERED_BUF.patch | 36 - ...39-fix-large_send_mss-divide-by-zero.patch | 72 + ...-Fix-crash-when-executing-HMP-commit.patch | 48 + ...double-free-on-BUSY-or-similar-statu.patch | 32 - ...hen-getting-cursor-without-a-console.patch | 36 + ...our-channel-order-for-PNG-screenshot.patch | 77 ++ ...arm-Fix-vd-vm-overlap-in-sve_ldff1_z.patch | 41 + ...ing-endian-conversions-for-doorbell-.patch | 67 - ...e-incorrect-computation-in-float32_e.patch | 56 + ...fix-field-corruption-in-type-4-table.patch | 50 - ...ge-wrong-XFRM-value-in-SGX-CPUID-lea.patch | 39 + ...t-assert_bdrv_graph_readable-by-defa.patch | 106 ++ ...ix-transitional-migration-compat-for.patch | 35 - ...CI_ERR_UNCOR_MASK-register-for-machi.patch | 100 ++ ...er-hpet-Fix-expiration-time-overflow.patch | 80 -- ...after-free-in-blockdev_mark_auto_del.patch | 57 + ...vdpa-stop-all-svq-on-device-deletion.patch | 71 - ...ly-call-bdrv_activate-outside-corout.patch | 64 + ...tential-use-of-an-uninitialized-vari.patch | 132 -- ...o_unref-for-calls-in-coroutine-conte.patch | 373 +++++ ...ket-set-s-listener-NULL-in-char_sock.patch | 70 - ...-no_coroutine_fns-in-qmp_block_resiz.patch | 43 + ...il-MAP-notifier-without-caching-mode.patch | 41 - ...-tcg-Fix-atomic_mmu_lookup-for-reads.patch | 36 + ...-fail-DEVIOTLB_UNMAP-without-dt-mode.patch | 50 - ...uest-visible-maximum-access-size-to-.patch | 166 --- ...Introduce-and-use-reg_t-consistently.patch | 286 ---- ...25-target-i386-Fix-BEXTR-instruction.patch | 97 -- ...i386-Fix-C-flag-for-BLSI-BLSMSK-BLSR.patch | 47 - ...arget-i386-fix-ADOX-followed-by-ADCX.patch | 192 --- ...028-target-i386-Fix-BZHI-instruction.patch | 64 - ...k-file-change-locking-default-to-off.patch | 6 +- ...djust-network-script-path-to-etc-kvm.patch | 4 +- ...he-CPU-model-to-kvm64-32-instead-of-.patch | 4 +- ...ui-spice-default-to-pve-certificates.patch | 4 +- ...erfs-no-default-logfile-if-daemonize.patch | 8 +- ...lock-rbd-disable-rbd_cache_writethro.patch | 4 +- .../0007-PVE-Up-qmp-add-get_link_status.patch | 8 +- ...PVE-Up-glusterfs-allow-partial-reads.patch | 14 +- ...return-success-on-info-without-snaps.patch | 4 +- ...dd-add-osize-and-read-from-to-stdin-.patch | 12 +- ...E-Up-qemu-img-dd-add-isize-parameter.patch | 14 +- ...PVE-Up-qemu-img-dd-add-n-skip_create.patch | 10 +- ...add-l-option-for-loading-a-snapshot.patch} | 18 +- ...irtio-balloon-improve-query-balloon.patch} | 95 +- ...0015-PVE-qapi-modify-query-machines.patch} | 14 +- ...=> 0016-PVE-qapi-modify-spice-query.patch} | 13 +- ...nel-implementation-for-savevm-async.patch} | 11 +- ...sync-for-background-state-snapshots.patch} | 125 +- ...dd-optional-buffer-size-to-QEMUFile.patch} | 10 +- ...dd-the-zeroinit-block-driver-filter.patch} | 30 +- ...Add-dummy-id-command-line-parameter.patch} | 10 +- ...-target-i386-disable-LINT0-after-re.patch} | 4 +- ...e-posix-make-locking-optiono-on-cre.patch} | 18 +- ...-PVE-monitor-disable-oob-capability.patch} | 0 ...ed-balloon-qemu-4-0-config-size-fal.patch} | 4 +- ...-Allow-version-code-in-machine-type.patch} | 31 +- ...-bcs-bitmap-initialization-to-job-c.patch} | 4 +- ...E-Backup-add-vma-backup-format-code.patch} | 277 ++-- ...Backup-add-backup-dump-block-driver.patch} | 39 +- ...-sequential-job-transaction-support.patch} | 0 ...irty-bitmap-tracking-for-incremental.patch | 452 ------ ...kup-Proxmox-backup-patches-for-QEMU.patch} | 1210 +++++++++++------ ...store-new-command-to-restore-from-p.patch} | 33 +- .../pve/0032-PVE-various-PBS-fixes.patch | 219 --- ...k-driver-to-map-backup-archives-into.patch | 92 +- ...dd-query_proxmox_support-QMP-command.patch | 74 - ...t-stderr-to-journal-when-daemonized.patch} | 8 +- ...grate-dirty-bitmap-state-via-savevm.patch} | 54 +- ...E-add-query-pbs-bitmap-info-QMP-call.patch | 441 ------ ...irty-bitmap-migrate-other-bitmaps-e.patch} | 4 +- ...ll-back-to-open-iscsi-initiatorname.patch} | 4 +- ...-transaction-to-synchronize-job-stat.patch | 293 ---- ...VE-block-stream-increase-chunk-size.patch} | 4 +- ...-block-on-finishing-and-cleanup-crea.patch | 499 ------- ...ccept-NULL-qiov-in-bdrv_pad_request.patch} | 4 +- ...> 0040-block-add-alloc-track-driver.patch} | 23 +- ...rbd-workaround-for-ceph-issue-53784.patch} | 8 +- ...fix-handling-of-holes-in-.bdrv_co_b.patch} | 4 +- ...routine-QMP-for-backup-cancel_backup.patch | 598 -------- ...-rbd-implement-bdrv_co_block_status.patch} | 10 +- .../pve/0044-PBS-add-master-key-support.patch | 98 -- ...alloc-track-fix-deadlock-during-drop.patch | 153 +++ ...st-path-reads-without-allocation-if-.patch | 53 - ...apshots-hold-the-BQL-during-setup-ca.patch | 190 +++ ...vm-async-don-t-hold-BQL-during-setup.patch | 29 + ...-register-yank-before-migration_inco.patch | 35 - .../pve/0051-vma-allow-partial-restore.patch | 407 ------ .../pve/0052-pbs-namespace-support.patch | 233 ---- ...e-jobs-correctly-cancel-in-error-sce.patch | 60 - ...nsure-jobs-in-di_list-are-referenced.patch | 73 - ...d-segfault-issues-upon-backup-cancel.patch | 118 -- ...support-64KiB-unaligned-input-images.patch | 57 - ...d-triggering-assertion-in-error-case.patch | 25 - ...ck-alloc-track-avoid-premature-break.patch | 36 - ...-passing-max-workers-performance-set.patch | 144 -- debian/patches/series | 128 +- debian/pve-qemu-kvm.lintian-overrides | 8 +- debian/rules | 4 +- qemu | 2 +- 116 files changed, 3020 insertions(+), 6790 deletions(-) delete mode 100644 debian/patches/extra/0002-init-daemonize-defuse-PID-file-resolve-error.patch rename debian/patches/extra/{0008-memory-prevent-dma-reentracy-issues.patch => 0002-memory-prevent-dma-reentracy-issues.patch} (98%) rename debian/patches/extra/{0010-scsi-megasas-Internal-cdbs-have-16-byte-length.patch => 0003-scsi-megasas-Internal-cdbs-have-16-byte-length.patch} (100%) delete mode 100644 debian/patches/extra/0003-virtio-mem-Fix-the-bitmap-index-of-the-section-offse.patch rename debian/patches/extra/{0011-ide-avoid-potential-deadlock-when-draining-during-tr.patch => 0004-ide-avoid-potential-deadlock-when-draining-during-tr.patch} (93%) delete mode 100644 debian/patches/extra/0004-virtio-mem-Fix-the-iterator-variable-in-a-vmem-rdl_l.patch rename debian/patches/extra/{0021-memory-Allow-disabling-re-entrancy-checking-per-MR.patch => 0005-memory-Allow-disabling-re-entrancy-checking-per-MR.patch} (91%) delete mode 100644 debian/patches/extra/0005-vhost-fix-vq-dirty-bitmap-syncing-when-vIOMMU-is-ena.patch rename debian/patches/extra/{0022-lsi53c895a-disable-reentrancy-detection-for-script-R.patch => 0006-lsi53c895a-disable-reentrancy-detection-for-script-R.patch} (97%) delete mode 100644 debian/patches/extra/0006-virtio-rng-pci-fix-migration-compat-for-vectors.patch delete mode 100644 debian/patches/extra/0007-block-fix-detect-zeroes-with-BDRV_REQ_REGISTERED_BUF.patch create mode 100644 debian/patches/extra/0007-rtl8139-fix-large_send_mss-divide-by-zero.patch create mode 100644 debian/patches/extra/0008-block-monitor-Fix-crash-when-executing-HMP-commit.patch delete mode 100644 debian/patches/extra/0009-block-iscsi-fix-double-free-on-BUSY-or-similar-statu.patch create mode 100644 debian/patches/extra/0009-ui-return-NULL-when-getting-cursor-without-a-console.patch create mode 100644 debian/patches/extra/0010-ui-Fix-pixel-colour-channel-order-for-PNG-screenshot.patch create mode 100644 debian/patches/extra/0011-target-arm-Fix-vd-vm-overlap-in-sve_ldff1_z.patch delete mode 100644 debian/patches/extra/0012-hw-nvme-fix-missing-endian-conversions-for-doorbell-.patch create mode 100644 debian/patches/extra/0012-softfloat-Fix-the-incorrect-computation-in-float32_e.patch delete mode 100644 debian/patches/extra/0013-hw-smbios-fix-field-corruption-in-type-4-table.patch create mode 100644 debian/patches/extra/0013-target-i386-Change-wrong-XFRM-value-in-SGX-CPUID-lea.patch create mode 100644 debian/patches/extra/0014-block-compile-out-assert_bdrv_graph_readable-by-defa.patch delete mode 100644 debian/patches/extra/0014-virtio-rng-pci-fix-transitional-migration-compat-for.patch create mode 100644 debian/patches/extra/0015-hw-pci-Disable-PCI_ERR_UNCOR_MASK-register-for-machi.patch delete mode 100644 debian/patches/extra/0015-hw-timer-hpet-Fix-expiration-time-overflow.patch create mode 100644 debian/patches/extra/0016-block-Fix-use-after-free-in-blockdev_mark_auto_del.patch delete mode 100644 debian/patches/extra/0016-vdpa-stop-all-svq-on-device-deletion.patch create mode 100644 debian/patches/extra/0017-block-Consistently-call-bdrv_activate-outside-corout.patch delete mode 100644 debian/patches/extra/0017-vhost-avoid-a-potential-use-of-an-uninitialized-vari.patch create mode 100644 debian/patches/extra/0018-block-bdrv-blk_co_unref-for-calls-in-coroutine-conte.patch delete mode 100644 debian/patches/extra/0018-chardev-char-socket-set-s-listener-NULL-in-char_sock.patch create mode 100644 debian/patches/extra/0019-block-Don-t-call-no_coroutine_fns-in-qmp_block_resiz.patch delete mode 100644 debian/patches/extra/0019-intel-iommu-fail-MAP-notifier-without-caching-mode.patch create mode 100644 debian/patches/extra/0020-accel-tcg-Fix-atomic_mmu_lookup-for-reads.patch delete mode 100644 debian/patches/extra/0020-intel-iommu-fail-DEVIOTLB_UNMAP-without-dt-mode.patch delete mode 100644 debian/patches/extra/0023-acpi-cpuhp-fix-guest-visible-maximum-access-size-to-.patch delete mode 100644 debian/patches/extra/0024-tests-tcg-i386-Introduce-and-use-reg_t-consistently.patch delete mode 100644 debian/patches/extra/0025-target-i386-Fix-BEXTR-instruction.patch delete mode 100644 debian/patches/extra/0026-target-i386-Fix-C-flag-for-BLSI-BLSMSK-BLSR.patch delete mode 100644 debian/patches/extra/0027-target-i386-fix-ADOX-followed-by-ADCX.patch delete mode 100644 debian/patches/extra/0028-target-i386-Fix-BZHI-instruction.patch rename debian/patches/pve/{0050-qemu-img-dd-add-l-option-for-loading-a-snapshot.patch => 0013-qemu-img-dd-add-l-option-for-loading-a-snapshot.patch} (89%) rename debian/patches/pve/{0013-PVE-virtio-balloon-improve-query-balloon.patch => 0014-PVE-virtio-balloon-improve-query-balloon.patch} (90%) rename debian/patches/pve/{0014-PVE-qapi-modify-query-machines.patch => 0015-PVE-qapi-modify-query-machines.patch} (84%) rename debian/patches/pve/{0015-PVE-qapi-modify-spice-query.patch => 0016-PVE-qapi-modify-spice-query.patch} (82%) rename debian/patches/pve/{0016-PVE-add-IOChannel-implementation-for-savevm-async.patch => 0017-PVE-add-IOChannel-implementation-for-savevm-async.patch} (97%) rename debian/patches/pve/{0017-PVE-add-savevm-async-for-background-state-snapshots.patch => 0018-PVE-add-savevm-async-for-background-state-snapshots.patch} (89%) rename debian/patches/pve/{0018-PVE-add-optional-buffer-size-to-QEMUFile.patch => 0019-PVE-add-optional-buffer-size-to-QEMUFile.patch} (96%) rename debian/patches/pve/{0019-PVE-block-add-the-zeroinit-block-driver-filter.patch => 0020-PVE-block-add-the-zeroinit-block-driver-filter.patch} (89%) rename debian/patches/pve/{0020-PVE-Add-dummy-id-command-line-parameter.patch => 0021-PVE-Add-dummy-id-command-line-parameter.patch} (87%) rename debian/patches/pve/{0021-PVE-Config-Revert-target-i386-disable-LINT0-after-re.patch => 0022-PVE-Config-Revert-target-i386-disable-LINT0-after-re.patch} (90%) rename debian/patches/pve/{0022-PVE-Up-Config-file-posix-make-locking-optiono-on-cre.patch => 0023-PVE-Up-Config-file-posix-make-locking-optiono-on-cre.patch} (89%) rename debian/patches/pve/{0023-PVE-monitor-disable-oob-capability.patch => 0024-PVE-monitor-disable-oob-capability.patch} (100%) rename debian/patches/pve/{0024-PVE-Compat-4.0-used-balloon-qemu-4-0-config-size-fal.patch => 0025-PVE-Compat-4.0-used-balloon-qemu-4-0-config-size-fal.patch} (95%) rename debian/patches/pve/{0025-PVE-Allow-version-code-in-machine-type.patch => 0026-PVE-Allow-version-code-in-machine-type.patch} (85%) rename debian/patches/pve/{0026-block-backup-move-bcs-bitmap-initialization-to-job-c.patch => 0027-block-backup-move-bcs-bitmap-initialization-to-job-c.patch} (96%) rename debian/patches/pve/{0027-PVE-Backup-add-vma-backup-format-code.patch => 0028-PVE-Backup-add-vma-backup-format-code.patch} (91%) rename debian/patches/pve/{0028-PVE-Backup-add-backup-dump-block-driver.patch => 0029-PVE-Backup-add-backup-dump-block-driver.patch} (89%) rename debian/patches/pve/{0037-PVE-Add-sequential-job-transaction-support.patch => 0030-PVE-Add-sequential-job-transaction-support.patch} (100%) delete mode 100644 debian/patches/pve/0031-PVE-Backup-Add-dirty-bitmap-tracking-for-incremental.patch rename debian/patches/pve/{0029-PVE-Backup-proxmox-backup-patches-for-qemu.patch => 0031-PVE-Backup-Proxmox-backup-patches-for-QEMU.patch} (53%) rename debian/patches/pve/{0030-PVE-Backup-pbs-restore-new-command-to-restore-from-p.patch => 0032-PVE-Backup-pbs-restore-new-command-to-restore-from-p.patch} (89%) delete mode 100644 debian/patches/pve/0032-PVE-various-PBS-fixes.patch delete mode 100644 debian/patches/pve/0034-PVE-add-query_proxmox_support-QMP-command.patch rename debian/patches/pve/{0036-PVE-redirect-stderr-to-journal-when-daemonized.patch => 0034-PVE-redirect-stderr-to-journal-when-daemonized.patch} (91%) rename debian/patches/pve/{0040-PVE-Migrate-dirty-bitmap-state-via-savevm.patch => 0035-PVE-Migrate-dirty-bitmap-state-via-savevm.patch} (83%) delete mode 100644 debian/patches/pve/0035-PVE-add-query-pbs-bitmap-info-QMP-call.patch rename debian/patches/pve/{0041-migration-block-dirty-bitmap-migrate-other-bitmaps-e.patch => 0036-migration-block-dirty-bitmap-migrate-other-bitmaps-e.patch} (92%) rename debian/patches/pve/{0042-PVE-fall-back-to-open-iscsi-initiatorname.patch => 0037-PVE-fall-back-to-open-iscsi-initiatorname.patch} (95%) delete mode 100644 debian/patches/pve/0038-PVE-Backup-Use-a-transaction-to-synchronize-job-stat.patch rename debian/patches/pve/{0046-PVE-block-stream-increase-chunk-size.patch => 0038-PVE-block-stream-increase-chunk-size.patch} (92%) delete mode 100644 debian/patches/pve/0039-PVE-Backup-Don-t-block-on-finishing-and-cleanup-crea.patch rename debian/patches/pve/{0047-block-io-accept-NULL-qiov-in-bdrv_pad_request.patch => 0039-block-io-accept-NULL-qiov-in-bdrv_pad_request.patch} (90%) rename debian/patches/pve/{0048-block-add-alloc-track-driver.patch => 0040-block-add-alloc-track-driver.patch} (95%) rename debian/patches/pve/{0053-Revert-block-rbd-workaround-for-ceph-issue-53784.patch => 0041-Revert-block-rbd-workaround-for-ceph-issue-53784.patch} (92%) rename debian/patches/pve/{0054-Revert-block-rbd-fix-handling-of-holes-in-.bdrv_co_b.patch => 0042-Revert-block-rbd-fix-handling-of-holes-in-.bdrv_co_b.patch} (90%) delete mode 100644 debian/patches/pve/0043-PVE-Use-coroutine-QMP-for-backup-cancel_backup.patch rename debian/patches/pve/{0055-Revert-block-rbd-implement-bdrv_co_block_status.patch => 0043-Revert-block-rbd-implement-bdrv_co_block_status.patch} (95%) delete mode 100644 debian/patches/pve/0044-PBS-add-master-key-support.patch create mode 100644 debian/patches/pve/0044-alloc-track-fix-deadlock-during-drop.patch delete mode 100644 debian/patches/pve/0045-PVE-block-pbs-fast-path-reads-without-allocation-if-.patch create mode 100644 debian/patches/pve/0045-migration-for-snapshots-hold-the-BQL-during-setup-ca.patch create mode 100644 debian/patches/pve/0046-savevm-async-don-t-hold-BQL-during-setup.patch delete mode 100644 debian/patches/pve/0049-PVE-savevm-async-register-yank-before-migration_inco.patch delete mode 100644 debian/patches/pve/0051-vma-allow-partial-restore.patch delete mode 100644 debian/patches/pve/0052-pbs-namespace-support.patch delete mode 100644 debian/patches/pve/0056-PVE-Backup-create-jobs-correctly-cancel-in-error-sce.patch delete mode 100644 debian/patches/pve/0057-PVE-Backup-ensure-jobs-in-di_list-are-referenced.patch delete mode 100644 debian/patches/pve/0058-PVE-Backup-avoid-segfault-issues-upon-backup-cancel.patch delete mode 100644 debian/patches/pve/0059-vma-create-support-64KiB-unaligned-input-images.patch delete mode 100644 debian/patches/pve/0060-vma-create-avoid-triggering-assertion-in-error-case.patch delete mode 100644 debian/patches/pve/0061-block-alloc-track-avoid-premature-break.patch delete mode 100644 debian/patches/pve/0062-PVE-Backup-allow-passing-max-workers-performance-set.patch -- 2.39.2