[PATCH qemu-server v7 0/2] hotplug: improve and fix cleanup/error handling

[PATCH qemu-server v7 0/2] hotplug: improve and fix cleanup/error handling

[Dominik Csapak]

This replaces my earlier v4 9/9 patch[0]

It uses a different approach now by unifying the cleanup and removal of
disks and their controllers.

changes from v6:
* call print_drivedevice_full before adding the SCSI controller, so a
  volume rejected by the storage layer (e.g. a vanished storage) does
  not cause a controller plug/unplug cycle, and add a test for it
* add a test for a failed disk hotplug on a shared SCSI controller,
  which must keep the controller for the remaining disks

changes from v5:
* rebase on master
* rename helper to 'delete_disk_hardware'
* don't eval the individual calls, but always the whole function
  (drops noerr parameter)

changes from v4:
* rebase on master
* new bugfix (1/4)
* new patch for iothread deletion
* new patch for refactoring the cleanup

0: https://lore.proxmox.com/pve-devel/20261023130324.451252-10-d.csapak@proxmox.com/

Dominik Csapak (2):
  hotplug: factor out cleanup of disk devices
  hotplug: clean up disk devices/objects if adding them failed

 src/PVE/QemuServer.pm                         | 75 ++++++++++++-------
 src/test/hotplug/disk-add-fail.conf           | 19 +++++
 src/test/hotplug/disk-add-fail.conf.expected  | 10 +++
 src/test/hotplug/disk-add-fail2.conf          | 17 +++++
 src/test/hotplug/disk-add-fail2.conf.expected |  1 +
 .../disk-add-scsi-shared-controller-fail.conf | 19 +++++
 ...-scsi-shared-controller-fail.conf.expected |  8 ++
 .../disk-add-scsi-single-disk-fail.conf       | 19 +++++
 ...sk-add-scsi-single-disk-fail.conf.expected | 12 +++
 .../hotplug/disk-add-scsi-single-fail.conf    | 19 +++++
 .../disk-add-scsi-single-fail.conf.expected   |  5 ++
 11 files changed, 175 insertions(+), 29 deletions(-)
 create mode 100644 src/test/hotplug/disk-add-fail.conf
 create mode 100644 src/test/hotplug/disk-add-fail.conf.expected
 create mode 100644 src/test/hotplug/disk-add-fail2.conf
 create mode 100644 src/test/hotplug/disk-add-fail2.conf.expected
 create mode 100644 src/test/hotplug/disk-add-scsi-shared-controller-fail.conf
 create mode 100644 src/test/hotplug/disk-add-scsi-shared-controller-fail.conf.expected
 create mode 100644 src/test/hotplug/disk-add-scsi-single-disk-fail.conf
 create mode 100644 src/test/hotplug/disk-add-scsi-single-disk-fail.conf.expected
 create mode 100644 src/test/hotplug/disk-add-scsi-single-fail.conf
 create mode 100644 src/test/hotplug/disk-add-scsi-single-fail.conf.expected

-- 
2.47.3

[PATCH qemu-server v7 1/2] hotplug: factor out cleanup of disk devices

[Dominik Csapak]

Unplugging a disk or SCSI controller removes the same parts that need to
be removed when hotplugging one of them failed. Factor this out into a
helper, so it can be reused for cleaning up after a failed hotplug in a
following commit.

Pass the parsed drive to qemu_deletescsihw instead of parsing it from
the config again, since a disk that failed to hotplug is still pending
and not in the config yet.

No functional change intended.

Signed-off-by: Dominik Csapak <d.csapak@proxmox.com>
---
 src/PVE/QemuServer.pm | 34 +++++++++++++++++++---------------
 1 file changed, 19 insertions(+), 15 deletions(-)

diff --git a/src/PVE/QemuServer.pm b/src/PVE/QemuServer.pm
index 69a2bd64..5bed6afa 100644
--- a/src/PVE/QemuServer.pm
+++ b/src/PVE/QemuServer.pm
@@ -3854,6 +3854,20 @@ sub vm_devices_list {
     return $devices;
 }
 
+# clean up disks and their controllers (if unused afterwards)
+sub delete_disk_hardware {
+    my ($conf, $vmid, $deviceid, $device, $timeout) = @_;
+
+    qemu_devicedel($vmid, $deviceid);
+    qemu_devicedelverify($vmid, $deviceid, $timeout);
+    qemu_drivedel($vmid, $deviceid) if $deviceid =~ m/^(virtio|scsi)\d+$/;
+    # the iothread of a virtio-scsi-single disk belongs to its controller and is removed there
+    qemu_deletescsihw($conf, $vmid, $device) if $deviceid =~ m/^scsi\d+$/;
+    qemu_iothread_del($vmid, $deviceid) if $deviceid =~ m/^virtio(scsi)?\d+$/;
+
+    return;
+}
+
 sub vm_deviceplug {
     my ($storecfg, $conf, $vmid, $deviceid, $device, $arch, $machine_type) = @_;
 
@@ -3972,20 +3986,12 @@ sub vm_deviceunplug {
         qemu_devicedel($vmid, $deviceid);
         qemu_devicedelverify($vmid, $deviceid);
     } elsif ($deviceid =~ m/^(virtio)(\d+)$/) {
-        qemu_devicedel($vmid, $deviceid);
-        qemu_devicedelverify($vmid, $deviceid);
-        qemu_drivedel($vmid, $deviceid);
-        qemu_iothread_del($vmid, $deviceid);
+        delete_disk_hardware($conf, $vmid, $deviceid);
     } elsif ($deviceid =~ m/^(virtioscsi|scsihw)(\d+)$/) {
-        qemu_devicedel($vmid, $deviceid);
-        qemu_devicedelverify($vmid, $deviceid, 15);
-        qemu_iothread_del($vmid, $deviceid) if $deviceid =~ m/^virtioscsi\d+$/;
+        delete_disk_hardware($conf, $vmid, $deviceid, undef, 15);
     } elsif ($deviceid =~ m/^(scsi)(\d+)$/) {
-        qemu_devicedel($vmid, $deviceid);
-        qemu_devicedelverify($vmid, $deviceid);
-        qemu_drivedel($vmid, $deviceid);
-        # the iothread of a virtio-scsi-single disk belongs to its controller and is removed there
-        qemu_deletescsihw($conf, $vmid, $deviceid);
+        my $device = parse_drive($deviceid, $conf->{$deviceid});
+        delete_disk_hardware($conf, $vmid, $deviceid, $device);
     } elsif ($deviceid =~ m/^(net)(\d+)$/) {
         qemu_devicedel($vmid, $deviceid);
         qemu_devicedelverify($vmid, $deviceid);
@@ -4124,9 +4130,7 @@ sub qemu_findorcreatescsihw {
 }
 
 sub qemu_deletescsihw {
-    my ($conf, $vmid, $opt) = @_;
-
-    my $device = parse_drive($opt, $conf->{$opt});
+    my ($conf, $vmid, $device) = @_;
 
     if ($conf->{scsihw} && ($conf->{scsihw} eq 'virtio-scsi-single')) {
         vm_deviceunplug($vmid, $conf, "virtioscsi$device->{index}");
-- 
2.47.3

[PATCH qemu-server v7 2/2] hotplug: clean up disk devices/objects if adding them failed

[Dominik Csapak]

Otherwise, parts of a disk are left over after a failed attempt to add
it. For VirtIO block disks this was the iothread. For SCSI disks, the
newly added controller was left over, including its iothread in case
of virtio-scsi-single, and if adding the controller itself failed, its
iothread too.

Use the same cleanup as for unplugging, so that all parts that might
have been added are removed again.

Also verify that a hotplugged SCSI disk actually shows up, like for
VirtIO block disks. Since errors of the HMP device_add command are not
reported, a failure was not noticed and the disk was moved from the
pending section into the config.

For SCSI disks, call print_drivedevice_full before adding any hardware,
which avoids either a leftover controller or an unnecessary controller
plug/unplug cycle if it fails. This can happen, for example, when the
storage vanished after the disk was put in the PENDING section. Add a
test for that, which would fail if we'd put print_drivedevice_full after
qemu_findorcreatescsihw but before the eval.

The failure can be tested by disabling hotplug, e.g. for an i440fx guest
one can use the following command line switches:

-global PIIX4_PM.acpi-root-pci-hotplug=off
-global PIIX4_PM.acpi-pci-hotplug-with-bridge-support=off
-global pci-bridge.shpc=off

to disable hotplug on all PCI bridges and the PCI root bus.

The added regression tests would have failed without the code change.

Signed-off-by: Dominik Csapak <d.csapak@proxmox.com>
---
 src/PVE/QemuServer.pm                         | 41 ++++++++++++-------
 src/test/hotplug/disk-add-fail.conf           | 19 +++++++++
 src/test/hotplug/disk-add-fail.conf.expected  | 10 +++++
 src/test/hotplug/disk-add-fail2.conf          | 17 ++++++++
 src/test/hotplug/disk-add-fail2.conf.expected |  1 +
 .../disk-add-scsi-shared-controller-fail.conf | 19 +++++++++
 ...-scsi-shared-controller-fail.conf.expected |  8 ++++
 .../disk-add-scsi-single-disk-fail.conf       | 19 +++++++++
 ...sk-add-scsi-single-disk-fail.conf.expected | 12 ++++++
 .../hotplug/disk-add-scsi-single-fail.conf    | 19 +++++++++
 .../disk-add-scsi-single-fail.conf.expected   |  5 +++
 11 files changed, 156 insertions(+), 14 deletions(-)
 create mode 100644 src/test/hotplug/disk-add-fail.conf
 create mode 100644 src/test/hotplug/disk-add-fail.conf.expected
 create mode 100644 src/test/hotplug/disk-add-fail2.conf
 create mode 100644 src/test/hotplug/disk-add-fail2.conf.expected
 create mode 100644 src/test/hotplug/disk-add-scsi-shared-controller-fail.conf
 create mode 100644 src/test/hotplug/disk-add-scsi-shared-controller-fail.conf.expected
 create mode 100644 src/test/hotplug/disk-add-scsi-single-disk-fail.conf
 create mode 100644 src/test/hotplug/disk-add-scsi-single-disk-fail.conf.expected
 create mode 100644 src/test/hotplug/disk-add-scsi-single-fail.conf
 create mode 100644 src/test/hotplug/disk-add-scsi-single-fail.conf.expected

diff --git a/src/PVE/QemuServer.pm b/src/PVE/QemuServer.pm
index 5bed6afa..8045c07e 100644
--- a/src/PVE/QemuServer.pm
+++ b/src/PVE/QemuServer.pm
@@ -3891,16 +3891,18 @@ sub vm_deviceplug {
             PVE::QemuServer::USB::print_usbdevice_full($conf, $deviceid, $device, {}, $1 + 1),
         );
     } elsif ($deviceid =~ m/^(virtio)(\d+)$/) {
-        qemu_iothread_add($vmid, $deviceid, $device);
-
-        qemu_driveadd($storecfg, $vmid, $device);
         my $devicefull =
             print_drivedevice_full($storecfg, $conf, $vmid, $device, $arch, $machine_type);
 
-        qemu_deviceadd($vmid, $devicefull);
-        eval { qemu_deviceaddverify($vmid, $deviceid); };
+        eval {
+            qemu_iothread_add($vmid, $deviceid, $device);
+            qemu_driveadd($storecfg, $vmid, $device);
+            qemu_deviceadd($vmid, $devicefull);
+            qemu_deviceaddverify($vmid, $deviceid);
+        };
+
         if (my $err = $@) {
-            eval { qemu_drivedel($vmid, $deviceid); };
+            eval { delete_disk_hardware($conf, $vmid, $deviceid, $device); };
             warn $@ if $@;
             die $err;
         }
@@ -3912,7 +3914,6 @@ sub vm_deviceplug {
         my $devicefull = "$scsihw_type,id=$deviceid$pciaddr";
 
         if ($deviceid =~ m/^virtioscsi(\d+)$/ && $device->{iothread}) {
-            qemu_iothread_add($vmid, $deviceid, $device);
             $devicefull .= ",iothread=iothread-$deviceid";
         }
 
@@ -3920,17 +3921,29 @@ sub vm_deviceplug {
             $devicefull .= ",num_queues=$device->{queues}";
         }
 
-        qemu_deviceadd($vmid, $devicefull);
-        qemu_deviceaddverify($vmid, $deviceid);
+        eval {
+            qemu_iothread_add($vmid, $deviceid, $device) if $deviceid =~ m/^virtioscsi/;
+            qemu_deviceadd($vmid, $devicefull);
+            qemu_deviceaddverify($vmid, $deviceid);
+        };
+        if (my $err = $@) {
+            eval { delete_disk_hardware($conf, $vmid, $deviceid, $device); };
+            warn $@ if $@;
+            die $err;
+        }
     } elsif ($deviceid =~ m/^(scsi)(\d+)$/) {
-        qemu_findorcreatescsihw($storecfg, $conf, $vmid, $device, $arch, $machine_type);
-        qemu_driveadd($storecfg, $vmid, $device);
-
         my $devicefull =
             print_drivedevice_full($storecfg, $conf, $vmid, $device, $arch, $machine_type);
-        eval { qemu_deviceadd($vmid, $devicefull); };
+
+        qemu_findorcreatescsihw($storecfg, $conf, $vmid, $device, $arch, $machine_type);
+
+        eval {
+            qemu_driveadd($storecfg, $vmid, $device);
+            qemu_deviceadd($vmid, $devicefull);
+            qemu_deviceaddverify($vmid, $deviceid);
+        };
         if (my $err = $@) {
-            eval { qemu_drivedel($vmid, $deviceid); };
+            eval { delete_disk_hardware($conf, $vmid, $deviceid, $device); };
             warn $@ if $@;
             die $err;
         }
diff --git a/src/test/hotplug/disk-add-fail.conf b/src/test/hotplug/disk-add-fail.conf
new file mode 100644
index 00000000..800b113e
--- /dev/null
+++ b/src/test/hotplug/disk-add-fail.conf
@@ -0,0 +1,19 @@
+# TEST: a disk that does not show up after hotplug is detached again
+# FAIL_DEVICE_ADD: virtio1
+# EXPECTED_ERROR: virtio1: hotplug problem - error on hotplug device 'virtio1'
+# STAYS_PENDING: 1
+bootdisk: scsi0
+cores: 2
+machine: pc-i440fx-10.1
+memory: 2048
+name: hotplug
+net0: virtio=A2:C0:43:77:08:A0,bridge=vmbr0
+ostype: l26
+scsi0: local:8006/vm-8006-disk-0.qcow2,size=32G
+scsihw: virtio-scsi-pci
+smbios1: uuid=7b10d7af-b932-4c66-b2c3-3996152ec465
+sockets: 1
+vmgenid: c773c261-d800-4348-9f5d-167fadd53cf8
+
+[PENDING]
+virtio1: local:8006/vm-8006-disk-1.qcow2,iothread=1,size=32G
diff --git a/src/test/hotplug/disk-add-fail.conf.expected b/src/test/hotplug/disk-add-fail.conf.expected
new file mode 100644
index 00000000..30946720
--- /dev/null
+++ b/src/test/hotplug/disk-add-fail.conf.expected
@@ -0,0 +1,10 @@
+storage activate_volumes ["local:8006/vm-8006-disk-1.qcow2"]
+qmp object-add {"id":"iothread-virtio1","qom-type":"iothread"}
+qmp object-del {"id":"throttle-drive-virtio1"}
+qmp object-add {"id":"throttle-drive-virtio1","limits":{},"qom-type":"throttle-group"}
+qmp blockdev-add {"detect-zeroes":"on","discard":"ignore","driver":"throttle","file":{"cache":{"direct":true,"no-flush":false},"detect-zeroes":"on","discard":"ignore","driver":"qcow2","file":{"aio":"io_uring","cache":{"direct":true,"no-flush":false},"detect-zeroes":"on","discard":"ignore","driver":"file","filename":"/var/lib/vz/images/8006/vm-8006-disk-1.qcow2","node-name":"ef4c217a7f08cf59741edc1790023f5","read-only":false},"node-name":"ff4c217a7f08cf59741edc1790023f5","read-only":false},"node-name":"drive-virtio1","read-only":false,"throttle-group":"throttle-drive-virtio1"}
+hmp device_add driver=virtio-blk-pci,drive=drive-virtio1,id=virtio1,bus=pci.0,addr=0xb,iothread=iothread-virtio1,write-cache=on
+hmp device_del virtio1
+qmp blockdev-del {"node-name":"drive-virtio1"}
+qmp object-del {"id":"throttle-drive-virtio1"}
+qmp object-del {"id":"iothread-virtio1"}
diff --git a/src/test/hotplug/disk-add-fail2.conf b/src/test/hotplug/disk-add-fail2.conf
new file mode 100644
index 00000000..bfa33eac
--- /dev/null
+++ b/src/test/hotplug/disk-add-fail2.conf
@@ -0,0 +1,17 @@
+# TEST: a disk where the storage vanishes after being put in PENDING
+# EXPECTED_ERROR: scsi7: hotplug problem - storage 'non-existing' does not exist
+# STAYS_PENDING: 1
+bootdisk: scsi0
+cores: 2
+machine: pc-i440fx-10.1
+memory: 2048
+name: hotplug
+net0: virtio=A2:C0:43:77:08:A0,bridge=vmbr0
+ostype: l26
+scsi0: local:8006/vm-8006-disk-0.qcow2,size=32G
+smbios1: uuid=7b10d7af-b932-4c66-b2c3-3996152ec465
+sockets: 1
+vmgenid: c773c261-d800-4348-9f5d-167fadd53cf8
+
+[PENDING]
+scsi7: non-existing:8006/vm-8006-disk-1.qcow2,iothread=1,size=32G
diff --git a/src/test/hotplug/disk-add-fail2.conf.expected b/src/test/hotplug/disk-add-fail2.conf.expected
new file mode 100644
index 00000000..49b6ac67
--- /dev/null
+++ b/src/test/hotplug/disk-add-fail2.conf.expected
@@ -0,0 +1 @@
+storage activate_volumes ["non-existing:8006/vm-8006-disk-1.qcow2"]
diff --git a/src/test/hotplug/disk-add-scsi-shared-controller-fail.conf b/src/test/hotplug/disk-add-scsi-shared-controller-fail.conf
new file mode 100644
index 00000000..5e148309
--- /dev/null
+++ b/src/test/hotplug/disk-add-scsi-shared-controller-fail.conf
@@ -0,0 +1,19 @@
+# TEST: a disk on a shared SCSI controller that does not show up after hotplug is detached again, but the controller is kept for the other disks
+# FAIL_DEVICE_ADD: scsi1
+# EXPECTED_ERROR: scsi1: hotplug problem - error on hotplug device 'scsi1'
+# STAYS_PENDING: 1
+bootdisk: scsi0
+cores: 2
+machine: pc-i440fx-10.1
+memory: 2048
+name: hotplug
+net0: virtio=A2:C0:43:77:08:A0,bridge=vmbr0
+ostype: l26
+scsi0: local:8006/vm-8006-disk-0.qcow2,size=32G
+scsihw: virtio-scsi-pci
+smbios1: uuid=7b10d7af-b932-4c66-b2c3-3996152ec465
+sockets: 1
+vmgenid: c773c261-d800-4348-9f5d-167fadd53cf8
+
+[PENDING]
+scsi1: local:8006/vm-8006-disk-1.qcow2,size=32G
diff --git a/src/test/hotplug/disk-add-scsi-shared-controller-fail.conf.expected b/src/test/hotplug/disk-add-scsi-shared-controller-fail.conf.expected
new file mode 100644
index 00000000..84f38e83
--- /dev/null
+++ b/src/test/hotplug/disk-add-scsi-shared-controller-fail.conf.expected
@@ -0,0 +1,8 @@
+storage activate_volumes ["local:8006/vm-8006-disk-1.qcow2"]
+qmp object-del {"id":"throttle-drive-scsi1"}
+qmp object-add {"id":"throttle-drive-scsi1","limits":{},"qom-type":"throttle-group"}
+qmp blockdev-add {"detect-zeroes":"on","discard":"ignore","driver":"throttle","file":{"cache":{"direct":true,"no-flush":false},"detect-zeroes":"on","discard":"ignore","driver":"qcow2","file":{"aio":"io_uring","cache":{"direct":true,"no-flush":false},"detect-zeroes":"on","discard":"ignore","driver":"file","filename":"/var/lib/vz/images/8006/vm-8006-disk-1.qcow2","node-name":"e70a10e5fb0473d3fc55686f720db61","read-only":false},"node-name":"f70a10e5fb0473d3fc55686f720db61","read-only":false},"node-name":"drive-scsi1","read-only":false,"throttle-group":"throttle-drive-scsi1"}
+hmp device_add driver=scsi-hd,bus=scsihw0.0,channel=0,scsi-id=0,lun=1,drive=drive-scsi1,id=scsi1,device_id=drive-scsi1,write-cache=on
+hmp device_del scsi1
+qmp blockdev-del {"node-name":"drive-scsi1"}
+qmp object-del {"id":"throttle-drive-scsi1"}
diff --git a/src/test/hotplug/disk-add-scsi-single-disk-fail.conf b/src/test/hotplug/disk-add-scsi-single-disk-fail.conf
new file mode 100644
index 00000000..f493f589
--- /dev/null
+++ b/src/test/hotplug/disk-add-scsi-single-disk-fail.conf
@@ -0,0 +1,19 @@
+# TEST: a disk on virtio-scsi-single that does not show up after hotplug has its controller and iothread removed again
+# FAIL_DEVICE_ADD: scsi1
+# EXPECTED_ERROR: scsi1: hotplug problem - error on hotplug device 'scsi1'
+# STAYS_PENDING: 1
+bootdisk: scsi0
+cores: 2
+machine: pc-i440fx-10.1
+memory: 2048
+name: hotplug
+net0: virtio=A2:C0:43:77:08:A0,bridge=vmbr0
+ostype: l26
+scsi0: local:8006/vm-8006-disk-0.qcow2,iothread=1,size=32G
+scsihw: virtio-scsi-single
+smbios1: uuid=7b10d7af-b932-4c66-b2c3-3996152ec465
+sockets: 1
+vmgenid: c773c261-d800-4348-9f5d-167fadd53cf8
+
+[PENDING]
+scsi1: local:8006/vm-8006-disk-1.qcow2,iothread=1,size=32G
diff --git a/src/test/hotplug/disk-add-scsi-single-disk-fail.conf.expected b/src/test/hotplug/disk-add-scsi-single-disk-fail.conf.expected
new file mode 100644
index 00000000..a5da2480
--- /dev/null
+++ b/src/test/hotplug/disk-add-scsi-single-disk-fail.conf.expected
@@ -0,0 +1,12 @@
+storage activate_volumes ["local:8006/vm-8006-disk-1.qcow2"]
+qmp object-add {"id":"iothread-virtioscsi1","qom-type":"iothread"}
+hmp device_add driver=virtio-scsi-pci,id=virtioscsi1,bus=pci.3,addr=0x2,iothread=iothread-virtioscsi1
+qmp object-del {"id":"throttle-drive-scsi1"}
+qmp object-add {"id":"throttle-drive-scsi1","limits":{},"qom-type":"throttle-group"}
+qmp blockdev-add {"detect-zeroes":"on","discard":"ignore","driver":"throttle","file":{"cache":{"direct":true,"no-flush":false},"detect-zeroes":"on","discard":"ignore","driver":"qcow2","file":{"aio":"io_uring","cache":{"direct":true,"no-flush":false},"detect-zeroes":"on","discard":"ignore","driver":"file","filename":"/var/lib/vz/images/8006/vm-8006-disk-1.qcow2","node-name":"e70a10e5fb0473d3fc55686f720db61","read-only":false},"node-name":"f70a10e5fb0473d3fc55686f720db61","read-only":false},"node-name":"drive-scsi1","read-only":false,"throttle-group":"throttle-drive-scsi1"}
+hmp device_add driver=scsi-hd,bus=virtioscsi1.0,channel=0,scsi-id=0,lun=1,drive=drive-scsi1,id=scsi1,device_id=drive-scsi1,write-cache=on
+hmp device_del scsi1
+qmp blockdev-del {"node-name":"drive-scsi1"}
+qmp object-del {"id":"throttle-drive-scsi1"}
+hmp device_del virtioscsi1
+qmp object-del {"id":"iothread-virtioscsi1"}
diff --git a/src/test/hotplug/disk-add-scsi-single-fail.conf b/src/test/hotplug/disk-add-scsi-single-fail.conf
new file mode 100644
index 00000000..d9a9a30f
--- /dev/null
+++ b/src/test/hotplug/disk-add-scsi-single-fail.conf
@@ -0,0 +1,19 @@
+# TEST: a virtio-scsi-single controller that does not show up after hotplug has its iothread removed again
+# FAIL_DEVICE_ADD: virtioscsi1
+# EXPECTED_ERROR: scsi1: hotplug problem - error on hotplug device 'virtioscsi1'
+# STAYS_PENDING: 1
+bootdisk: scsi0
+cores: 2
+machine: pc-i440fx-10.1
+memory: 2048
+name: hotplug
+net0: virtio=A2:C0:43:77:08:A0,bridge=vmbr0
+ostype: l26
+scsi0: local:8006/vm-8006-disk-0.qcow2,iothread=1,size=32G
+scsihw: virtio-scsi-single
+smbios1: uuid=7b10d7af-b932-4c66-b2c3-3996152ec465
+sockets: 1
+vmgenid: c773c261-d800-4348-9f5d-167fadd53cf8
+
+[PENDING]
+scsi1: local:8006/vm-8006-disk-1.qcow2,iothread=1,size=32G
diff --git a/src/test/hotplug/disk-add-scsi-single-fail.conf.expected b/src/test/hotplug/disk-add-scsi-single-fail.conf.expected
new file mode 100644
index 00000000..fc291ec6
--- /dev/null
+++ b/src/test/hotplug/disk-add-scsi-single-fail.conf.expected
@@ -0,0 +1,5 @@
+storage activate_volumes ["local:8006/vm-8006-disk-1.qcow2"]
+qmp object-add {"id":"iothread-virtioscsi1","qom-type":"iothread"}
+hmp device_add driver=virtio-scsi-pci,id=virtioscsi1,bus=pci.3,addr=0x2,iothread=iothread-virtioscsi1
+hmp device_del virtioscsi1
+qmp object-del {"id":"iothread-virtioscsi1"}
-- 
2.47.3