From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from firstgate.proxmox.com (firstgate.proxmox.com [IPv6:2a01:7e0:0:424::9]) by lore.proxmox.com (Postfix) with ESMTPS id C02921FF15E for ; Mon, 15 Sep 2025 05:50:10 +0200 (CEST) Received: from firstgate.proxmox.com (localhost [127.0.0.1]) by firstgate.proxmox.com (Proxmox) with ESMTP id BF6D81AB15; Mon, 15 Sep 2025 05:50:14 +0200 (CEST) To: Proxmox VE development discussion Date: Mon, 15 Sep 2025 03:34:00 +0000 MIME-Version: 1.0 Message-ID: List-Id: Proxmox VE development discussion List-Post: From: Lorne Guse via pve-devel Precedence: list Cc: Lorne Guse X-Mailman-Version: 2.1.29 X-BeenThere: pve-devel@lists.proxmox.com List-Subscribe: , List-Unsubscribe: , List-Archive: Reply-To: Proxmox VE development discussion List-Help: Subject: [pve-devel] busy dataset when trying the migrate iscsi disk Content-Type: multipart/mixed; boundary="===============2499336067769617482==" Errors-To: pve-devel-bounces@lists.proxmox.com Sender: "pve-devel" --===============2499336067769617482== Content-Type: message/rfc822 Content-Disposition: inline Return-Path: X-Original-To: pve-devel@lists.proxmox.com Delivered-To: pve-devel@lists.proxmox.com Received: from firstgate.proxmox.com (firstgate.proxmox.com [212.224.123.68]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by lists.proxmox.com (Postfix) with ESMTPS id 0CD4AD08F2 for ; Mon, 15 Sep 2025 05:50:13 +0200 (CEST) Received: from firstgate.proxmox.com (localhost [127.0.0.1]) by firstgate.proxmox.com (Proxmox) with ESMTP id E57BC1AB00 for ; Mon, 15 Sep 2025 05:50:12 +0200 (CEST) Received: from NAM11-CO1-obe.outbound.protection.outlook.com (mail-co1nam11olkn2094.outbound.protection.outlook.com [40.92.18.94]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (secp384r1) server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by firstgate.proxmox.com (Proxmox) with ESMTPS for ; Mon, 15 Sep 2025 05:50:11 +0200 (CEST) ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=osA5FC8aid2PbyjCqVWya3GEvzbBrW8CBmpSYom8EZhPtZi2sHRMCEA+PQu8x8PncLqRPVWDgRUXPTHh2J/xSfDtVrh4wwvc1DebltKQcH4RxqI/icdHZ0rKNuXLs7CJmTd4GvHu1CLykd6YgmfjfJwzxRxxs0ToBEetv0k9iBQqvnrDHHEgdXdRntzc0uVjc9JBMtwWRXH2p245Q+a139BY8wGws9p7OrJm36y4LRoZT9RdCNUVW0stQVwQu+OSWrGBQ8KV9N+MOPzX35waF/t304nxstvqpogQE7nTiQZCtcmMxikxZkLo31K9pKuXXLJsaDz3a6OaHxMF2Iz/wg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=BTwUQfsrbulQBbaboLm2OHzVEvz3JmQBuql0hH98wBQ=; b=WsEfSFphptOhE6jP6ENO+UI9ntfLWI8sWYtEja5BaDL+5e+2/xYTgIpru+fcMcdg00EXTdKuJ55wT7tGZgLy4X5RpNeUXO2H0PJIc9/fRicaSybLzIhCTHJU05T04N5//Jzd/fM3RgQAnmfKI5tc/ayvsg3V6Zejlqsber1LUyqWEiqHDiHVeaiI+0U5/os7O76coqzQZMhALHKBWdqM+2YGh7SZF98ISWZgD6tCyhl0tZKUHvFNwQ0YJ7/8IcdL82gARRifszpgpY4dEDv/csLd9FpDpWipMjdb7XXztPV82pGfp+iEZrGEqDluAaN2lVv+xNk9+YDL00YHxtHJvw== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=none; dmarc=none; dkim=none; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=hotmail.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=BTwUQfsrbulQBbaboLm2OHzVEvz3JmQBuql0hH98wBQ=; b=Mm2kstH+PO9MxN+Hdcxk4oCVkR6uAH+vJi7zs651+VVq8Nn9z1ntcWBeX+7a7sJxVKDLXiNIV9kwLddkDQhVb6hJsUKa2CxP//vNThVLL/2t+RJ+2rWspa4MEoTBhjrEiN07X3EliwmkfM28ZyoroPxtgk1/Jh10meQcPE6KhaPd69GYBlTk0qKd1tB9CWdjpCVcKzzI5rMB0VZmrZM8qCpVZtuJlyN22NtMQasr0HWngOLrE+UDbI64W8fFNVyH52ajYkkk6jNZjX9RwqEzAwvtj48Udf9D8tjOySvCR7sBvo5dAyRllwe2VTraLRJPfXA/qoaATSIqrMA6gjEHRQ== Received: from DM6PR17MB3466.namprd17.prod.outlook.com (2603:10b6:5:1df::23) by DS0PR17MB6862.namprd17.prod.outlook.com (2603:10b6:8:12c::6) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.9094.22; Mon, 15 Sep 2025 03:34:00 +0000 Received: from DM6PR17MB3466.namprd17.prod.outlook.com ([fe80::e9a8:2d84:b202:de5c]) by DM6PR17MB3466.namprd17.prod.outlook.com ([fe80::e9a8:2d84:b202:de5c%5]) with mapi id 15.20.9115.018; Mon, 15 Sep 2025 03:34:00 +0000 From: Lorne Guse To: Proxmox VE development discussion Subject: busy dataset when trying the migrate iscsi disk Thread-Topic: busy dataset when trying the migrate iscsi disk Thread-Index: AQHcJfFQa4et/y9I0Uq+NSt187RQxg== Date: Mon, 15 Sep 2025 03:34:00 +0000 Message-ID: Accept-Language: en-US, en-CA Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: msip_labels: x-ms-exchange-messagesentrepresentingtype: 1 x-ms-publictraffictype: Email x-ms-traffictypediagnostic: DM6PR17MB3466:EE_|DS0PR17MB6862:EE_ x-ms-office365-filtering-correlation-id: 2d4bb4bb-ac88-45b0-239e-08ddf408b59c x-microsoft-antispam: BCL:0;ARA:14566002|8060799015|15080799012|31061999003|19110799012|461199028|15030799006|8062599012|3412199025|40105399003|440099028|102099032; x-microsoft-antispam-message-info: =?iso-8859-1?Q?uK5kdUVvLMYln1NMX43cixVqkbeHuaF003mhRRX71a0IGuzmBhnPHlQYRP?= =?iso-8859-1?Q?UJpwXlMdMZNUVG7/P7Bgk+az5W2kE4yw25rC6DPLn6qGqbam9kNn4CXtYk?= =?iso-8859-1?Q?mqpqBLuzhej5BId9q0BX97MnDc7BhJky78WCl0OCkhHfh4Cbef0pgEZ3mZ?= =?iso-8859-1?Q?AhnqxOFzf2mY+M7n70PX5gE9wNxrVPlPqsGw2mld9EVKKwh/ZnH7H9at3y?= =?iso-8859-1?Q?pGli46PBO9oDWRn6ojw9hmnY1GDD+BA7xLA5IIOHCE7rLnzDxvz6GMlAPd?= =?iso-8859-1?Q?vs0Og5/rflby8UBy0Gq+T5b1hdMWZ3uYD3fH4x1RIIG66rcBdzxUVDU1EN?= =?iso-8859-1?Q?MFmvKXb3PNQmmO3Kc+zNiAGOC6kp7PDvfpM9RbAyPyVjuhxWO3iDxTj28L?= =?iso-8859-1?Q?sUGrqVBFyepYMRPytPOBAg0mM/YJ7fQdmnxCNfqx8HJ56RM6jWNl5Ts81d?= =?iso-8859-1?Q?y8Mzxt1Fh+BuRYOXEHpf/dMQH7AnZkZsyJPB3k+B8tFJK5aN+3VybL8eIJ?= =?iso-8859-1?Q?/ICh6OEHeCP4OVOfEcl258hON1Nhrr/e+1HqG1QtRi+V4eG8/iEqNPq7+3?= =?iso-8859-1?Q?9WnkirmlfBAclrr7cKB/egDuLZrjlr9DyyT+QoH3yd5d89ghGccDnj9YXN?= =?iso-8859-1?Q?xKh5i7EXVNoFy9kf7Rhaa/kdVGIrh7JvpNNEZ4XXc4wGSmVEArlM3KTu4y?= =?iso-8859-1?Q?YL+OOvPcFxTA/5qmFomuXBUGAE9hqEeljJhyEdg+9qqZMz3LgrOlq+ic8w?= =?iso-8859-1?Q?kbySDNOf5sl+CsTKNX0YfXCFqvvj5N2N6DydSS/P5k9Ppp/A7d5Q3b8NZ7?= =?iso-8859-1?Q?IaIeGwrqZFLBWgcloEG4DQT/GxSuEAaVe1ng+hDUP6+/U2LVDIUjOZF9gz?= =?iso-8859-1?Q?5UIf6FzO13NrHW8cRfzX5ZzqXPYnX8WEzl8sCeZeRMb7nElM3NsgR3pMZy?= =?iso-8859-1?Q?edIb1R5Ozf424GUHlqZbSWOjj5IN4lRhHEi4smqttXDPSx7xiyanGBj3tv?= =?iso-8859-1?Q?2C+nVLtwtIvP9Ol+s9cugJN4YxFRftCsISGlrrHwK2RB2/GiVE+DJTij/Q?= =?iso-8859-1?Q?D5TP3KQ0TjVrTNnKgVbA8PzJ0PKyg48HfOnaK1Mhd6ZjfRJ+3SMmBjLvmk?= =?iso-8859-1?Q?Kd0yiNX/++33O3mWxIn6Zuoia8FYZiPzEtKpJXqk26iIIvMrcm3ngFTZRu?= =?iso-8859-1?Q?Nbgy+xaUAVmbOdA1kOZcyvQ3KRVvb/IonxI=3D?= x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?iso-8859-1?Q?+FiaxXox0Qa4DT7d4vXoPxBvjOhZU9k+5MWtn8XK6QbwM87vqQmO1wzxul?= =?iso-8859-1?Q?XOlvgt6coyoGzWVgDuc6polLdUW4TaWuj7JcmTn33NV9xEwDIXTVhGcXwi?= =?iso-8859-1?Q?Ji2XTPfztE9gcwyOCWr0MrJkBSp2bzAY1Zm0O08+Eq5oz5RF48eBpwTHUX?= =?iso-8859-1?Q?mXM79EYP0SyamvdZufOhKWjKtyBv4FCVJVPrCyRDlgpQ2RT2H1YJFZn0gT?= =?iso-8859-1?Q?nmCbzfjG3UC8z+KaKzETO6tXHMAr/14SLSiIhWFBEfwkQLHleNzVSJXaB1?= =?iso-8859-1?Q?xrZ27I500Qip1IkHfIWOP9DyTITJ3KKrCgBN6FU3Pcfsai9hMc5olMT3fs?= =?iso-8859-1?Q?j9igxHgx08crP00SDd6tzLSR4SHT5/x+P2bQ7wzVrpnhg5Xrpj2stFyGW7?= =?iso-8859-1?Q?9tVezvGLQezSvkfRNOWpqxYgE7YNp5fX9XEX1eQM1Z6t5lgrLg/vaE44l7?= =?iso-8859-1?Q?YFaiNL3jtn51MIdntdEMKmgjTHAx9pAEy+unSRqOYycDyz8e4s2hNTyL3/?= =?iso-8859-1?Q?P+MARjyqS4B/RZlU0wakSQD7W6lM7EYwYIrBVrSITPciV7OgxI6BsD6MrN?= =?iso-8859-1?Q?TNqeRW6K/GDXrRDlFd2e1tdrUZ3FI+eJStDYAJJf9PSimJ8fvPfw9Q5MMI?= =?iso-8859-1?Q?KJWI+zh6o45G10SaBr0tOyahBdAduFIFH5pUKkv2Z6AVLuk5mU6yF3IEre?= =?iso-8859-1?Q?WLAnDT5YvxcIpFkq56stg/2/KRI6tFiczZZyAWqYZIC6muIq8xbmzgurAL?= =?iso-8859-1?Q?tkT8Ia1SG76FdZ+emRP4KRNq7vLTY6skqiNcpWGWy5DaLm+GWmwVnDFjJj?= =?iso-8859-1?Q?BTCjHg9gjRVkh340UZpwpyWwcvzn2kPJ0Tr8Hu7qftOcWmGQGf3mG8UBs2?= =?iso-8859-1?Q?5j90bwlvzka4yuYF0w53dhvQKxTVOOCUX55hTbZMyQWfCYaF7uQvXNYn9F?= =?iso-8859-1?Q?kRdkc6ZrlRvKke6fKZEhbJdC4XFZfSWC+l+4A8Vi/u23OXK53tRKmYC1Ey?= =?iso-8859-1?Q?PYY8GNbT/xf5VE+F24K3w2OhUd+cKCt/hsjBjYrPEns1yPjZTap5WkvjMW?= =?iso-8859-1?Q?y1Td++JPSjdOgTRfPXeuMB4Hbpd0BHbwE/fxKn4jeUBZQEqIZSmCDlp1PX?= =?iso-8859-1?Q?DZPgBrivDmojIF2fBbgm5m8h9PJG9OjzvN9G6lv2fke0dy1IhTUzctpkYr?= =?iso-8859-1?Q?q40uMhVvE1RXH6jfo5ErMg8OFtBN2/JEpUta+ZcCSbzbvB36bN1IeF0IKL?= =?iso-8859-1?Q?FHH+Q+nsqwyTgaND4D3s2yIZYAuk2AI0QVEYKOQHo=3D?= MIME-Version: 1.0 X-OriginatorOrg: sct-15-20-8534-20-msonline-outlook-31e5f.templateTenant X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: DM6PR17MB3466.namprd17.prod.outlook.com X-MS-Exchange-CrossTenant-RMS-PersistedConsumerOrg: 00000000-0000-0000-0000-000000000000 X-MS-Exchange-CrossTenant-Network-Message-Id: 2d4bb4bb-ac88-45b0-239e-08ddf408b59c X-MS-Exchange-CrossTenant-originalarrivaltime: 15 Sep 2025 03:34:00.0226 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 84df9e7f-e9f6-40af-b435-aaaaaaaaaaaa X-MS-Exchange-CrossTenant-rms-persistedconsumerorg: 00000000-0000-0000-0000-000000000000 X-MS-Exchange-Transport-CrossTenantHeadersStamped: DS0PR17MB6862 X-SPAM-LEVEL: Spam detection results: 0 ARC_SIGNED 0.001 Message has a ARC signature ARC_VALID -0.1 Message has a valid ARC signature AWL 0.056 Adjusted score from AWL reputation of From: address BAYES_00 -1.9 Bayes spam probability is 0 to 1% DKIM_SIGNED 0.1 Message has a DKIM or DK signature, not necessarily valid DKIM_VALID -0.1 Message has at least one valid DKIM or DK signature DKIM_VALID_AU -0.1 Message has a valid DKIM or DK signature from author's domain DKIM_VALID_EF -0.1 Message has a valid DKIM or DK signature from envelope-from domain DMARC_PASS -0.1 DMARC pass policy FREEMAIL_FROM 0.001 Sender email is commonly abused enduser mail provider HTML_MESSAGE 0.001 HTML included in message RCVD_IN_DNSWL_NONE -0.0001 Sender listed at https://www.dnswl.org/, no trust RCVD_IN_MSPIKE_H2 -0.01 Average reputation (+2) RCVD_IN_VALIDITY_CERTIFIED_BLOCKED 0.001 ADMINISTRATOR NOTICE: The query to Validity was blocked. See https://knowledge.validity.com/hc/en-us/articles/20961730681243 for more information. RCVD_IN_VALIDITY_RPBL_BLOCKED 0.001 ADMINISTRATOR NOTICE: The query to Validity was blocked. See https://knowledge.validity.com/hc/en-us/articles/20961730681243 for more information. RCVD_IN_VALIDITY_SAFE_BLOCKED 0.001 ADMINISTRATOR NOTICE: The query to Validity was blocked. See https://knowledge.validity.com/hc/en-us/articles/20961730681243 for more information. SPF_HELO_PASS -0.001 SPF: HELO matches SPF record SPF_PASS -0.001 SPF: sender matches SPF record Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.29 I'm working on TrueNAS over iSCSI for Proxmox and have run into an issue mi= grating disks. When trying to delete the old storage, which has just succes= sfully been transfered, the iscsidirect connection must remain open because= we are getting: cannot destroy 'slow/vm-188-disk-0': dataset is busy Is there a way to ensure the iscsidirect connection is closed before trying= to delete the underlying zfs dataset? TrueNAS [INFO] : zvol/slow/vm-188-disk-0 with key 'path' found : /dev/zvol/= slow/vm-188-disk-0 TrueNAS [INFO] : zvol/slow/vm-188-disk-0 with key 'lunid' found : 3 create full clone of drive scsi0 (iSCSI-vm-storage-HDD:vm-188-disk-0) TrueNAS [INFO] : /dev/zvol/fast/vm-188-disk-0 TrueNAS [INFO] : Created LUN: /dev/zvol/fast/vm-188-disk-0 : T2:E236:L4 TrueNAS [INFO] : zvol/fast/vm-188-disk-0 with key 'path' found : /dev/zvol/= fast/vm-188-disk-0 TrueNAS [INFO] : zvol/fast/vm-188-disk-0 with key 'lunid' found : 4 drive mirror is starting for drive-scsi0 mirror-scsi0: transferred 924.0 MiB of 32.0 GiB (2.82%) in 1s mirror-scsi0: transferred 1.8 GiB of 32.0 GiB (5.70%) in 2s mirror-scsi0: transferred 2.7 GiB of 32.0 GiB (8.56%) in 3s mirror-scsi0: transferred 3.7 GiB of 32.0 GiB (11.68%) in 4s mirror-scsi0: transferred 4.7 GiB of 32.0 GiB (14.54%) in 5s mirror-scsi0: transferred 5.5 GiB of 32.0 GiB (17.22%) in 6s mirror-scsi0: transferred 6.3 GiB of 32.0 GiB (19.71%) in 7s mirror-scsi0: transferred 7.1 GiB of 32.0 GiB (22.29%) in 8s mirror-scsi0: transferred 8.0 GiB of 32.0 GiB (24.97%) in 9s mirror-scsi0: transferred 8.8 GiB of 32.0 GiB (27.55%) in 10s mirror-scsi0: transferred 9.6 GiB of 32.0 GiB (30.06%) in 11s mirror-scsi0: transferred 10.6 GiB of 32.0 GiB (33.00%) in 12s mirror-scsi0: transferred 11.5 GiB of 32.0 GiB (36.04%) in 13s mirror-scsi0: transferred 12.5 GiB of 32.0 GiB (38.97%) in 14s mirror-scsi0: transferred 13.4 GiB of 32.0 GiB (41.72%) in 15s mirror-scsi0: transferred 14.2 GiB of 32.0 GiB (44.43%) in 16s mirror-scsi0: transferred 15.1 GiB of 32.0 GiB (47.25%) in 17s mirror-scsi0: transferred 16.1 GiB of 32.0 GiB (50.19%) in 18s mirror-scsi0: transferred 17.0 GiB of 32.0 GiB (53.15%) in 19s mirror-scsi0: transferred 18.0 GiB of 32.0 GiB (56.16%) in 20s mirror-scsi0: transferred 18.8 GiB of 32.0 GiB (58.88%) in 21s mirror-scsi0: transferred 19.8 GiB of 32.0 GiB (61.81%) in 22s mirror-scsi0: transferred 20.6 GiB of 32.0 GiB (64.42%) in 23s mirror-scsi0: transferred 21.5 GiB of 32.0 GiB (67.07%) in 24s mirror-scsi0: transferred 22.4 GiB of 32.0 GiB (70.02%) in 25s mirror-scsi0: transferred 23.3 GiB of 32.0 GiB (72.92%) in 26s mirror-scsi0: transferred 24.3 GiB of 32.0 GiB (75.80%) in 27s mirror-scsi0: transferred 25.1 GiB of 32.0 GiB (78.58%) in 28s mirror-scsi0: transferred 26.1 GiB of 32.0 GiB (81.62%) in 29s mirror-scsi0: transferred 27.1 GiB of 32.0 GiB (84.76%) in 30s mirror-scsi0: transferred 28.1 GiB of 32.0 GiB (87.73%) in 31s mirror-scsi0: transferred 29.1 GiB of 32.0 GiB (90.79%) in 32s mirror-scsi0: transferred 30.0 GiB of 32.0 GiB (93.73%) in 33s mirror-scsi0: transferred 30.9 GiB of 32.0 GiB (96.55%) in 34s mirror-scsi0: transferred 31.8 GiB of 32.0 GiB (99.44%) in 35s mirror-scsi0: transferred 32.0 GiB of 32.0 GiB (100.00%) in 36s, ready all 'mirror' jobs are ready mirror-scsi0: Completing block job... mirror-scsi0: Completed successfully. mirror-scsi0: mirror-job finished TrueNAS [INFO] : Ping TrueNAS [INFO] : Pong TrueNAS [INFO] : zvol/slow/vm-188-disk-0 with key 'path' found : /dev/zvol/= slow/vm-188-disk-0 TrueNAS [INFO] : Deleted LUN: zvol/slow/vm-188-disk-0 cannot destroy 'slow/vm-188-disk-0': dataset is busy TrueNAS [INFO] : /dev/zvol/slow/vm-188-disk-0 TrueNAS [INFO] : Created LUN: /dev/zvol/slow/vm-188-disk-0 : T5:E237:L3 command '/usr/bin/ssh -o 'BatchMode=3Dyes' -i /etc/pve/priv/zfs/vm-storage_= id_rsa root@vm-storage zfs destroy -r slow/vm-188-disk-0' failed: exit code= 1 TASK OK [ --===============2499336067769617482== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ pve-devel mailing list pve-devel@lists.proxmox.com https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-devel --===============2499336067769617482==--