From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from firstgate.proxmox.com (firstgate.proxmox.com [IPv6:2a01:7e0:0:424::9]) by lore.proxmox.com (Postfix) with ESMTPS id 8793A1FF17C for ; Wed, 17 Sep 2025 19:47:59 +0200 (CEST) Received: from firstgate.proxmox.com (localhost [127.0.0.1]) by firstgate.proxmox.com (Proxmox) with ESMTP id 29136B8EF; Wed, 17 Sep 2025 19:48:12 +0200 (CEST) To: "Max R. Carrara" , Proxmox VE development discussion Date: Wed, 17 Sep 2025 17:47:25 +0000 References: In-Reply-To: MIME-Version: 1.0 Message-ID: List-Id: Proxmox VE development discussion List-Post: From: Lorne Guse via pve-devel Precedence: list Cc: Lorne Guse X-Mailman-Version: 2.1.29 X-BeenThere: pve-devel@lists.proxmox.com List-Subscribe: , List-Unsubscribe: , List-Archive: Reply-To: Proxmox VE development discussion List-Help: Subject: Re: [pve-devel] busy dataset when trying the migrate iscsi disk Content-Type: multipart/mixed; boundary="===============4156363011799744810==" Errors-To: pve-devel-bounces@lists.proxmox.com Sender: "pve-devel" --===============4156363011799744810== Content-Type: message/rfc822 Content-Disposition: inline Return-Path: X-Original-To: pve-devel@lists.proxmox.com Delivered-To: pve-devel@lists.proxmox.com Received: from firstgate.proxmox.com (firstgate.proxmox.com [212.224.123.68]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits)) (No client certificate requested) by lists.proxmox.com (Postfix) with ESMTPS id AAF56D1F42 for ; Wed, 17 Sep 2025 19:48:10 +0200 (CEST) Received: from firstgate.proxmox.com (localhost [127.0.0.1]) by firstgate.proxmox.com (Proxmox) with ESMTP id 83E83B869 for ; Wed, 17 Sep 2025 19:47:40 +0200 (CEST) Received: from NAM11-CO1-obe.outbound.protection.outlook.com (mail-co1nam11olkn2082c.outbound.protection.outlook.com [IPv6:2a01:111:f403:2c16::82c]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (secp384r1) server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by firstgate.proxmox.com (Proxmox) with ESMTPS for ; Wed, 17 Sep 2025 19:47:38 +0200 (CEST) ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=wkONOGvJwAxN6jWVKlqKo6c4YLUPzRCp+kHW4eFZ24loIgxy1wYu2HNyGoypYy0MakDPo0yvaRwjvltM7t9wV8PtriAHy+b/GqZ0z5Q13BsmJ9Y6q5k8gCfDUKYTeXHPwgbJY2rvLNRJuxtMTwYYZJnCrIQ0C15PA8WM6tgWGxfJ1TxV2ST6GdEl4K2eCG1o8WXtunT8q4SDlIsYRrqmHpgnsiv4YnsqjoS/97B7zo07Fo6wPEN9569cL8obyx2UXVaxlAa2QgyMxXJF+0LbNRqVVTUESpEkdep/POl+rPSSp9eeaLbu5Dzdqm1o4iihhWBPmDw9/lEaU8BpxPAhbw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=PyjVL50kn+Lt6WUN2dQ9g3YyhyXafHjXdPdmwF+Bccs=; b=sZ0h4vRJohL+Hphyoap+qlZilm0gsJs1oM41jz3TCj3D2/C95Zm7lxaLJJM/V4wr/Jlsqw/00bx+g/1tu7akdNaWm67JrcfZOHm3M4hbq5ibTGPi76SXzhtrvbXa00/rBTHKkLD60zK3hBOOsnEYfj9ZbwKDEPHdzAUyrXyc11mpaEr5R/6Y00K8AOf+sFdna55BNGWUGVDD7wJtO2FtgOoDXROq7Z/uouUKN6JZM+0gVkX7uTBPBb8XcfRU80l4fhuy+oDT6A0KVCRD/xUfohHUtMQwM6z6HzKaw7gQ3nj3iq17PaKDfOpKz4FUayG0sdCAHe6ioDXW76vlZ4qBmw== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=none; dmarc=none; dkim=none; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=hotmail.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=PyjVL50kn+Lt6WUN2dQ9g3YyhyXafHjXdPdmwF+Bccs=; b=Vzu3M5naFs6Nur+ZeWQ+v4oP4XJbWOcNFeqODQuUMrMNhOoUE4en6eo7BVyu2Fqx1JMeNdbIuTW35u8z7ktSopwrAO/ZEbgRAepy5e9ryvaPLOi+4jFQZUziCayPzSDBf1B0pxnQTPhwJkDU8u19p3iq7ABPOx6ZrgB5JIkqGsVVHOcisN7vf5yvWSnca+lKugsJ8iczMuS3XAt/ToMFp6oQ15UUkMRCZfZwJl/jDxHrh9fSvofImMCbOvzTwiUnNBhkeLMeCkY6qdtT4vLGD081FFexCqQMy/Kjr140f7bFoRm7F61NYv3ngOqwOVy33hKuRNnm2zjhJYMjEWxeTQ== Received: from DM6PR17MB3466.namprd17.prod.outlook.com (2603:10b6:5:1df::23) by IA0PR17MB6298.namprd17.prod.outlook.com (2603:10b6:208:43a::18) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.9137.13; Wed, 17 Sep 2025 17:47:25 +0000 Received: from DM6PR17MB3466.namprd17.prod.outlook.com ([fe80::e9a8:2d84:b202:de5c]) by DM6PR17MB3466.namprd17.prod.outlook.com ([fe80::e9a8:2d84:b202:de5c%5]) with mapi id 15.20.9137.012; Wed, 17 Sep 2025 17:47:25 +0000 From: Lorne Guse To: "Max R. Carrara" , Proxmox VE development discussion Subject: Re: busy dataset when trying the migrate iscsi disk Thread-Topic: busy dataset when trying the migrate iscsi disk Thread-Index: AQHcJfFQa4et/y9I0Uq+NSt187RQxrSXSocAgABaRoc= Date: Wed, 17 Sep 2025 17:47:25 +0000 Message-ID: References: In-Reply-To: Accept-Language: en-US, en-CA Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: msip_labels: x-ms-exchange-messagesentrepresentingtype: 1 x-ms-publictraffictype: Email x-ms-traffictypediagnostic: DM6PR17MB3466:EE_|IA0PR17MB6298:EE_ x-ms-office365-filtering-correlation-id: 787e5536-db29-4046-bc63-08ddf612432e x-microsoft-antispam: BCL:0;ARA:14566002|8062599012|8060799015|19110799012|31061999003|12050799012|461199028|15080799012|15030799006|9400799033|40105399003|440099028|3412199025|10035399007|102099032; x-microsoft-antispam-message-info: =?us-ascii?Q?EvcxhA1UldSbUSgIQ73Rnj5LuXi6JlwX7psU4zU+3R6IEhFjviYdQmYszbF1?= =?us-ascii?Q?ZE4S8NVTEjo2HPIgBp//IC8q8iukhtFLXX2a0BZ+0jmQHvwOQaMVWV1bbTca?= =?us-ascii?Q?++rNgv2JyT++NG/fhKjIzdPYbISeRpMwz1V/RvMdoXrLhzOoQWBojDytMQ7S?= =?us-ascii?Q?VsSeWNl6NKQL3B1QYs5/NCUsRV/0JWVtZN4USHvvfObsyPJ5iD8sn/ZlomIO?= =?us-ascii?Q?aqznzSc4M8KCH3Jy5w8MG6kYSdu2BiTziPmYpSpe9qG/WbxUCKiD2S1lt1e5?= =?us-ascii?Q?cInkzrxCwjgFHVUoNTaqGgG3skStiE4o7bAxO7YXvi+TD0EQZZig00l5BSwB?= =?us-ascii?Q?8qXdP6XyfmSTs+LzFs2rK6HEU8YFagVpZo5g4BHBPBOL6j34mhbexyu91Uen?= =?us-ascii?Q?pPPmpo2+4QwO7YHZiPPf6raWmQ8XUFGhjBEiOkqEzGx8yYJutt/l44GLN3Pl?= =?us-ascii?Q?1Gl4eQPaIjC3vsxH0ii5o9/AiD3hXlEMYx9QU25vZoWn9izA6rYH5RYUA9ov?= =?us-ascii?Q?KrMJm5VfgttsFJX06iCM7L4ZFtiYZuwVWulQ5bks45t2pcrD+mTybmMXMiRh?= =?us-ascii?Q?bpjqC4ka3HplYPvV1GEVYxKlx8cK01cZW/8YaDmx7BvlWY2KIgzI1bSWmB4p?= =?us-ascii?Q?kadGFwXkg961XCbMA2m6coMsj8T/LryKVd2mkuuw5tB+SiUdWX2PjbsdpOim?= =?us-ascii?Q?eaMMJYwOhDLcQMJ3pxVI/tORbWbtjXVNV5KBua6STqO/3Y4L3Tbmjy64diHC?= =?us-ascii?Q?E5roq3HiIqh7QsFxIfo6JkKKP8PQKakR5CvDlpJO1Hp7l0IqyCWMGVPyjZwC?= =?us-ascii?Q?8/bnvuTBnQ4y3aB5JG0MdHdoQmJ3/EcmFDBkN26GKzqGCHgTkPsCNxq5pAOe?= =?us-ascii?Q?n//lifIgb55PIl7Bs+S2xmtehgdrf0GK9DPWMDDv4ZJ8nw+zYQ56+bNuT7Nv?= =?us-ascii?Q?DGEkFnHL2+JPXolgFxf5pfsxl8DLC5+vb6u3PXMNy8Ptv/1RRokE5Hw8fUwQ?= =?us-ascii?Q?/MscrQwWYDVVVA7mqQvp1JpaGt1X/STEQRIFwvDx3Gz9pCl/AANnPMkhfpCJ?= =?us-ascii?Q?yoPth32SQjoeaO1LTTgFDquYm2vLM2IgUAG8s5wz2Prqai/IGn5njYphCTqm?= =?us-ascii?Q?ptGOL0RjowcltIEIZZh98mra/mDMDz/alDYP7/ebbEuZ5zRXr5rWonsZT/Ah?= =?us-ascii?Q?j8k+3Vn/MIuSMOEJMnFgDDjnz3qviO5/43a8C8lJpoJ2rKb2vWZsCwk87vHv?= =?us-ascii?Q?GKdet8Iwd7E8czRVE18s?= x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?us-ascii?Q?s7MINViCcTFkO1Mp2mH4MawNMv4815mQInvaDvWEBLDGjtO70AJkJs790p8E?= =?us-ascii?Q?j7v7uCsBJpVhjaEJ7SkAly12KcMEFwwm0LvaOr3icmhBXljx7DNGenWDcDja?= =?us-ascii?Q?+RRoo+UtmEROLxRyrHA3HiX9ocQb1X7rh9v7P3S1ZdxZyYIf4a2jkT5pft3Z?= =?us-ascii?Q?j4HJoJ7j/pl3Q1cAgQ+yTFqCDxFk1Ah3rF1fmCx+UkJwVZxWO6qT0/LE66fm?= =?us-ascii?Q?Q1gQtzwm8UaYxu5jG6kJw8g/iQFkQjXgxboEr1o7i2hrAStgPn7BDu4j4qbS?= =?us-ascii?Q?WHrKGZNOnmA+yVKazyjABjXS53XFs2dN8PSYXUXSXSLfJJnZsLu8PuFJ4hvL?= =?us-ascii?Q?r0cl74gIMdQor9DDczSSjyGHfsATkXEsEEUccB2HK8u1PLtsg07R+TxPbD8D?= =?us-ascii?Q?gbBnYxUq2Zet07yEf7Kjh3sENyPfSg38S/OeIiD4sX3u+nhJVeK5F8M+q8MN?= =?us-ascii?Q?h8E5j0hRUic5Btr3Aa8h4ULpFlP6aaIYAafxZGxrbnARsXXDs3YkUObbTYnE?= =?us-ascii?Q?vi3ey3WwX/4rR8+26cvbDdLqtCtu84Uywm6kQ1sNhV/kCXeocsdJmnDSyPVu?= =?us-ascii?Q?Oo5Fr8jo9wFz5IV3sG2NQ8Wf6PxlPvH2fiQDcHCx56hndS4O33a/nAIsoDgf?= =?us-ascii?Q?ew7qKeVDEvbxCiqIU2NRACZYpACQv5xSl/lkjLfcLvt5g2qoCKomWPWbsLjT?= =?us-ascii?Q?97tq0ktcem08CQSqBWu94DjmwOiDB4Wqn6dd9MDXciaMSvnnJ334at9Wt8ds?= =?us-ascii?Q?7kuU4YyVRX2v7p/aY4ANj2+243fZK/0fjfQASnjl4HtmM7L0EKmQUEKYE3uH?= =?us-ascii?Q?xtClfdV9cXnVf8dpNETcgI0az7A1noVHqA9PdyunsqJFYnLC0dKM5O50R5RK?= =?us-ascii?Q?7Iks4U98j54crkT2vGI1wZ0t0M4xV8MT8EG7gX09M6IQkKhF9DsV9NTowAP3?= =?us-ascii?Q?1aNnxp2CAD/BU2VEzbkHHfq7nk541Kk1YKGJneBNvJw7dehrkl+CtDXSrZWs?= =?us-ascii?Q?cdYOg4NrwPA6osIeJ6CvO+PdkiO7MlM3+rkXoaODBEkNjk7XYhTz+x1+56fM?= =?us-ascii?Q?qnbLr3gLbHjzMZ1cih13JfzpVzkHkUOoDEgxBl6B6A1MbujMdQBj20ZAAtqr?= =?us-ascii?Q?hGqXSRjTOA0Dbz4td+0J/bludoIAl5bgUy0QQ3+AbKgySGykZh3MAqvLW7IH?= =?us-ascii?Q?8OdIfjOn5ZZUd6zDpLaPsiNnWwLfT0yxS1akKKOENnV54urM50UrNm8vumQ?= =?us-ascii?Q?=3D?= MIME-Version: 1.0 X-OriginatorOrg: sct-15-20-8534-20-msonline-outlook-31e5f.templateTenant X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: DM6PR17MB3466.namprd17.prod.outlook.com X-MS-Exchange-CrossTenant-RMS-PersistedConsumerOrg: 00000000-0000-0000-0000-000000000000 X-MS-Exchange-CrossTenant-Network-Message-Id: 787e5536-db29-4046-bc63-08ddf612432e X-MS-Exchange-CrossTenant-originalarrivaltime: 17 Sep 2025 17:47:25.3350 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 84df9e7f-e9f6-40af-b435-aaaaaaaaaaaa X-MS-Exchange-CrossTenant-rms-persistedconsumerorg: 00000000-0000-0000-0000-000000000000 X-MS-Exchange-Transport-CrossTenantHeadersStamped: IA0PR17MB6298 X-SPAM-LEVEL: Spam detection results: 0 ARC_SIGNED 0.001 Message has a ARC signature ARC_VALID 0.001 Message has a valid ARC signature AWL -0.434 Adjusted score from AWL reputation of From: address BAYES_00 -1.9 Bayes spam probability is 0 to 1% DKIM_SIGNED 0.1 Message has a DKIM or DK signature, not necessarily valid DKIM_VALID -0.1 Message has at least one valid DKIM or DK signature DKIM_VALID_AU -0.1 Message has a valid DKIM or DK signature from author's domain DKIM_VALID_EF -0.1 Message has a valid DKIM or DK signature from envelope-from domain DMARC_PASS -0.1 DMARC pass policy FREEMAIL_FROM 0.001 Sender email is commonly abused enduser mail provider GB_GEN_REDIR_URL 0.5 Redirector found in href link HTML_MESSAGE 0.001 HTML included in message HTTPS_HTTP_MISMATCH 0.1 - KAM_LOTSOFHASH 0.25 Emails with lots of hash-like gibberish SPF_HELO_PASS -0.001 SPF: HELO matches SPF record SPF_PASS -0.001 SPF: sender matches SPF record URIBL_BLOCKED 0.001 ADMINISTRATOR NOTICE: The query to URIBL was blocked. See http://wiki.apache.org/spamassassin/DnsBlocklists#dnsbl-block for more information. [proxmox.com,zfsplugin.pm,zfspoolplugin.pm] Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.29 Ironically the patch version of the plugin actually utilizes the native Pro= xmox code in ZFSPlugin.pm / ZFSPoolPlugin.pm for managed the zvol dataset. = The patch version only manages the iSCSI configuration. I think the best course is to consider the patch version legacy and focus o= n the new fully API driven Custom Storage Plugin. TrueNAS indicated there are plans to implement some form of UI hooks for Cu= stom Storage Plugins. This is very encouraging. ________________________________ From: Max R. Carrara Sent: Wednesday, September 17, 2025 6:04 AM To: Lorne Guse ; Proxmox VE development discussio= n Subject: Re: busy dataset when trying the migrate iscsi disk On Mon Sep 15, 2025 at 5:34 AM CEST, Lorne Guse wrote: > I'm working on TrueNAS over iSCSI for Proxmox and have run into an issue = migrating disks. When trying to delete the old storage, which has just succ= essfully been transfered, the iscsidirect connection must remain open becau= se we are getting: > > cannot destroy 'slow/vm-188-disk-0': dataset is busy > > Is there a way to ensure the iscsidirect connection is closed before tryi= ng to delete the underlying zfs dataset? Hi Lorne! Glad to see you on the mailing list! I've sifted around our code to see how we handle this, and it seems that we're simply retrying a couple of times until the dataset is actually deleted [0]. I think that might be your best bet, though if you find an alternative, I'd be curious to know. [0]: https://na01.safelinks.protection.outlook.com/?url=3Dhttps%3A%2F%2Fgit= .proxmox.com%2F%3Fp%3Dpve-storage.git%3Ba%3Dblob%3Bf%3Dsrc%2FPVE%2FStorage%= 2FZFSPoolPlugin.pm%3Bh%3Dd8d8d0f9fc1cc6f1a02d8f5800c388b355609bf5%3Bhb%3Dre= fs%2Fheads%2Fmaster%23l362&data=3D05%7C02%7C%7C08ddb2ac62744e0c4a2908ddf5e2= 59ac%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C638937074705932603%7CUnkn= own%7CTWFpbGZsb3d8eyJFbXB0eU1hcGkiOnRydWUsIlYiOiIwLjAuMDAwMCIsIlAiOiJXaW4zM= iIsIkFOIjoiTWFpbCIsIldUIjoyfQ%3D%3D%7C0%7C%7C%7C&sdata=3DdV3Ch024RrnvSKKDsT= 4k1zP23S%2BCX9jFR6YISZ5Lpe0%3D&reserved=3D0 --===============4156363011799744810== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ pve-devel mailing list pve-devel@lists.proxmox.com https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-devel --===============4156363011799744810==--