From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from gate001.proxmox.com (gate001.proxmox.com [45.144.208.40]) by lore.proxmox.com (Postfix) with ESMTPS id DFDD41FF0EF for ; Sun, 02 Aug 2026 05:37:08 +0200 (CEST) Received: from gate001.proxmox.com (localhost.localdomain [127.0.0.1]) by gate001.proxmox.com (Proxmox) with ESMTP id 2AF4721560; Sun, 02 Aug 2026 05:36:56 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=neatech-ar.20251104.gappssmtp.com; s=20251104; t=1785641798; x=1786246598; darn=lists.proxmox.com; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:from:to:cc:subject:date :message-id:reply-to:content-type; bh=ibOP4wxjLl7LFf1NVwpk2IThIGGTmPsHZx8+Obyu2YE=; b=VgGs8WwXz3y6ej4r+G60WNe27N02SFps5MBFCS0CfEWd26nJxwAzdZGnfney1qK0Mj KKS7+L02ptQ1d6ZAFai/D9SynutzDOsY8Q6CZUI9ERd0avuc7JHiaZjDjuMPnNMBnF7q ej2lq/fbRmy+TZYHpE+GYBgyA7sx+4DRnaS0dE1CFuvdpnlBdgLwY92/zdDc7nZrzXYW qYd3cKTDN1EZlve49nYLrZI5uOADHiz+kaW7E7GAbWZDcxWeWQwIN1eD+d8DB7UfNlLt Olmi4+OitYb7ux3jsi6bQjX9kV0fzEaj5FQKq+xvhofRBpC0fGFvMphvZONdeD9RpJn0 USCw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20251104; t=1785641798; x=1786246598; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:x-gm-gg:x-gm-message-state:from :to:cc:subject:date:message-id:reply-to:content-type; bh=ibOP4wxjLl7LFf1NVwpk2IThIGGTmPsHZx8+Obyu2YE=; b=lcufUY/xGeJR8a6g1JG6xGGPSLECq9/OO5xB8aL9w2FknardZ3D5pV6T3y24inysfK 0LjxuxO9gTjzvVwGVnMmWoD0nx7qXa0tvVISVopTfnDxh6QoRmQ9sSIOPNdaeiy66dQx LdDjtUOfrB44icoN71vpSkmxDLX0AHnWsKTklkYXBa3vcsno5COYrCp+gfFdchrYrS4D BwI/8RlkOISs+hasXnTcF5P3b5rwGtTgjL2Qme612qDf9Cm6NKUef0hWv+zbtrYOUol6 At+KFX/Tzz1SxyTDSTdDR4jBW4DV0XwOsMUeiIhyz6PVoAttl1oQC6O0Nxt0zScyezkb WPkQ== X-Gm-Message-State: AOJu0Ywcsj+HU/d7EmPpsF3vLLs5NUpLb2ttv68YJ4/tDEXDJA9u8Hcf uMHSPbTWtGyHaRKSCzssrTushMejsouoJwF3YH+/GNw7RdgcjMFwS9G/VvybQNwRWdr5oNg6u/y 4++r5LoQ= X-Gm-Gg: AR+sD12PZvVY5j1kVB9YrbdwX5filAvVsRn5s6rkvcmc75fG0Klw+2hvSlumS2znjNL H83lkoOlJjcaUPNZyhYd9MoIXKI79KmKS9ITqox4N5HT5WOoEiiJnB//tOyB071kSIGNsjBGtjb YytXv3xUb+onpCRJe7oYiQSX6o0TUTvogAczCOXpng+9l4QiMUvyzBzvnDDQDvMm1ipTaUeK9pq 7mfCWZsfhq+SWwuO+cYVRSKZE281GChJ/ulfSKwvqCMZ86OHTJhkjNvn/Hvw+DuI9LmnlA/U8HN 5wT6CbXXhhoB8bTgHZrMyQ/+OIGa4C/V4ZRZOe+Gt2LjzfP3ORSZ3H1GpyPdTyaIDK0ld6omL1l S4oKCKMcgW7e91zVo4CBdEtlM+9lJZwiF86a9JoZhhH7g7pBRMrHJPt59XJmHo1eFkb8mpL0n80 pYamrTaLrKekOj+Yb4r/zCrLwJtuhSqhHrfTTooTSN3Sv+j32cOmATx6T/kqxYekxBYi4+YYMl8 KEIbSafXxvbcAUO0NCuZkAUZ1/e7iwGgeJLTVCuX3DkvkVQM/ZbR3w= X-Received: by 2002:a17:903:2443:b0:2cf:9e90:8be with SMTP id d9443c01a7336-2d0524799d8mr72431015ad.4.1785641798087; Sat, 01 Aug 2026 20:36:38 -0700 (PDT) From: Joaquin Varela To: pve-devel@lists.proxmox.com Subject: [PATCH docs v2 3/5] storage: document NVMe all-path loss policy Date: Sun, 2 Aug 2026 00:36:28 -0300 Message-ID: X-Mailer: git-send-email 2.54.0.windows.1 In-Reply-To: References: MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-SPAM-LEVEL: Spam detection results: 0 AWL 0.027 Adjusted score from AWL reputation of From: address DKIM_SIGNED 0.1 Message has a DKIM or DK signature, not necessarily valid DKIM_VALID -0.1 Message has at least one valid DKIM or DK signature DMARC_PASS -0.1 DMARC pass policy RCVD_IN_DNSWL_NONE -0.0001 Sender listed at https://www.dnswl.org/, no trust SPF_HELO_NONE 0.001 SPF: HELO does not publish an SPF Record SPF_PASS -0.001 SPF: sender matches SPF record Message-ID-Hash: 7ME3236NO5SCXDP5NBQG25JBQLXMHWLT X-Message-ID-Hash: 7ME3236NO5SCXDP5NBQG25JBQLXMHWLT X-MailFrom: joaquinvarela@neatech.ar X-Mailman-Rule-Misses: dmarc-mitigation; no-senders; approved; loop; banned-address; emergency; member-moderation; nonmember-moderation; administrivia; implicit-dest; max-recipients; max-size; news-moderation; no-subject; digests; suspicious-header CC: Joaquin Varela X-Mailman-Version: 3.3.10 Precedence: list List-Id: Proxmox VE development discussion List-Help: List-Owner: List-Post: List-Subscribe: List-Unsubscribe: Describe queue-until-controller-loss and optional fast-I/O-fail behavior. Make the availability-versus-prompt-error trade-off explicit and show an example without prescribing one policy for every workload. Signed-off-by: Joaquin Varela --- pve-storage-zfsnvme.adoc | 15 +++++++++++++++ 1 file changed, 15 insertions(+) diff --git a/pve-storage-zfsnvme.adoc b/pve-storage-zfsnvme.adoc index c9ae180..35f09f8 100644 --- a/pve-storage-zfsnvme.adoc +++ b/pve-storage-zfsnvme.adoc @@ -85,6 +85,13 @@ nvme-ctrl-loss-tmo:: How long a controller remains reconnectable after path loss. `-1` retries indefinitely. +nvme-fast-io-fail-tmo:: + +Optional time in seconds before outstanding I/O fails while a controller is +reconnecting. If this property is absent, the kernel queues I/O until +`nvme-ctrl-loss-tmo` expires. A configured value must not exceed a finite +controller-loss timeout. A value of `0` selects immediate fail-fast behavior. + nvme-nr-io-queues:: Optional number of I/O queues per controller. @@ -111,6 +118,7 @@ zfsnvme: nvme-shared nvme-keep-alive-tmo 5 nvme-reconnect-delay 2 nvme-ctrl-loss-tmo 600 + nvme-fast-io-fail-tmo 30 content images shared 1 ---- @@ -131,6 +139,13 @@ fencing before placing production guests on the storage. Use independent failure domains for the configured paths and make sure the ZFS target itself is not a single point of failure. +Choose the all-path outage policy for the workload. The default configuration +leaves `nvme-fast-io-fail-tmo` unset: transient outages can recover without +guest block errors, but an I/O request can remain queued for as long as +`nvme-ctrl-loss-tmo` (600 seconds in the example). Set a shorter fast-I/O-fail +timeout when the application prefers a prompt block error over a long stall. +This is a service-level decision, not a universally safer default. + Online resize of a running guest disk is not supported. Stop the VM before resizing; the new size is detected when the block device is reopened. -- 2.54.0.windows.1