From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: <pve-devel-bounces@lists.proxmox.com> Received: from firstgate.proxmox.com (firstgate.proxmox.com [IPv6:2a01:7e0:0:424::9]) by lore.proxmox.com (Postfix) with ESMTPS id 8B4431FF168 for <inbox@lore.proxmox.com>; Tue, 4 Feb 2025 13:44:03 +0100 (CET) Received: from firstgate.proxmox.com (localhost [127.0.0.1]) by firstgate.proxmox.com (Proxmox) with ESMTP id 699F616203; Tue, 4 Feb 2025 13:44:01 +0100 (CET) Date: Tue, 4 Feb 2025 14:43:48 +0200 To: pve-devel@lists.proxmox.com MIME-Version: 1.0 Message-ID: <mailman.19.1738673040.293.pve-devel@lists.proxmox.com> List-Id: Proxmox VE development discussion <pve-devel.lists.proxmox.com> List-Post: <mailto:pve-devel@lists.proxmox.com> From: Ivaylo Markov via pve-devel <pve-devel@lists.proxmox.com> Precedence: list Cc: Ivaylo Markov <ivaylo.markov@storpool.com>, nikolay.angelov@storpool.com X-Mailman-Version: 2.1.29 X-BeenThere: pve-devel@lists.proxmox.com List-Subscribe: <https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-devel>, <mailto:pve-devel-request@lists.proxmox.com?subject=subscribe> List-Unsubscribe: <https://lists.proxmox.com/cgi-bin/mailman/options/pve-devel>, <mailto:pve-devel-request@lists.proxmox.com?subject=unsubscribe> List-Archive: <http://lists.proxmox.com/pipermail/pve-devel/> Reply-To: Proxmox VE development discussion <pve-devel@lists.proxmox.com> List-Help: <mailto:pve-devel-request@lists.proxmox.com?subject=help> Subject: [pve-devel] StorPool storage plugin concerns Content-Type: multipart/mixed; boundary="===============8826639894942174671==" Errors-To: pve-devel-bounces@lists.proxmox.com Sender: "pve-devel" <pve-devel-bounces@lists.proxmox.com> --===============8826639894942174671== Content-Type: message/rfc822 Content-Disposition: inline Return-Path: <ivaylo.markov@storpool.com> X-Original-To: pve-devel@lists.proxmox.com Delivered-To: pve-devel@lists.proxmox.com Received: from firstgate.proxmox.com (firstgate.proxmox.com [212.224.123.68]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by lists.proxmox.com (Postfix) with ESMTPS id 56AB9CA692 for <pve-devel@lists.proxmox.com>; Tue, 4 Feb 2025 13:43:59 +0100 (CET) Received: from firstgate.proxmox.com (localhost [127.0.0.1]) by firstgate.proxmox.com (Proxmox) with ESMTP id 3AF8116149 for <pve-devel@lists.proxmox.com>; Tue, 4 Feb 2025 13:43:59 +0100 (CET) Received: from mail-wm1-x32b.google.com (mail-wm1-x32b.google.com [IPv6:2a00:1450:4864:20::32b]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by firstgate.proxmox.com (Proxmox) with ESMTPS for <pve-devel@lists.proxmox.com>; Tue, 4 Feb 2025 13:43:57 +0100 (CET) Received: by mail-wm1-x32b.google.com with SMTP id 5b1f17b1804b1-4362bae4d7dso39278815e9.1 for <pve-devel@lists.proxmox.com>; Tue, 04 Feb 2025 04:43:57 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=storpool.com; s=google; t=1738673031; x=1739277831; darn=lists.proxmox.com; h=content-transfer-encoding:organization:subject:from:cc:to :content-language:user-agent:mime-version:date:message-id:from:to:cc :subject:date:message-id:reply-to; bh=yFyHDuctHlinWgsN77KynwHr7pc0Q1Lyx9l1VSZRtbE=; b=Zll7Hrkn4IFsWCackWeJOVSeIUm8nF9cD65RsPlPyal/V6yZXZw/XKdnM51gwqs9AL 9R3dwDmydT8KsSvybZQbFMEOx1vda5oqi+DtxlXj8v863lYXRBeBvXrVxVSYujKfvcJY bT7jXfMmwwSbQtul246Et4BoQ7Oec/3cvEwL+6XiUUjv/mqX8zdpBoB/crQxgLsvmtA3 5LjCkfINDLR2dRAZcYfvW0pYx66hLy/3yiximDtFWi1NyeFjeCKCJlKUf0tJ1+IReLIz AkmbxkxWCR5AG29mH4lNsnxfFUADXUvD0IbymIXZFVyfARlFMEc5sMy2xbcLXLjoVeV6 pidQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1738673031; x=1739277831; h=content-transfer-encoding:organization:subject:from:cc:to :content-language:user-agent:mime-version:date:message-id :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=yFyHDuctHlinWgsN77KynwHr7pc0Q1Lyx9l1VSZRtbE=; b=ssDBxKWegIzdTZZFgmMGlbNfNnSXIQuMVfunNpC9DJyEt72iMqnI4JcSO80DqjPfP7 SveKYn01Pxagl65/iypdgBR6UZH5YsCTZ0LFUpJSsUaE+YRrCDwikpW6mWH+vG05uz0f NqT/uwLurf0aislZcLnrwrysmk/52tzIqID6Y7MwCCHq7KDg2GOsyCCmWSYmtbG0ehQz W9YB0Q9S1afo6SUSNXXiktC4BMFH3ViYEDvHz5bgu5xNNz56jt9R3YGTMsIh8vno5S2z bu22VZsDTvi8lDZWY6fmE+LmNmVqQt1UimWT+UksJOj4wCG7MJLt0d7P/X47d5HdWdb4 dK0g== X-Gm-Message-State: AOJu0YyavRNYYyNwFXzaLDFapiysKZ9E2pHqYANbuFrYPR/cCgtCEmG5 KJBjAmu4QaQ2pM8x8MCuRWxBTnI29XhFZUNXKMOWWi/1Dlvxk3/mv8Qbq4rb2DKgBkJKjp+lGkm 3lFU= X-Gm-Gg: ASbGncsSjQsX5N9nLMT3/GXvtFOn2KqNWirfi4d1iG8NDQUoCAA1hoT3ItdsiSXM7Be N9QhBTqzzcJrUWeU0MsiVCxnpwK9CE5yaarspwd+/aTDDLbzX6am5IIs6f5N4o+WSn/P8O1UKh4 1f008H1q2GFdZlP6Q+4g4Savv0GNKHQ1KyipigfT5Nd1nDrHz6bAsErSLH2cPiExZAeme5NKgvc SKZ1bc1DdO/lHX6wnMj1DjIfGSFfc5tyDxO2xuA7HKKuCcsZrkZtkTXCWkTH6jQDNo7YWF0t75s 83wO+v8zrerZvJZb7jz/Y4xgSfKJEhp4JVjhYtQ2cF/QwRmIbJu3L4aLmHT+OgKj X-Google-Smtp-Source: AGHT+IFPG72AwNcKBdODO05deCp3eN3OB5iqUfhNdleOfptU8BE515W1S5DLyx/mZGZssmm5W4EviA== X-Received: by 2002:a05:600c:b89:b0:438:a240:c54 with SMTP id 5b1f17b1804b1-438dc3ae14bmr207626595e9.9.1738673030811; Tue, 04 Feb 2025 04:43:50 -0800 (PST) Received: from ?IPV6:2001:67c:21bc:e:796b:85b4:3761:7320? ([2001:67c:21bc:e:796b:85b4:3761:7320]) by smtp.gmail.com with ESMTPSA id 5b1f17b1804b1-438e245f492sm187463615e9.38.2025.02.04.04.43.49 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Tue, 04 Feb 2025 04:43:49 -0800 (PST) Message-ID: <9d570efd-53b7-4fc2-a83f-436ff4d34880@storpool.com> Date: Tue, 4 Feb 2025 14:43:48 +0200 MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Content-Language: en-US To: pve-devel@lists.proxmox.com Cc: nikolay.angelov@storpool.com From: Ivaylo Markov <ivaylo.markov@storpool.com> Subject: StorPool storage plugin concerns Organization: StorPool Storage Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-SPAM-LEVEL: Spam detection results: 0 AWL 0.000 Adjusted score from AWL reputation of From: address BAYES_00 -1.9 Bayes spam probability is 0 to 1% DKIM_SIGNED 0.1 Message has a DKIM or DK signature, not necessarily valid DKIM_VALID -0.1 Message has at least one valid DKIM or DK signature DKIM_VALID_AU -0.1 Message has a valid DKIM or DK signature from author's domain DKIM_VALID_EF -0.1 Message has a valid DKIM or DK signature from envelope-from domain DMARC_PASS -0.1 DMARC pass policy RCVD_IN_DNSWL_NONE -0.0001 Sender listed at https://www.dnswl.org/, no trust SPF_HELO_NONE 0.001 SPF: HELO does not publish an SPF Record SPF_PASS -0.001 SPF: sender matches SPF record Greetings, I was pointed here to discuss the StorPool storage plugin[0] with the dev team. If I understand correctly, there is a concern with the our HA watchdog daemon, and I'd like to explain the why and how. As a distributed storage system, StorPool has its own internal clustering mechanisms; it can run on networks that are independent from the PVE cluster one, and thus remain unaffected by network partitions or other problems that would cause the standard PVE watchdog to reboot a node. In the case of HCI (compute + storage) nodes, this reboot can interrupt the normal operation of the StorPool cluster, causing reduced performance or downtime, which could be avoided if the host is not restarted. This is why we do our best to avoid such behavior across the different cloud management platforms. Currently, when our daemon detects an unexpected exit of a resource manager, it will SIGKILL PVE HA services and running VMs on the node, which should prevent 2 instances of the same VM running at the same time. PVE services and our block storage client daemon are restarted as well. We're open to discussion and suggestions for our approach and implementation. [0] https://github.com/storpool/pve-storpool -- Ivaylo Markov Quality & Automation Engineer StorPool Storage https://www.storpool.com --===============8826639894942174671== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ pve-devel mailing list pve-devel@lists.proxmox.com https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-devel --===============8826639894942174671==--