From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: <pve-devel-bounces@lists.proxmox.com> Received: from firstgate.proxmox.com (firstgate.proxmox.com [212.224.123.68]) by lore.proxmox.com (Postfix) with ESMTPS id 825F31FF17C for <inbox@lore.proxmox.com>; Wed, 28 May 2025 17:43:10 +0200 (CEST) Received: from firstgate.proxmox.com (localhost [127.0.0.1]) by firstgate.proxmox.com (Proxmox) with ESMTP id 402AE946E; Wed, 28 May 2025 17:43:23 +0200 (CEST) Date: Wed, 28 May 2025 11:42:46 -0400 To: Proxmox VE development discussion <pve-devel@lists.proxmox.com> MIME-Version: 1.0 Message-ID: <mailman.86.1748447002.395.pve-devel@lists.proxmox.com> List-Id: Proxmox VE development discussion <pve-devel.lists.proxmox.com> List-Post: <mailto:pve-devel@lists.proxmox.com> From: Andrei Perapiolkin via pve-devel <pve-devel@lists.proxmox.com> Precedence: list Cc: Andrei Perapiolkin <andrei.perepiolkin@open-e.com> X-Mailman-Version: 2.1.29 X-BeenThere: pve-devel@lists.proxmox.com List-Subscribe: <https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-devel>, <mailto:pve-devel-request@lists.proxmox.com?subject=subscribe> List-Unsubscribe: <https://lists.proxmox.com/cgi-bin/mailman/options/pve-devel>, <mailto:pve-devel-request@lists.proxmox.com?subject=unsubscribe> List-Archive: <http://lists.proxmox.com/pipermail/pve-devel/> Reply-To: Proxmox VE development discussion <pve-devel@lists.proxmox.com> List-Help: <mailto:pve-devel-request@lists.proxmox.com?subject=help> Subject: [pve-devel] Cluster storage plugin assistant service Content-Type: multipart/mixed; boundary="===============2017762916173690122==" Errors-To: pve-devel-bounces@lists.proxmox.com Sender: "pve-devel" <pve-devel-bounces@lists.proxmox.com> --===============2017762916173690122== Content-Type: message/rfc822 Content-Disposition: inline Return-Path: <andrei.perepiolkin@open-e.com> X-Original-To: pve-devel@lists.proxmox.com Delivered-To: pve-devel@lists.proxmox.com Received: from firstgate.proxmox.com (firstgate.proxmox.com [212.224.123.68]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by lists.proxmox.com (Postfix) with ESMTPS id 0495FC9E24 for <pve-devel@lists.proxmox.com>; Wed, 28 May 2025 17:43:22 +0200 (CEST) Received: from firstgate.proxmox.com (localhost [127.0.0.1]) by firstgate.proxmox.com (Proxmox) with ESMTP id D5818947E for <pve-devel@lists.proxmox.com>; Wed, 28 May 2025 17:42:51 +0200 (CEST) Received: from mout.kundenserver.de (mout.kundenserver.de [212.227.126.130]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (prime256v1) server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by firstgate.proxmox.com (Proxmox) with ESMTPS for <pve-devel@lists.proxmox.com>; Wed, 28 May 2025 17:42:48 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=open-e.com; s=s1-ionos; t=1748446968; x=1749051768; i=andrei.perepiolkin@open-e.com; bh=0PytT50Mfo4zfnF4BC8z9ccvnbTwMqD/QF3/WbtC898=; h=X-UI-Sender-Class:Message-ID:Date:MIME-Version:From:To:Subject: Content-Type:Content-Transfer-Encoding:cc: content-transfer-encoding:content-type:date:from:message-id: mime-version:reply-to:subject:to; b=uMGQyhbPAQdDe0fo1AxxPg2yvd4CZ8Bm8ZLqTwAYErwb8nC5ygoVTLzOXUdRAlEn CI/VlRJG439R6fmJdVmN17DXdmviv+GsQRxiXkzJkLJB2CmTgNWXT2KLyeFb1aDYH BZd0yHI6d6yyUdkYptZqz7UsfJEwaEbrfxSZbV6cB8hYIkwKRpWN7zOr081budMqu oEAy8BTF2jTyTefyOSHaHBqtB2pp6m6l8AVELrFCzz3ct8qojjhZ8AQ8HMXZ8ZKl2 S7UOU6NmEU1fADScaHzgXCbi0lnBQY9sp+qEwoOH1H5FAmZtUSzJ9QGfFX3YKopkC aqy5/wXbOFgTx/Jr4g== X-UI-Sender-Class: 55c96926-9e95-11ee-ae09-1f7a4046a0f6 Received: from [10.137.0.75] ([149.102.246.43]) by mrelayeu.kundenserver.de (mreue009 [212.227.15.167]) with ESMTPSA (Nemesis) id 1Mg6mM-1upn7e0ULG-00ogX2 for <pve-devel@lists.proxmox.com>; Wed, 28 May 2025 17:42:48 +0200 Message-ID: <59e66c97-2337-4717-8c8f-c7b31b47da6b@open-e.com> Date: Wed, 28 May 2025 11:42:46 -0400 MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Content-Language: en-US From: Andrei Perapiolkin <andrei.perepiolkin@open-e.com> To: Proxmox VE development discussion <pve-devel@lists.proxmox.com> Subject: [pve-devel] Cluster storage plugin assistant service Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: quoted-printable X-Provags-ID: V03:K1:D13Q3zZT3jW92/drZeBVktA41eUwttOd53+2bEFxywxVVXPt0J0 /MwTjGmy7eFHdO4HdfIIAQEVdUTUZ7/ma7KMaIMtLKlRremDYMS4Cm8+vomsSml4J2UB8cP UJ27VWEKzr6rTrU/NhD/GbQILmkZd42xYeZuw3a68lVq2cFj2HKM/Vby2BPa9opavrrhf6T zKg7U/eW8NxaUlNs9z9NA== X-Spam-Flag: NO UI-OutboundReport: notjunk:1;M01:P0:s2UHleEFdAw=;+inUCyvI5GI47vYLczI4D3ECouV PF5HMvlyPoUemnW3zVRA0E3clvAN1p9GWiAS55Lv68GUUHb8y3FGD9RYyDB+n1k8XoFrgP+MS zvW6ttRdYNy9dO8alJA1N7kZPbjn9ZWL6SPSqxEUzJfGvNU15gRwouQIg0kNnm3oTlcBUJ4Yy mGikEnrsy9rJMPjS2chKHFy3MybFHKUCqfpGlEVLme8yig9N3fFJOHzjj82NFZ65j4eDsZ0PZ 61/DvNhSdb4mfKkB8tm4oGz+vk7ZuJoCFQ0L0GhU4zUXecwxrS7DxWmckScphcZgFvlrwHxY5 HWUJvE83TD53mQUsIzfMv07rneBokcOWMzRuBWdTN2dp9eJrSl20rY/neCaHebesgKI77HiIs ofcFfjp4eBaf5in6boh3JbzhZWMe4LKTggm9ZR5DpETKhyApMMlhJZ0ZmVwuRFNBF496/3UF+ Ha/3qz4gXQJSE7ABOBYfyI8INzylodoKIcXWxmbLiSp0f3ahRhzv4Bsj4OZir1BdcFYJbIJE1 iXhG/0cNDmQZDx+X3i2tphPaWJiiz3FTeRt3jYGAfOvIJQ4iI7TWyaN1tqQMKCWWJheWdIE2Q B1cEF1ijz3DO90+1LODys+7yzAe5rho24f7dFsZOatrdryVIK38klz0eGJyQwIFsLIxv3HIbK 8d1YRXHYlCUWDi7Em0Yi5vPj4WwH5x56apzxtKd8evStu6dUf8womwd3Pny33JLaVXLMXuAcZ AzmXt6IZPDlIeQCE+3HobrTYZe5XgTQ2pfFReItRWcROLBsvc9HW+726jDDnNU04MHyFd6muI xDIfGyhPWKF5lX37/eASuUpnDoLsc54ECwQCIeKIJR312XsAKjYO5Y81meDY4DQdDljRb1OVL wm6jy1/HnK+ljcKVTFH4XZ2z/XqoGknQgDPyrasTaBRR6EINMT7aIONTcjS0zYzF0rvvHJ37g yNOaoAXYGnjdIPb6g7mVA9SZL+jCJxz5DJbFLOM2DcYCkkbX1hJW8ihwQBuonkzQR4UAElV+0 Ysb5btTZLQ7lBqvtx6eUBisjFGtGjYwuFiwwRPH1GCKVj4YB8L7kZjzZlHrNWwr1gbtpFIMXc /zogCbf2qNkzkZYTpynGFUUTtptIu7Iha0UahQhr9LIGklndOE6qachtUYIDEZPDJty8Z8W6N adjN1C8TWshQZxPf4k4pZe5O8UVSM6hDE5D6nJcRTlbzTHey00uy+BLDTIvpv8Ts5fLSrlkcD eq/y2V3a4ol2k8FanfqT0/uKgAhIV/6dahoLGOvsMF5MroDWd0wlafvz1eidW1zK/qj4JiKxi jG67LJGPBrz43kQdQgWY2N/LPfrfPqgFW+K/7EAoaEVmGffogjMCpackb1pYCguci9JOPFaaw tkBnY4EYGaFPZygmheVM6moYRfsGN/6Hy5gOU76uLxS26VJUHWwZP3gUGpvrHCPy2zJC4pkM4 +b5iC8g== X-SPAM-LEVEL: Spam detection results: 0 AWL -0.010 Adjusted score from AWL reputation of From: address BAYES_00 -1.9 Bayes spam probability is 0 to 1% DKIM_SIGNED 0.1 Message has a DKIM or DK signature, not necessarily valid DKIM_VALID -0.1 Message has at least one valid DKIM or DK signature DKIM_VALID_AU -0.1 Message has a valid DKIM or DK signature from author's domain DKIM_VALID_EF -0.1 Message has a valid DKIM or DK signature from envelope-from domain DMARC_PASS -0.1 DMARC pass policy RCVD_IN_DNSWL_NONE -0.0001 Sender listed at https://www.dnswl.org/, no trust RCVD_IN_MSPIKE_H5 0.001 Excellent reputation (+5) RCVD_IN_MSPIKE_WL 0.001 Mailspike good senders RCVD_IN_VALIDITY_CERTIFIED_BLOCKED 0.001 ADMINISTRATOR NOTICE: The query to Validity was blocked. See https://knowledge.validity.com/hc/en-us/articles/20961730681243 for more information. RCVD_IN_VALIDITY_RPBL_BLOCKED 0.001 ADMINISTRATOR NOTICE: The query to Validity was blocked. See https://knowledge.validity.com/hc/en-us/articles/20961730681243 for more information. RCVD_IN_VALIDITY_SAFE_BLOCKED 0.001 ADMINISTRATOR NOTICE: The query to Validity was blocked. See https://knowledge.validity.com/hc/en-us/articles/20961730681243 for more information. SPF_HELO_NONE 0.001 SPF: HELO does not publish an SPF Record SPF_PASS -0.001 SPF: sender matches SPF record URIBL_BLOCKED 0.001 ADMINISTRATOR NOTICE: The query to URIBL was blocked. See http://wiki.apache.org/spamassassin/DnsBlocklists#dnsbl-block for more information. [open-e.com] Hi Proxmox Community, I am working on implementing custom storage plugin and after evaluating=20 various edge cases related to volume live migration, I have decided to=20 create a 'storage assistant service'. This service will be responsible for managing my storage plugin volumes=20 activation and deactivation across all nodes in the cluster. The idea is to run a service on every cluster node that conducts: =C2=A0=C2=A0=C2=A0 Volume activation upon creation =C2=A0=C2=A0=C2=A0 Volume deactivation upon deletion To achieve this, the service must receive notifications from the storage= =20 plugin whenever a volume is created or deleted. However, I am not yet familiar with the internal mechanisms of Proxmox=20 clustering and am unsure what technology or approach would be most=20 appropriate for such inter-node communication. At present, I am considering using the Proxmox Cluster File System=20 (pmxcfs)=E2=80=94specifically the '/etc/pve/priv' directory=E2=80=94as a m= eans of=20 transferring notifications through file creation and deletion. Another option I=E2=80=99m exploring is executing remote commands over SSH= . I would appreciate any feedback on potential issues with this approach. Additionally, if there are any existing services or projects that have=20 solved similar design problems, I would be grateful to learn about them. Best regards, Andrei --===============2017762916173690122== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ pve-devel mailing list pve-devel@lists.proxmox.com https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-devel --===============2017762916173690122==--