From mboxrd@z Thu Jan  1 00:00:00 1970
Return-Path: <pve-devel-bounces@lists.proxmox.com>
Received: from firstgate.proxmox.com (firstgate.proxmox.com [212.224.123.68])
	by lore.proxmox.com (Postfix) with ESMTPS id 825F31FF17C
	for <inbox@lore.proxmox.com>; Wed, 28 May 2025 17:43:10 +0200 (CEST)
Received: from firstgate.proxmox.com (localhost [127.0.0.1])
	by firstgate.proxmox.com (Proxmox) with ESMTP id 402AE946E;
	Wed, 28 May 2025 17:43:23 +0200 (CEST)
Date: Wed, 28 May 2025 11:42:46 -0400
To: Proxmox VE development discussion <pve-devel@lists.proxmox.com>
MIME-Version: 1.0
Message-ID: <mailman.86.1748447002.395.pve-devel@lists.proxmox.com>
List-Id: Proxmox VE development discussion <pve-devel.lists.proxmox.com>
List-Post: <mailto:pve-devel@lists.proxmox.com>
From: Andrei Perapiolkin via pve-devel <pve-devel@lists.proxmox.com>
Precedence: list
Cc: Andrei Perapiolkin <andrei.perepiolkin@open-e.com>
X-Mailman-Version: 2.1.29
X-BeenThere: pve-devel@lists.proxmox.com
List-Subscribe: <https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-devel>, 
 <mailto:pve-devel-request@lists.proxmox.com?subject=subscribe>
List-Unsubscribe: <https://lists.proxmox.com/cgi-bin/mailman/options/pve-devel>, 
 <mailto:pve-devel-request@lists.proxmox.com?subject=unsubscribe>
List-Archive: <http://lists.proxmox.com/pipermail/pve-devel/>
Reply-To: Proxmox VE development discussion <pve-devel@lists.proxmox.com>
List-Help: <mailto:pve-devel-request@lists.proxmox.com?subject=help>
Subject: [pve-devel] Cluster storage plugin assistant service
Content-Type: multipart/mixed; boundary="===============2017762916173690122=="
Errors-To: pve-devel-bounces@lists.proxmox.com
Sender: "pve-devel" <pve-devel-bounces@lists.proxmox.com>

--===============2017762916173690122==
Content-Type: message/rfc822
Content-Disposition: inline

Return-Path: <andrei.perepiolkin@open-e.com>
X-Original-To: pve-devel@lists.proxmox.com
Delivered-To: pve-devel@lists.proxmox.com
Received: from firstgate.proxmox.com (firstgate.proxmox.com [212.224.123.68])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256)
	(No client certificate requested)
	by lists.proxmox.com (Postfix) with ESMTPS id 0495FC9E24
	for <pve-devel@lists.proxmox.com>; Wed, 28 May 2025 17:43:22 +0200 (CEST)
Received: from firstgate.proxmox.com (localhost [127.0.0.1])
	by firstgate.proxmox.com (Proxmox) with ESMTP id D5818947E
	for <pve-devel@lists.proxmox.com>; Wed, 28 May 2025 17:42:51 +0200 (CEST)
Received: from mout.kundenserver.de (mout.kundenserver.de [212.227.126.130])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange ECDHE (prime256v1) server-signature RSA-PSS (2048 bits) server-digest SHA256)
	(No client certificate requested)
	by firstgate.proxmox.com (Proxmox) with ESMTPS
	for <pve-devel@lists.proxmox.com>; Wed, 28 May 2025 17:42:48 +0200 (CEST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=open-e.com;
	s=s1-ionos; t=1748446968; x=1749051768;
	i=andrei.perepiolkin@open-e.com;
	bh=0PytT50Mfo4zfnF4BC8z9ccvnbTwMqD/QF3/WbtC898=;
	h=X-UI-Sender-Class:Message-ID:Date:MIME-Version:From:To:Subject:
	 Content-Type:Content-Transfer-Encoding:cc:
	 content-transfer-encoding:content-type:date:from:message-id:
	 mime-version:reply-to:subject:to;
	b=uMGQyhbPAQdDe0fo1AxxPg2yvd4CZ8Bm8ZLqTwAYErwb8nC5ygoVTLzOXUdRAlEn
	 CI/VlRJG439R6fmJdVmN17DXdmviv+GsQRxiXkzJkLJB2CmTgNWXT2KLyeFb1aDYH
	 BZd0yHI6d6yyUdkYptZqz7UsfJEwaEbrfxSZbV6cB8hYIkwKRpWN7zOr081budMqu
	 oEAy8BTF2jTyTefyOSHaHBqtB2pp6m6l8AVELrFCzz3ct8qojjhZ8AQ8HMXZ8ZKl2
	 S7UOU6NmEU1fADScaHzgXCbi0lnBQY9sp+qEwoOH1H5FAmZtUSzJ9QGfFX3YKopkC
	 aqy5/wXbOFgTx/Jr4g==
X-UI-Sender-Class: 55c96926-9e95-11ee-ae09-1f7a4046a0f6
Received: from [10.137.0.75] ([149.102.246.43]) by mrelayeu.kundenserver.de
 (mreue009 [212.227.15.167]) with ESMTPSA (Nemesis) id
 1Mg6mM-1upn7e0ULG-00ogX2 for <pve-devel@lists.proxmox.com>; Wed, 28 May 2025
 17:42:48 +0200
Message-ID: <59e66c97-2337-4717-8c8f-c7b31b47da6b@open-e.com>
Date: Wed, 28 May 2025 11:42:46 -0400
MIME-Version: 1.0
User-Agent: Mozilla Thunderbird
Content-Language: en-US
From: Andrei Perapiolkin <andrei.perepiolkin@open-e.com>
To: Proxmox VE development discussion <pve-devel@lists.proxmox.com>
Subject: [pve-devel] Cluster storage plugin assistant service
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: quoted-printable
X-Provags-ID: V03:K1:D13Q3zZT3jW92/drZeBVktA41eUwttOd53+2bEFxywxVVXPt0J0
 /MwTjGmy7eFHdO4HdfIIAQEVdUTUZ7/ma7KMaIMtLKlRremDYMS4Cm8+vomsSml4J2UB8cP
 UJ27VWEKzr6rTrU/NhD/GbQILmkZd42xYeZuw3a68lVq2cFj2HKM/Vby2BPa9opavrrhf6T
 zKg7U/eW8NxaUlNs9z9NA==
X-Spam-Flag: NO
UI-OutboundReport: notjunk:1;M01:P0:s2UHleEFdAw=;+inUCyvI5GI47vYLczI4D3ECouV
 PF5HMvlyPoUemnW3zVRA0E3clvAN1p9GWiAS55Lv68GUUHb8y3FGD9RYyDB+n1k8XoFrgP+MS
 zvW6ttRdYNy9dO8alJA1N7kZPbjn9ZWL6SPSqxEUzJfGvNU15gRwouQIg0kNnm3oTlcBUJ4Yy
 mGikEnrsy9rJMPjS2chKHFy3MybFHKUCqfpGlEVLme8yig9N3fFJOHzjj82NFZ65j4eDsZ0PZ
 61/DvNhSdb4mfKkB8tm4oGz+vk7ZuJoCFQ0L0GhU4zUXecwxrS7DxWmckScphcZgFvlrwHxY5
 HWUJvE83TD53mQUsIzfMv07rneBokcOWMzRuBWdTN2dp9eJrSl20rY/neCaHebesgKI77HiIs
 ofcFfjp4eBaf5in6boh3JbzhZWMe4LKTggm9ZR5DpETKhyApMMlhJZ0ZmVwuRFNBF496/3UF+
 Ha/3qz4gXQJSE7ABOBYfyI8INzylodoKIcXWxmbLiSp0f3ahRhzv4Bsj4OZir1BdcFYJbIJE1
 iXhG/0cNDmQZDx+X3i2tphPaWJiiz3FTeRt3jYGAfOvIJQ4iI7TWyaN1tqQMKCWWJheWdIE2Q
 B1cEF1ijz3DO90+1LODys+7yzAe5rho24f7dFsZOatrdryVIK38klz0eGJyQwIFsLIxv3HIbK
 8d1YRXHYlCUWDi7Em0Yi5vPj4WwH5x56apzxtKd8evStu6dUf8womwd3Pny33JLaVXLMXuAcZ
 AzmXt6IZPDlIeQCE+3HobrTYZe5XgTQ2pfFReItRWcROLBsvc9HW+726jDDnNU04MHyFd6muI
 xDIfGyhPWKF5lX37/eASuUpnDoLsc54ECwQCIeKIJR312XsAKjYO5Y81meDY4DQdDljRb1OVL
 wm6jy1/HnK+ljcKVTFH4XZ2z/XqoGknQgDPyrasTaBRR6EINMT7aIONTcjS0zYzF0rvvHJ37g
 yNOaoAXYGnjdIPb6g7mVA9SZL+jCJxz5DJbFLOM2DcYCkkbX1hJW8ihwQBuonkzQR4UAElV+0
 Ysb5btTZLQ7lBqvtx6eUBisjFGtGjYwuFiwwRPH1GCKVj4YB8L7kZjzZlHrNWwr1gbtpFIMXc
 /zogCbf2qNkzkZYTpynGFUUTtptIu7Iha0UahQhr9LIGklndOE6qachtUYIDEZPDJty8Z8W6N
 adjN1C8TWshQZxPf4k4pZe5O8UVSM6hDE5D6nJcRTlbzTHey00uy+BLDTIvpv8Ts5fLSrlkcD
 eq/y2V3a4ol2k8FanfqT0/uKgAhIV/6dahoLGOvsMF5MroDWd0wlafvz1eidW1zK/qj4JiKxi
 jG67LJGPBrz43kQdQgWY2N/LPfrfPqgFW+K/7EAoaEVmGffogjMCpackb1pYCguci9JOPFaaw
 tkBnY4EYGaFPZygmheVM6moYRfsGN/6Hy5gOU76uLxS26VJUHWwZP3gUGpvrHCPy2zJC4pkM4
 +b5iC8g==
X-SPAM-LEVEL: Spam detection results:  0
	AWL                    -0.010 Adjusted score from AWL reputation of From: address
	BAYES_00                 -1.9 Bayes spam probability is 0 to 1%
	DKIM_SIGNED               0.1 Message has a DKIM or DK signature, not necessarily valid
	DKIM_VALID               -0.1 Message has at least one valid DKIM or DK signature
	DKIM_VALID_AU            -0.1 Message has a valid DKIM or DK signature from author's domain
	DKIM_VALID_EF            -0.1 Message has a valid DKIM or DK signature from envelope-from domain
	DMARC_PASS               -0.1 DMARC pass policy
	RCVD_IN_DNSWL_NONE     -0.0001 Sender listed at https://www.dnswl.org/, no trust
	RCVD_IN_MSPIKE_H5       0.001 Excellent reputation (+5)
	RCVD_IN_MSPIKE_WL       0.001 Mailspike good senders
	RCVD_IN_VALIDITY_CERTIFIED_BLOCKED  0.001 ADMINISTRATOR NOTICE: The query to Validity was blocked.  See https://knowledge.validity.com/hc/en-us/articles/20961730681243 for more information.
	RCVD_IN_VALIDITY_RPBL_BLOCKED  0.001 ADMINISTRATOR NOTICE: The query to Validity was blocked.  See https://knowledge.validity.com/hc/en-us/articles/20961730681243 for more information.
	RCVD_IN_VALIDITY_SAFE_BLOCKED  0.001 ADMINISTRATOR NOTICE: The query to Validity was blocked.  See https://knowledge.validity.com/hc/en-us/articles/20961730681243 for more information.
	SPF_HELO_NONE           0.001 SPF: HELO does not publish an SPF Record
	SPF_PASS               -0.001 SPF: sender matches SPF record
	URIBL_BLOCKED           0.001 ADMINISTRATOR NOTICE: The query to URIBL was blocked.  See http://wiki.apache.org/spamassassin/DnsBlocklists#dnsbl-block for more information. [open-e.com]

Hi Proxmox Community,

I am working on implementing custom storage plugin and after evaluating=20
various edge cases related to volume live migration, I have decided to=20
create a 'storage assistant service'.
This service will be responsible for managing my storage plugin volumes=20
activation and deactivation across all nodes in the cluster.
The idea is to run a service on every cluster node that conducts:
 =C2=A0=C2=A0=C2=A0 Volume activation upon creation
 =C2=A0=C2=A0=C2=A0 Volume deactivation upon deletion

To achieve this, the service must receive notifications from the storage=
=20
plugin whenever a volume is created or deleted.

However, I am not yet familiar with the internal mechanisms of Proxmox=20
clustering and am unsure what technology or approach would be most=20
appropriate for such inter-node communication.

At present, I am considering using the Proxmox Cluster File System=20
(pmxcfs)=E2=80=94specifically the '/etc/pve/priv' directory=E2=80=94as a m=
eans of=20
transferring notifications through file creation and deletion.
Another option I=E2=80=99m exploring is executing remote commands over SSH=
.

I would appreciate any feedback on potential issues with this approach.
Additionally, if there are any existing services or projects that have=20
solved similar design problems, I would be grateful to learn about them.


Best regards,

Andrei



--===============2017762916173690122==
Content-Type: text/plain; charset="us-ascii"
MIME-Version: 1.0
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

_______________________________________________
pve-devel mailing list
pve-devel@lists.proxmox.com
https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-devel

--===============2017762916173690122==--