[pve-devel] [pve-dev] Storage assisted copy feature for Proxmox storage plugin

[pve-devel] [pve-dev] Storage assisted copy feature for Proxmox storage plugin

[Andrei Perapiolkin via pve-devel]

[-- Attachment #1: Type: message/rfc822, Size: 6871 bytes --]

From: Andrei Perapiolkin <andrei.perepiolkin@open-e.com>
To: Proxmox VE development discussion <pve-devel@lists.proxmox.com>
Subject: [pve-dev] Storage assisted copy feature for Proxmox storage plugin
Date: Thu, 2 Oct 2025 20:15:34 -0400
Message-ID: <75fcae3c-1112-45f0-b1f9-ff4bdccf0966@open-e.com>

Hi,

Can the honorable community help me find an elegant way for 
volume_import to identify the source volume origin type and name?

I’m investigating this to implement storage-assisted copy (i.e., 
performing the volume copy entirely on the storage side).

My initial assumption was that this could be achieved by defining custom 
volume_export and volume_import functions.
However, may be  there is a better way to  do storage assisted copy.



Best regards,
Andrei Perepiolkin


P.S.
Just found out about 
https://pve.proxmox.com/wiki/Storage_Plugin_Development:_Writing_a_Storage_Plugin_for_SSHFS
This is grate!
Many thanks for posting this article!



[-- Attachment #2: Type: text/plain, Size: 160 bytes --]

_______________________________________________
pve-devel mailing list
pve-devel@lists.proxmox.com
https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-devel

Re: [pve-devel] [pve-dev] Storage assisted copy feature for Proxmox storage plugin

[Fabian Grünbichler]

On October 3, 2025 2:15 am, Andrei Perapiolkin via pve-devel wrote:
> Hi,
> 
> Can the honorable community help me find an elegant way for
> volume_import to identify the source volume origin type and name?
> 
> I'm investigating this to implement storage-assisted copy (i.e.,
> performing the volume copy entirely on the storage side).
> 
> My initial assumption was that this could be achieved by defining custom
> volume_export and volume_import functions.
> However, may be there is a better way to do storage assisted copy.

volume_export and volume_import are only used for a few specific cases
(mainly offline migration of local disks, and offline remote migration
of disks).

for those you could define your own transport format that includes or
just contains the relevant metadata to do a storage side copy - it would
only be selected if the storage for the source and target volume both
say they support that particular format.

I assume your storage is shared, so you'd be more interested in the
move disk/full clone case, which currently uses either a mirror block
job (if the VM is running), qemu-img convert (if the VM is not running)
or rsync (for container volumes). These mechanisms are all not
extensible at the moment for storage plugins.

Maybe you could describe for which tasks you would see a clear benefit
for extending the interface to allow a storage plugin to provide a "copy
volume A into volume B storage side" - for the live move disk it might
be hard (without dirty bitmap trickery like we use for replication, but
that might be an option?), for the offline moves it would probably be
possible to somehow special case this and let plugins opt in, we've
discussed this ourselves in the past..

> P.S.
> Just found out about
> https://pve.proxmox.com/wiki/Storage_Plugin_Development:_Writing_a_Storage=
> _Plugin_for_SSHFS
> This is grate!
> Many thanks for posting this article!

Great that it found its intended audience! :)


_______________________________________________
pve-devel mailing list
pve-devel@lists.proxmox.com
https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-devel