all lists on lists.proxmox.com
 help / color / mirror / Atom feed
From: Fiona Ebner <f.ebner@proxmox.com>
To: pve-devel@lists.proxmox.com
Subject: Re: [pve-devel] [PATCH storage 4/6] rbd plugin: implement volume import/export
Date: Tue, 17 Dec 2024 13:10:17 +0100	[thread overview]
Message-ID: <38f0b278-1170-4ac9-8def-1faf7e34452f@proxmox.com> (raw)
In-Reply-To: <792d36b7-05a5-41c0-9213-095301da221e@proxmox.com>

Am 13.12.24 um 17:34 schrieb Fiona Ebner:
> Am 13.12.24 um 17:30 schrieb Fiona Ebner:
>> +	run_command(['dd', "if=$file", "bs=64k", "status=progress"], output => '>&'.fileno($fh));
> 
> ---snip---
> 
>> +	run_command(['dd', "of=$file", 'bs=64k'], input => '<&'.fileno($fh));
> 
> 
> Forgot to mention, I did not test with different block sizes yet. This
> is just copied from the LVM plugin. Will do that next week and see if
> it's worth changing.

Tested between a virtual cluster with integrated Ceph (A) and another
node with external Ceph (B) with a VM with a 4 GiB OS disk and 15 GiB
disk full of random data. Don't see much difference, with 64K slightly
winning:

A -> B

16 KiB

2024-12-17 13:00:49 migration finished successfully (duration 00:02:01)
qm remote-migrate 1234 1234  --target-storage rbd --target-bridge vmbr0
12.67s user 42.01s system 45% cpu 2:01.29 total

2024-12-17 13:05:40 migration finished successfully (duration 00:02:01)
qm remote-migrate 1234 1234  --target-storage rbd --target-bridge vmbr0
12.49s user 42.34s system 45% cpu 2:00.89 total

64 KiB

2024-12-17 11:59:35 migration finished successfully (duration 00:01:56)
qm remote-migrate 1234 1234  --target-storage rbd --target-bridge vmbr0
12.31s user 41.10s system 45% cpu 1:57.31 total

2024-12-17 12:05:39 migration finished successfully (duration 00:01:58)
qm remote-migrate 1234 1234  --target-storage rbd --target-bridge vmbr0
12.07s user 41.30s system 45% cpu 1:58.00 total

256 KiB

2024-12-17 12:11:00 migration finished successfully (duration 00:02:05)
qm remote-migrate 1234 1234  --target-storage rbd --target-bridge vmbr0
11.29s user 37.89s system 39% cpu 2:06.03 total

2024-12-17 12:16:54 migration finished successfully (duration 00:02:07)
qm remote-migrate 1234 1234  --target-storage rbd --target-bridge vmbr0
11.64s user 38.70s system 39% cpu 2:07.61 total


B -> A

16 KiB

2024-12-17 13:02:47 migration finished successfully (duration 00:01:28)
qm remote-migrate 1234 1234  --target-storage rbd --target-bridge vnet0
13.06s user 40.22s system 58% cpu 1:31.23 total

2024-12-17 13:07:57 migration finished successfully (duration 00:01:28)
qm remote-migrate 1234 1234  --target-storage rbd --target-bridge vnet0
13.00s user 40.25s system 58% cpu 1:30.64 total

64 KiB

2024-12-17 11:56:34 migration finished successfully (duration 00:01:22)
qm remote-migrate 1234 1234  --target-storage rbd --target-bridge vnet0
12.72s user 37.16s system 59% cpu 1:24.53 total

2024-12-17 12:03:15 migration finished successfully (duration 00:01:27)
qm remote-migrate 1234 1234  --target-storage rbd --target-bridge vnet0
13.19s user 38.45s system 57% cpu 1:30.10 total

256 KiB

2024-12-17 12:08:10 migration finished successfully (duration 00:01:31)
qm remote-migrate 1234 1234  --target-storage rbd --target-bridge vnet0
12.18s user 37.23s system 52% cpu 1:34.39 total

2024-12-17 12:14:05 migration finished successfully (duration 00:01:35)
qm remote-migrate 1234 1234  --target-storage rbd --target-bridge vnet0
11.85s user 36.74s system 49% cpu 1:37.46 total



_______________________________________________
pve-devel mailing list
pve-devel@lists.proxmox.com
https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-devel


  reply	other threads:[~2024-12-17 12:10 UTC|newest]

Thread overview: 9+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2024-12-13 16:30 [pve-devel] [PATCH-SERIES storage 0/6] basic RBD import/export Fiona Ebner
2024-12-13 16:30 ` [pve-devel] [PATCH storage 1/6] rbd plugin: schema: document default value for 'krbd' setting Fiona Ebner
2024-12-13 16:30 ` [pve-devel] [PATCH storage 2/6] export: redirect stdout to avoid any unrelated messages ending up in the export stream Fiona Ebner
2024-12-13 16:30 ` [pve-devel] [PATCH storage 3/6] rbd plugin: factor out helper to check if volume already exists Fiona Ebner
2024-12-13 16:30 ` [pve-devel] [PATCH storage 4/6] rbd plugin: implement volume import/export Fiona Ebner
2024-12-13 16:34   ` Fiona Ebner
2024-12-17 12:10     ` Fiona Ebner [this message]
2024-12-13 16:30 ` [pve-devel] [PATCH storage 5/6] common: introduce common module Fiona Ebner
2024-12-13 16:30 ` [pve-devel] [PATCH storage 6/6] plugins: volume import: align size up to 1KiB Fiona Ebner

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=38f0b278-1170-4ac9-8def-1faf7e34452f@proxmox.com \
    --to=f.ebner@proxmox.com \
    --cc=pve-devel@lists.proxmox.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.
Service provided by Proxmox Server Solutions GmbH | Privacy | Legal