public inbox for pve-user@lists.proxmox.com
 help / color / mirror / Atom feed
From: Dmitry Petuhov <mityapetuhov@gmail.com>
To: pve-user@lists.proxmox.com
Subject: Re: [PVE-User] The low network throughput obsered on Open vSwitch bridge.
Date: Mon, 15 Mar 2021 07:00:00 +0300	[thread overview]
Message-ID: <67f6fcec-ae6b-2ebe-a104-84f4c2a6008f@gmail.com> (raw)
In-Reply-To: <CAGP6PO+ufdPXvKRi=B=yhjsZWCnQJ2HFiZ=iJ0t586+n38F42Q@mail.gmail.com>

Hello.

That's how TCP throughput mediation works. In basic case, you cannot 
canot fully saturate link by two opposite TCP connections regardless of 
using Open vSwitch.

There's one dirty hack that can override this behavior: you could use 
qdisc on interface that prioritize packets that have ACK bit set over 
those that don't in same connection. It will saturate link, but may lead 
to other issues on certain types of traffic (because of packet 
reordering), so [almost] nobody use it in real life.

Multiple parallel connections in same direction also saturate link more 
evenly.


15.03.2021 6:33, Hongyi Zhao пишет:
> I install the pve on an I7 8886U machine with 6 full-duplex gigabit
> network cards. The network configuration of the pve host is shown
> below:
>
> <quote>
> root@pve:~# cat /etc/network/interfaces
> # network interface settings; autogenerated
> # Please do NOT modify this file directly, unless you know what
> # you're doing.
> #
> # If you want to manage parts of the network configuration manually,
> # please utilize the 'source' or 'source-directory' directives to do
> # so.
> # PVE will preserve these directives, but will NOT read its network
> # configuration from sourced files, so do not attempt to move any of
> # the PVE managed interfaces into external files!
>
> auto lo
> iface lo inet loopback
>
> auto enp1s0
> iface enp1s0 inet manual
>          ovs_type OVSPort
>          ovs_bridge vmbr0
>
> auto enp2s0
> iface enp2s0 inet manual
>          ovs_type OVSPort
>          ovs_bridge vmbr1
>
> iface enp3s0 inet manual
> iface enp4s0 inet manual
> iface enp5s0 inet manual
> iface enp6s0 inet manual
>
> auto vmbr0
> iface vmbr0 inet static
>          address 192.168.10.254/24
>          gateway 192.168.10.1
>          ovs_type OVSBridge
>          ovs_ports enp1s0
>
> auto vmbr1
> iface vmbr1 inet manual
>          ovs_type OVSBridge
>          ovs_ports enp2s0
> </quote>
>
> Now I use scp to transfer file from pve (192.168.10.254) to another
> physical machine (192.168.10.100) or vice versa, but run the following
> two commands in order:
>
> root@pve:~# scp macOS-10.13.qcow2 werner@192.168.10.100:/dev/null
> werner@192.168.10.100's password:
> macOS-10.13.qcow2                              37% 6209MB  83.6MB/s   02:01 ETA
>
> werner@X10DAi:~$ scp macOS-10.13.qcow2 root@192.168.10.254:/dev/null
> root@192.168.10.254's password:
> macOS-10.13.qcow2                                        30% 1408MB
> 53.5MB/s   01:00 ETA
>
> As you can see, the show different network transfer speed. OTOH, if I
> run the above two commands simultaneously, the results will look like
> the following:
>
> werner@X10DAi:~$ scp macOS-10.13.qcow2 root@192.168.10.254:/dev/null
> root@192.168.10.254's password:
> macOS-10.13.qcow2                                        17%  811MB
> 26.0MB/s   02:26 ETA
>
> root@pve:~# scp macOS-10.13.qcow2 werner@192.168.10.100:/dev/null
> werner@192.168.10.100's password:
> macOS-10.13.qcow2                              13% 2205MB  51.7MB/s   04:34 ETA
>
>
> Any hints for the above observations and results will be highly appreciated.
>
> Regards



  reply	other threads:[~2021-03-15  4:00 UTC|newest]

Thread overview: 3+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2021-03-15  3:33 Hongyi Zhao
2021-03-15  4:00 ` Dmitry Petuhov [this message]
2021-03-15  4:37   ` Hongyi Zhao

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=67f6fcec-ae6b-2ebe-a104-84f4c2a6008f@gmail.com \
    --to=mityapetuhov@gmail.com \
    --cc=pve-user@lists.proxmox.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox
Service provided by Proxmox Server Solutions GmbH | Privacy | Legal