[pbs-devel] Ratelimit for remote sites

[pbs-devel] Ratelimit for remote sites

[Harald Leithner]

[-- Attachment #1.1.1: Type: text/plain, Size: 385 bytes --]

Hi,

is it possible to have a rate limit for the sync process? Maybe per Site?

Some sites have a really small upload bandwidth and the sync process my 
block the rest of the local users.

thanks

Harald
-- 
ITronic

Harald Leithner
Wiedner Hauptstraße 120/5.1, 1050 Wien, Austria
Tel: +43-1-545 0 604
Mobil: +43-699-123 78 4 78
Mail: leithner@itronic.at | itronic.at

[-- Attachment #1.1.2: OpenPGP public key --]
[-- Type: application/pgp-keys, Size: 3669 bytes --]

[-- Attachment #2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 665 bytes --]

Re: [pbs-devel] Ratelimit for remote sites

[Fabian Grünbichler]

On March 25, 2021 7:58 am, Harald Leithner wrote:
> Hi,
> 
> is it possible to have a rate limit for the sync process? Maybe per Site?

like dietmar said - not yet implemented. but tracked over at 
https://bugzilla.proxmox.com/show_bug.cgi?id=3151 , so maybe add 
yourself to the CC list to get updates on progress.

> Some sites have a really small upload bandwidth and the sync process my 
> block the rest of the local users.

some sort of `tc` or port-based shaping on your FW to just slow down the 
uplink for connections to port 8007 could be a stop-gap measure (or stop 
any running syncs at the start of office hours - the sync is resumable 
modulo the in-progress downloads, but task status etc. might become ugly 
as a result if you have to force-stop sync jobs all the time..).

Re: [pbs-devel] Ratelimit for remote sites

[Harald Leithner]

[-- Attachment #1.1.1: Type: text/plain, Size: 1648 bytes --]

Hi Fabian,

 > or stop any running syncs at the start of office hours - the sync is 
resumable
 > modulo the in-progress downloads, but task status etc. might become ugly
 > as a result if you have to force-stop sync jobs all the time..).

That's what I'm doing now but I was not sure if it really can resume the 
sync. So thanks that you answered the question before asked ;-)

regards,

Harald



On 25.03.2021 08:41, Fabian Grünbichler wrote:
> On March 25, 2021 7:58 am, Harald Leithner wrote:
>> Hi,
>>
>> is it possible to have a rate limit for the sync process? Maybe per Site?
> 
> like dietmar said - not yet implemented. but tracked over at
> https://bugzilla.proxmox.com/show_bug.cgi?id=3151 , so maybe add
> yourself to the CC list to get updates on progress.
> 
>> Some sites have a really small upload bandwidth and the sync process my
>> block the rest of the local users.
> 
> some sort of `tc` or port-based shaping on your FW to just slow down the
> uplink for connections to port 8007 could be a stop-gap measure (or stop
> any running syncs at the start of office hours - the sync is resumable
> modulo the in-progress downloads, but task status etc. might become ugly
> as a result if you have to force-stop sync jobs all the time..).
> 
> 
> _______________________________________________
> pbs-devel mailing list
> pbs-devel@lists.proxmox.com
> https://lists.proxmox.com/cgi-bin/mailman/listinfo/pbs-devel
> 

-- 
ITronic

Harald Leithner
Wiedner Hauptstraße 120/5.1, 1050 Wien, Austria
Tel: +43-1-545 0 604
Mobil: +43-699-123 78 4 78
Mail: leithner@itronic.at | itronic.at

[-- Attachment #1.1.2: OpenPGP public key --]
[-- Type: application/pgp-keys, Size: 3669 bytes --]

[-- Attachment #2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 665 bytes --]

Re: [pbs-devel] Ratelimit for remote sites

[Harald Leithner]

[-- Attachment #1.1.1: Type: text/plain, Size: 594 bytes --]

Thanks for the quick response. I'm looking forward for it. So at the 
moment my workaround would be to use linux trafficshaping to do this.

thx

Harald

On 25.03.2021 08:23, Dietmar Maurer wrote:
>> is it possible to have a rate limit for the sync process? Maybe per Site?
> 
> Sorry, that is not implemented - but definitely a good idea. I guess we 
should have
> an optional rate limit for sync jobs.
> 

-- 
ITronic

Harald Leithner
Wiedner Hauptstraße 120/5.1, 1050 Wien, Austria
Tel: +43-1-545 0 604
Mobil: +43-699-123 78 4 78
Mail: leithner@itronic.at | itronic.at

[-- Attachment #1.1.2: OpenPGP public key --]
[-- Type: application/pgp-keys, Size: 3669 bytes --]

[-- Attachment #2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 665 bytes --]

Re: [pbs-devel] Ratelimit for remote sites

[Dietmar Maurer]

> is it possible to have a rate limit for the sync process? Maybe per Site?

Sorry, that is not implemented - but definitely a good idea. I guess we should have
an optional rate limit for sync jobs.