From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from firstgate.proxmox.com (firstgate.proxmox.com [212.224.123.68]) by lore.proxmox.com (Postfix) with ESMTPS id 0931C1FF171 for ; Fri, 13 Dec 2024 17:51:13 +0100 (CET) Received: from firstgate.proxmox.com (localhost [127.0.0.1]) by firstgate.proxmox.com (Proxmox) with ESMTP id 64C7C13124; Fri, 13 Dec 2024 17:51:19 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=tuxis.nl; s=mail; h=from:reply-to:subject:date:message-id:to:mime-version:content-type; bh=iNPoy9OIADZvrfi2kgtDHcvr6FVq+oBXhB5b4CG01go=; b=qWkxlHk/5F0GUNqEQ3KaT+idh4UuD5DOJM6NgpfJBA8s3bO1WdwfJq7e2SK9oVQQEDevrz3z+QbDr KtB114hRcPt5gDkbRU/1xev6urEMJVTj7jpZQPQKLwqoRftnOG3W+2hoBSsMBr7Dq81Ab7Waj99jQ3 sZ2+iUuWNB3qPAjZoItWdCNe+i/ezEKPBXFdvikG3ynk7wEAOeH14tweCMDT28SKffC8YgV45n2v1F EraZKmV8hzxbaWl2QaD7o3WkIB6XAjHmIgQS0bjp2oOpu02W5KOdtVmVBmYhwsRjBEtfF5INkSUcZo xqWt/B5IvGDmx96VRz5nuVbvclUtrtQ== X-Footer: dHV4aXMubmw= From: "Mark Schouten" To: pbs-devel Date: Fri, 13 Dec 2024 16:21:02 +0000 Message-Id: User-Agent: eM_Client/10.1.4828.0 MIME-Version: 1.0 X-SPAM-LEVEL: Spam detection results: 0 AWL 0.017 Adjusted score from AWL reputation of From: address BAYES_00 -1.9 Bayes spam probability is 0 to 1% DKIM_SIGNED 0.1 Message has a DKIM or DK signature, not necessarily valid DKIM_VALID -0.1 Message has at least one valid DKIM or DK signature DKIM_VALID_AU -0.1 Message has a valid DKIM or DK signature from author's domain DKIM_VALID_EF -0.1 Message has a valid DKIM or DK signature from envelope-from domain DMARC_PASS -0.1 DMARC pass policy HTML_MESSAGE 0.001 HTML included in message RCVD_IN_VALIDITY_CERTIFIED_BLOCKED 0.001 ADMINISTRATOR NOTICE: The query to Validity was blocked. See https://knowledge.validity.com/hc/en-us/articles/20961730681243 for more information. RCVD_IN_VALIDITY_RPBL_BLOCKED 0.001 ADMINISTRATOR NOTICE: The query to Validity was blocked. See https://knowledge.validity.com/hc/en-us/articles/20961730681243 for more information. RCVD_IN_VALIDITY_SAFE_BLOCKED 0.001 ADMINISTRATOR NOTICE: The query to Validity was blocked. See https://knowledge.validity.com/hc/en-us/articles/20961730681243 for more information. SPF_HELO_NONE 0.001 SPF: HELO does not publish an SPF Record SPF_PASS -0.001 SPF: sender matches SPF record URIBL_BLOCKED 0.001 ADMINISTRATOR NOTICE: The query to URIBL was blocked. See http://wiki.apache.org/spamassassin/DnsBlocklists#dnsbl-block for more information. [tuxis.nl] Subject: [pbs-devel] Authentication performance X-BeenThere: pbs-devel@lists.proxmox.com X-Mailman-Version: 2.1.29 Precedence: list List-Id: Proxmox Backup Server development discussion List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Reply-To: Mark Schouten , Proxmox Backup Server development discussion Content-Type: multipart/mixed; boundary="===============3290861004797813272==" Errors-To: pbs-devel-bounces@lists.proxmox.com Sender: "pbs-devel" --===============3290861004797813272== Content-Type: multipart/alternative; boundary="------=_MB52652FA2-2576-4986-93FE-C07A89F2ED3B" --------=_MB52652FA2-2576-4986-93FE-C07A89F2ED3B Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: quoted-printable Hi All, As you may know, we offer free PBS accounts up to 150GB and this is=20 quite popular. So popular, that I am seeing performance issues on the=20 PBS-end. Yesterday, we rebooted a PBS and directly after booting, the=20 load was about 14, without any running tasks. I think one of the obvious bottlenecks is authentication, as we=E2=80=99re= using=20 PBS in a slightly different manner than it was probably initially=20 intended. Because we=E2=80=99re currently doing about 240 succesful=20 authentication-requests per second (on average) on this server. But we do notice that the PBS is responding slow, even though there are=20 not that many tasks. Which leads me to believe that if we can tweak the=20 authentication process, OR one of the calls that a PVE cluster is doing=20 on the PBS. I=E2=80=99m thinking one of these two calls: 1879332 GET /api2/json/admin/datastore (on average 30 per second) 14587762 POST /api2/json/access/ticket. (on average 238 per second) Where the number is the amount of requests today, so far. Again, I know this is a different situation from normal, but if we can=20 improve PBS even further. My knowledge of Rust is minimal, but if=20 someone can point me to the logic here, I may be able to see possible=20 improvements myself. Although you guys are probably much more capable at=20 that. Let me know what you think, thanks! =E2=80=94 Mark Schouten CTO, Tuxis B.V. +31 318 200208 / mark@tuxis.nl --------=_MB52652FA2-2576-4986-93FE-C07A89F2ED3B Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: quoted-printable
Hi All,

As you may know, we offer free PBS= accounts up to 150GB and this is quite popular. So popular, that I am seein= g performance issues on the PBS-end. Yesterday, we rebooted a PBS and direc= tly after booting, the load was about 14, without any running tasks.
<= div>
I think one of the obvious bottlenecks is authenticati= on, as we=E2=80=99re using PBS in a slightly different manner than it was p= robably initially intended. Because we=E2=80=99re currently doing about 240 = succesful authentication-requests per second (on average) on this server.<= /div>

But we do notice that the PBS is responding slow= , even though there are not that many tasks. Which leads me to believe that = if we can tweak the authentication process, OR one of the calls that a PVE = cluster is doing on the PBS.

I=E2=80=99m thinki= ng one of these two calls:

1879332 GET /api2/jso= n/admin/datastore (on average 30 per second)
14587762 POST /api2/= json/access/ticket. (on average 238 per second)

Where the number is the amount of requests today, so= far.

Again, I know this is a different situation = from normal, but if we can improve PBS even further. My knowledge of Rust= is minimal, but if someone can point me to the logic here, I may be able to = see possible improvements myself. Although you guys are probably much more = capable at that.

Let me know what you think, th= anks!

=
=E2=80= =94=C2=A0
Mark Schouten
CTO, Tuxis B.V.
+31 318 200208 /=C2=A0mark@tuxis.nl

--------=_MB52652FA2-2576-4986-93FE-C07A89F2ED3B-- --===============3290861004797813272== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ pbs-devel mailing list pbs-devel@lists.proxmox.com https://lists.proxmox.com/cgi-bin/mailman/listinfo/pbs-devel --===============3290861004797813272==--