From mboxrd@z Thu Jan 1 00:00:00 1970
Return-Path: <pbs-devel-bounces@lists.proxmox.com>
Received: from firstgate.proxmox.com (firstgate.proxmox.com [212.224.123.68])
by lore.proxmox.com (Postfix) with ESMTPS id 0931C1FF171
for <inbox@lore.proxmox.com>; Fri, 13 Dec 2024 17:51:13 +0100 (CET)
Received: from firstgate.proxmox.com (localhost [127.0.0.1])
by firstgate.proxmox.com (Proxmox) with ESMTP id 64C7C13124;
Fri, 13 Dec 2024 17:51:19 +0100 (CET)
DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=tuxis.nl; s=mail;
h=from:reply-to:subject:date:message-id:to:mime-version:content-type;
bh=iNPoy9OIADZvrfi2kgtDHcvr6FVq+oBXhB5b4CG01go=;
b=qWkxlHk/5F0GUNqEQ3KaT+idh4UuD5DOJM6NgpfJBA8s3bO1WdwfJq7e2SK9oVQQEDevrz3z+QbDr
KtB114hRcPt5gDkbRU/1xev6urEMJVTj7jpZQPQKLwqoRftnOG3W+2hoBSsMBr7Dq81Ab7Waj99jQ3
sZ2+iUuWNB3qPAjZoItWdCNe+i/ezEKPBXFdvikG3ynk7wEAOeH14tweCMDT28SKffC8YgV45n2v1F
EraZKmV8hzxbaWl2QaD7o3WkIB6XAjHmIgQS0bjp2oOpu02W5KOdtVmVBmYhwsRjBEtfF5INkSUcZo
xqWt/B5IvGDmx96VRz5nuVbvclUtrtQ==
X-Footer: dHV4aXMubmw=
From: "Mark Schouten" <mark@tuxis.nl>
To: pbs-devel <pbs-devel@lists.proxmox.com>
Date: Fri, 13 Dec 2024 16:21:02 +0000
Message-Id: <ema6032dba-8585-4377-bec1-11a37159087c@192dede7.com>
User-Agent: eM_Client/10.1.4828.0
MIME-Version: 1.0
X-SPAM-LEVEL: Spam detection results: 0
AWL 0.017 Adjusted score from AWL reputation of From: address
BAYES_00 -1.9 Bayes spam probability is 0 to 1%
DKIM_SIGNED 0.1 Message has a DKIM or DK signature,
not necessarily valid
DKIM_VALID -0.1 Message has at least one valid DKIM or DK signature
DKIM_VALID_AU -0.1 Message has a valid DKIM or DK signature from author's
domain
DKIM_VALID_EF -0.1 Message has a valid DKIM or DK signature from envelope-from
domain DMARC_PASS -0.1 DMARC pass policy
HTML_MESSAGE 0.001 HTML included in message
RCVD_IN_VALIDITY_CERTIFIED_BLOCKED 0.001 ADMINISTRATOR NOTICE: The query to
Validity was blocked. See
https://knowledge.validity.com/hc/en-us/articles/20961730681243 for more
information.
RCVD_IN_VALIDITY_RPBL_BLOCKED 0.001 ADMINISTRATOR NOTICE: The query to
Validity was blocked. See
https://knowledge.validity.com/hc/en-us/articles/20961730681243 for more
information.
RCVD_IN_VALIDITY_SAFE_BLOCKED 0.001 ADMINISTRATOR NOTICE: The query to
Validity was blocked. See
https://knowledge.validity.com/hc/en-us/articles/20961730681243 for more
information.
SPF_HELO_NONE 0.001 SPF: HELO does not publish an SPF Record
SPF_PASS -0.001 SPF: sender matches SPF record
URIBL_BLOCKED 0.001 ADMINISTRATOR NOTICE: The query to URIBL was blocked. See
http://wiki.apache.org/spamassassin/DnsBlocklists#dnsbl-block for more
information. [tuxis.nl]
Subject: [pbs-devel] Authentication performance
X-BeenThere: pbs-devel@lists.proxmox.com
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Proxmox Backup Server development discussion
<pbs-devel.lists.proxmox.com>
List-Unsubscribe: <https://lists.proxmox.com/cgi-bin/mailman/options/pbs-devel>,
<mailto:pbs-devel-request@lists.proxmox.com?subject=unsubscribe>
List-Archive: <http://lists.proxmox.com/pipermail/pbs-devel/>
List-Post: <mailto:pbs-devel@lists.proxmox.com>
List-Help: <mailto:pbs-devel-request@lists.proxmox.com?subject=help>
List-Subscribe: <https://lists.proxmox.com/cgi-bin/mailman/listinfo/pbs-devel>,
<mailto:pbs-devel-request@lists.proxmox.com?subject=subscribe>
Reply-To: Mark Schouten <mark@tuxis.nl>,
Proxmox Backup Server development discussion
<pbs-devel@lists.proxmox.com>
Content-Type: multipart/mixed; boundary="===============3290861004797813272=="
Errors-To: pbs-devel-bounces@lists.proxmox.com
Sender: "pbs-devel" <pbs-devel-bounces@lists.proxmox.com>
--===============3290861004797813272==
Content-Type: multipart/alternative;
boundary="------=_MB52652FA2-2576-4986-93FE-C07A89F2ED3B"
--------=_MB52652FA2-2576-4986-93FE-C07A89F2ED3B
Content-Type: text/plain; charset=utf-8; format=flowed
Content-Transfer-Encoding: quoted-printable
Hi All,
As you may know, we offer free PBS accounts up to 150GB and this is=20
quite popular. So popular, that I am seeing performance issues on the=20
PBS-end. Yesterday, we rebooted a PBS and directly after booting, the=20
load was about 14, without any running tasks.
I think one of the obvious bottlenecks is authentication, as we=E2=80=99re=
using=20
PBS in a slightly different manner than it was probably initially=20
intended. Because we=E2=80=99re currently doing about 240 succesful=20
authentication-requests per second (on average) on this server.
But we do notice that the PBS is responding slow, even though there are=20
not that many tasks. Which leads me to believe that if we can tweak the=20
authentication process, OR one of the calls that a PVE cluster is doing=20
on the PBS.
I=E2=80=99m thinking one of these two calls:
1879332 GET /api2/json/admin/datastore (on average 30 per second)
14587762 POST /api2/json/access/ticket. (on average 238 per second)
Where the number is the amount of requests today, so far.
Again, I know this is a different situation from normal, but if we can=20
improve PBS even further. My knowledge of Rust is minimal, but if=20
someone can point me to the logic here, I may be able to see possible=20
improvements myself. Although you guys are probably much more capable at=20
that.
Let me know what you think, thanks!
=E2=80=94
Mark Schouten
CTO, Tuxis B.V.
+31 318 200208 / mark@tuxis.nl
--------=_MB52652FA2-2576-4986-93FE-C07A89F2ED3B
Content-Type: text/html; charset=utf-8
Content-Transfer-Encoding: quoted-printable
<html><head>
<style id=3D"css_styles">=20
blockquote.cite { margin-left: 5px; margin-right: 0px; padding-left: 10px;=
padding-right:0px; border-left: 1px solid #cccccc }
blockquote.cite2 {margin-left: 5px; margin-right: 0px; padding-left: 10px;=
padding-right:0px; border-left: 1px solid #cccccc; margin-top: 3px; padding=
-top: 0px; }
a img { border: 0px; }
table { border-collapse: collapse; }
li[style=3D'text-align: center;'], li[style=3D'text-align: center; '], li[s=
tyle=3D'text-align: right;'], li[style=3D'text-align: right; '] { list-sty=
le-position: inside;}
body { font-family: Helvetica; font-size: 9pt; }
.quote { margin-left: 1em; margin-right: 1em; border-left: 5px #ebebeb soli=
d; padding-left: 0.3em; }
a.em-mention[href] { text-decoration: none; color: inherit; border-radius:=
3px; padding-left: 2px; padding-right: 2px; background-color: #e2e2e2; }
</style>
</head>
<body style=3D"overflow-wrap: break-word; -webkit-nbsp-mode: space; line-br=
eak: after-white-space;">
<div>Hi All,</div><div><br /></div><div>As you may know, we offer free PBS=
accounts up to 150GB and this is quite popular. So popular, that I am seein=
g performance issues on the PBS-end. Yesterday, we rebooted a PBS and direc=
tly after booting, the load was about 14, without any running tasks.</div><=
div><br /></div><div>I think one of the obvious bottlenecks is authenticati=
on, as we=E2=80=99re using PBS in a slightly different manner than it was p=
robably initially intended. Because we=E2=80=99re currently doing about 240 =
succesful authentication-requests per second (on average) on this server.<=
/div><div><br /></div><div>But we do notice that the PBS is responding slow=
, even though there are not that many tasks. Which leads me to believe that =
if we can tweak the authentication process, OR one of the calls that a PVE =
cluster is doing on the PBS.</div><div><br /></div><div>I=E2=80=99m thinki=
ng one of these two calls:</div><div><br /></div><div>1879332 GET /api2/jso=
n/admin/datastore (on average 30 per second)</div><div>14587762 POST /api2/=
json/access/ticket. (on average 238 per second)</div>
<div><br /></div><div>Where the number is the amount of requests today, so=
far.</div><div><br /></div><div>Again, I know this is a different situation =
from normal, but if we can improve PBS even further. My knowledge of Rust=
is minimal, but if someone can point me to the logic here, I may be able to =
see possible improvements myself. Although you guys are probably much more =
capable at that.</div><div><br /></div><div>Let me know what you think, th=
anks!</div><div><br /></div><div id=3D"signature_old" style=3D"clear:both">=
<div style=3D"margin: 0px; padding: 0px; box-sizing: content-box;">=E2=80=
=94=C2=A0</div><div style=3D"margin: 0px; padding: 0px; box-sizing: content=
-box;">Mark Schouten</div><div style=3D"margin: 0px; padding: 0px; box-sizi=
ng: content-box;">CTO, Tuxis B.V.</div><div style=3D"margin: 0px; padding:=
0px; box-sizing: content-box;">+31 318 200208 /=C2=A0mark@tuxis.nl</div></d=
iv><div><br /></div>
</body></html>
--------=_MB52652FA2-2576-4986-93FE-C07A89F2ED3B--
--===============3290861004797813272==
Content-Type: text/plain; charset="us-ascii"
MIME-Version: 1.0
Content-Transfer-Encoding: 7bit
Content-Disposition: inline
_______________________________________________
pbs-devel mailing list
pbs-devel@lists.proxmox.com
https://lists.proxmox.com/cgi-bin/mailman/listinfo/pbs-devel
--===============3290861004797813272==--