From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from firstgate.proxmox.com (firstgate.proxmox.com [212.224.123.68]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by lists.proxmox.com (Postfix) with ESMTPS id 2A929A1B09 for ; Fri, 16 Jun 2023 08:54:21 +0200 (CEST) Received: from firstgate.proxmox.com (localhost [127.0.0.1]) by firstgate.proxmox.com (Proxmox) with ESMTP id 1469D2E4C0 for ; Fri, 16 Jun 2023 08:54:21 +0200 (CEST) Received: from mx2.ovgu.de (mx2.ovgu.de [141.44.1.65]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by firstgate.proxmox.com (Proxmox) with ESMTPS for ; Fri, 16 Jun 2023 08:54:19 +0200 (CEST) Received: from exchange.ovgu.de (pwedge03.ads.uni-magdeburg.de [141.44.16.177]) by mx2.ovgu.de (Postfix) with ESMTPS id AD963220287 for ; Fri, 16 Jun 2023 06:54:12 +0000 (UTC) Received: from pwedge04.ads.uni-magdeburg.de (141.44.16.180) by pwedge03.ads.uni-magdeburg.de (141.44.16.177) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.1258.16; Fri, 16 Jun 2023 08:54:12 +0200 Received: from pwedge04.ads.uni-magdeburg.de ([fe80::20c4:dbee:f95e:5e44]) by pwedge04.ads.uni-magdeburg.de ([fe80::20c4:dbee:f95e:5e44%11]) with mapi id 15.02.1258.016; Fri, 16 Jun 2023 08:54:12 +0200 From: "Naumann, Thomas" To: "pve-user@lists.proxmox.com" Thread-Topic: [PVE-User] Limitation File Restore List Thread-Index: AQHZndFdJ7xw4OLdzk64yMhlNGb8fK+KoJCAgAJA/AA= Date: Fri, 16 Jun 2023 06:54:12 +0000 Message-ID: <33a7c8ec94705b13f36fa4c2b0b57b087ac3c05b.camel@ovgu.de> References: <49ddc1dbfa93638026bac9a89dda78da3a8f99c6.camel@ovgu.de> In-Reply-To: Accept-Language: de-DE, en-US Content-Language: de-DE X-MS-Has-Attach: yes X-MS-TNEF-Correlator: x-originating-ip: [141.44.13.75] Content-Type: multipart/signed; micalg=sha-256; protocol="application/pkcs7-signature"; boundary="=-UoXp03ESDQkzsvhI6LqV" MIME-Version: 1.0 X-SPAM-LEVEL: Spam detection results: 0 AWL 0.154 Adjusted score from AWL reputation of From: address BAYES_00 -1.9 Bayes spam probability is 0 to 1% DMARC_MISSING 0.1 Missing DMARC policy KAM_DMARC_STATUS 0.01 Test Rule for DKIM or SPF Failure with Strict Alignment RCVD_IN_DNSWL_MED -2.3 Sender listed at https://www.dnswl.org/, medium trust SPF_HELO_NONE 0.001 SPF: HELO does not publish an SPF Record SPF_PASS -0.001 SPF: sender matches SPF record T_SCC_BODY_TEXT_LINE -0.01 - X-Content-Filtered-By: Mailman/MimeDel 2.1.29 Subject: Re: [PVE-User] Limitation File Restore List X-BeenThere: pve-user@lists.proxmox.com X-Mailman-Version: 2.1.29 Precedence: list List-Id: Proxmox VE user list List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 16 Jun 2023 06:54:21 -0000 --=-UoXp03ESDQkzsvhI6LqV Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Hi, thanks for your response. I did some tests about numbers of directories and behaviour of web-GUI listing the directories. Result: maximum number of directories of directories that will be listed correctly is 18999. From 19000 directories the mentioned error message ("list not finished in time (503)") appears. best regards --=20 Thomas Naumann On Wed, 2023-06-14 at 22:29 +0200, Stefan wrote: > Long shot: > Since you say it's working from cli and you get a timeout error after > a couple of minutes when trying to render a 23000 elements webpage, I > would guess it's an inefficiency on how that feature is implemented. > So some web component aborts the request before it has finished. ( > e.g. JavaScript, reverse proxy, web server etc.). >=20 >=20 >=20 > Am 13. Juni 2023 10:30:52 MESZ schrieb "Naumann, Thomas" > : > > Hi at all, > >=20 > > following general conditions are given: > >=20 > > - 12 node Proxmox-Cluster (48 x Intel(R) Xeon(R) CPU E5-2690 v3 / > > 256 > > GB RAM) > > - 96 Osd Ceph-Pool -> 6x HDD / TOSHIBA_MG07ACA14TE + 2x SSD / > > SAMSUNG_MZILT7T6HALA_007 (Ceph-DB) per node > > - 10 GBit Network > > - 10 PBS VMs running > > - 1 PBS VM (55 GB RAM, 16 CPUs, 35 TB Backup-Datastore XFS) > >=20 > > Last mentioned PBS VM ist connected with another Proxmox-Cluster (9 > > nodes 24 x Intel(R) Xeon(R) CPU X5670, 142 GB RAM, 56 SSD OSDs, 30 > > VMs > > running) as Backup-Storage for VMs. 1 VM running on this cluster > > (32 GB > > RAM, 16 CPUs, 12 TB HDD (virtio, discard, iothread), OpenSuse Leap > > 15.4) is mailserver. 12 TB HDD has one directory "MAIL" with 23000 > > subdirectories (1 subdir per user), 10 TB are in use. PBS-client > > per > > CLI is working without any problems - for example: mapping PBS- > > snapshot > > and listing subdirs in MAIL-directory. > > Listening / viewing subdirectories of MAIL-dir per Web-GUI (VM -> > > Backup -> File Restore -> click "+" of MAIL-dir) is not working. > > After > > waiting for about 4-5 minutes error code "list not finished in time > > (503)" appears. Logfiles (/var/log/proxmox-backup/file- > > restore/qemu.log > > + journalctl) do not show anything "unnormal" or error related. > >=20 > > What exactly is the root cause of this behaviour and how to solve > > this? > > Any hint / thought is welcome / helpful.... > >=20 > > best regards > > Th. Naumann > _______________________________________________ > pve-user mailing list > pve-user@lists.proxmox.com > https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-user >=20 --=-UoXp03ESDQkzsvhI6LqV--