From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: <proxmox@qwertz1.com> Received: from firstgate.proxmox.com (firstgate.proxmox.com [212.224.123.68]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits)) (No client certificate requested) by lists.proxmox.com (Postfix) with ESMTPS id 732E5A15AC for <pve-user@lists.proxmox.com>; Wed, 14 Jun 2023 22:35:49 +0200 (CEST) Received: from firstgate.proxmox.com (localhost [127.0.0.1]) by firstgate.proxmox.com (Proxmox) with ESMTP id 48311203E0 for <pve-user@lists.proxmox.com>; Wed, 14 Jun 2023 22:35:19 +0200 (CEST) Received: from relay.yourmailgateway.de (relay.yourmailgateway.de [194.59.206.189]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by firstgate.proxmox.com (Proxmox) with ESMTPS for <pve-user@lists.proxmox.com>; Wed, 14 Jun 2023 22:35:18 +0200 (CEST) Received: from relay02-mors.netcup.net (localhost [127.0.0.1]) by relay02-mors.netcup.net (Postfix) with ESMTPS id 4QhH8M09Dmz42bX for <pve-user@lists.proxmox.com>; Wed, 14 Jun 2023 22:29:23 +0200 (CEST) Authentication-Results: relay02-mors.netcup.net; dkim=permerror (bad message/signature format) Received: from policy01-mors.netcup.net (unknown [46.38.225.35]) by relay02-mors.netcup.net (Postfix) with ESMTPS id 4QhH8L6w0yz7wjR for <pve-user@lists.proxmox.com>; Wed, 14 Jun 2023 22:29:22 +0200 (CEST) X-Virus-Scanned: Debian amavisd-new at policy01-mors.netcup.net X-Spam-Flag: NO X-Spam-Score: -2.899 X-Spam-Status: No, score=-2.899 required=6.31 tests=[ALL_TRUSTED=-1, BAYES_00=-1.9, HTML_MESSAGE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no Received: from mx2fb1.netcup.net (unknown [10.243.12.53]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by policy01-mors.netcup.net (Postfix) with ESMTPS id 4QhH8C3C0yz8sZM for <pve-user@lists.proxmox.com>; Wed, 14 Jun 2023 22:29:15 +0200 (CEST) Received: from [127.0.0.1] (p579e7c79.dip0.t-ipconnect.de [87.158.124.121]) by mx2fb1.netcup.net (Postfix) with ESMTPSA id D3F748018C for <pve-user@lists.proxmox.com>; Wed, 14 Jun 2023 22:29:10 +0200 (CEST) Authentication-Results: mx2fb1; spf=pass (sender IP is 87.158.124.121) smtp.mailfrom=proxmox@qwertz1.com smtp.helo=[127.0.0.1] Received-SPF: pass (mx2fb1: connection is authenticated) Date: Wed, 14 Jun 2023 22:29:05 +0200 From: Stefan <proxmox@qwertz1.com> To: Proxmox VE user list <pve-user@lists.proxmox.com> User-Agent: K-9 Mail for Android In-Reply-To: <49ddc1dbfa93638026bac9a89dda78da3a8f99c6.camel@ovgu.de> References: <49ddc1dbfa93638026bac9a89dda78da3a8f99c6.camel@ovgu.de> Message-ID: <E289558D-890E-4783-B627-DF9268F568A3@qwertz1.com> MIME-Version: 1.0 X-PPP-Message-ID: <168677455122.31824.14666940466086898323@mx2fb1.netcup.net> X-Rspamd-Queue-Id: D3F748018C X-Spamd-Result: default: False [-5.60 / 15.00]; BAYES_HAM(-5.50)[100.00%]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ASN(0.00)[asn:3320, ipnet:87.128.0.0/10, country:DE]; RCVD_COUNT_ZERO(0.00)[0]; TO_DN_ALL(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; ARC_NA(0.00)[] X-Rspamd-Server: rspamd-worker-8404 X-NC-CID: FkxacL+NZcfAQSL9GPQ41NU/VTAPBu41Rl3YxmifSwIWcA== X-SPAM-LEVEL: Spam detection results: 0 BAYES_00 -1.9 Bayes spam probability is 0 to 1% DMARC_MISSING 0.1 Missing DMARC policy HTML_MESSAGE 0.001 HTML included in message KAM_DMARC_STATUS 0.01 Test Rule for DKIM or SPF Failure with Strict Alignment KAM_LAZY_DOMAIN_SECURITY 1 Sending domain does not have any anti-forgery methods RCVD_IN_DNSWL_NONE -0.0001 Sender listed at https://www.dnswl.org/, no trust SPF_HELO_PASS -0.001 SPF: HELO matches SPF record SPF_NONE 0.001 SPF: sender does not publish an SPF Record T_SCC_BODY_TEXT_LINE -0.01 - Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.29 Subject: Re: [PVE-User] Limitation File Restore List X-BeenThere: pve-user@lists.proxmox.com X-Mailman-Version: 2.1.29 Precedence: list List-Id: Proxmox VE user list <pve-user.lists.proxmox.com> List-Unsubscribe: <https://lists.proxmox.com/cgi-bin/mailman/options/pve-user>, <mailto:pve-user-request@lists.proxmox.com?subject=unsubscribe> List-Archive: <http://lists.proxmox.com/pipermail/pve-user/> List-Post: <mailto:pve-user@lists.proxmox.com> List-Help: <mailto:pve-user-request@lists.proxmox.com?subject=help> List-Subscribe: <https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-user>, <mailto:pve-user-request@lists.proxmox.com?subject=subscribe> X-List-Received-Date: Wed, 14 Jun 2023 20:35:49 -0000 Long shot: Since you say it's working from cli and you get a timeout error after a co= uple of minutes when trying to render a 23000 elements webpage, I would gue= ss it's an inefficiency on how that feature is implemented=2E So some web component aborts the request before it has finished=2E ( e=2Eg= =2E JavaScript, reverse proxy, web server etc=2E)=2E Am 13=2E Juni 2023 10:30:52 MESZ schrieb "Naumann, Thomas" <thomas=2Enauma= nn@ovgu=2Ede>: >Hi at all, > >following general conditions are given: > >- 12 node Proxmox-Cluster (48 x Intel(R) Xeon(R) CPU E5-2690 v3 / 256 >GB RAM) >- 96 Osd Ceph-Pool -> 6x HDD / TOSHIBA_MG07ACA14TE + 2x SSD / >SAMSUNG_MZILT7T6HALA_007 (Ceph-DB) per node >- 10 GBit Network >- 10 PBS VMs running >- 1 PBS VM (55 GB RAM, 16 CPUs, 35 TB Backup-Datastore XFS) > >Last mentioned PBS VM ist connected with another Proxmox-Cluster (9 >nodes 24 x Intel(R) Xeon(R) CPU X5670, 142 GB RAM, 56 SSD OSDs, 30 VMs >running) as Backup-Storage for VMs=2E 1 VM running on this cluster (32 GB >RAM, 16 CPUs, 12 TB HDD (virtio, discard, iothread), OpenSuse Leap >15=2E4) is mailserver=2E 12 TB HDD has one directory "MAIL" with 23000 >subdirectories (1 subdir per user), 10 TB are in use=2E PBS-client per >CLI is working without any problems - for example: mapping PBS-snapshot >and listing subdirs in MAIL-directory=2E >Listening / viewing subdirectories of MAIL-dir per Web-GUI (VM -> >Backup -> File Restore -> click "+" of MAIL-dir) is not working=2E After >waiting for about 4-5 minutes error code "list not finished in time >(503)" appears=2E Logfiles (/var/log/proxmox-backup/file-restore/qemu=2El= og >+ journalctl) do not show anything "unnormal" or error related=2E > >What exactly is the root cause of this behaviour and how to solve this? >Any hint / thought is welcome / helpful=2E=2E=2E=2E > >best regards >Th=2E Naumann