From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from firstgate.proxmox.com (firstgate.proxmox.com [IPv6:2a01:7e0:0:424::9]) by lore.proxmox.com (Postfix) with ESMTPS id 790141FF187 for ; Tue, 18 Nov 2025 11:46:08 +0100 (CET) Received: from firstgate.proxmox.com (localhost [127.0.0.1]) by firstgate.proxmox.com (Proxmox) with ESMTP id 329C7107BF; Tue, 18 Nov 2025 11:46:12 +0100 (CET) From: Christian Ebner To: pbs-devel@lists.proxmox.com Date: Tue, 18 Nov 2025 11:45:27 +0100 Message-ID: <20251118104529.254348-1-c.ebner@proxmox.com> X-Mailer: git-send-email 2.47.3 MIME-Version: 1.0 X-Bm-Milter-Handled: 55990f41-d878-4baa-be0a-ee34c49e34d2 X-Bm-Transport-Timestamp: 1763462708968 X-SPAM-LEVEL: Spam detection results: 0 AWL 0.048 Adjusted score from AWL reputation of From: address BAYES_00 -1.9 Bayes spam probability is 0 to 1% DMARC_MISSING 0.1 Missing DMARC policy KAM_DMARC_STATUS 0.01 Test Rule for DKIM or SPF Failure with Strict Alignment SPF_HELO_NONE 0.001 SPF: HELO does not publish an SPF Record SPF_PASS -0.001 SPF: sender matches SPF record Subject: [pbs-devel] [PATCH proxmox-backup 0/2] raise nofile limit for GC on S3 stores X-BeenThere: pbs-devel@lists.proxmox.com X-Mailman-Version: 2.1.29 Precedence: list List-Id: Proxmox Backup Server development discussion List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Reply-To: Proxmox Backup Server development discussion Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Errors-To: pbs-devel-bounces@lists.proxmox.com Sender: "pbs-devel" Datastores backed by s3 object stores rely on per-chunk file locks for consistency. However, the soft limit for open file handles might be to low during garbage collection, as there chunks are processed in batches of up to 1000 objects. Therefore, use the pre-existing helper defined in the proxmox-backup-client to raise the resource limits to the hard limit at start of garbage collection for s3 backed datastores. Christian Ebner (2): tools: move rlimit helper from pbs-client to pbs-tools GC: raise nofile soft limit to the hard limit on s3 backed stores pbs-client/src/tools/mod.rs | 23 ----------------------- pbs-datastore/src/datastore.rs | 7 +++++++ pbs-tools/src/lib.rs | 25 +++++++++++++++++++++++++ proxmox-backup-client/src/main.rs | 4 ++-- 4 files changed, 34 insertions(+), 25 deletions(-) -- 2.47.3 _______________________________________________ pbs-devel mailing list pbs-devel@lists.proxmox.com https://lists.proxmox.com/cgi-bin/mailman/listinfo/pbs-devel