From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from firstgate.proxmox.com (firstgate.proxmox.com [IPv6:2a01:7e0:0:424::9]) by lore.proxmox.com (Postfix) with ESMTPS id 36E7D1FF165 for ; Thu, 31 Jul 2025 09:09:01 +0200 (CEST) Received: from firstgate.proxmox.com (localhost [127.0.0.1]) by firstgate.proxmox.com (Proxmox) with ESMTP id 59AC333754; Thu, 31 Jul 2025 09:10:27 +0200 (CEST) From: Christian Ebner To: pbs-devel@lists.proxmox.com Date: Thu, 31 Jul 2025 09:09:45 +0200 Message-ID: <20250731070945.34344-1-c.ebner@proxmox.com> X-Mailer: git-send-email 2.47.2 MIME-Version: 1.0 X-Bm-Milter-Handled: 55990f41-d878-4baa-be0a-ee34c49e34d2 X-Bm-Transport-Timestamp: 1753945782764 X-SPAM-LEVEL: Spam detection results: 0 AWL 0.045 Adjusted score from AWL reputation of From: address BAYES_00 -1.9 Bayes spam probability is 0 to 1% DMARC_MISSING 0.1 Missing DMARC policy KAM_DMARC_STATUS 0.01 Test Rule for DKIM or SPF Failure with Strict Alignment RCVD_IN_VALIDITY_CERTIFIED_BLOCKED 0.001 ADMINISTRATOR NOTICE: The query to Validity was blocked. See https://knowledge.validity.com/hc/en-us/articles/20961730681243 for more information. RCVD_IN_VALIDITY_RPBL_BLOCKED 0.001 ADMINISTRATOR NOTICE: The query to Validity was blocked. See https://knowledge.validity.com/hc/en-us/articles/20961730681243 for more information. RCVD_IN_VALIDITY_SAFE_BLOCKED 0.001 ADMINISTRATOR NOTICE: The query to Validity was blocked. See https://knowledge.validity.com/hc/en-us/articles/20961730681243 for more information. SPF_HELO_NONE 0.001 SPF: HELO does not publish an SPF Record SPF_PASS -0.001 SPF: sender matches SPF record Subject: [pbs-devel] [PATCH proxmox-backup] docs: s3: extend recommendations and limitations for local cache X-BeenThere: pbs-devel@lists.proxmox.com X-Mailman-Version: 2.1.29 Precedence: list List-Id: Proxmox Backup Server development discussion List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Reply-To: Proxmox Backup Server development discussion Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Errors-To: pbs-devel-bounces@lists.proxmox.com Sender: "pbs-devel" Specify that the local cache must be a dedicated storage, it cannot reuse pre-existing datastores. Further, give some more recommendations about size and clarify that storage backed by volatile memory cannot be used for this, at least for the time being. Signed-off-by: Christian Ebner --- docs/storage.rst | 13 ++++++++----- 1 file changed, 8 insertions(+), 5 deletions(-) diff --git a/docs/storage.rst b/docs/storage.rst index ef6eb7657..54540219b 100644 --- a/docs/storage.rst +++ b/docs/storage.rst @@ -288,11 +288,14 @@ To list your s3 endpoint configuration, run: # proxmox-backup-manager s3 endpoint list A new datastore with S3 backend can be created using one of the configured S3 endpoints. Although -storing all contents on the S3 object store, the datastore requires nevertheless a local cache store, -used to increase performance and reduce the number of requests to the backend. For this, a local -filesystem path has to be provided during datastore creation, just like for regular datastore setup. -A minimum size of a few GiB of storage is recommended, given that cache datastore contents include -also data chunks. +storing all contents on the S3 object store, the datastore requires nevertheless a local persisant +cache, used to increase performance and reduce the number of requests to the backend. For this, a +local filesystem path has to be provided during datastore creation, just like for regular datastore +setup. However, unlike for regular datastores the size of the local cache can be limited, 64 GiB to +128 GiB are recommended given that cached datastore contents include also data chunks. Best is to +use a dedicated disk, partition or ZFS dataset with quota as local cache. Note however, it is not +possible to use a pre-existing regular datastore for this. Further, the use of volatile memory only +for the cache is currently not possible. To setup a new datastore called ``my-s3-store`` placed in a bucket called ``pbs-s3-bucket``, run: -- 2.47.2 _______________________________________________ pbs-devel mailing list pbs-devel@lists.proxmox.com https://lists.proxmox.com/cgi-bin/mailman/listinfo/pbs-devel