From: Christian Ebner <c.ebner@proxmox.com>
To: pbs-devel@lists.proxmox.com
Subject: [pbs-devel] [PATCH proxmox-backup 2/2] docs: s3: add object store provider specific configuration examples
Date: Wed, 23 Jul 2025 10:02:31 +0200 [thread overview]
Message-ID: <20250723080231.189207-3-c.ebner@proxmox.com> (raw)
In-Reply-To: <20250723080231.189207-1-c.ebner@proxmox.com>
To reduce friction, provide several provider specific example
configurations as reference.
With vhost style vs. path style bucket addressing, templating and all
the other provider specific configuration options, it can be rather
confusing on how to actually configure an S3 endpoint to be used as
PBS datastore backend. So having some concrete examples to lookup or
point to can help.
Signed-off-by: Christian Ebner <c.ebner@proxmox.com>
---
docs/storage.rst | 70 ++++++++++++++++++++++++++++++++++++++++++++++++
1 file changed, 70 insertions(+)
diff --git a/docs/storage.rst b/docs/storage.rst
index 2b2db05c6..7a4e703b1 100644
--- a/docs/storage.rst
+++ b/docs/storage.rst
@@ -314,6 +314,76 @@ same datastore name must be used.
on the S3 object store manually and refresh the contents via an ``S3 refresh``, either via the
CLI or UI.
+
+S3 Datastore Backend Configuration Examples
+^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
+
+The following shows example configurations for some typical S3 object store providers as excerpts
+(data relevant to S3 config only) from ``/etc/proxmox-backup/s3.cfg`` and
+``/etc/proxmox-backup/datastore.cfg``:
+
+Self hosted S3 object store with Ceph Rados Gateway using plain IP address, custom port, self-signed
+certificate and path-style bucket:
+
+.. code-block:: console
+
+ # cat /etc/proxmox-backup/s3.cfg
+
+ s3client: ceph-s3-rados-gw
+ access-key XXXXXXXXXXXXXXXXXXXX
+ endpoint 172.16.0.200
+ fingerprint XX:XX:XX:XX:XX:XX:XX:XX:XX:XX:XX:XX:XX:XX:XX:XX:XX:XX:XX:XX:XX:XX:XX:XX:XX:XX:XX:XX:XX:XX:XX:XX
+ path-style true
+ port 7480
+ secret-key XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
+
+
+ # cat /etc/proxmox-backup/datastore.cfg
+
+ datastore: ceph-s3-rgw-store
+ backend bucket=pbs-ceph-bucket,client=ceph-s3-rados-gw,type=s3
+ path /mnt/datastore/ceph-s3-rgw-store-local-cache
+
+AWS S3 with vhost style bucket addressing, using bucket name and region templating for the endpoint
+url:
+
+.. code-block:: console
+
+ # cat /etc/proxmox-backup/s3.cfg
+
+ s3client: aws-s3
+ access-key XXXXXXXXXXXXXXXXXXXX
+ endpoint {{bucket}}.s3.{{region}}.amazonaws.com
+ region eu-central-1
+ secret-key XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
+
+ # cat /etc/proxmox-backup/datastore.cfg
+
+ datastore: aws-s3-store
+ backend bucket=pbs-s3-bucket,client=aws-s3,type=s3
+ path /mnt/datastore/aws-s3-store-local-cache
+
+Cloudflare R2 with path style bucket addressing, note that region must be set to ``auto`` as
+otherwise request authentication might fail:
+
+.. code-block:: console
+
+ # cat /etc/proxmox-backup/s3.cfg
+
+ s3client: cloudflare-r2
+ access-key XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
+ endpoint XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.r2.cloudflarestorage.com
+ path-style true
+ region auto
+ secret-key XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
+
+ # cat /etc/proxmox-backup/datastore.cfg
+
+ datastore: r2-s3-store
+ backend bucket=pbs-r2-bucket,client=cloudflare-r2,type=s3
+ path /mnt/datastore/r2-s3-store-local-cache
+
+
Managing Datastores
^^^^^^^^^^^^^^^^^^^
--
2.47.2
_______________________________________________
pbs-devel mailing list
pbs-devel@lists.proxmox.com
https://lists.proxmox.com/cgi-bin/mailman/listinfo/pbs-devel
next prev parent reply other threads:[~2025-07-23 8:01 UTC|newest]
Thread overview: 5+ messages / expand[flat|nested] mbox.gz Atom feed top
2025-07-23 8:02 [pbs-devel] [PATCH proxmox-backup 0/2] docs: extend S3 related documentation Christian Ebner
2025-07-23 8:02 ` [pbs-devel] [PATCH proxmox-backup 1/2] docs: s3: add warning of potential costs when using s3 backends Christian Ebner
2025-07-23 8:02 ` Christian Ebner [this message]
2025-07-23 11:45 ` [pbs-devel] [PATCH proxmox-backup 0/2] docs: extend S3 related documentation Lukas Wagner
2025-07-23 11:51 ` [pbs-devel] applied: " Thomas Lamprecht
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20250723080231.189207-3-c.ebner@proxmox.com \
--to=c.ebner@proxmox.com \
--cc=pbs-devel@lists.proxmox.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox