public inbox for pbs-devel@lists.proxmox.com
 help / color / mirror / Atom feed
From: Lukas Wagner <l.wagner@proxmox.com>
To: Proxmox Backup Server development discussion
	<pbs-devel@lists.proxmox.com>,
	Christian Ebner <c.ebner@proxmox.com>
Subject: Re: [pbs-devel] [PATCH proxmox-backup v8 27/45] ui: add s3 client selector and bucket field for s3 backend setup
Date: Fri, 18 Jul 2025 12:02:04 +0200	[thread overview]
Message-ID: <7bb55d70-bc35-4fd4-b6e1-14c771263593@proxmox.com> (raw)
In-Reply-To: <20250715125332.954494-37-c.ebner@proxmox.com>



On  2025-07-15 14:53, Christian Ebner wrote:
> In order to be able to create datastore with an s3 object store
> backend. Implements a s3 client selector and exposes it in the
> datastore edit window, together with the additional bucket name field
> to associate with the datastore's s3 backend.
> 
> Signed-off-by: Christian Ebner <c.ebner@proxmox.com>
> ---
> changes since version 7:
> - use field endpoint insteand of host, fixing the selector listing
> 
>  www/Makefile                 |  1 +
>  www/form/S3ClientSelector.js | 33 +++++++++++++++++++++++++++
>  www/window/DataStoreEdit.js  | 44 ++++++++++++++++++++++++++++++++++++
>  3 files changed, 78 insertions(+)
>  create mode 100644 www/form/S3ClientSelector.js
> 
> diff --git a/www/Makefile b/www/Makefile
> index 767713c75..410e9f3e0 100644
> --- a/www/Makefile
> +++ b/www/Makefile
> @@ -42,6 +42,7 @@ JSSRC=							\
>  	Schema.js					\
>  	form/TokenSelector.js				\
>  	form/AuthidSelector.js				\
> +	form/S3ClientSelector.js			\
>  	form/RemoteSelector.js				\
>  	form/RemoteTargetSelector.js   			\
>  	form/DataStoreSelector.js			\
> diff --git a/www/form/S3ClientSelector.js b/www/form/S3ClientSelector.js
> new file mode 100644
> index 000000000..243484909
> --- /dev/null
> +++ b/www/form/S3ClientSelector.js
> @@ -0,0 +1,33 @@
> +Ext.define('PBS.form.S3ClientSelector', {
> +    extend: 'Proxmox.form.ComboGrid',
> +    alias: 'widget.pbsS3ClientSelector',
> +
> +    allowBlank: false,
> +    autoSelect: false,
> +    valueField: 'id',
> +    displayField: 'id',
> +
> +    store: {
> +        model: 'pmx-s3client',
> +        autoLoad: true,
> +        sorters: 'id',
> +    },
> +
> +    listConfig: {
> +        columns: [
> +            {
> +                header: gettext('S3 Client ID'),
> +                sortable: true,
> +                dataIndex: 'id',
> +                renderer: Ext.String.htmlEncode,
> +                flex: 1,
> +            },
> +            {
> +                header: gettext('Endpoint'),
> +                sortable: true,
> +                dataIndex: 'endpoint',
> +                flex: 1,
> +            },
> +        ],
> +    },
> +});
> diff --git a/www/window/DataStoreEdit.js b/www/window/DataStoreEdit.js
> index cd94f0335..3379bf773 100644
> --- a/www/window/DataStoreEdit.js
> +++ b/www/window/DataStoreEdit.js
> @@ -61,6 +61,7 @@ Ext.define('PBS.DataStoreEdit', {
>                          comboItems: [
>                              ['__default__', 'Local'],
>                              ['removable', 'Removable'],
> +                            ['s3', 'S3 (experimental)'],

Missing gettext here as well

>                          ],
>                          cbind: {
>                              disabled: '{!isCreate}',
> @@ -68,18 +69,32 @@ Ext.define('PBS.DataStoreEdit', {
>                          listeners: {
>                              change: function (checkbox, selected) {
>                                  let isRemovable = selected === 'removable';
> +                                let isS3 = selected === 's3';
>  
>                                  let inputPanel = checkbox.up('inputpanel');
>                                  let pathField = inputPanel.down('[name=path]');
>                                  let uuidEditField = inputPanel.down('[name=backing-device]');
> +                                let bucketField = inputPanel.down('[name=bucket]');
> +                                let s3ClientSelector = inputPanel.down('[name=s3client]');
>  
>                                  uuidEditField.setDisabled(!isRemovable);
>                                  uuidEditField.allowBlank = !isRemovable;
>                                  uuidEditField.setValue('');
>  
> +                                bucketField.setDisabled(!isS3);
> +                                bucketField.allowBlank = !isS3;
> +                                bucketField.setValue('');
> +
> +                                s3ClientSelector.setDisabled(!isS3);
> +                                s3ClientSelector.allowBlank = !isS3;
> +                                s3ClientSelector.setValue('');
> +
>                                  if (isRemovable) {
>                                      pathField.setFieldLabel(gettext('Path on Device'));
>                                      pathField.setEmptyText(gettext('A relative path'));
> +                                } else if (isS3) {
> +                                    pathField.setFieldLabel(gettext('Store Cache'));
> +                                    pathField.setEmptyText(gettext('An absolute path'));
>                                  } else {
>                                      pathField.setFieldLabel(gettext('Backing Path'));
>                                      pathField.setEmptyText(gettext('An absolute path'));

Yup, with these additional changes I'd definitely prefer the viewModel approach mentioned earlier :)

> @@ -98,6 +113,15 @@ Ext.define('PBS.DataStoreEdit', {
>                          emptyText: gettext('An absolute path'),
>                          validator: (val) => val?.trim() !== '/',
>                      },
> +                    {
> +                        xtype: 'pbsS3ClientSelector',
> +                        name: 's3client',
> +                        fieldLabel: gettext('S3 Client ID'),
> +                        disabled: true,
> +                        cbind: {
> +                            editable: '{isCreate}',
> +                        },
> +                    },
>                  ],
>                  column2: [
>                      {
> @@ -132,6 +156,13 @@ Ext.define('PBS.DataStoreEdit', {
>                          },
>                          emptyText: gettext('Device path'),
>                      },
> +                    {
> +                        xtype: 'proxmoxtextfield',
> +                        name: 'bucket',
> +                        fieldLabel: gettext('Bucket'),
> +                        allowBlank: false,
> +                        disabled: true,
> +                    },
>                  ],
>                  columnB: [
>                      {
> @@ -154,7 +185,20 @@ Ext.define('PBS.DataStoreEdit', {
>                      if (me.isCreate) {
>                          // New datastores default to using the notification system
>                          values['notification-mode'] = 'notification-system';
> +
> +                        if (values.s3client) {
> +                            let s3BackendConf = {
> +                                type: 's3',
> +                                client: values.s3client,
> +                                bucket: values.bucket,
> +                            };
> +                            values.backend = PBS.Utils.printPropertyString(s3BackendConf);
> +                        }
>                      }
> +
> +                    delete values.s3client;
> +                    delete values.bucket;
> +
>                      return values;
>                  },
>              },

-- 
- Lukas



_______________________________________________
pbs-devel mailing list
pbs-devel@lists.proxmox.com
https://lists.proxmox.com/cgi-bin/mailman/listinfo/pbs-devel


  reply	other threads:[~2025-07-18 10:01 UTC|newest]

Thread overview: 108+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2025-07-15 12:52 [pbs-devel] [PATCH proxmox{, -backup} v8 00/54] fix #2943: S3 storage backend for datastores Christian Ebner
2025-07-15 12:52 ` [pbs-devel] [PATCH proxmox v8 1/9] s3 client: add crate for AWS s3 compatible object store client Christian Ebner
2025-07-15 21:13   ` [pbs-devel] partially-applied-series: " Thomas Lamprecht
2025-07-15 12:52 ` [pbs-devel] [PATCH proxmox v8 2/9] s3 client: implement AWS signature v4 request authentication Christian Ebner
2025-07-15 12:52 ` [pbs-devel] [PATCH proxmox v8 3/9] s3 client: add dedicated type for s3 object keys Christian Ebner
2025-07-15 12:52 ` [pbs-devel] [PATCH proxmox v8 4/9] s3 client: add type for last modified timestamp in responses Christian Ebner
2025-07-15 12:52 ` [pbs-devel] [PATCH proxmox v8 5/9] s3 client: add helper to parse http date headers Christian Ebner
2025-07-15 12:52 ` [pbs-devel] [PATCH proxmox v8 6/9] s3 client: implement methods to operate on s3 objects in bucket Christian Ebner
2025-07-15 12:52 ` [pbs-devel] [PATCH proxmox v8 7/9] s3 client: add example usage for basic operations Christian Ebner
2025-07-15 12:52 ` [pbs-devel] [PATCH proxmox v8 8/9] pbs-api-types: extend datastore config by backend config enum Christian Ebner
2025-07-15 12:52 ` [pbs-devel] [PATCH proxmox v8 9/9] pbs-api-types: maintenance: add new maintenance mode S3 refresh Christian Ebner
2025-07-15 12:52 ` [pbs-devel] [PATCH proxmox-backup v8 01/45] datastore: add helpers for path/digest to s3 object key conversion Christian Ebner
2025-07-18  7:24   ` Lukas Wagner
2025-07-18  8:34     ` Christian Ebner
2025-07-15 12:52 ` [pbs-devel] [PATCH proxmox-backup v8 02/45] config: introduce s3 object store client configuration Christian Ebner
2025-07-18  7:22   ` Lukas Wagner
2025-07-18  8:37     ` Christian Ebner
2025-07-15 12:52 ` [pbs-devel] [PATCH proxmox-backup v8 03/45] api: config: implement endpoints to manipulate and list s3 configs Christian Ebner
2025-07-18  7:32   ` Lukas Wagner
2025-07-18  8:40     ` Christian Ebner
2025-07-18  9:07       ` Lukas Wagner
2025-07-15 12:52 ` [pbs-devel] [PATCH proxmox-backup v8 04/45] api: datastore: check s3 backend bucket access on datastore create Christian Ebner
2025-07-18  7:40   ` Lukas Wagner
2025-07-18  8:55     ` Christian Ebner
2025-07-15 12:52 ` [pbs-devel] [PATCH proxmox-backup v8 05/45] api/cli: add endpoint and command to check s3 client connection Christian Ebner
2025-07-18  7:43   ` Lukas Wagner
2025-07-18  9:04     ` Christian Ebner
2025-07-15 12:52 ` [pbs-devel] [PATCH proxmox-backup v8 06/45] datastore: allow to get the backend for a datastore Christian Ebner
2025-07-18  7:52   ` Lukas Wagner
2025-07-18  9:10     ` Christian Ebner
2025-07-15 12:52 ` [pbs-devel] [PATCH proxmox-backup v8 07/45] api: backup: store datastore backend in runtime environment Christian Ebner
2025-07-18  7:54   ` Lukas Wagner
2025-07-15 12:52 ` [pbs-devel] [PATCH proxmox-backup v8 08/45] api: backup: conditionally upload chunks to s3 object store backend Christian Ebner
2025-07-18  8:11   ` Lukas Wagner
2025-07-15 12:52 ` [pbs-devel] [PATCH proxmox-backup v8 09/45] api: backup: conditionally upload blobs " Christian Ebner
2025-07-18  8:13   ` Lukas Wagner
2025-07-15 12:52 ` [pbs-devel] [PATCH proxmox-backup v8 10/45] api: backup: conditionally upload indices " Christian Ebner
2025-07-18  8:20   ` Lukas Wagner
2025-07-18  9:24     ` Christian Ebner
2025-07-15 12:52 ` [pbs-devel] [PATCH proxmox-backup v8 11/45] api: backup: conditionally upload manifest " Christian Ebner
2025-07-18  8:26   ` Lukas Wagner
2025-07-18  9:33     ` Christian Ebner
2025-07-15 12:52 ` [pbs-devel] [PATCH proxmox-backup v8 12/45] api: datastore: conditionally upload client log to s3 backend Christian Ebner
2025-07-18  8:28   ` Lukas Wagner
2025-07-15 12:53 ` [pbs-devel] [PATCH proxmox-backup v8 13/45] sync: pull: conditionally upload content " Christian Ebner
2025-07-18  8:35   ` Lukas Wagner
2025-07-18  9:43     ` Christian Ebner
2025-07-15 12:53 ` [pbs-devel] [PATCH proxmox-backup v8 14/45] api: reader: fetch chunks based on datastore backend Christian Ebner
2025-07-18  8:38   ` Lukas Wagner
2025-07-18  9:58     ` Christian Ebner
2025-07-18 10:03       ` Lukas Wagner
2025-07-18 10:10         ` Christian Ebner
2025-07-15 12:53 ` [pbs-devel] [PATCH proxmox-backup v8 15/45] datastore: local chunk reader: read chunks based on backend Christian Ebner
2025-07-18  8:45   ` Lukas Wagner
2025-07-18 10:11     ` Christian Ebner
2025-07-15 12:53 ` [pbs-devel] [PATCH proxmox-backup v8 16/45] verify worker: add datastore backed to verify worker Christian Ebner
2025-07-15 12:53 ` [pbs-devel] [PATCH proxmox-backup v8 17/45] verify: implement chunk verification for stores with s3 backend Christian Ebner
2025-07-18  8:56   ` Lukas Wagner
2025-07-18 11:45     ` Christian Ebner
2025-07-15 12:53 ` [pbs-devel] [PATCH proxmox-backup v8 18/45] datastore: create namespace marker in " Christian Ebner
2025-07-15 12:53 ` [pbs-devel] [PATCH proxmox-backup v8 19/45] datastore: create/delete protected marker file on s3 storage backend Christian Ebner
2025-07-15 12:53 ` [pbs-devel] [PATCH proxmox-backup v8 20/45] datastore: prune groups/snapshots from s3 object store backend Christian Ebner
2025-07-15 12:53 ` [pbs-devel] [PATCH proxmox-backup v8 21/45] datastore: get and set owner for s3 " Christian Ebner
2025-07-18  9:25   ` Lukas Wagner
2025-07-18 12:12     ` Christian Ebner
2025-07-15 12:53 ` [pbs-devel] [PATCH proxmox-backup v8 22/45] datastore: implement garbage collection for s3 backend Christian Ebner
2025-07-18  9:47   ` Lukas Wagner
2025-07-18 14:31     ` Christian Ebner
2025-07-15 12:53 ` [pbs-devel] [PATCH proxmox-backup v8 23/45] ui: add datastore type selector and reorganize component layout Christian Ebner
2025-07-18  9:55   ` Lukas Wagner
2025-07-15 12:53 ` [pbs-devel] [PATCH proxmox-backup v8 24/45] ui: add s3 client edit window for configuration create/edit Christian Ebner
2025-07-15 12:53 ` [pbs-devel] [PATCH proxmox-backup v8 25/45] ui: add s3 client view for configuration Christian Ebner
2025-07-15 12:53 ` [pbs-devel] [PATCH proxmox-backup v8 26/45] ui: expose the s3 client view in the navigation tree Christian Ebner
2025-07-15 12:53 ` [pbs-devel] [PATCH proxmox-backup v8 27/45] ui: add s3 client selector and bucket field for s3 backend setup Christian Ebner
2025-07-18 10:02   ` Lukas Wagner [this message]
2025-07-19 12:28     ` Christian Ebner
2025-07-22  9:25       ` Lukas Wagner
2025-07-15 12:53 ` [pbs-devel] [PATCH proxmox-backup v8 28/45] tools: lru cache: add removed callback for evicted cache nodes Christian Ebner
2025-07-15 12:53 ` [pbs-devel] [PATCH proxmox-backup v8 29/45] tools: async lru cache: implement insert, remove and contains methods Christian Ebner
2025-07-15 12:53 ` [pbs-devel] [PATCH proxmox-backup v8 30/45] datastore: add local datastore cache for network attached storages Christian Ebner
2025-07-18 11:24   ` Lukas Wagner
2025-07-18 14:59     ` Christian Ebner
2025-07-15 12:53 ` [pbs-devel] [PATCH proxmox-backup v8 31/45] api: backup: use local datastore cache on s3 backend chunk upload Christian Ebner
2025-07-15 12:53 ` [pbs-devel] [PATCH proxmox-backup v8 32/45] api: reader: use local datastore cache on s3 backend chunk fetching Christian Ebner
2025-07-15 12:53 ` [pbs-devel] [PATCH proxmox-backup v8 33/45] datastore: local chunk reader: get cached chunk from local cache store Christian Ebner
2025-07-18 11:36   ` Lukas Wagner
2025-07-18 15:04     ` Christian Ebner
2025-07-15 12:53 ` [pbs-devel] [PATCH proxmox-backup v8 34/45] api: backup: add no-cache flag to bypass local datastore cache Christian Ebner
2025-07-18 11:41   ` Lukas Wagner
2025-07-18 15:37     ` Christian Ebner
2025-07-15 12:53 ` [pbs-devel] [PATCH proxmox-backup v8 35/45] api/datastore: implement refresh endpoint for stores with s3 backend Christian Ebner
2025-07-18 12:01   ` Lukas Wagner
2025-07-18 15:51     ` Christian Ebner
2025-07-15 12:53 ` [pbs-devel] [PATCH proxmox-backup v8 36/45] cli: add dedicated subcommand for datastore s3 refresh Christian Ebner
2025-07-15 12:53 ` [pbs-devel] [PATCH proxmox-backup v8 37/45] ui: render s3 refresh as valid maintenance type and task description Christian Ebner
2025-07-15 12:53 ` [pbs-devel] [PATCH proxmox-backup v8 38/45] ui: expose s3 refresh button for datastores backed by object store Christian Ebner
2025-07-18 12:46   ` Lukas Wagner
2025-07-15 12:53 ` [pbs-devel] [PATCH proxmox-backup v8 39/45] datastore: conditionally upload atime marker chunk to s3 backend Christian Ebner
2025-07-15 12:53 ` [pbs-devel] [PATCH proxmox-backup v8 40/45] bin: implement client subcommands for s3 configuration manipulation Christian Ebner
2025-07-15 12:53 ` [pbs-devel] [PATCH proxmox-backup v8 41/45] bin: expose reuse-datastore flag for proxmox-backup-manager Christian Ebner
2025-07-15 12:53 ` [pbs-devel] [PATCH proxmox-backup v8 42/45] datastore: mark store as in-use by setting marker on s3 backend Christian Ebner
2025-07-15 12:53 ` [pbs-devel] [PATCH proxmox-backup v8 43/45] datastore: run s3-refresh when reusing a datastore with " Christian Ebner
2025-07-15 12:53 ` [pbs-devel] [PATCH proxmox-backup v8 44/45] api/ui: add flag to allow overwriting in-use marker for " Christian Ebner
2025-07-15 12:53 ` [pbs-devel] [PATCH proxmox-backup v8 45/45] docs: Add section describing how to setup s3 backed datastore Christian Ebner
2025-07-18 13:14   ` Maximiliano Sandoval
2025-07-18 14:38     ` Christian Ebner
2025-07-18 13:16 ` [pbs-devel] [PATCH proxmox{, -backup} v8 00/54] fix #2943: S3 storage backend for datastores Lukas Wagner
2025-07-19 12:52 ` [pbs-devel] superseded: " Christian Ebner

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=7bb55d70-bc35-4fd4-b6e1-14c771263593@proxmox.com \
    --to=l.wagner@proxmox.com \
    --cc=c.ebner@proxmox.com \
    --cc=pbs-devel@lists.proxmox.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox
Service provided by Proxmox Server Solutions GmbH | Privacy | Legal