From: Christian Ebner <c.ebner@proxmox.com>
To: pbs-devel@lists.proxmox.com
Subject: [pbs-devel] [RFC v2 proxmox-backup 00/21] implement trash bin functionality
Date: Thu, 8 May 2025 15:05:34 +0200 [thread overview]
Message-ID: <20250508130555.494782-1-c.ebner@proxmox.com> (raw)
This patch series implements a trash bin functionality, marking
backup snapshots, groups and namespaces as trashed on prune and
forget instead of deleting them immediately. Cleanup is deferred to
the garbage collection job, allowing to recover the trashed items if
removed by accident.
In contrast to the previous version 1 of the patch series [0] which
moved trashed items to a separate folder structure, this patch series
utilizes the proposed `.trashed` marker file approach to mark and
filter content items. These marker files have to be set and removed
accordingly in a consistent manner and are used to filter in
iterators based on the trash state.
Sending this series as RFC in order to gain some initial feedback on
the chosen implementation approach and possible
shortcomings/oversights. Further, feedback especially for the design
of the WebUI (which still has some rough edges) is very welcome!
[0] https://lore.proxmox.com/pbs-devel/7db77767-ed54-4d7f-8caa-24b7216b159c@proxmox.com/T/
Christian Ebner (21):
datastore/api: mark snapshots as trash on destroy
datastore: mark groups as trash on destroy
datastore: allow filtering of backups by their trash status
datastore: ignore trashed snapshots for last successful backup
sync: ignore trashed snapshots when reading from local source
api: tape: check trash marker when trying to write snapshot
sync: ignore trashed groups in local source reader
datastore: namespace: add filter for trash status
datastore: refactor recursive namespace removal
datastore: mark namespace as trash instead of deleting it
datastore: check for trash marker in namespace exists check
datastore: clear trashed snapshot dir if re-creation requested
datastore: recreate trashed backup groups if requested
datastore: GC: clean-up trashed snapshots, groups and namespaces
client: expose skip trash flags for cli commands
api: datastore: add flag to list trashed snapshots only
api: namespace: add option to list all namespaces, including trashed
api: admin: implement endpoints to restore trashed contents
ui: add recover for trashed items tab to datastore panel
ui: drop 'permanent' in group/snapshot forget, default is to trash
ui: allow to skip trash on namespace deletion
pbs-datastore/examples/ls-snapshots.rs | 8 +-
pbs-datastore/src/backup_info.rs | 130 +++-
pbs-datastore/src/datastore.rs | 320 ++++++++-
pbs-datastore/src/hierarchy.rs | 91 ++-
pbs-datastore/src/lib.rs | 1 +
proxmox-backup-client/src/group.rs | 14 +-
proxmox-backup-client/src/namespace.rs | 14 +-
proxmox-backup-client/src/snapshot.rs | 16 +-
src/api2/admin/datastore.rs | 225 +++++-
src/api2/admin/namespace.rs | 28 +-
src/api2/backup/environment.rs | 1 +
src/api2/tape/backup.rs | 20 +-
src/backup/hierarchy.rs | 26 +-
src/backup/verify.rs | 4 +-
src/bin/proxmox-backup-manager.rs | 12 +-
src/bin/proxmox_backup_manager/prune.rs | 2 +-
src/server/prune_job.rs | 7 +-
src/server/pull.rs | 25 +-
src/server/sync.rs | 7 +-
www/Makefile | 1 +
www/datastore/Content.js | 4 +-
www/datastore/Panel.js | 8 +
www/datastore/RecoverTrashed.js | 876 ++++++++++++++++++++++++
www/window/NamespaceEdit.js | 21 +-
24 files changed, 1737 insertions(+), 124 deletions(-)
create mode 100644 www/datastore/RecoverTrashed.js
--
2.39.5
_______________________________________________
pbs-devel mailing list
pbs-devel@lists.proxmox.com
https://lists.proxmox.com/cgi-bin/mailman/listinfo/pbs-devel
next reply other threads:[~2025-05-08 13:06 UTC|newest]
Thread overview: 51+ messages / expand[flat|nested] mbox.gz Atom feed top
2025-05-08 13:05 Christian Ebner [this message]
2025-05-08 13:05 ` [pbs-devel] [RFC v2 proxmox-backup 01/21] datastore/api: mark snapshots as trash on destroy Christian Ebner
2025-05-09 12:27 ` Fabian Grünbichler
2025-05-08 13:05 ` [pbs-devel] [RFC v2 proxmox-backup 02/21] datastore: mark groups " Christian Ebner
2025-05-09 12:27 ` Fabian Grünbichler
2025-05-08 13:05 ` [pbs-devel] [RFC v2 proxmox-backup 03/21] datastore: allow filtering of backups by their trash status Christian Ebner
2025-05-09 12:27 ` Fabian Grünbichler
2025-05-12 9:32 ` Christian Ebner
2025-05-12 10:08 ` Fabian Grünbichler
2025-05-08 13:05 ` [pbs-devel] [RFC v2 proxmox-backup 04/21] datastore: ignore trashed snapshots for last successful backup Christian Ebner
2025-05-08 13:05 ` [pbs-devel] [RFC v2 proxmox-backup 05/21] sync: ignore trashed snapshots when reading from local source Christian Ebner
2025-05-08 13:05 ` [pbs-devel] [RFC v2 proxmox-backup 06/21] api: tape: check trash marker when trying to write snapshot Christian Ebner
2025-05-09 12:27 ` Fabian Grünbichler
2025-05-12 9:19 ` Christian Ebner
2025-05-12 9:38 ` Fabian Grünbichler
2025-05-12 9:46 ` Christian Ebner
2025-05-12 9:55 ` Christian Ebner
2025-05-12 10:09 ` Fabian Grünbichler
2025-05-08 13:05 ` [pbs-devel] [RFC v2 proxmox-backup 07/21] sync: ignore trashed groups in local source reader Christian Ebner
2025-05-09 12:27 ` Fabian Grünbichler
2025-05-08 13:05 ` [pbs-devel] [RFC v2 proxmox-backup 08/21] datastore: namespace: add filter for trash status Christian Ebner
2025-05-08 13:05 ` [pbs-devel] [RFC v2 proxmox-backup 09/21] datastore: refactor recursive namespace removal Christian Ebner
2025-05-08 13:05 ` [pbs-devel] [RFC v2 proxmox-backup 10/21] datastore: mark namespace as trash instead of deleting it Christian Ebner
2025-05-09 12:27 ` Fabian Grünbichler
2025-05-12 7:47 ` Christian Ebner
2025-05-12 9:46 ` Fabian Grünbichler
2025-05-12 10:35 ` Christian Ebner
2025-05-08 13:05 ` [pbs-devel] [RFC v2 proxmox-backup 11/21] datastore: check for trash marker in namespace exists check Christian Ebner
2025-05-08 13:05 ` [pbs-devel] [RFC v2 proxmox-backup 12/21] datastore: clear trashed snapshot dir if re-creation requested Christian Ebner
2025-05-09 12:27 ` Fabian Grünbichler
2025-05-12 8:31 ` Christian Ebner
2025-05-08 13:05 ` [pbs-devel] [RFC v2 proxmox-backup 13/21] datastore: recreate trashed backup groups if requested Christian Ebner
2025-05-09 12:27 ` Fabian Grünbichler
2025-05-12 8:05 ` Christian Ebner
2025-05-12 10:02 ` Fabian Grünbichler
2025-05-08 13:05 ` [pbs-devel] [RFC v2 proxmox-backup 14/21] datastore: GC: clean-up trashed snapshots, groups and namespaces Christian Ebner
2025-05-09 12:27 ` Fabian Grünbichler
2025-05-08 13:05 ` [pbs-devel] [RFC v2 proxmox-backup 15/21] client: expose skip trash flags for cli commands Christian Ebner
2025-05-08 13:05 ` [pbs-devel] [RFC v2 proxmox-backup 16/21] api: datastore: add flag to list trashed snapshots only Christian Ebner
2025-05-09 12:27 ` Fabian Grünbichler
2025-05-12 7:57 ` Christian Ebner
2025-05-12 10:01 ` Fabian Grünbichler
2025-05-08 13:05 ` [pbs-devel] [RFC v2 proxmox-backup 17/21] api: namespace: add option to list all namespaces, including trashed Christian Ebner
2025-05-08 13:05 ` [pbs-devel] [RFC v2 proxmox-backup 18/21] api: admin: implement endpoints to restore trashed contents Christian Ebner
2025-05-09 12:27 ` Fabian Grünbichler
2025-05-09 12:59 ` Christian Ebner
2025-05-12 10:03 ` Fabian Grünbichler
2025-05-08 13:05 ` [pbs-devel] [RFC v2 proxmox-backup 19/21] ui: add recover for trashed items tab to datastore panel Christian Ebner
2025-05-08 13:05 ` [pbs-devel] [RFC v2 proxmox-backup 20/21] ui: drop 'permanent' in group/snapshot forget, default is to trash Christian Ebner
2025-05-08 13:05 ` [pbs-devel] [RFC v2 proxmox-backup 21/21] ui: allow to skip trash on namespace deletion Christian Ebner
2025-05-13 13:54 ` [pbs-devel] superseded: [RFC v2 proxmox-backup 00/21] implement trash bin functionality Christian Ebner
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20250508130555.494782-1-c.ebner@proxmox.com \
--to=c.ebner@proxmox.com \
--cc=pbs-devel@lists.proxmox.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.
Service provided by Proxmox Server Solutions GmbH | Privacy | Legal