* [pbs-devel] [PATCH proxmox-backup 1/4] add missing proxmox-sys features for client/file-restore
@ 2022-08-26 8:09 Dominik Csapak
2022-08-26 8:09 ` [pbs-devel] [PATCH proxmox-backup 2/4] docs: terminology: update snapshot uniqueness for namespaces Dominik Csapak
` (3 more replies)
0 siblings, 4 replies; 5+ messages in thread
From: Dominik Csapak @ 2022-08-26 8:09 UTC (permalink / raw)
To: pbs-devel
noticed while building proxmox-backup-client and proxmox-file-restore
manually
Signed-off-by: Dominik Csapak <d.csapak@proxmox.com>
---
pbs-config/Cargo.toml | 2 +-
proxmox-file-restore/Cargo.toml | 2 +-
2 files changed, 2 insertions(+), 2 deletions(-)
diff --git a/pbs-config/Cargo.toml b/pbs-config/Cargo.toml
index d1cde91f..1cea630c 100644
--- a/pbs-config/Cargo.toml
+++ b/pbs-config/Cargo.toml
@@ -24,7 +24,7 @@ proxmox-section-config = "1"
proxmox-time = "1"
proxmox-serde = "0.1"
proxmox-shared-memory = "0.2"
-proxmox-sys = { version = "0.4", features = [ "acl", "crypt" ] }
+proxmox-sys = { version = "0.4", features = [ "acl", "crypt", "timer" ] }
proxmox-metrics = "0.2"
pbs-api-types = { path = "../pbs-api-types" }
diff --git a/proxmox-file-restore/Cargo.toml b/proxmox-file-restore/Cargo.toml
index 6ea66b0a..c3d8a6e4 100644
--- a/proxmox-file-restore/Cargo.toml
+++ b/proxmox-file-restore/Cargo.toml
@@ -24,7 +24,7 @@ proxmox-router = { version = "1.2.4", features = [ "cli" ] }
proxmox-schema = { version = "1.3.1", features = [ "api-macro" ] }
proxmox-time = "1"
proxmox-uuid = "1"
-proxmox-sys = "0.4"
+proxmox-sys = { version = "0.4", features = [ "logrotate" ] }
pbs-api-types = { path = "../pbs-api-types" }
pbs-buildcfg = { path = "../pbs-buildcfg" }
--
2.30.2
^ permalink raw reply [flat|nested] 5+ messages in thread
* [pbs-devel] [PATCH proxmox-backup 2/4] docs: terminology: update snapshot uniqueness for namespaces
2022-08-26 8:09 [pbs-devel] [PATCH proxmox-backup 1/4] add missing proxmox-sys features for client/file-restore Dominik Csapak
@ 2022-08-26 8:09 ` Dominik Csapak
2022-08-26 8:09 ` [pbs-devel] [PATCH proxmox-backup 3/4] docs: technical overview: add section about snapshots Dominik Csapak
` (2 subsequent siblings)
3 siblings, 0 replies; 5+ messages in thread
From: Dominik Csapak @ 2022-08-26 8:09 UTC (permalink / raw)
To: pbs-devel
since we introduced namespaces, a snapshot does not have be unique
across the datastore anymore, only a namespace.
Signed-off-by: Dominik Csapak <d.csapak@proxmox.com>
---
docs/terminology.rst | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/docs/terminology.rst b/docs/terminology.rst
index 1f2cb8f8..131bd28c 100644
--- a/docs/terminology.rst
+++ b/docs/terminology.rst
@@ -118,7 +118,7 @@ Backup Snapshot
---------------
The triplet ``<type>/<ID>/<time>`` is called a backup snapshot. It
-uniquely identifies a specific backup within a datastore.
+uniquely identifies a specific backup within a namespace.
.. code-block:: console
:caption: Backup Snapshot Examples
--
2.30.2
^ permalink raw reply [flat|nested] 5+ messages in thread
* [pbs-devel] [PATCH proxmox-backup 3/4] docs: technical overview: add section about snapshots
2022-08-26 8:09 [pbs-devel] [PATCH proxmox-backup 1/4] add missing proxmox-sys features for client/file-restore Dominik Csapak
2022-08-26 8:09 ` [pbs-devel] [PATCH proxmox-backup 2/4] docs: terminology: update snapshot uniqueness for namespaces Dominik Csapak
@ 2022-08-26 8:09 ` Dominik Csapak
2022-08-26 8:09 ` [pbs-devel] [PATCH proxmox-backup 4/4] docs: faq: add better clarification on full/incremental Dominik Csapak
2022-09-12 8:50 ` [pbs-devel] applied-series: [PATCH proxmox-backup 1/4] add missing proxmox-sys features for client/file-restore Fabian Grünbichler
3 siblings, 0 replies; 5+ messages in thread
From: Dominik Csapak @ 2022-08-26 8:09 UTC (permalink / raw)
To: pbs-devel
to clarify that snapshots get uploaded in an incremental manner, but
still represent a full backup.
Signed-off-by: Dominik Csapak <d.csapak@proxmox.com>
---
docs/technical-overview.rst | 21 +++++++++++++++++++++
1 file changed, 21 insertions(+)
diff --git a/docs/technical-overview.rst b/docs/technical-overview.rst
index 59a59c11..f3e25b59 100644
--- a/docs/technical-overview.rst
+++ b/docs/technical-overview.rst
@@ -18,6 +18,27 @@ referenced by the indexes in a backup snapshot. This means that multiple
indexes can reference the same chunks, reducing the amount of space needed to
contain the data (even across backup snapshots).
+Snapshots
+---------
+
+A Snapshot is the collection of manifest, blobs and indexes that represent
+a backup. When a client creates a snapshot, it can upload blobs (single files
+which are not chunked, e.g. the client log), or one or more indexes
+(fixed or dynamic).
+
+When uploading an index, the client first has to read the source data, chunk it
+and send the data as chunks with their identifying checksum to the server.
+
+If there is a previous Snapshot in the backup group, the client can first
+download the chunk list of the previous Snapshot. If it detects a chunk that
+already exists on the server, it can send only the checksum instead of data
+and checksum. This way the actual upload of Snapshots is incremental while
+each Snapshot references all chunks and is thus a full backup.
+
+After uploading all data, the client has to signal to the server that the
+backup is finished. If that is not done before the connection closes, the
+server will remove the unfinished snapshot.
+
Chunks
------
--
2.30.2
^ permalink raw reply [flat|nested] 5+ messages in thread
* [pbs-devel] [PATCH proxmox-backup 4/4] docs: faq: add better clarification on full/incremental
2022-08-26 8:09 [pbs-devel] [PATCH proxmox-backup 1/4] add missing proxmox-sys features for client/file-restore Dominik Csapak
2022-08-26 8:09 ` [pbs-devel] [PATCH proxmox-backup 2/4] docs: terminology: update snapshot uniqueness for namespaces Dominik Csapak
2022-08-26 8:09 ` [pbs-devel] [PATCH proxmox-backup 3/4] docs: technical overview: add section about snapshots Dominik Csapak
@ 2022-08-26 8:09 ` Dominik Csapak
2022-09-12 8:50 ` [pbs-devel] applied-series: [PATCH proxmox-backup 1/4] add missing proxmox-sys features for client/file-restore Fabian Grünbichler
3 siblings, 0 replies; 5+ messages in thread
From: Dominik Csapak @ 2022-08-26 8:09 UTC (permalink / raw)
To: pbs-devel
and add a link to the technical overview
Signed-off-by: Dominik Csapak <d.csapak@proxmox.com>
---
docs/faq.rst | 6 ++++--
1 file changed, 4 insertions(+), 2 deletions(-)
diff --git a/docs/faq.rst b/docs/faq.rst
index 874b081a..4ff68178 100644
--- a/docs/faq.rst
+++ b/docs/faq.rst
@@ -66,9 +66,11 @@ be able to read the data.
:ref:`backup client encryption section <client_encryption>`.
-Is the backup incremental/deduplicated?
+Is the backup incremental/deduplicated/full?
---------------------------------------
With Proxmox Backup Server, backups are sent incrementally to the server, and
data is then deduplicated on the server. This minimizes both the storage
-consumed and the impact on the network.
+consumed and the impact on the network. Each backup still references all
+data and such is a full backup. For details see the
+:ref:`Technical Overview <tech_design_overview>`
--
2.30.2
^ permalink raw reply [flat|nested] 5+ messages in thread
* [pbs-devel] applied-series: [PATCH proxmox-backup 1/4] add missing proxmox-sys features for client/file-restore
2022-08-26 8:09 [pbs-devel] [PATCH proxmox-backup 1/4] add missing proxmox-sys features for client/file-restore Dominik Csapak
` (2 preceding siblings ...)
2022-08-26 8:09 ` [pbs-devel] [PATCH proxmox-backup 4/4] docs: faq: add better clarification on full/incremental Dominik Csapak
@ 2022-09-12 8:50 ` Fabian Grünbichler
3 siblings, 0 replies; 5+ messages in thread
From: Fabian Grünbichler @ 2022-09-12 8:50 UTC (permalink / raw)
To: Proxmox Backup Server development discussion
except the first one, since that was already fixed in the meantime ;)
small follow-up to fixup the FAQ heading underline.
On August 26, 2022 10:09 am, Dominik Csapak wrote:
> noticed while building proxmox-backup-client and proxmox-file-restore
> manually
>
> Signed-off-by: Dominik Csapak <d.csapak@proxmox.com>
> ---
> pbs-config/Cargo.toml | 2 +-
> proxmox-file-restore/Cargo.toml | 2 +-
> 2 files changed, 2 insertions(+), 2 deletions(-)
>
> diff --git a/pbs-config/Cargo.toml b/pbs-config/Cargo.toml
> index d1cde91f..1cea630c 100644
> --- a/pbs-config/Cargo.toml
> +++ b/pbs-config/Cargo.toml
> @@ -24,7 +24,7 @@ proxmox-section-config = "1"
> proxmox-time = "1"
> proxmox-serde = "0.1"
> proxmox-shared-memory = "0.2"
> -proxmox-sys = { version = "0.4", features = [ "acl", "crypt" ] }
> +proxmox-sys = { version = "0.4", features = [ "acl", "crypt", "timer" ] }
> proxmox-metrics = "0.2"
>
> pbs-api-types = { path = "../pbs-api-types" }
> diff --git a/proxmox-file-restore/Cargo.toml b/proxmox-file-restore/Cargo.toml
> index 6ea66b0a..c3d8a6e4 100644
> --- a/proxmox-file-restore/Cargo.toml
> +++ b/proxmox-file-restore/Cargo.toml
> @@ -24,7 +24,7 @@ proxmox-router = { version = "1.2.4", features = [ "cli" ] }
> proxmox-schema = { version = "1.3.1", features = [ "api-macro" ] }
> proxmox-time = "1"
> proxmox-uuid = "1"
> -proxmox-sys = "0.4"
> +proxmox-sys = { version = "0.4", features = [ "logrotate" ] }
>
> pbs-api-types = { path = "../pbs-api-types" }
> pbs-buildcfg = { path = "../pbs-buildcfg" }
> --
> 2.30.2
>
>
>
> _______________________________________________
> pbs-devel mailing list
> pbs-devel@lists.proxmox.com
> https://lists.proxmox.com/cgi-bin/mailman/listinfo/pbs-devel
>
>
>
^ permalink raw reply [flat|nested] 5+ messages in thread
end of thread, other threads:[~2022-09-12 8:51 UTC | newest]
Thread overview: 5+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2022-08-26 8:09 [pbs-devel] [PATCH proxmox-backup 1/4] add missing proxmox-sys features for client/file-restore Dominik Csapak
2022-08-26 8:09 ` [pbs-devel] [PATCH proxmox-backup 2/4] docs: terminology: update snapshot uniqueness for namespaces Dominik Csapak
2022-08-26 8:09 ` [pbs-devel] [PATCH proxmox-backup 3/4] docs: technical overview: add section about snapshots Dominik Csapak
2022-08-26 8:09 ` [pbs-devel] [PATCH proxmox-backup 4/4] docs: faq: add better clarification on full/incremental Dominik Csapak
2022-09-12 8:50 ` [pbs-devel] applied-series: [PATCH proxmox-backup 1/4] add missing proxmox-sys features for client/file-restore Fabian Grünbichler
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.
Service provided by Proxmox Server Solutions GmbH | Privacy | Legal