public inbox for pbs-devel@lists.proxmox.com
 help / color / mirror / Atom feed
* [pbs-devel] [PATCH proxmox-backup 1/4] add missing proxmox-sys features for client/file-restore
@ 2022-08-26  8:09 Dominik Csapak
  2022-08-26  8:09 ` [pbs-devel] [PATCH proxmox-backup 2/4] docs: terminology: update snapshot uniqueness for namespaces Dominik Csapak
                   ` (3 more replies)
  0 siblings, 4 replies; 5+ messages in thread
From: Dominik Csapak @ 2022-08-26  8:09 UTC (permalink / raw)
  To: pbs-devel

noticed while building proxmox-backup-client and proxmox-file-restore
manually

Signed-off-by: Dominik Csapak <d.csapak@proxmox.com>
---
 pbs-config/Cargo.toml           | 2 +-
 proxmox-file-restore/Cargo.toml | 2 +-
 2 files changed, 2 insertions(+), 2 deletions(-)

diff --git a/pbs-config/Cargo.toml b/pbs-config/Cargo.toml
index d1cde91f..1cea630c 100644
--- a/pbs-config/Cargo.toml
+++ b/pbs-config/Cargo.toml
@@ -24,7 +24,7 @@ proxmox-section-config = "1"
 proxmox-time = "1"
 proxmox-serde = "0.1"
 proxmox-shared-memory = "0.2"
-proxmox-sys = { version = "0.4", features = [ "acl", "crypt" ] }
+proxmox-sys = { version = "0.4", features = [ "acl", "crypt", "timer" ] }
 proxmox-metrics = "0.2"
 
 pbs-api-types = { path = "../pbs-api-types" }
diff --git a/proxmox-file-restore/Cargo.toml b/proxmox-file-restore/Cargo.toml
index 6ea66b0a..c3d8a6e4 100644
--- a/proxmox-file-restore/Cargo.toml
+++ b/proxmox-file-restore/Cargo.toml
@@ -24,7 +24,7 @@ proxmox-router = { version = "1.2.4", features = [ "cli" ] }
 proxmox-schema = { version = "1.3.1", features = [ "api-macro" ] }
 proxmox-time = "1"
 proxmox-uuid = "1"
-proxmox-sys = "0.4"
+proxmox-sys = { version = "0.4", features = [ "logrotate" ] }
 
 pbs-api-types = { path = "../pbs-api-types" }
 pbs-buildcfg = { path = "../pbs-buildcfg" }
-- 
2.30.2





^ permalink raw reply	[flat|nested] 5+ messages in thread

* [pbs-devel] [PATCH proxmox-backup 2/4] docs: terminology: update snapshot uniqueness for namespaces
  2022-08-26  8:09 [pbs-devel] [PATCH proxmox-backup 1/4] add missing proxmox-sys features for client/file-restore Dominik Csapak
@ 2022-08-26  8:09 ` Dominik Csapak
  2022-08-26  8:09 ` [pbs-devel] [PATCH proxmox-backup 3/4] docs: technical overview: add section about snapshots Dominik Csapak
                   ` (2 subsequent siblings)
  3 siblings, 0 replies; 5+ messages in thread
From: Dominik Csapak @ 2022-08-26  8:09 UTC (permalink / raw)
  To: pbs-devel

since we introduced namespaces, a snapshot does not have be unique
across the datastore anymore, only a namespace.

Signed-off-by: Dominik Csapak <d.csapak@proxmox.com>
---
 docs/terminology.rst | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/docs/terminology.rst b/docs/terminology.rst
index 1f2cb8f8..131bd28c 100644
--- a/docs/terminology.rst
+++ b/docs/terminology.rst
@@ -118,7 +118,7 @@ Backup Snapshot
 ---------------
 
 The triplet ``<type>/<ID>/<time>`` is called a backup snapshot. It
-uniquely identifies a specific backup within a datastore.
+uniquely identifies a specific backup within a namespace.
 
 .. code-block:: console
    :caption: Backup Snapshot Examples
-- 
2.30.2





^ permalink raw reply	[flat|nested] 5+ messages in thread

* [pbs-devel] [PATCH proxmox-backup 3/4] docs: technical overview: add section about snapshots
  2022-08-26  8:09 [pbs-devel] [PATCH proxmox-backup 1/4] add missing proxmox-sys features for client/file-restore Dominik Csapak
  2022-08-26  8:09 ` [pbs-devel] [PATCH proxmox-backup 2/4] docs: terminology: update snapshot uniqueness for namespaces Dominik Csapak
@ 2022-08-26  8:09 ` Dominik Csapak
  2022-08-26  8:09 ` [pbs-devel] [PATCH proxmox-backup 4/4] docs: faq: add better clarification on full/incremental Dominik Csapak
  2022-09-12  8:50 ` [pbs-devel] applied-series: [PATCH proxmox-backup 1/4] add missing proxmox-sys features for client/file-restore Fabian Grünbichler
  3 siblings, 0 replies; 5+ messages in thread
From: Dominik Csapak @ 2022-08-26  8:09 UTC (permalink / raw)
  To: pbs-devel

to clarify that snapshots get uploaded in an incremental manner, but
still represent a full backup.

Signed-off-by: Dominik Csapak <d.csapak@proxmox.com>
---
 docs/technical-overview.rst | 21 +++++++++++++++++++++
 1 file changed, 21 insertions(+)

diff --git a/docs/technical-overview.rst b/docs/technical-overview.rst
index 59a59c11..f3e25b59 100644
--- a/docs/technical-overview.rst
+++ b/docs/technical-overview.rst
@@ -18,6 +18,27 @@ referenced by the indexes in a backup snapshot. This means that multiple
 indexes can reference the same chunks, reducing the amount of space needed to
 contain the data (even across backup snapshots).
 
+Snapshots
+---------
+
+A Snapshot is the collection of manifest, blobs and indexes that represent
+a backup. When a client creates a snapshot, it can upload blobs (single files
+which are not chunked, e.g. the client log), or one or more indexes
+(fixed or dynamic).
+
+When uploading an index, the client first has to read the source data, chunk it
+and send the data as chunks with their identifying checksum to the server.
+
+If there is a previous Snapshot in the backup group, the client can first
+download the chunk list of the previous Snapshot. If it detects a chunk that
+already exists on the server, it can send only the checksum instead of data
+and checksum. This way the actual upload of Snapshots is incremental while
+each Snapshot references all chunks and is thus a full backup.
+
+After uploading all data, the client has to signal to the server that the
+backup is finished. If that is not done before the connection closes, the
+server will remove the unfinished snapshot.
+
 Chunks
 ------
 
-- 
2.30.2





^ permalink raw reply	[flat|nested] 5+ messages in thread

* [pbs-devel] [PATCH proxmox-backup 4/4] docs: faq: add better clarification on full/incremental
  2022-08-26  8:09 [pbs-devel] [PATCH proxmox-backup 1/4] add missing proxmox-sys features for client/file-restore Dominik Csapak
  2022-08-26  8:09 ` [pbs-devel] [PATCH proxmox-backup 2/4] docs: terminology: update snapshot uniqueness for namespaces Dominik Csapak
  2022-08-26  8:09 ` [pbs-devel] [PATCH proxmox-backup 3/4] docs: technical overview: add section about snapshots Dominik Csapak
@ 2022-08-26  8:09 ` Dominik Csapak
  2022-09-12  8:50 ` [pbs-devel] applied-series: [PATCH proxmox-backup 1/4] add missing proxmox-sys features for client/file-restore Fabian Grünbichler
  3 siblings, 0 replies; 5+ messages in thread
From: Dominik Csapak @ 2022-08-26  8:09 UTC (permalink / raw)
  To: pbs-devel

and add a link to the technical overview

Signed-off-by: Dominik Csapak <d.csapak@proxmox.com>
---
 docs/faq.rst | 6 ++++--
 1 file changed, 4 insertions(+), 2 deletions(-)

diff --git a/docs/faq.rst b/docs/faq.rst
index 874b081a..4ff68178 100644
--- a/docs/faq.rst
+++ b/docs/faq.rst
@@ -66,9 +66,11 @@ be able to read the data.
   :ref:`backup client encryption section <client_encryption>`.
 
 
-Is the backup incremental/deduplicated?
+Is the backup incremental/deduplicated/full?
 ---------------------------------------
 
 With Proxmox Backup Server, backups are sent incrementally to the server, and
 data is then deduplicated on the server. This minimizes both the storage
-consumed and the impact on the network.
+consumed and the impact on the network. Each backup still references all
+data and such is a full backup. For details see the
+:ref:`Technical Overview <tech_design_overview>`
-- 
2.30.2





^ permalink raw reply	[flat|nested] 5+ messages in thread

* [pbs-devel] applied-series: [PATCH proxmox-backup 1/4] add missing proxmox-sys features for client/file-restore
  2022-08-26  8:09 [pbs-devel] [PATCH proxmox-backup 1/4] add missing proxmox-sys features for client/file-restore Dominik Csapak
                   ` (2 preceding siblings ...)
  2022-08-26  8:09 ` [pbs-devel] [PATCH proxmox-backup 4/4] docs: faq: add better clarification on full/incremental Dominik Csapak
@ 2022-09-12  8:50 ` Fabian Grünbichler
  3 siblings, 0 replies; 5+ messages in thread
From: Fabian Grünbichler @ 2022-09-12  8:50 UTC (permalink / raw)
  To: Proxmox Backup Server development discussion

except the first one, since that was already fixed in the meantime ;)

small follow-up to fixup the FAQ heading underline.

On August 26, 2022 10:09 am, Dominik Csapak wrote:
> noticed while building proxmox-backup-client and proxmox-file-restore
> manually
> 
> Signed-off-by: Dominik Csapak <d.csapak@proxmox.com>
> ---
>  pbs-config/Cargo.toml           | 2 +-
>  proxmox-file-restore/Cargo.toml | 2 +-
>  2 files changed, 2 insertions(+), 2 deletions(-)
> 
> diff --git a/pbs-config/Cargo.toml b/pbs-config/Cargo.toml
> index d1cde91f..1cea630c 100644
> --- a/pbs-config/Cargo.toml
> +++ b/pbs-config/Cargo.toml
> @@ -24,7 +24,7 @@ proxmox-section-config = "1"
>  proxmox-time = "1"
>  proxmox-serde = "0.1"
>  proxmox-shared-memory = "0.2"
> -proxmox-sys = { version = "0.4", features = [ "acl", "crypt" ] }
> +proxmox-sys = { version = "0.4", features = [ "acl", "crypt", "timer" ] }
>  proxmox-metrics = "0.2"
>  
>  pbs-api-types = { path = "../pbs-api-types" }
> diff --git a/proxmox-file-restore/Cargo.toml b/proxmox-file-restore/Cargo.toml
> index 6ea66b0a..c3d8a6e4 100644
> --- a/proxmox-file-restore/Cargo.toml
> +++ b/proxmox-file-restore/Cargo.toml
> @@ -24,7 +24,7 @@ proxmox-router = { version = "1.2.4", features = [ "cli" ] }
>  proxmox-schema = { version = "1.3.1", features = [ "api-macro" ] }
>  proxmox-time = "1"
>  proxmox-uuid = "1"
> -proxmox-sys = "0.4"
> +proxmox-sys = { version = "0.4", features = [ "logrotate" ] }
>  
>  pbs-api-types = { path = "../pbs-api-types" }
>  pbs-buildcfg = { path = "../pbs-buildcfg" }
> -- 
> 2.30.2
> 
> 
> 
> _______________________________________________
> pbs-devel mailing list
> pbs-devel@lists.proxmox.com
> https://lists.proxmox.com/cgi-bin/mailman/listinfo/pbs-devel
> 
> 
> 




^ permalink raw reply	[flat|nested] 5+ messages in thread

end of thread, other threads:[~2022-09-12  8:51 UTC | newest]

Thread overview: 5+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2022-08-26  8:09 [pbs-devel] [PATCH proxmox-backup 1/4] add missing proxmox-sys features for client/file-restore Dominik Csapak
2022-08-26  8:09 ` [pbs-devel] [PATCH proxmox-backup 2/4] docs: terminology: update snapshot uniqueness for namespaces Dominik Csapak
2022-08-26  8:09 ` [pbs-devel] [PATCH proxmox-backup 3/4] docs: technical overview: add section about snapshots Dominik Csapak
2022-08-26  8:09 ` [pbs-devel] [PATCH proxmox-backup 4/4] docs: faq: add better clarification on full/incremental Dominik Csapak
2022-09-12  8:50 ` [pbs-devel] applied-series: [PATCH proxmox-backup 1/4] add missing proxmox-sys features for client/file-restore Fabian Grünbichler

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox
Service provided by Proxmox Server Solutions GmbH | Privacy | Legal