[pbs-devel] [PATCH proxmox{, -backup} v2 0/2] GC: log progress output for phase 2 S3 datastores

[Christian Ebner <c.ebner@proxmox.com>]

This patch series adds accounting for basic request statistics to
the S3 client, and uses it to provide request count and average
request time for phase 2 of garbage collection on S3 stores.

Logging for phase 2 is implemented using a rate limited logger
implementation, to control the number of output lines and avoid
log spamming, given that the total number of objects cannot be
determined a-priori.

Output the number of processed chunks as well as to be removed
object count and size, including the number of objects still pending
a delete API call as stored in the delete list.

Changes since v1 (thanks @Fabian for feedback):
- Switch from dedicated thread output for logging to the rate limited
  logging implementation.
- Extend logging output to include delete object accounting and
  request statistics.

proxmox:

Christian Ebner (1):
  s3-client: add request statistics gathering capabilities

 proxmox-s3-client/src/client.rs | 52 ++++++++++++++++++++++++++++++++-
 1 file changed, 51 insertions(+), 1 deletion(-)


proxmox-backup:

Christian Ebner (1):
  GC: log progress output for phase 2 on datastores backed by s3

 pbs-datastore/src/datastore.rs | 98 +++++++++++++++++++++++++++++++++-
 1 file changed, 96 insertions(+), 2 deletions(-)


Summary over all repositories:
  2 files changed, 147 insertions(+), 3 deletions(-)

-- 
Generated by git-murpp 0.8.1


_______________________________________________
pbs-devel mailing list
pbs-devel@lists.proxmox.com
https://lists.proxmox.com/cgi-bin/mailman/listinfo/pbs-devel