From: Dominik Csapak <d.csapak@proxmox.com>
To: pbs-devel@lists.proxmox.com
Subject: [pbs-devel] [PATCH proxmox-backup v2 0/9] improve task list handling
Date: Mon, 28 Sep 2020 15:32:03 +0200 [thread overview]
Message-ID: <20200928133212.409-1-d.csapak@proxmox.com> (raw)
this series extends the task handling in a way so that we can safely
have more than 1000 tasks and properly filter and read them
this also introduces a daily task to rotate the now existing
task archive when it is over 500k up to maximum 20 files
strictly speaking the widget-toolkit patch is not necessary, but makes
the user interface a bit better to use
changes from v1:
* rebases on master
* move the logrotate to proxmox-backup
* use zstd in logrotate instead of gzip
* TaskListInfoIterator now has an option to only return the 'active' tasks
(this is a performance optimization)
NOTE: i did not resend the widget-toolkit patch, but i would still
recommend that it gets applied
Dominik Csapak (9):
tools: add logrotate module
server/worker_task: refactor locking of the task list
server/worker_task: split task list file into two
server/worker_task: write older tasks into archive file
server/worker_task: add TaskListInfoIterator
api2/node/tasks: use TaskListInfoIterator instead of read_task_list
api2/status: use the TaskListInfoIterator here
server/worker_task: remove unecessary read_task_list
proxmox-backup-proxy: add task archive rotation
src/api2/node/tasks.rs | 52 +++---
src/api2/status.rs | 32 +++-
src/bin/proxmox-backup-proxy.rs | 96 ++++++++++
src/server/worker_task.rs | 300 ++++++++++++++++++++++++--------
src/tools.rs | 1 +
src/tools/logrotate.rs | 184 ++++++++++++++++++++
6 files changed, 553 insertions(+), 112 deletions(-)
create mode 100644 src/tools/logrotate.rs
--
2.20.1
next reply other threads:[~2020-09-28 13:32 UTC|newest]
Thread overview: 11+ messages / expand[flat|nested] mbox.gz Atom feed top
2020-09-28 13:32 Dominik Csapak [this message]
2020-09-28 13:32 ` [pbs-devel] [PATCH proxmox-backup v2 1/9] tools: add logrotate module Dominik Csapak
2020-09-28 13:32 ` [pbs-devel] [PATCH proxmox-backup v2 2/9] server/worker_task: refactor locking of the task list Dominik Csapak
2020-09-28 13:32 ` [pbs-devel] [PATCH proxmox-backup v2 3/9] server/worker_task: split task list file into two Dominik Csapak
2020-09-28 13:32 ` [pbs-devel] [PATCH proxmox-backup v2 4/9] server/worker_task: write older tasks into archive file Dominik Csapak
2020-09-28 13:32 ` [pbs-devel] [PATCH proxmox-backup v2 5/9] server/worker_task: add TaskListInfoIterator Dominik Csapak
2020-09-28 13:32 ` [pbs-devel] [PATCH proxmox-backup v2 6/9] api2/node/tasks: use TaskListInfoIterator instead of read_task_list Dominik Csapak
2020-09-28 13:32 ` [pbs-devel] [PATCH proxmox-backup v2 7/9] api2/status: use the TaskListInfoIterator here Dominik Csapak
2020-09-28 13:32 ` [pbs-devel] [PATCH proxmox-backup v2 8/9] server/worker_task: remove unecessary read_task_list Dominik Csapak
2020-09-28 13:32 ` [pbs-devel] [PATCH proxmox-backup v2 9/9] proxmox-backup-proxy: add task archive rotation Dominik Csapak
2020-09-29 7:16 ` [pbs-devel] applied: [PATCH proxmox-backup v2 0/9] improve task list handling Dietmar Maurer
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20200928133212.409-1-d.csapak@proxmox.com \
--to=d.csapak@proxmox.com \
--cc=pbs-devel@lists.proxmox.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.
Service provided by Proxmox Server Solutions GmbH | Privacy | Legal