From: Dominik Csapak <d.csapak@proxmox.com>
To: pbs-devel@lists.proxmox.com
Subject: [pbs-devel] [PATCH proxmox-backup v2 0/9] improve task list handling
Date: Mon, 28 Sep 2020 15:32:03 +0200 [thread overview]
Message-ID: <20200928133212.409-1-d.csapak@proxmox.com> (raw)
this series extends the task handling in a way so that we can safely
have more than 1000 tasks and properly filter and read them
this also introduces a daily task to rotate the now existing
task archive when it is over 500k up to maximum 20 files
strictly speaking the widget-toolkit patch is not necessary, but makes
the user interface a bit better to use
changes from v1:
* rebases on master
* move the logrotate to proxmox-backup
* use zstd in logrotate instead of gzip
* TaskListInfoIterator now has an option to only return the 'active' tasks
(this is a performance optimization)
NOTE: i did not resend the widget-toolkit patch, but i would still
recommend that it gets applied
Dominik Csapak (9):
tools: add logrotate module
server/worker_task: refactor locking of the task list
server/worker_task: split task list file into two
server/worker_task: write older tasks into archive file
server/worker_task: add TaskListInfoIterator
api2/node/tasks: use TaskListInfoIterator instead of read_task_list
api2/status: use the TaskListInfoIterator here
server/worker_task: remove unecessary read_task_list
proxmox-backup-proxy: add task archive rotation
src/api2/node/tasks.rs | 52 +++---
src/api2/status.rs | 32 +++-
src/bin/proxmox-backup-proxy.rs | 96 ++++++++++
src/server/worker_task.rs | 300 ++++++++++++++++++++++++--------
src/tools.rs | 1 +
src/tools/logrotate.rs | 184 ++++++++++++++++++++
6 files changed, 553 insertions(+), 112 deletions(-)
create mode 100644 src/tools/logrotate.rs
--
2.20.1
next reply other threads:[~2020-09-28 13:32 UTC|newest]
Thread overview: 11+ messages / expand[flat|nested] mbox.gz Atom feed top
2020-09-28 13:32 Dominik Csapak [this message]
2020-09-28 13:32 ` [pbs-devel] [PATCH proxmox-backup v2 1/9] tools: add logrotate module Dominik Csapak
2020-09-28 13:32 ` [pbs-devel] [PATCH proxmox-backup v2 2/9] server/worker_task: refactor locking of the task list Dominik Csapak
2020-09-28 13:32 ` [pbs-devel] [PATCH proxmox-backup v2 3/9] server/worker_task: split task list file into two Dominik Csapak
2020-09-28 13:32 ` [pbs-devel] [PATCH proxmox-backup v2 4/9] server/worker_task: write older tasks into archive file Dominik Csapak
2020-09-28 13:32 ` [pbs-devel] [PATCH proxmox-backup v2 5/9] server/worker_task: add TaskListInfoIterator Dominik Csapak
2020-09-28 13:32 ` [pbs-devel] [PATCH proxmox-backup v2 6/9] api2/node/tasks: use TaskListInfoIterator instead of read_task_list Dominik Csapak
2020-09-28 13:32 ` [pbs-devel] [PATCH proxmox-backup v2 7/9] api2/status: use the TaskListInfoIterator here Dominik Csapak
2020-09-28 13:32 ` [pbs-devel] [PATCH proxmox-backup v2 8/9] server/worker_task: remove unecessary read_task_list Dominik Csapak
2020-09-28 13:32 ` [pbs-devel] [PATCH proxmox-backup v2 9/9] proxmox-backup-proxy: add task archive rotation Dominik Csapak
2020-09-29 7:16 ` [pbs-devel] applied: [PATCH proxmox-backup v2 0/9] improve task list handling Dietmar Maurer
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20200928133212.409-1-d.csapak@proxmox.com \
--to=d.csapak@proxmox.com \
--cc=pbs-devel@lists.proxmox.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox