From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: <dcsapak@zita.proxmox.com> Received: from firstgate.proxmox.com (firstgate.proxmox.com [212.224.123.68]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits)) (No client certificate requested) by lists.proxmox.com (Postfix) with ESMTPS id F292860E44 for <pbs-devel@lists.proxmox.com>; Fri, 25 Sep 2020 16:13:30 +0200 (CEST) Received: from firstgate.proxmox.com (localhost [127.0.0.1]) by firstgate.proxmox.com (Proxmox) with ESMTP id E29251C19E for <pbs-devel@lists.proxmox.com>; Fri, 25 Sep 2020 16:13:30 +0200 (CEST) Received: from proxmox-new.maurer-it.com (proxmox-new.maurer-it.com [212.186.127.180]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits)) (No client certificate requested) by firstgate.proxmox.com (Proxmox) with ESMTPS id 3AA611C171 for <pbs-devel@lists.proxmox.com>; Fri, 25 Sep 2020 16:13:29 +0200 (CEST) Received: from proxmox-new.maurer-it.com (localhost.localdomain [127.0.0.1]) by proxmox-new.maurer-it.com (Proxmox) with ESMTP id 001F3456E6 for <pbs-devel@lists.proxmox.com>; Fri, 25 Sep 2020 16:13:29 +0200 (CEST) From: Dominik Csapak <d.csapak@proxmox.com> To: pbs-devel@lists.proxmox.com Date: Fri, 25 Sep 2020 16:13:13 +0200 Message-Id: <20200925141327.25024-1-d.csapak@proxmox.com> X-Mailer: git-send-email 2.20.1 MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-SPAM-LEVEL: Spam detection results: 0 AWL -0.177 Adjusted score from AWL reputation of From: address KAM_DMARC_STATUS 0.01 Test Rule for DKIM or SPF Failure with Strict Alignment KAM_LAZY_DOMAIN_SECURITY 1 Sending domain does not have any anti-forgery methods NO_DNS_FOR_FROM 0.379 Envelope sender has no MX or A DNS records RCVD_IN_DNSWL_MED -2.3 Sender listed at https://www.dnswl.org/, medium trust SPF_HELO_NONE 0.001 SPF: HELO does not publish an SPF Record SPF_NONE 0.001 SPF: sender does not publish an SPF Record URIBL_BLOCKED 0.001 ADMINISTRATOR NOTICE: The query to URIBL was blocked. See http://wiki.apache.org/spamassassin/DnsBlocklists#dnsbl-block for more information. [logrotate.rs, mod.rs, tasks.rs, proxmox-backup-proxy.rs, status.rs, fs.rs] Subject: [pbs-devel] [PATCH proxmox/proxmox-backup/widget-toolkit] improve task list handling X-BeenThere: pbs-devel@lists.proxmox.com X-Mailman-Version: 2.1.29 Precedence: list List-Id: Proxmox Backup Server development discussion <pbs-devel.lists.proxmox.com> List-Unsubscribe: <https://lists.proxmox.com/cgi-bin/mailman/options/pbs-devel>, <mailto:pbs-devel-request@lists.proxmox.com?subject=unsubscribe> List-Archive: <http://lists.proxmox.com/pipermail/pbs-devel/> List-Post: <mailto:pbs-devel@lists.proxmox.com> List-Help: <mailto:pbs-devel-request@lists.proxmox.com?subject=help> List-Subscribe: <https://lists.proxmox.com/cgi-bin/mailman/listinfo/pbs-devel>, <mailto:pbs-devel-request@lists.proxmox.com?subject=subscribe> X-List-Received-Date: Fri, 25 Sep 2020 14:13:31 -0000 this series extends the task handling in a way so that we can safely have more than 1000 tasks and properly filter and read them this also introduces a daily task to rotate the now existing task archive when it is over 500k up to maximum 20 files strictly speaking the widget-toolkit patch is not necessary, but makes the user interface a bit better to use proxmox: Dominik Csapak (3): proxmox/tools/fs: add shared lock helper proxmox/tools/fs: create tmpfile helper proxmox/tools: add logrotate module proxmox/Cargo.toml | 1 + proxmox/src/tools/fs.rs | 52 ++++++--- proxmox/src/tools/logrotate.rs | 188 +++++++++++++++++++++++++++++++++ proxmox/src/tools/mod.rs | 1 + 4 files changed, 226 insertions(+), 16 deletions(-) create mode 100644 proxmox/src/tools/logrotate.rs proxmox-backup: Dominik Csapak (10): api2/node/tasks: move userfilter to function signature server/worker_task: refactor locking of the task list server/worker_task: factor out task list rendering server/worker_task: split task list file into two server/worker_task: write older tasks into archive file server/worker_task: add TaskListInfoIterator api2/node/tasks: use TaskListInfoIterator instead of read_task_list api2/status: use the TaskListInfoIterator here server/worker_task: remove unecessary read_task_list proxmox-backup-proxy: add task archive rotation src/api2/node/tasks.rs | 49 +++-- src/api2/status.rs | 32 +++- src/bin/proxmox-backup-proxy.rs | 96 ++++++++++ src/server/worker_task.rs | 313 +++++++++++++++++++++++--------- 4 files changed, 373 insertions(+), 117 deletions(-) proxmox-widget-toolkit: Dominik Csapak (1): node/Tasks: improve scroller behaviour on datastore loading src/node/Tasks.js | 8 ++++++++ 1 file changed, 8 insertions(+) -- 2.20.1