From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: <pbs-devel-bounces@lists.proxmox.com> Received: from firstgate.proxmox.com (firstgate.proxmox.com [IPv6:2a01:7e0:0:424::9]) by lore.proxmox.com (Postfix) with ESMTPS id 64CFA1FF16E for <inbox@lore.proxmox.com>; Mon, 17 Mar 2025 16:39:48 +0100 (CET) Received: from firstgate.proxmox.com (localhost [127.0.0.1]) by firstgate.proxmox.com (Proxmox) with ESMTP id 676447AA8; Mon, 17 Mar 2025 16:39:38 +0100 (CET) Message-ID: <28ba79b3-3d84-4f95-ac73-3e700766ef15@proxmox.com> Date: Mon, 17 Mar 2025 16:39:34 +0100 MIME-Version: 1.0 User-Agent: Mozilla Thunderbird To: Proxmox Backup Server development discussion <pbs-devel@lists.proxmox.com>, =?UTF-8?Q?Fabian_Gr=C3=BCnbichler?= <f.gruenbichler@proxmox.com> References: <20250310111634.162156-1-c.ebner@proxmox.com> <20250310111634.162156-4-c.ebner@proxmox.com> <1742220221.ebt1keyfny.astroid@yuna.none> Content-Language: en-US, de-DE From: Christian Ebner <c.ebner@proxmox.com> In-Reply-To: <1742220221.ebt1keyfny.astroid@yuna.none> X-SPAM-LEVEL: Spam detection results: 0 AWL -0.370 Adjusted score from AWL reputation of From: address BAYES_00 -1.9 Bayes spam probability is 0 to 1% DMARC_MISSING 0.1 Missing DMARC policy KAM_ASCII_DIVIDERS 0.8 Email that uses ascii formatting dividers and possible spam tricks KAM_DMARC_STATUS 0.01 Test Rule for DKIM or SPF Failure with Strict Alignment RCVD_IN_VALIDITY_CERTIFIED_BLOCKED 0.001 ADMINISTRATOR NOTICE: The query to Validity was blocked. See https://knowledge.validity.com/hc/en-us/articles/20961730681243 for more information. RCVD_IN_VALIDITY_RPBL_BLOCKED 0.001 ADMINISTRATOR NOTICE: The query to Validity was blocked. See https://knowledge.validity.com/hc/en-us/articles/20961730681243 for more information. RCVD_IN_VALIDITY_SAFE_BLOCKED 0.001 ADMINISTRATOR NOTICE: The query to Validity was blocked. See https://knowledge.validity.com/hc/en-us/articles/20961730681243 for more information. SPF_HELO_NONE 0.001 SPF: HELO does not publish an SPF Record SPF_PASS -0.001 SPF: sender matches SPF record URIBL_BLOCKED 0.001 ADMINISTRATOR NOTICE: The query to URIBL was blocked. See http://wiki.apache.org/spamassassin/DnsBlocklists#dnsbl-block for more information. [proxmox.com, datastore.rs] Subject: Re: [pbs-devel] [PATCH v2 proxmox-backup 3/4] garbage collection: allow to keep track of already touched chunks X-BeenThere: pbs-devel@lists.proxmox.com X-Mailman-Version: 2.1.29 Precedence: list List-Id: Proxmox Backup Server development discussion <pbs-devel.lists.proxmox.com> List-Unsubscribe: <https://lists.proxmox.com/cgi-bin/mailman/options/pbs-devel>, <mailto:pbs-devel-request@lists.proxmox.com?subject=unsubscribe> List-Archive: <http://lists.proxmox.com/pipermail/pbs-devel/> List-Post: <mailto:pbs-devel@lists.proxmox.com> List-Help: <mailto:pbs-devel-request@lists.proxmox.com?subject=help> List-Subscribe: <https://lists.proxmox.com/cgi-bin/mailman/listinfo/pbs-devel>, <mailto:pbs-devel-request@lists.proxmox.com?subject=subscribe> Reply-To: Proxmox Backup Server development discussion <pbs-devel@lists.proxmox.com> Content-Transfer-Encoding: base64 Content-Type: text/plain; charset="utf-8"; Format="flowed" Errors-To: pbs-devel-bounces@lists.proxmox.com Sender: "pbs-devel" <pbs-devel-bounces@lists.proxmox.com> T24gMy8xNy8yNSAxNTo1NSwgRmFiaWFuIEdyw7xuYmljaGxlciB3cm90ZToKPiBPbiBNYXJjaCAx MCwgMjAyNSAxMjoxNiBwbSwgQ2hyaXN0aWFuIEVibmVyIHdyb3RlOgo+PiBJbXBsZW1lbnRzIHRo ZSBgVG91Y2hlZENodW5rc2Agc3RydWN0IGFuZCBtZXRob2RzIHRvIGtlZXAgdHJhY2sgb2YKPj4g YWxyZWFkeSB0b3VjaGVkIGNodW5rcyBkdXJpbmcgZ2FyYmFnZSBjb2xsZWN0aW9uIHBoYXNlIDEs IHRvIGF2b2lkCj4+IG11bHRpcGxlIGNvbXB1dGF0aW9uYWwgYW5kIEkvTyBpbnRlbnNpdmUgYXRp bWUgdXBkYXRlcyB2aWEgYSBzeXNjYWxsLgo+Pgo+PiBCeSBpbnNlcnRpbmcgYSBkaWdlc3QsIHRo ZSBjaHVuayB3aWxsIGJlIGNvbnNpZGVyZWQgYXMgdG91Y2hlZCBhbmQKPj4gY2FuIGJlIGlnbm9y ZWQgZm9yIHN1YnNlcXVlbnQgZW5jb3VudGVycy4gVG8gbGltaXQgbWVtb3J5IHVzYWdlLCB0aGUK Pj4gc3RydWN0dXJlIGFsbG93cyB0byByZXNldCB0aGUgY2h1bmsgc3RhdHVzLCBmbGFnZ2luZyB0 aGVtIGFzIHNlZW4KPj4gcHJldmlvdXMgdG8gdGhlIHJlc2V0LiBBIHN1YnNlcXVlbnQgaW5zZXJ0 IHdpbGwgdGhlbiBmbGFnIGl0IGFzIHNlZW4KPj4gYWZ0ZXIgdGhlIHJlc2V0LiBDaHVua3Mgbm90 IHNlZW4gYWZ0ZXIgYSByZXNldCwgd2lsbCBiZSBjbGVhcmVkIGZyb20KPj4gdGhlIHN0cnVjdHVy ZSBieSB0aGUgbmV4dCByZXNldCBjYWxsLCBlbGltaW5hdGluZyB0aGVtIGZyb20gbWVtb3J5Lgo+ Pgo+PiBUaGlzIGFsbG93cyB0byByZXNldCB0aGUgdHJhY2tpbmcgc3RhdCBhZnRlciBlYWNoIHBy b2Nlc3NlcyBpbWFnZQo+PiBpbmRleCBmaWxlLCB0byBtaW1pYyB0aGUgaW5jcmVtZW50YWwgYmFj a3VwIGJlaGF2aW91ciBvZiBrbm93biBjaHVua3MKPj4gYW5kIGxpbWl0IG1lbW9yeSBmb290cHJp bnQuCj4+Cj4+IFNpZ25lZC1vZmYtYnk6IENocmlzdGlhbiBFYm5lciA8Yy5lYm5lckBwcm94bW94 LmNvbT4KPj4gLS0tCj4+IGNoYW5nZXMgc2luY2UgdmVyc2lvbiAxOgo+PiAtIG5vIGNoYW5nZXMK Pj4KPj4gICBwYnMtZGF0YXN0b3JlL3NyYy9kYXRhc3RvcmUucnMgfCAyOSArKysrKysrKysrKysr KysrKysrKysrKysrKysrKwo+PiAgIDEgZmlsZSBjaGFuZ2VkLCAyOSBpbnNlcnRpb25zKCspCj4+ Cj4+IGRpZmYgLS1naXQgYS9wYnMtZGF0YXN0b3JlL3NyYy9kYXRhc3RvcmUucnMgYi9wYnMtZGF0 YXN0b3JlL3NyYy9kYXRhc3RvcmUucnMKPj4gaW5kZXggNzJiYzlmNzdmLi5mZGJiMzNhOTggMTAw NjQ0Cj4+IC0tLSBhL3Bicy1kYXRhc3RvcmUvc3JjL2RhdGFzdG9yZS5ycwo+PiArKysgYi9wYnMt ZGF0YXN0b3JlL3NyYy9kYXRhc3RvcmUucnMKPj4gQEAgLTE1ODUsMyArMTU4NSwzMiBAQCBpbXBs IERhdGFTdG9yZSB7Cj4+ICAgICAgICAgICBPaygoKSkKPj4gICAgICAgfQo+PiAgIH0KPj4gKwo+ PiArc3RydWN0IFRvdWNoZWRDaHVua3Mgewo+PiArICAgIGxpc3Q6IEhhc2hNYXA8W3U4OyAzMl0s IGJvb2w+LAo+PiArfQo+PiArCj4+ICtpbXBsIFRvdWNoZWRDaHVua3Mgewo+PiArICAgIGZuIG5l dygpIC0+IFNlbGYgewo+PiArICAgICAgICBTZWxmIHsKPj4gKyAgICAgICAgICAgIGxpc3Q6IEhh c2hNYXA6Om5ldygpLAo+PiArICAgICAgICB9Cj4+ICsgICAgfQo+PiArCj4+ICsgICAgLy8gQ2xl YXIgdW50b3VjaGVkIGNodW5rcyBhbmQgcmVzZXQgdGhlIHRvdWNoZWQgbWFya2VyIGZvciBvdGhl cnMuCj4+ICsgICAgZm4gcmVzZXQoJm11dCBzZWxmKSB7Cj4+ICsgICAgICAgIGxldCBtdXQgbmV3 X2xpc3QgPSBIYXNoTWFwOjpuZXcoKTsKPj4gKyAgICAgICAgZm9yIChkaWdlc3QsIHRvdWNoZWQp IGluIHNlbGYubGlzdC5kcmFpbigpIHsKPj4gKyAgICAgICAgICAgIGlmIHRvdWNoZWQgewo+PiAr ICAgICAgICAgICAgICAgIG5ld19saXN0Lmluc2VydChkaWdlc3QsIGZhbHNlKTsKPj4gKyAgICAg ICAgICAgIH0KPj4gKyAgICAgICAgfQo+PiArICAgICAgICBzZWxmLmxpc3QgPSBuZXdfbGlzdDsK PiAKPiB0aGlzIGNvdWxkIGF2b2lkIHRoZSBtZW1vcnkgYWxsb2NhdGlvbiAoYW5kIGZvciBiaWdn ZXIKPiBpbmRpY2VzL3NuYXBzaG90cywgcHJvYmFibHkgbXVsdGlwbGUgcmVhbGxvY2F0aW9ucyB2 aWEgdGhlIGluc2VydHMpIGJ5Cj4gc3dpdGNoaW5nIHRvIGByZXRhaW5gICh3aGljaCBnZXRzIGEg YCZtdXQgVmAgYW5kIGNhbiB0aHVzIGZsaXAgdGhlIHZhbHVlCj4gb2YgdG91Y2hlZCB3aGlsZSBm aWx0ZXJpbmcgaW4gYSBzaW5nbGUgcGFzcykuCj4gCj4gZGVzcGl0ZSB0aGUgcGVyZm9ybWFuY2Ug d2FybmluZyBhYm91dCBpdCB2aXNpdGluZyBlbXB0eSBidWNrZXRzIGFzIHdlbGwsCj4gdGhpcyBz ZWVtcyB0byBiZSAoc2xpZ2h0bHkpIGZhc3RlciBmb3IgbXkgdGVzdCBkYXRhc3RvcmUgKHdvdWxk IGJlCj4gaW50ZXJlc3RpbmcgaWYgeW91ciB0ZXN0IGNhc2VzIGFncmVlPykgd2hlbiBiZW5jaG1h cmtpbmcgd2l0aCBhIHdhcm1lZAo+IHVwIGNhY2hlLgo+IAo+IEkgdXNlZCB0aGUgZm9sbG93aW5n IG9uLXRvcCBvZiB5b3VyIHNlcmllcyAodGhlIHNocmlua190byBpcyB0byByZWR1Y2UKPiBtZW1v cnkgdXNhZ2UgaW4gY2FzZSBvZiBvdXRsaWVycyBhZnRlciB0aGV5J3ZlIGJlZW4gcHJvY2Vzc2Vk KToKPiAKPiBgYGAKPiBkaWZmIC0tZ2l0IGEvcGJzLWRhdGFzdG9yZS9zcmMvZGF0YXN0b3JlLnJz IGIvcGJzLWRhdGFzdG9yZS9zcmMvZGF0YXN0b3JlLnJzCj4gaW5kZXggYTgwMzQzZDliLi5kM2Mz ZjgzMWYgMTAwNjQ0Cj4gLS0tIGEvcGJzLWRhdGFzdG9yZS9zcmMvZGF0YXN0b3JlLnJzCj4gKysr IGIvcGJzLWRhdGFzdG9yZS9zcmMvZGF0YXN0b3JlLnJzCj4gQEAgLTE2NTAsMTMgKzE2NTAsMTIg QEAgaW1wbCBUb3VjaGVkQ2h1bmtzIHsKPiAgIAo+ICAgICAgIC8vIENsZWFyIHVudG91Y2hlZCBj aHVua3MgYW5kIHJlc2V0IHRoZSB0b3VjaGVkIG1hcmtlciBmb3Igb3RoZXJzLgo+ICAgICAgIGZu IHJlc2V0KCZtdXQgc2VsZikgewo+IC0gICAgICAgIGxldCBtdXQgbmV3X2xpc3QgPSBIYXNoTWFw OjpuZXcoKTsKPiAtICAgICAgICBmb3IgKGRpZ2VzdCwgdG91Y2hlZCkgaW4gc2VsZi5saXN0LmRy YWluKCkgewo+IC0gICAgICAgICAgICBpZiB0b3VjaGVkIHsKPiAtICAgICAgICAgICAgICAgIG5l d19saXN0Lmluc2VydChkaWdlc3QsIGZhbHNlKTsKPiAtICAgICAgICAgICAgfQo+IC0gICAgICAg IH0KPiAtICAgICAgICBzZWxmLmxpc3QgPSBuZXdfbGlzdDsKPiArICAgICAgICBzZWxmLmxpc3Qu cmV0YWluKHxfZGlnZXN0LCB0b3VjaGVkfCB7Cj4gKyAgICAgICAgICAgICp0b3VjaGVkID0gISp0 b3VjaGVkOwo+ICsgICAgICAgICAgICAhKnRvdWNoZWQKPiArICAgICAgICB9KTsKPiArICAgICAg ICBsZXQgbWF4X2NhcGFjaXR5ID0gc2VsZi5saXN0LmxlbigpLnNhdHVyYXRpbmdfYWRkKHNlbGYu bGlzdC5sZW4oKSAvIDMpOwo+ICsgICAgICAgIHNlbGYubGlzdC5zaHJpbmtfdG8obWF4X2NhcGFj aXR5KTsKPiAgICAgICB9Cj4gICAKPiAgICAgICAvLyBJbnNlcnQgdGhlIGRpZ2VzdCBpbiB0aGUg bGlzdCBvZiB0b3VjaGVkIGNodW5rcy4KPiBgYGAKPiAKPiBpZiB0aGUgYWJvdmUgaXMgc2xvd2Vy IGZvciB5b3VyIHRlc3QgaW5wdXRzLCB0aGVuIGF0IGxlYXN0IGluaXRpYWxpemluZwo+IHRoZSBz ZWNvbmQgSGFzaE1hcCB3aXRoIHNvbWUgaW5pdGlhbCBjYXBhY2l0eSAodGhlIGxlbiBvZiB0aGUg cHJldmlvdXMKPiBsaXN0PykgaXMgcHJvYmFibHkgc2Vuc2libGUuLgoKT2theSwgd2lsbCBjaGVj ayBhbmQgaW5jb3Jwb3JhdGUgdGhlc2Ugc3VnZ2VzdGlvbnMsIHRoYW5rcyEKCj4gCj4gYWx0ZXJu YXRpdmVseSwgd2UgY291bGQgYWxzbyBleHBsb3JlIChtYXliZSBhcyBhIGZvbGxvdy11cCB0bwo+ IGltbWVkaWF0ZWx5IHJlYWxpemUgdGhlIHBlcmZvcm1hbmNlIGdhaW5zIHdlIGFscmVhZHkga25v dyB3ZSBnZXQgZnJvbQo+IHRoZSBjdXJyZW50IGFwcm9hY2g/KSBzb21lIHNvcnQgb2YgTFJVLWJh c2VkIGFwcHJvYWNoPwoKWWVhaCwgaGFkIHNvbWV0aGluZyBsaWtlIHRoYXQgaW4gbWluZCBhcyB3 ZWxsIGJlY2F1c2Ugb2YgdGhlIHJlY2VudCB3b3JrIApvbiB0aGF0LiBUaGlzIHdvdWxkIGFsbG93 IHRvIGJldHRlciBjb250cm9sIHRoZSBvdmVyYWxsIG1lbW9yeSAKcmVxdWlyZW1lbnRzIGZvciB0 aGUgZ2FyYmFnZSBjb2xsZWN0aW9uIHRhc2sgYXMgd2VsbCwgYXMgaXQgdGhlbiBkb2VzIApub3Qg ZGVwZW5kIG9uIHRoZSBpbmRleCBmaWxlcy4gS2VlcGluZyB0aGUgY2FjaGUgY2FwYWNpdHkgbGFy Z2UgaXMgb2YgCmNvdXJzZSBhIHByZS1jb25kaXRpb24gZm9yIHRoYXQuCgo+IAo+IHRoYXQgbWln aHQgZ2l2ZSB1cyB0aGUgb3B0aW9uIG9mOgo+IC0gZHJvcHBpbmcgdGhlIHJlc2V0IGNhbGwvZm4g d2hpbGUgc3RpbGwgaGF2aW5nIGJvdW5kZWQgKGV2ZW4KPiAgICBjb25maWd1cmFibGU/KSBtZW1v cnkgb3ZlcmhlYWQKPiAtIGV4dGVuZCBza2lwcGluZyB0b3VjaGVzIGFjcm9zcyBhIGJyb2FkZXIg cmFuZ2Ugb2Ygc25hcHNob3RzL2luZGljZXMKPiAgICBmb3IgYWRkaXRpb25hbCBwZXJmb3JtYW5j ZSBnYWlucyAoaWYgdGhlIGNhcGFjaXR5IGlzIGhpZ2ggZW5vdWdoKQo+IAo+PiArICAgIH0KPj4g Kwo+PiArICAgIC8vIEluc2VydCB0aGUgZGlnZXN0IGluIHRoZSBsaXN0IG9mIHRvdWNoZWQgY2h1 bmtzLgo+PiArICAgIC8vIFJldHVybnMgdHJ1ZSBpZiB0aGUgY2h1bmsgd2FzIGFscmVhZHkgcHJl c2VudCwgZmFsc2Ugb3RoZXJ3aXNlLgo+PiArICAgIGZuIGluc2VydCgmbXV0IHNlbGYsIGRpZ2Vz dDogW3U4OyAzMl0pIC0+IGJvb2wgewo+PiArICAgICAgICBzZWxmLmxpc3QuaW5zZXJ0KGRpZ2Vz dCwgdHJ1ZSkuaXNfc29tZSgpCj4+ICsgICAgfQo+PiArfQo+PiAtLSAKPj4gMi4zOS41Cj4+Cj4+ Cj4+Cj4+IF9fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fCj4+ IHBicy1kZXZlbCBtYWlsaW5nIGxpc3QKPj4gcGJzLWRldmVsQGxpc3RzLnByb3htb3guY29tCj4+ IGh0dHBzOi8vbGlzdHMucHJveG1veC5jb20vY2dpLWJpbi9tYWlsbWFuL2xpc3RpbmZvL3Bicy1k ZXZlbAo+Pgo+Pgo+Pgo+IAo+IAo+IF9fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19f X19fX19fX19fX19fCj4gcGJzLWRldmVsIG1haWxpbmcgbGlzdAo+IHBicy1kZXZlbEBsaXN0cy5w cm94bW94LmNvbQo+IGh0dHBzOi8vbGlzdHMucHJveG1veC5jb20vY2dpLWJpbi9tYWlsbWFuL2xp c3RpbmZvL3Bicy1kZXZlbAo+IAo+IAoKCgpfX19fX19fX19fX19fX19fX19fX19fX19fX19fX19f X19fX19fX19fX19fX19fXwpwYnMtZGV2ZWwgbWFpbGluZyBsaXN0CnBicy1kZXZlbEBsaXN0cy5w cm94bW94LmNvbQpodHRwczovL2xpc3RzLnByb3htb3guY29tL2NnaS1iaW4vbWFpbG1hbi9saXN0 aW5mby9wYnMtZGV2ZWwK