From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from firstgate.proxmox.com (firstgate.proxmox.com [212.224.123.68]) by lore.proxmox.com (Postfix) with ESMTPS id 4B1051FF15F for ; Mon, 7 Oct 2024 13:32:34 +0200 (CEST) Received: from firstgate.proxmox.com (localhost [127.0.0.1]) by firstgate.proxmox.com (Proxmox) with ESMTP id 36A283C6F9; Mon, 7 Oct 2024 13:32:59 +0200 (CEST) From: Christian Ebner To: pbs-devel@lists.proxmox.com Date: Mon, 7 Oct 2024 13:32:11 +0200 Message-Id: <20241007113211.129770-1-c.ebner@proxmox.com> X-Mailer: git-send-email 2.39.5 MIME-Version: 1.0 X-SPAM-LEVEL: Spam detection results: 0 AWL -0.378 Adjusted score from AWL reputation of From: address BAYES_00 -1.9 Bayes spam probability is 0 to 1% DMARC_MISSING 0.1 Missing DMARC policy KAM_ASCII_DIVIDERS 0.8 Email that uses ascii formatting dividers and possible spam tricks KAM_DMARC_STATUS 0.01 Test Rule for DKIM or SPF Failure with Strict Alignment RCVD_IN_VALIDITY_CERTIFIED_BLOCKED 0.001 ADMINISTRATOR NOTICE: The query to Validity was blocked. See https://knowledge.validity.com/hc/en-us/articles/20961730681243 for more information. RCVD_IN_VALIDITY_RPBL_BLOCKED 0.001 ADMINISTRATOR NOTICE: The query to Validity was blocked. See https://knowledge.validity.com/hc/en-us/articles/20961730681243 for more information. RCVD_IN_VALIDITY_SAFE_BLOCKED 0.001 ADMINISTRATOR NOTICE: The query to Validity was blocked. See https://knowledge.validity.com/hc/en-us/articles/20961730681243 for more information. SPF_HELO_NONE 0.001 SPF: HELO does not publish an SPF Record SPF_PASS -0.001 SPF: sender matches SPF record Subject: [pbs-devel] [PATCH v3 proxmox-backup] fix #5710: api: backup: stat known chunks on backup finish X-BeenThere: pbs-devel@lists.proxmox.com X-Mailman-Version: 2.1.29 Precedence: list List-Id: Proxmox Backup Server development discussion List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Reply-To: Proxmox Backup Server development discussion Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 Errors-To: pbs-devel-bounces@lists.proxmox.com Sender: "pbs-devel" S25vd24gY2h1bmtzIGFyZSBleHBlY3RlZCB0byBiZSBwcmVzZW50IG9uIHRoZSBkYXRhc3RvcmUg YS1wcmlvcmksCmFsbG93aW5nIGNsaWVudHMgdG8gb25seSByZS1pbmRleCB0aGVzZSBjaHVua3Mg d2l0aG91dCB1cGxvYWRpbmcgdGhlCnJhdyBjaHVuayBkYXRhLiBUaGUgbGlzdCBvZiByZXVzYWJs ZSBrbm93biBjaHVua3MgaXMgc2VuZCB0byB0aGUKY2xpZW50IGJ5IHRoZSBzZXJ2ZXIsIGRlZHVj ZWQgZnJvbSB0aGUgaW5kZXhlZCBjaHVua3Mgb2YgdGhlIHByZXZpb3VzCmJhY2t1cCBzbmFwc2hv dCBvZiB0aGUgZ3JvdXAuCgpJZiBob3dldmVyIHN1Y2ggYSBrbm93biBjaHVuayBkaXNhcHBlYXJl ZCAodGhlIHByZXZpb3VzIGJhY2t1cApzbmFwc2hvdCBoYXZpbmcgYmVlbiB2ZXJpZmllZCBiZWZv cmUgdGhhdCBvciBub3QgdmVyaWZpZWQganVzdCB5ZXQpLAp0aGUgYmFja3VwIHdpbGwgZmluaXNo IGp1c3QgZmluZSwgbGVhZGluZyB0byBhIHNlZW1pbmdseSBzdWNjZXNzZnVsCmJhY2t1cC4gT25s eSBhIHN1YnNlcXVlbnQgdmVyaWZpY2F0aW9uIGpvYiB3aWxsIGRldGVjdCB0aGUgYmFja3VwCnNu YXBzaG90IGFzIGJlaW5nIGNvcnJ1cHQuCgpJbiBvcmRlciB0byByZWR1Y2UgdGhlIGltcGFjdCwg c3RhdCB0aGUgbGlzdCBvZiBwcmV2aW91c2x5IGtub3duCmNodW5rcyB3aGVuIGZpbmlzaGluZyB0 aGUgYmFja3VwLiBJZiBhIG1pc3NpbmcgY2h1bmsgaXMgZGV0ZWN0ZWQsIHRoZQpiYWNrdXAgcnVu IGl0c2VsZiB3aWxsIGZhaWwgYW5kIHRoZSBwcmV2aW91cyBiYWNrdXAgc25hcHNob3RzIHZlcmlm eQpzdGF0ZSBpcyBzZXQgdG8gZmFpbGVkLgpUaGlzIHByZXZlbnRzIHRoZSBzYW1lIHNuYXBzaG90 IGZyb20gYmVpbmcgcmV1c2VkIGJ5IGFub3RoZXIsCnN1YnNlcXVlbnQgYmFja3VwIGpvYi4KCk5v dGU6ClRoZSBjdXJyZW50IGJhY2t1cCBydW4gbWlnaHQgaGF2ZSBiZWVuIGp1c3QgZmluZSwgaWYg dGhlIG5vdyBtaXNzaW5nCmtub3duIGNodW5rIGlzIG5vdCBpbmRleGVkLiBCdXQgc2luY2UgdGhl cmUgaXMgbm8gc3RyYWlnaHQgZm9yd2FyZAp3YXkgdG8gZGV0ZWN0IHdoaWNoIGtub3duIGNodW5r cyBoYXZlIG5vdCBiZWVuIHJldXNlZCBpbiB0aGUgZmFzdAppbmNyZW1lbnRhbCBtb2RlIGZvciBm aXhlZCBpbmRleCBiYWNrdXBzLCB0aGUgYmFja3VwIHJ1biBpcwpjb25zaWRlcmVkIGZhaWxlZC4K CmxpbmsgdG8gaXNzdWUgaW4gYnVndHJhY2tlcjoKaHR0cHM6Ly9idWd6aWxsYS5wcm94bW94LmNv bS9zaG93X2J1Zy5jZ2k/aWQ9NTcxMAoKU2lnbmVkLW9mZi1ieTogQ2hyaXN0aWFuIEVibmVyIDxj LmVibmVyQHByb3htb3guY29tPgpUZXN0ZWQtYnk6IEdhYnJpZWwgR29sbGVyIDxnLmdvbGxlckBw cm94bW94LmNvbT4KUmV2aWV3ZWQtYnk6IEdhYnJpZWwgR29sbGVyIDxnLmdvbGxlckBwcm94bW94 LmNvbT4KLS0tCkNoYW5nZXMgc2luY2UgdmVyc2lvbiAyLCB0aGFua3MgdG8gR2FicmllbCBmb3Ig dGVzdGluZyBhbmQgcmV2aWV3OgotIFVzZSBhbmQgZGlzcGxheSBhbnlob3cgZXJyb3IgY29udGV4 dAotIHMvYmFja3AvYmFja3VwLwoKQ2hhbmdlcyBzaW5jZSB2ZXJzaW9uIDEsIHRoYW5rcyB0byBE aWV0bWFyIGFuZCBHYWJyaWVsIGZvciBmZWVkYmFjazoKLSBPbmx5IHN0YXQgb24gYmFja3VwIGZp bmlzaAotIERpc3Rpbmd1aXNoIG5ld2x5IHVwbG9hZGVkIGZyb20gcHJldmlvdXNseSBrbm93biBj aHVua3MsIHRvIGJlIGFibGUKICB0byBvbmx5IHN0YXQgdGhlIGxhdHRlci4KCk5ldyB0ZXN0IG9u IG15IHNpZGUgc2hvdyBhIHBlcmZvcm1hbmNlIGRlZ3JhZGF0aW9uIG9mIH4yJSBmb3IgdGhlIFZN CmJhY2t1cCBhbmQgYWJvdXQgfjEwJSBmb3IgdGhlIExYQyBiYWNrdXAgYXMgY29tcGFyZWQgdG8g YW4gdW5wYXRjaGVkCnNlcnZlci4KSW4gY29udHJhc3QgdG8gdmVyc2lvbiAxIG9mIHRoZSBwYXRj aGVzIHRoZSBQQlMgZGF0YXN0b3JlIHRoaXMgdGltZQp3YXMgbG9jYXRlZCBvbiBhbiBORlMgc2hh cmUgYmFja2VkIGJ5IGFuIE5WTUUgU1NELgoKSSBkaWQgcGVyZm9ybSB2emR1bXAgYmFja3VwcyBv ZiBhIFZNIHdpdGggYSAzMkcgZGlzayBhdHRhY2hlZCBhbmQgYQpMWEMgY29udGFpbmVyIHdpdGgg YSBEZWJpYW4gaW5zdGFsbCBhbmQgcm9vdGZzIG9mIGNhLiA0MDBNIChib3RoIG9mZiwKbm8gY2hh bmdlcyBpbiBkYXRhIGluLWJldHdlZW4gYmFja3VwIHJ1bnMpLgpBZ2FpbiBwZXJmb3JtZWQgNSBy dW5zIGVhY2ggYWZ0ZXIgYW4gaW5pdGlhbCBydW4gdG8gYXNzdXJlIGZ1bGwgY2h1bmsKcHJlc2Vu Y2Ugb24gc2VydmVyIGFuZCB2YWxpZCBwcmV2aW91cyBzbmFwc2hvdC4KCkhlcmUgdGhlIHVwZGF0 ZWQgZmlndXJlczoKCi0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t LS0tLS0tLS0tLS0tLS0tCnBhdGNoZWQgICAgICAgICAgICAgICAgICAgIHwgdW5wYXRjaGVkCi0t LS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t ClZNICAgICAgICAgICB8IExYQyAgICAgICAgIHwgVk0gICAgICAgICAgIHwgTFhDCi0tLS0tLS0t LS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tCjE0LjBz IMKxIDAuOHMgfCAyLjJzIMKxIDAuMXMgfCAxMy43cyDCsSAwLjVzIHwgMi4wcyDCsSAwLjAzcwot LS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t LQoKIHNyYy9hcGkyL2JhY2t1cC9lbnZpcm9ubWVudC5ycyB8IDUyICsrKysrKysrKysrKysrKysr KysrKysrKysrKysrKy0tLS0KIHNyYy9hcGkyL2JhY2t1cC9tb2QucnMgICAgICAgICB8IDIwICsr KysrKysrKysrKysKIDIgZmlsZXMgY2hhbmdlZCwgNjYgaW5zZXJ0aW9ucygrKSwgNiBkZWxldGlv bnMoLSkKCmRpZmYgLS1naXQgYS9zcmMvYXBpMi9iYWNrdXAvZW52aXJvbm1lbnQucnMgYi9zcmMv YXBpMi9iYWNrdXAvZW52aXJvbm1lbnQucnMKaW5kZXggOTlkODg1ZTJlLi42MzBhNzdiNzkgMTAw NjQ0Ci0tLSBhL3NyYy9hcGkyL2JhY2t1cC9lbnZpcm9ubWVudC5ycworKysgYi9zcmMvYXBpMi9i YWNrdXAvZW52aXJvbm1lbnQucnMKQEAgLTcyLDggKzcyLDE0IEBAIHN0cnVjdCBGaXhlZFdyaXRl clN0YXRlIHsKICAgICBpbmNyZW1lbnRhbDogYm9vbCwKIH0KIAotLy8ga2V5PWRpZ2VzdCwgdmFs dWU9bGVuZ3RoCi10eXBlIEtub3duQ2h1bmtzTWFwID0gSGFzaE1hcDxbdTg7IDMyXSwgdTMyPjsK KyNbZGVyaXZlKENvcHksIENsb25lKV0KK3N0cnVjdCBLbm93bkNodW5rSW5mbyB7CisgICAgdXBs b2FkZWQ6IGJvb2wsCisgICAgbGVuZ3RoOiB1MzIsCit9CisKKy8vIGtleT1kaWdlc3QsIHZhbHVl PUtub3duQ2h1bmtJbmZvCit0eXBlIEtub3duQ2h1bmtzTWFwID0gSGFzaE1hcDxbdTg7IDMyXSwg S25vd25DaHVua0luZm8+OwogCiBzdHJ1Y3QgU2hhcmVkQmFja3VwU3RhdGUgewogICAgIGZpbmlz aGVkOiBib29sLApAQCAtMTU5LDcgKzE2NSwxMyBAQCBpbXBsIEJhY2t1cEVudmlyb25tZW50IHsK IAogICAgICAgICBzdGF0ZS5lbnN1cmVfdW5maW5pc2hlZCgpPzsKIAotICAgICAgICBzdGF0ZS5r bm93bl9jaHVua3MuaW5zZXJ0KGRpZ2VzdCwgbGVuZ3RoKTsKKyAgICAgICAgc3RhdGUua25vd25f Y2h1bmtzLmluc2VydCgKKyAgICAgICAgICAgIGRpZ2VzdCwKKyAgICAgICAgICAgIEtub3duQ2h1 bmtJbmZvIHsKKyAgICAgICAgICAgICAgICB1cGxvYWRlZDogZmFsc2UsCisgICAgICAgICAgICAg ICAgbGVuZ3RoLAorICAgICAgICAgICAgfSwKKyAgICAgICAgKTsKIAogICAgICAgICBPaygoKSkK ICAgICB9CkBAIC0yMTMsNyArMjI1LDEzIEBAIGltcGwgQmFja3VwRW52aXJvbm1lbnQgewogICAg ICAgICB9CiAKICAgICAgICAgLy8gcmVnaXN0ZXIgY2h1bmsKLSAgICAgICAgc3RhdGUua25vd25f Y2h1bmtzLmluc2VydChkaWdlc3QsIHNpemUpOworICAgICAgICBzdGF0ZS5rbm93bl9jaHVua3Mu aW5zZXJ0KAorICAgICAgICAgICAgZGlnZXN0LAorICAgICAgICAgICAgS25vd25DaHVua0luZm8g eworICAgICAgICAgICAgICAgIHVwbG9hZGVkOiB0cnVlLAorICAgICAgICAgICAgICAgIGxlbmd0 aDogc2l6ZSwKKyAgICAgICAgICAgIH0sCisgICAgICAgICk7CiAKICAgICAgICAgT2soKCkpCiAg ICAgfQpAQCAtMjQ4LDcgKzI2NiwxMyBAQCBpbXBsIEJhY2t1cEVudmlyb25tZW50IHsKICAgICAg ICAgfQogCiAgICAgICAgIC8vIHJlZ2lzdGVyIGNodW5rCi0gICAgICAgIHN0YXRlLmtub3duX2No dW5rcy5pbnNlcnQoZGlnZXN0LCBzaXplKTsKKyAgICAgICAgc3RhdGUua25vd25fY2h1bmtzLmlu c2VydCgKKyAgICAgICAgICAgIGRpZ2VzdCwKKyAgICAgICAgICAgIEtub3duQ2h1bmtJbmZvIHsK KyAgICAgICAgICAgICAgICB1cGxvYWRlZDogdHJ1ZSwKKyAgICAgICAgICAgICAgICBsZW5ndGg6 IHNpemUsCisgICAgICAgICAgICB9LAorICAgICAgICApOwogCiAgICAgICAgIE9rKCgpKQogICAg IH0KQEAgLTI1Niw3ICsyODAsMjMgQEAgaW1wbCBCYWNrdXBFbnZpcm9ubWVudCB7CiAgICAgcHVi IGZuIGxvb2t1cF9jaHVuaygmc2VsZiwgZGlnZXN0OiAmW3U4OyAzMl0pIC0+IE9wdGlvbjx1MzI+ IHsKICAgICAgICAgbGV0IHN0YXRlID0gc2VsZi5zdGF0ZS5sb2NrKCkudW53cmFwKCk7CiAKLSAg ICAgICAgc3RhdGUua25vd25fY2h1bmtzLmdldChkaWdlc3QpLmNvcGllZCgpCisgICAgICAgIHN0 YXRlCisgICAgICAgICAgICAua25vd25fY2h1bmtzCisgICAgICAgICAgICAuZ2V0KGRpZ2VzdCkK KyAgICAgICAgICAgIC5tYXAofGtub3duX2NodW5rX2luZm98IGtub3duX2NodW5rX2luZm8ubGVu Z3RoKQorICAgIH0KKworICAgIC8vLyBzdGF0IGtub3duIGNodW5rcyBmcm9tIHByZXZpb3VzIGJh Y2t1cCwgc28gZXhjbHVkaW5nIG5ld2x5IHVwbG9hZGVkIG9uZXMKKyAgICBwdWIgZm4gc3RhdF9w cmV2X2tub3duX2NodW5rcygmc2VsZikgLT4gUmVzdWx0PCgpLCBFcnJvcj4geworICAgICAgICBs ZXQgc3RhdGUgPSBzZWxmLnN0YXRlLmxvY2soKS51bndyYXAoKTsKKyAgICAgICAgZm9yIChkaWdl c3QsIGtub3duX2NodW5rX2luZm8pIGluICZzdGF0ZS5rbm93bl9jaHVua3MgeworICAgICAgICAg ICAgaWYgIWtub3duX2NodW5rX2luZm8udXBsb2FkZWQgeworICAgICAgICAgICAgICAgIHNlbGYu ZGF0YXN0b3JlLnN0YXRfY2h1bmsoZGlnZXN0KS5tYXBfZXJyKHxlcnJ8IHsKKyAgICAgICAgICAg ICAgICAgICAgZXJyLmNvbnRleHQoZm9ybWF0ISgic3RhdCBmYWlsZWQgb24ge30iLCBoZXg6OmVu Y29kZShkaWdlc3QpKSkKKyAgICAgICAgICAgICAgICB9KT87CisgICAgICAgICAgICB9CisgICAg ICAgIH0KKyAgICAgICAgT2soKCkpCiAgICAgfQogCiAgICAgLy8vIFN0b3JlIHRoZSB3cml0ZXIg d2l0aCBhbiB1bmlxdWUgSUQKZGlmZiAtLWdpdCBhL3NyYy9hcGkyL2JhY2t1cC9tb2QucnMgYi9z cmMvYXBpMi9iYWNrdXAvbW9kLnJzCmluZGV4IGVhMGQwMjkyZS4uNjY0ZTI0ZDk5IDEwMDY0NAot LS0gYS9zcmMvYXBpMi9iYWNrdXAvbW9kLnJzCisrKyBiL3NyYy9hcGkyL2JhY2t1cC9tb2QucnMK QEAgLTc4NSw2ICs3ODUsMjYgQEAgZm4gZmluaXNoX2JhY2t1cCgKICkgLT4gUmVzdWx0PFZhbHVl LCBFcnJvcj4gewogICAgIGxldCBlbnY6ICZCYWNrdXBFbnZpcm9ubWVudCA9IHJwY2Vudi5hc19y ZWYoKTsKIAorICAgIGlmIGxldCBFcnIoZXJyKSA9IGVudi5zdGF0X3ByZXZfa25vd25fY2h1bmtz KCkgeworICAgICAgICBlbnYuZGVidWcoZm9ybWF0ISgic3RhdCByZWdpc3RlcmVkIGNodW5rcyBm YWlsZWQgLSB7ZXJyOj99IikpOworCisgICAgICAgIGlmIGxldCBTb21lKGxhc3QpID0gZW52Lmxh c3RfYmFja3VwLmFzX3JlZigpIHsKKyAgICAgICAgICAgIC8vIE5vIG5lZWQgdG8gYWNxdWlyZSBz bmFwc2hvdCBsb2NrLCBhbHJlYWR5IGxvY2tlZCB3aGVuIHN0YXJ0aW5nIHRoZSBiYWNrdXAKKyAg ICAgICAgICAgIGxldCB2ZXJpZnlfc3RhdGUgPSBTbmFwc2hvdFZlcmlmeVN0YXRlIHsKKyAgICAg ICAgICAgICAgICBzdGF0ZTogVmVyaWZ5U3RhdGU6OkZhaWxlZCwKKyAgICAgICAgICAgICAgICB1 cGlkOiBlbnYud29ya2VyLnVwaWQoKS5jbG9uZSgpLCAvLyBiYWNrdXAgd3JpdGVyIFVQSUQKKyAg ICAgICAgICAgIH07CisgICAgICAgICAgICBsZXQgdmVyaWZ5X3N0YXRlID0gc2VyZGVfanNvbjo6 dG9fdmFsdWUodmVyaWZ5X3N0YXRlKT87CisgICAgICAgICAgICBsYXN0LmJhY2t1cF9kaXIKKyAg ICAgICAgICAgICAgICAudXBkYXRlX21hbmlmZXN0KHxtYW5pZmVzdHwgeworICAgICAgICAgICAg ICAgICAgICBtYW5pZmVzdC51bnByb3RlY3RlZFsidmVyaWZ5X3N0YXRlIl0gPSB2ZXJpZnlfc3Rh dGU7CisgICAgICAgICAgICAgICAgfSkKKyAgICAgICAgICAgICAgICAubWFwX2Vycih8ZXJyfCBm b3JtYXRfZXJyISgibWFuaWZlc3QgdXBkYXRlIGZhaWxlZCAtIHtlcnI6P30iKSk/OworICAgICAg ICB9CisKKyAgICAgICAgYmFpbCEoInN0YXQga25vd24gY2h1bmtzIGZhaWxlZCAtIHtlcnI6P30i KTsKKyAgICB9CisKICAgICBlbnYuZmluaXNoX2JhY2t1cCgpPzsKICAgICBlbnYubG9nKCJzdWNj ZXNzZnVsbHkgZmluaXNoZWQgYmFja3VwIik7CiAKLS0gCjIuMzkuNQoKCgpfX19fX19fX19fX19f X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fXwpwYnMtZGV2ZWwgbWFpbGluZyBsaXN0 CnBicy1kZXZlbEBsaXN0cy5wcm94bW94LmNvbQpodHRwczovL2xpc3RzLnByb3htb3guY29tL2Nn aS1iaW4vbWFpbG1hbi9saXN0aW5mby9wYnMtZGV2ZWwK