From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from firstgate.proxmox.com (firstgate.proxmox.com [212.224.123.68]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits)) (No client certificate requested) by lists.proxmox.com (Postfix) with ESMTPS id 85D0D7175C for ; Thu, 8 Apr 2021 14:14:13 +0200 (CEST) Received: from firstgate.proxmox.com (localhost [127.0.0.1]) by firstgate.proxmox.com (Proxmox) with ESMTP id 791F31B27D for ; Thu, 8 Apr 2021 14:14:13 +0200 (CEST) Received: from EUR02-HE1-obe.outbound.protection.outlook.com (mail-he1eur02on0613.outbound.protection.outlook.com [IPv6:2a01:111:f400:fe05::613]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by firstgate.proxmox.com (Proxmox) with ESMTPS id 6D7D81B26C for ; Thu, 8 Apr 2021 14:14:12 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=inettGmbH.onmicrosoft.com; s=selector2-inettGmbH-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=qSH5+JRo3hzrdlVHwGinZ25dOLoamnaTfAR5m21Gv2U=; b=y1hpxl/h8rnEcowpc9TBUdKjmskMYLb6Z6mPAOvGwDBqqA32qKeL5SqPYXlyw9887bWsEuh790HlJTsO/b6Q10BWscJU/4Wap8aqztK7H1HII6hNkH6cQt9sge6RHzt3q25DBa5sp0zqTbToFBhCgdln7KP2KN7S/5rLmB7WHnk= Received: from DB6PR0801CA0046.eurprd08.prod.outlook.com (2603:10a6:4:2b::14) by AM9PR05MB8385.eurprd05.prod.outlook.com (2603:10a6:20b:3a8::19) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4020.16; Thu, 8 Apr 2021 12:14:04 +0000 Received: from DB5EUR03FT023.eop-EUR03.prod.protection.outlook.com (2603:10a6:4:2b:cafe::fa) by DB6PR0801CA0046.outlook.office365.com (2603:10a6:4:2b::14) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4020.16 via Frontend Transport; Thu, 8 Apr 2021 12:14:04 +0000 X-MS-Exchange-Authentication-Results: spf=pass (sender IP is 13.81.10.179) smtp.mailfrom=inett.de; lists.proxmox.com; dkim=fail (body hash did not verify) header.d=inettGmbH.onmicrosoft.com;lists.proxmox.com; dmarc=bestguesspass action=none header.from=inett.de; Received-SPF: Pass (protection.outlook.com: domain of inett.de designates 13.81.10.179 as permitted sender) receiver=protection.outlook.com; client-ip=13.81.10.179; helo=westeu13-emailsignatures-cloud.codetwo.com; Received: from westeu13-emailsignatures-cloud.codetwo.com (13.81.10.179) by DB5EUR03FT023.mail.protection.outlook.com (10.152.20.68) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4020.17 via Frontend Transport; Thu, 8 Apr 2021 12:14:04 +0000 Received: from EUR05-DB8-obe.outbound.protection.outlook.com (104.47.17.112) by westeu13-emailsignatures-cloud.codetwo.com with CodeTwo SMTP Server (TLS12) via SMTP; Thu, 08 Apr 2021 12:14:03 +0000 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=CrLDtEBqb6xfauzvI5NCYJHUBM0UeAM6993KRWsSLnPuSMG1nedR7h6UZs7EtP/k0WgHYWrdttrN1uABRPYCvssNCeT22yH3bj9x/NiEeK9LLT5l4cqufU49rJNlBlO9YrKf3AYlqVwGWqm3g6ZX/HOqsKKKRXa6G6nPf2NLVzi6V5Ybff0TdQwu6XdZaq9weg4x5nddn722bTf4+EHycGPdXGs+gYB8t1XCoaKoGayaMaJ/7NhnS3SOOCNRZPYFU1tYhObBVAWrtnOuszp1k4wn+psazjgZdxZ+lWC77cnmMzRBADQyu/oG9vbrnekSSOGymJiebiM/gOZDCOUxXg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=sTLExpfe8BKtlde2hCDqnvDhZqNL18RVBvy00mX4RKY=; b=c4WHd34AtmpLLh/7tUv0yEjkp/C9skf7cvG39MC0L21SiPEnRi4qgOLhAkqUtwplwyHcxUVfLzT3FcLuSiMiPFD2P7cQsjGdwupsOvYJkaRDUGCQSY2bKCWkuwTME5I6o55yG//yDUghsvRQKdlYOAwuoxaEiqwjbfb0lIUx148fbAocz1i6Hsif8SM4Bms7eVqLhJxp1r8UN9nhEy4B7/vQu6qqE75XPTaBGKzNSNQea0wV3BqMSd1FxdGj+dnWm32GkHznoGj3a3OSWxj8EXrAeoq1iNaMAB0/fK06YdGhh1aZkKv7x0/TxS952rKlGQxNUsmPOXw/PORLIj6n6Q== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=inett.de; dmarc=pass action=none header.from=inett.de; dkim=pass header.d=inett.de; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=inettGmbH.onmicrosoft.com; s=selector2-inettGmbH-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=sTLExpfe8BKtlde2hCDqnvDhZqNL18RVBvy00mX4RKY=; b=14HqmsL4AY0++wsG/e9Sg9BFeUXem60E264PrwD7RL1SSV/VWXi/+x/zc7tlHKJCw1AEID4Aw61YNvUF979vUI/EGPp3OHcvdCerw0QtBzVTtQ/S+36Jt7oiC37U9xnLe2dIXkieufJh6Mun5RY0Fj/V4yNolWOV0CdUWlGEyjU= Received: from DB7PR05MB5607.eurprd05.prod.outlook.com (2603:10a6:10:53::22) by DB7PR05MB5445.eurprd05.prod.outlook.com (2603:10a6:10:57::22) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3999.27; Thu, 8 Apr 2021 12:14:02 +0000 Received: from DB7PR05MB5607.eurprd05.prod.outlook.com ([fe80::1cf3:6380:fd8f:88f8]) by DB7PR05MB5607.eurprd05.prod.outlook.com ([fe80::1cf3:6380:fd8f:88f8%4]) with mapi id 15.20.3999.032; Thu, 8 Apr 2021 12:14:02 +0000 From: Marco Gabriel - inett GmbH To: "pbs-devel@lists.proxmox.com" Thread-Topic: Status of Garbage Collection marks in memory (not atime based) Thread-Index: AQHXLG4+gl/LSN1La0Wlj3LJ5P5+fQ== Date: Thu, 8 Apr 2021 12:14:02 +0000 Message-ID: Accept-Language: de-DE, en-US Content-Language: de-DE X-MS-Has-Attach: X-MS-TNEF-Correlator: Authentication-Results-Original: lists.proxmox.com; dkim=none (message not signed) header.d=none;lists.proxmox.com; dmarc=none action=none header.from=inett.de; x-originating-ip: [77.204.97.43] x-ms-publictraffictype: Email X-MS-Office365-Filtering-Correlation-Id: 8826f312-b26f-4a64-96dc-08d8fa87cd49 x-ms-traffictypediagnostic: DB7PR05MB5445:|AM9PR05MB8385: X-Microsoft-Antispam-PRVS: x-ms-oob-tlc-oobclassifiers: OLM:2512;OLM:2512; X-MS-Exchange-SenderADCheck: 1 X-Microsoft-Antispam-Untrusted: BCL:0; X-Microsoft-Antispam-Message-Info-Original: ozVBLlTFA3eiCnzsYIYEdpjGQbdqj4KZ9CsHDpW+YgAZ6guutNRUiINlsvFynLAko3yv2rDGe1386/x+QwLYtS4bE/xAinIF8IGn6/x8fvEIpE+AtZSTd8sRzXZEhI8LOzctZtQDFV//Au9/DhSqDhrGXatwyDtT3XEIQC46BlL2IWwc/HnlSvIfqO04YYkkQCPnmNVSh5imYaAYq/tZpry6hBL4dxwpbrZVWqMW6Yqfq0ruXuHxzljYZMHLtSDLvTsiqmANJ2visnU9TNOyIRPixOcBWnHIuFq2mWT0pTDFJqX45k+2kwEbnnYegYe2/4/nSL/9p/+a5jNVrzvTkCTQBmsur+QTxh3PIhb2UrrWC67AZrihsmSjE1N5TdkptwNqWZ/shkvBPnfBxDuFj9YEtKXkJorAEJrjkt1T3QdXXhmOqRioubzUVqxy0BR6gQ/YBlHQAWa1nKa4xklUDygza7YzsJm23t9y2qsA7MsSc0PFsDTlV/S//9ThG7uLN6Wd0zaAOMkrOHMiYi157x7hmCARk5y0A19XmPFJSZQbmykJ1iJ5Z6X8Y5sH8XOcMkNasBpOUFre1ytaCmkiX0ezNoOEr3niMYBGpQ8L+dSnGqgYdtA9nBQVQPcaMkBfOjbMT383zCRGdoA1bpfqtKyMX0as/QwytxfPfH4jYpH9j5Xo3uiZEVuYJGyDyxv/lx4pgZlvcx5qihwFfDueh8yVGzCaW44NhStru2LisEAsznAb7mtRhOG834YyMGsZ X-Forefront-Antispam-Report-Untrusted: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:DB7PR05MB5607.eurprd05.prod.outlook.com; PTR:; CAT:NONE; SFS:(366004)(376002)(396003)(346002)(136003)(39830400003)(8676002)(64756008)(166002)(7696005)(5660300002)(55016002)(19627405001)(33656002)(66446008)(66556008)(6506007)(66946007)(6916009)(86362001)(71200400001)(966005)(2906002)(8936002)(186003)(76116006)(91956017)(4744005)(83380400001)(316002)(26005)(52536014)(9686003)(38100700001)(66476007)(478600001); DIR:OUT; SFP:1101; x-ms-exchange-antispam-messagedata: =?iso-8859-1?Q?aNkm+UyD0w4LKHkn5WrBII5Ci+yyR8OV9dHwO8+wXcoW7sHLkYhSZNJj2S?= =?iso-8859-1?Q?PHcsTe6F0fVBehX4615MyAF/Zz0VuFwXw/eUaq7aFd8uUw/9s5mKBFhdma?= =?iso-8859-1?Q?x/pSR0fXM29pSyKiLZZriItzBgUFUsorDEk+3VB7RPUnK/dqJApy0qtI0S?= =?iso-8859-1?Q?9z0Wix/3xMyPcC7Xgf0li5GreZS3h5P6OM3SxUUjpQyWAbTGWLQMnGYG6E?= =?iso-8859-1?Q?hYMWwriaiKL3VAaqsVnIk/8x0S7Q/4uDL10hv6cYJaouxF7NYGA8LioaJd?= =?iso-8859-1?Q?Skki1Gko5LZFkbFSSxSoJ5rD4w4kKitt1Uoezx2x/X9dr8ORoZ3+fOFktk?= =?iso-8859-1?Q?+t9E8nKmLGDNFgYuaIuepi1lpcXkQEtYVg1fDxcnCenYrYcktdojOzInVL?= =?iso-8859-1?Q?RCIrzznwSqbvmAX3+VFZLuf2QjCo0qXAUsuSH23cuCDH5A1SuQCS7gtCu2?= =?iso-8859-1?Q?YKwQgRA72ydPSc7oeNoS7+Wald+tjAVwWcD0GnidxS6H7CKh4giE1NlEbA?= =?iso-8859-1?Q?4TMFeiiU4T/wehPwRtrambS2IgviWQ0vEKjCr/1qWiJzFPbcS5EtOBLw98?= =?iso-8859-1?Q?oTqHI7VycIjFGxprXkt67BSZ9fb0ECiMMg3Re4hAyJsXIKFUbedAvq8Yf3?= =?iso-8859-1?Q?fSk1kRlFWQppj8cFod3FUyLBGTx6hfD9bEcrSJDyzm0PkRTahxTiaaXOW6?= =?iso-8859-1?Q?YYJ8Ozn6rDqjpT7n+PrpeLbxGVZ23MovXUajFPpumuKlOt8Hz+YANhDK0u?= =?iso-8859-1?Q?fQWlEypjIM54qpMhWqqWMW5KuQEA6ISHG/JEmbCKH5rebJK9F5MR5r9SuS?= =?iso-8859-1?Q?LaG0kJQc/lUEbacqbLzlsTH9RygBbuGdIKoxb9b6NBXm3n+tnakRhdUDUo?= =?iso-8859-1?Q?il5m1VYkYSjbQboMS6vUL/TIUHlAGV9WMGJXyHSVHLHfRLEv/htky92gOR?= =?iso-8859-1?Q?arPQ0Pw+bMUA1+df8E0p08Cammqk74RUZ1Mi8W6YE0aa3e4rGvIMFWmvVi?= =?iso-8859-1?Q?7NcALckYXMKzAr7YIQdDqfu/pflVKMNqCNKiUqg0g2ack25KKY8yF/W+4v?= =?iso-8859-1?Q?VvvyFE+ropzJ6dqO5y4C980R8XhCEByEw7WzXOjSyWyFS6KkgQDrmomITN?= =?iso-8859-1?Q?2rn6DJIwLPKG9YUttTtZ3MocHI8wiMNUsqvElMe5jka3Zf+JSumOsZTjfN?= =?iso-8859-1?Q?qPMf9M5DvkNrTELloNuC+CyhhK52VZ2XuVfsPOsaxT9nGwC0Rm5EjRWr/P?= =?iso-8859-1?Q?Mj9dCZLj6pIxpQi356hQM+BzJMLaQohw75jvoLagBqS9FYPYSw1w1ILgTK?= =?iso-8859-1?Q?g0TW8q7Tj2EYmOdL2hwLXoOnt2UxfCQyP7Zny5UwdufeBl8=3D?= x-ms-exchange-transport-forked: True Content-Type: multipart/alternative; boundary="_000_DB7PR05MB560757B22B65219E974E7482AC749DB7PR05MB5607eurp_" MIME-Version: 1.0 X-MS-Exchange-Transport-CrossTenantHeadersStamped: DB7PR05MB5445 X-CodeTwo-MessageID: 6ef38b10-2da8-444e-a27a-3450845bb2ab.20210408121403@westeu13-emailsignatures-cloud.codetwo.com X-CodeTwoProcessed: true X-EOPAttributedMessage: 0 X-MS-Exchange-Transport-CrossTenantHeadersStripped: DB5EUR03FT023.eop-EUR03.prod.protection.outlook.com X-MS-Office365-Filtering-Correlation-Id-Prvs: 73582dd8-b6ec-4437-7416-08d8fa87cc3c X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: +fBpQBYge3VBYnt4P0lcUKs6d0ow1/6iZmJtk5hmhUwUb8lNIZQVzuQQkgMqCRcBO5kZAcWqhIJQXNJjex00bI24ywEmDc2zXmXacnl+/4+B8qqU5JGjGDw+odZ+TxkMMrnYmMudaeQEt+mVANUcCWGEbfWc0gq5pFhRZ0yhloCYrigRbaYqlJ9YO/DjkepK0zgl09F6aSvFWRM1DSStWoPcvyFd3hPnm+IvUFtPima8pwy7v5HyzD4Gq4Iv8ap8I2BFo96upJAasaojdAN/j1oofsrM9qhNex5zuGW7y6GmAYpcBbp6f0IfVW+3auQoCVVe4ABvc1b2DJVgtGmDLVNV2LSC9WXXRBZnvVm+dNLeSy1ezrnrEYwRham+vP0XWX+BrxkUmatfqNN52psKqOyu81qxAhMSQzTXB31vVyWgWsZm/mVPEhaNm3V9oCnu2VEvb/b0/3r9mA8nrUYlKVIBiNJvltqdpLAIk/nEa/e7GCP4aCbGm8nKJo7oJD5jG/V/TVWYp00QWUEl8EiqOijb1WxrP10QOHP59RSaZHaAZ3G7MKPQ2hwAse2VZ3uKcp5qkAsuiwQxGJZHbcFAR/jcoCBoHADkBsC2zSKtpgxhUAHjyUStl0kCyAfYxuuRsylVNgPOyFrU+tUkXNID1/UdXmPwEafSEvEvF87SrW4lWdC/BonGd2sft0ogpSCwWl319kT+ip/4HOJ8HBuDvCvh5h3FzMoN1/NWL9csvU8= X-Forefront-Antispam-Report: CIP:13.81.10.179; CTRY:NL; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:westeu13-emailsignatures-cloud.codetwo.com; PTR:westeu13-emailsignatures-cloud.codetwo.com; CAT:NONE; SFS:(346002)(376002)(39830400003)(396003)(136003)(46966006)(36840700001)(166002)(82310400003)(83380400001)(70206006)(86362001)(336012)(6506007)(33656002)(966005)(7696005)(52536014)(70586007)(8936002)(8676002)(478600001)(47076005)(19627405001)(6916009)(26005)(9686003)(36860700001)(356005)(186003)(2906002)(7596003)(316002)(7636003)(55016002)(5660300002); DIR:OUT; SFP:1101; X-OriginatorOrg: inett.de X-MS-Exchange-CrossTenant-OriginalArrivalTime: 08 Apr 2021 12:14:04.4176 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: 8826f312-b26f-4a64-96dc-08d8fa87cd49 X-MS-Exchange-CrossTenant-Id: fbb4c88a-8c06-44c8-b416-5376f93313e0 X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=fbb4c88a-8c06-44c8-b416-5376f93313e0; Ip=[13.81.10.179]; Helo=[westeu13-emailsignatures-cloud.codetwo.com] X-MS-Exchange-CrossTenant-AuthSource: DB5EUR03FT023.eop-EUR03.prod.protection.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Anonymous X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: AM9PR05MB8385 X-SPAM-LEVEL: Spam detection results: 0 DKIM_SIGNED 0.1 Message has a DKIM or DK signature, not necessarily valid DKIM_VALID -0.1 Message has at least one valid DKIM or DK signature HTML_MESSAGE 0.001 HTML included in message SPF_HELO_PASS -0.001 SPF: HELO matches SPF record SPF_PASS -0.001 SPF: sender matches SPF record URIBL_BLOCKED 0.001 ADMINISTRATOR NOTICE: The query to URIBL was blocked. See http://wiki.apache.org/spamassassin/DnsBlocklists#dnsbl-block for more information. [inettgmbh.onmicrosoft.com, proxmox.com] X-Mailman-Approved-At: Fri, 09 Apr 2021 09:59:33 +0200 Subject: [pbs-devel] Status of Garbage Collection marks in memory (not atime based) X-BeenThere: pbs-devel@lists.proxmox.com X-Mailman-Version: 2.1.29 Precedence: list List-Id: Proxmox Backup Server development discussion List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 08 Apr 2021 12:14:13 -0000 --_000_DB7PR05MB560757B22B65219E974E7482AC749DB7PR05MB5607eurp_ Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable Hi, on https://git.proxmox.com/?p=3Dproxmox-backup.git;a=3Dblob;f=3Dsrc/backup.= rs;h=3Dcca438818b49724e10594ae2e12302f5fbf021df;hb=3DHEAD I saw, that besid= es the currently implemented atime based garbage collection approach, anoth= er approach using hashes in memory is under investigation. I couldn't find any references besides the lines under that link. Is this i= nvestigation still ongoing? Is there any publicly available source? We use a CephFS as datastore in our test environment and this is rather slo= w because of the metadata updates. The in-memory based approach could possi= bly make a huge difference for CephFS based datastores. Thanks, Marco --_000_DB7PR05MB560757B22B65219E974E7482AC749DB7PR05MB5607eurp_ Content-Type: text/html; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable
Hi,

on https://git.proxmox.com/?p=3Dproxmox-backup.git;a=3Dblob;f=3Dsrc/backup.rs;= h=3Dcca438818b49724e10594ae2e12302f5fbf021df;hb=3DHEAD I saw, that besi= des the currently implemented atime based garbage collection approach, anot= her approach using hashes in memory is under investigation.

I couldn't find any references besides the lines under that link. Is this i= nvestigation still ongoing? Is there any publicly available source?

We use a CephFS as datastore in our test environment and this is rather slo= w because of the metadata updates. The in-memory based approach could possi= bly make a huge difference for CephFS based datastores.

Thanks,
Marco


= --_000_DB7PR05MB560757B22B65219E974E7482AC749DB7PR05MB5607eurp_--