From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from firstgate.proxmox.com (firstgate.proxmox.com [212.224.123.68]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits)) (No client certificate requested) by lists.proxmox.com (Postfix) with ESMTPS id 2524970DA0 for ; Tue, 6 Apr 2021 09:42:11 +0200 (CEST) Received: from firstgate.proxmox.com (localhost [127.0.0.1]) by firstgate.proxmox.com (Proxmox) with ESMTP id 11A3A2A842 for ; Tue, 6 Apr 2021 09:41:41 +0200 (CEST) Received: from EUR05-VI1-obe.outbound.protection.outlook.com (mail-vi1eur05on20621.outbound.protection.outlook.com [IPv6:2a01:111:f400:7d00::621]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by firstgate.proxmox.com (Proxmox) with ESMTPS id 811792A835 for ; Tue, 6 Apr 2021 09:41:40 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=inettGmbH.onmicrosoft.com; s=selector2-inettGmbH-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=E7I0C1KWN7xEP+rJONsdi3xZyimATuPuQJ/EPspzggI=; b=v12Cd9Jj9xKIr4xooJesW8r4A0tHo6scYqGl+Mpbdlssu0K3jATWCe3VGwQJLU0EMMG5d7VlbUfYa7AaHda+C435cROD98lgbLc7kzkXHFkSSBN2xlieBJP91briVqjwKFOKgHOrQg55huhWvTS4KEjIqE6X81oGzbPAtnIl8Cg= Received: from DB6PR0501CA0029.eurprd05.prod.outlook.com (2603:10a6:4:67::15) by AM0PR05MB4770.eurprd05.prod.outlook.com (2603:10a6:208:b8::20) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3999.28; Tue, 6 Apr 2021 07:41:32 +0000 Received: from DB5EUR03FT026.eop-EUR03.prod.protection.outlook.com (2603:10a6:4:67:cafe::b6) by DB6PR0501CA0029.outlook.office365.com (2603:10a6:4:67::15) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3999.28 via Frontend Transport; Tue, 6 Apr 2021 07:41:32 +0000 X-MS-Exchange-Authentication-Results: spf=pass (sender IP is 13.81.10.179) smtp.mailfrom=inett.de; lists.proxmox.com; dkim=pass (signature was verified) header.d=inettGmbH.onmicrosoft.com;lists.proxmox.com; dmarc=bestguesspass action=none header.from=inett.de; Received-SPF: Pass (protection.outlook.com: domain of inett.de designates 13.81.10.179 as permitted sender) receiver=protection.outlook.com; client-ip=13.81.10.179; helo=westeu13-emailsignatures-cloud.codetwo.com; Received: from westeu13-emailsignatures-cloud.codetwo.com (13.81.10.179) by DB5EUR03FT026.mail.protection.outlook.com (10.152.20.159) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3999.29 via Frontend Transport; Tue, 6 Apr 2021 07:41:32 +0000 Received: from EUR04-DB3-obe.outbound.protection.outlook.com (104.47.12.51) by westeu13-emailsignatures-cloud.codetwo.com with CodeTwo SMTP Server (TLS12) via SMTP; Tue, 06 Apr 2021 07:41:31 +0000 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=Szb52jJ74bkyfML4wpWHW7r5E+B+mD4QnK6TKAqwGEBS5CcWbXmoVP2uHdBRrc5TZfosmIuf6NAPQFkNZJyF42FccnE+4XgNuDrx8+K7mgjvDQLY+QNY7KeO631nlv/5smBEoWePNTEsIcjr7pjOygW93Y0nFyurJx1fiNciB6ofFc0ueKINJr//U68EB+ChLNxNZ0DvEueQbDak7UGWQ0QyUm2uIX3NHzih5dYpbZmpCHLxbvXYUW8oCZUpLpBkhOEJw65ugkr7Y5nPyGv9tk5yjZ2SDXRlJMXZM54hWQCEA+n4cfoLrtqfy5TpNimProDJhqm5McauiiCJHzRL7w== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=E7I0C1KWN7xEP+rJONsdi3xZyimATuPuQJ/EPspzggI=; b=bP3RI+2Jl3cKzp4GfDaWqP9X8ubDEW2jbUp3S6hJIUvYV7q/+uMnl7bxGjEyRWFqz4d7ld4gg1V+f+5kM3QgFdNvRK1Ts0S/MG+yEwQP9offZkh5kidbu6zyiBGMsUlDT0UPs7Cgxdve+jKY4MgFbAeG2jIV5I/Q9uSAQynFfPqoWPHevWB3tbnGK0KTxPeHt3HglhZjqlTjHJx60cwtfUWT/FzS3TOgIxbFw03LuZ7ZqWFx2kohGvCvtMx0lL9HqQOIDy4YhXG6xpzuAQMOc3ULLkZwTwoisHlq7RqH9retID4V2ZNr3AoA07fdpMqvgWZItuXjT+wvfo1nJwQvCQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=inett.de; dmarc=pass action=none header.from=inett.de; dkim=pass header.d=inett.de; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=inettGmbH.onmicrosoft.com; s=selector2-inettGmbH-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=E7I0C1KWN7xEP+rJONsdi3xZyimATuPuQJ/EPspzggI=; b=v12Cd9Jj9xKIr4xooJesW8r4A0tHo6scYqGl+Mpbdlssu0K3jATWCe3VGwQJLU0EMMG5d7VlbUfYa7AaHda+C435cROD98lgbLc7kzkXHFkSSBN2xlieBJP91briVqjwKFOKgHOrQg55huhWvTS4KEjIqE6X81oGzbPAtnIl8Cg= Authentication-Results-Original: lists.proxmox.com; dkim=none (message not signed) header.d=none;lists.proxmox.com; dmarc=none action=none header.from=inett.de; Received: from AM0PR05MB5764.eurprd05.prod.outlook.com (2603:10a6:208:11c::31) by AM0PR05MB4835.eurprd05.prod.outlook.com (2603:10a6:208:cc::22) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3999.26; Tue, 6 Apr 2021 07:41:30 +0000 Received: from AM0PR05MB5764.eurprd05.prod.outlook.com ([fe80::9813:2048:5cc2:c844]) by AM0PR05MB5764.eurprd05.prod.outlook.com ([fe80::9813:2048:5cc2:c844%3]) with mapi id 15.20.3999.032; Tue, 6 Apr 2021 07:41:30 +0000 Date: Tue, 6 Apr 2021 09:41:26 +0200 From: Maximilian Hill To: Proxmox VE user list Message-ID: References: <7e9d1358dcb12b288e884547553e39b4@konsec.com> Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="rtpKBBePSRxmUA2z" Content-Disposition: inline In-Reply-To: <7e9d1358dcb12b288e884547553e39b4@konsec.com> User-Agent: Mutt/2.0.6 (98f8cb83) (2021-03-06) X-Originating-IP: [217.7.208.212] X-ClientProxiedBy: PR3P191CA0044.EURP191.PROD.OUTLOOK.COM (2603:10a6:102:55::19) To AM0PR05MB5764.eurprd05.prod.outlook.com (2603:10a6:208:11c::31) MIME-Version: 1.0 X-MS-Exchange-MessageSentRepresentingType: 1 Received: from inett.de (217.7.208.212) by PR3P191CA0044.EURP191.PROD.OUTLOOK.COM (2603:10a6:102:55::19) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3999.27 via Frontend Transport; Tue, 6 Apr 2021 07:41:28 +0000 X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: ae9f9ec3-13ad-49fe-546f-08d8f8cf65dc X-MS-TrafficTypeDiagnostic: AM0PR05MB4835:|AM0PR05MB4770: X-Microsoft-Antispam-PRVS: X-MS-Oob-TLC-OOBClassifiers: OLM:4125;OLM:4125; X-MS-Exchange-SenderADCheck: 1 X-Microsoft-Antispam-Untrusted: BCL:0; X-Microsoft-Antispam-Message-Info-Original: sqI2775f96645nBoIeY4vNsNbE7E/QlpYJ1OGS3M/zjvAY3e1dYcZ0JqqSSvS7eGy9AZfH3kUpSCLSAu49as/IkfoXA6CDE3bCjuABURQp0yxT1UTj3X5yiRdyq5ZvqcS2GFgGu9lGwVvL7AbSHG9QF6DzIgwujD8ufxLZ5iknXBQw8TFxr8q8QWjCm9+zkEzFkWxV+x6h+yZ1QCrPKZWVHD7UwMTqZGjb6YZ9yeYWz26xwm2M55U+LdIX/djxEMPT/s3pr4dBCAXNIPFNcGEZbhTEqmOb+khKeM9NOJ7HgLqS6QiAHRx+60FUa7RMqKZ1BaFargyqHfX5ZCt+moHVHkcDoGqpXe0TTkEEwR4svr6++jc8yxJ1mLnPSX5KR8BHk1svdrd/5eKL2j1JiLiYtVUit1aWAhgBVSkwOTAseVUnS2iUpIaeCu5HuSmo67Gxvhgg78O02CEDdeU/lwC/ZRKsAFyGND7wGr4UJG302ZiBDhjWm0jbm2URwT2REdlYgofgEpVul3SfWUA3T2OwffA3meseTEABP8EE5wwFOcg7zp0JphAOIJEM0XzbUu6Lb5rhPa1K7VidQeK2KRp195R/udS5Q4T3ACLwMrEwDTrCrR4OFjknnZ6/ExWrDJAA6H1ywPlyl1ADJYW1ISSSRp0YcOIogrW5O62FFCFdR1QOBEkYAyF47hx1VVBXYz0QFD3Op6eQ5GKWNCtR0ccw== X-Forefront-Antispam-Report-Untrusted: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:AM0PR05MB5764.eurprd05.prod.outlook.com; PTR:; CAT:NONE; SFS:(346002)(136003)(396003)(366004)(39830400003)(376002)(8936002)(26005)(8676002)(8886007)(2616005)(86362001)(38350700001)(316002)(36756003)(956004)(21480400003)(44144004)(186003)(6916009)(16526019)(7696005)(66556008)(66476007)(55016002)(52116002)(478600001)(38100700001)(2906002)(5660300002)(66946007)(2700100001); DIR:OUT; SFP:1101; X-MS-Exchange-AntiSpam-MessageData: =?us-ascii?Q?kVTreaheMZW/VZ00WJnzwfPoMBxonZcqNI8s2awwVP2uS8D59mM36rmYHa8u?= =?us-ascii?Q?3WfvqlZyL4ys5rEDCPhDvipJRb7APqJEOrDAAvrusapmYliqzzKTUtHu/Hw/?= =?us-ascii?Q?DRbuWeqdPKC7WKhZw6/gk1H9UXSitHImWp19Nb3Ltsmeci7icBnmSjCoerlm?= =?us-ascii?Q?6aLRAATRkKBGbKgSX++XfHbsYa4eDvAdijeFDxiyr4z+zFQJhIHoHCmIBxSQ?= =?us-ascii?Q?UZ/qtz6z96qUCv+p/y8D0FPcMP3c88MuydjVF98eqkEHfWxI2KBUXsPeohx0?= =?us-ascii?Q?dKNaJ6SAtW9kc+/cK4jFGY7jI0KejgB/l6eKdfms0FU7d3OaTDUDmtvC0Aw9?= =?us-ascii?Q?r6bBY2XOtiekN8e9uGrCqMwCm6v5wAOCENubNo/qOBU3E2tHc83FsdesSO0h?= =?us-ascii?Q?JGh8N0t9Ab502EytEGwP7UMOCZTgBXwQLL7lH4mSD4qIc11YOJARta4kAjOc?= =?us-ascii?Q?pfeslyEY/QQOTohrI5kDXiZ7svlT4cEgRYEqBUOUNgTvAcwvKsbrI0550kxF?= =?us-ascii?Q?SmRYjPly8F3Dz5y4CixaOyxSZMZwsauaxVhWePnwa9NPlePeMxjKusdbHOnb?= =?us-ascii?Q?vAdRLw7CZxnn/mXjSHb7RIZhtSITdBlr/UtwW8wqqaaoytDrUmRzWTc2bX9c?= =?us-ascii?Q?V+wz8GNdAWaKgKCtXfawGwLPF8EaJBPxjX01o1o0Oreny2cMH74Hii/5J6xl?= =?us-ascii?Q?lonSxxbwvpzKNthld0/XjqUz6/lDJbCCZF+s/nEY5NAtlZ6HJ8v5Z2HNadfT?= =?us-ascii?Q?tk0dI+1lIz2Rc1E1nWEtCfeG5ihxn4/TZG2MP219ogmz/BGzfLphrMdprkBv?= =?us-ascii?Q?1KYj9aVIDPD6dSH8Nm4xALgwGbIGNkdAlqtaUBcmIs6+Bc5ZgJse0neLWS6m?= =?us-ascii?Q?GpDgr0xNYecyohUvdxE200cMxrQtP2ZlDFybfiG9xVCrgs7JXZoav6o5Y0/L?= =?us-ascii?Q?54mfbJBMUxTqHWY77xtNtqthgAm2mgr2HqDTWivjy7n0UKLVgmtPW3oMv+Q5?= =?us-ascii?Q?2gEfTtkNhoQuyb+q0QTkBkKkT2UYR0YSiDpUYyfAhDUSs9nhDkY2w3G6U/Ye?= =?us-ascii?Q?t8ulF1fI1ZjvxYcxffhiByFThbarfoKIiqgsiBVKFTZ7TKv+nfh8deC91Ifx?= =?us-ascii?Q?rxbxEhw6B9MRR0xsIe8stBvKW3szGlnUoy/9gItPXkYHxBxLafhJNk26aoMx?= =?us-ascii?Q?F9VlGLuqs7V117yvvjlRZK+8Tzl6mDHl9hdwdUYm/+ZuKPiC3Fv6rStgjAIG?= =?us-ascii?Q?S14BJpNQLY0y4gilqfsyQAKpxXJFVB5ytLj3aHoKkPGUlUq97wB5lLpefYiL?= =?us-ascii?Q?vfkR8opPJaMhWUguSifalrs1?= X-MS-Exchange-Transport-CrossTenantHeadersStamped: AM0PR05MB4835 X-CodeTwo-MessageID: 007c075d-1329-4e84-a140-d5b517c3c115.20210406074131@westeu13-emailsignatures-cloud.codetwo.com X-CodeTwoProcessed: true X-EOPAttributedMessage: 0 X-MS-Exchange-Transport-CrossTenantHeadersStripped: DB5EUR03FT026.eop-EUR03.prod.protection.outlook.com X-MS-Office365-Filtering-Correlation-Id-Prvs: c8ee7a71-d297-4046-9f1b-08d8f8cf639c X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: QROzorc564bMq1rMtzsEXwgxLunYhjaICgYrdmonMxBBq53FAFwv8nhmJw7MlTGMEDj+QQUdVS4amEVLPEw52ocLABGjSQyPpsBVbTxpCDt06L/N8FPvfHXdNcEwKgFP4/wGHzrJ4OvjtsMRp9TjN+g0owPffmmJhjFPK0fVJac8XwMf9jnIfeetjvOGjQ9nfK/VUS1lQ4R/TGH+KPuxdaG22Pew716CcPqDeLN8FTgdJbnRnRIsRvWqNlGPiJA/k55PPE/WmHzP9KKhm8YYDhsDHy0squg2EaNqC1Odm46HELdFO2p6o+LiZm05DWMAhpFQHI36taV2jK4OUhaCJsuzexMlsnRCeC/NJt1bGgvO9rxuqZaU4ZtBZiUUfARTe1d5VfqA6N2OpEVjiU0+R8E6WfIWMgS4LvwGzSLAZ9OaK2TL7eo/D1VFS+BfYHVCguCVbEF1J2AEsCFZVjfmiWMsRVu4Zvfp9bq3RrvQsunLx682+WyvSM/7j51LcR93pjv48uRW2bYtHz6psH9hCOWn4JOXAM6Lz9p+EBQh3YrL7CjfNOZi9V+S1XzUB9OlptkIKmHuoLq/lw3vdjxSAZjIQQsgO/NUiBXcVUNUh0QaCbFfABICSDvy5FxR1KFBZFoFzwRAjjKGEeJSq83hdWM+E/3pxn5EBWfGs/HtQCpi0pIdLn8hLxdFokF9F5DS X-Forefront-Antispam-Report: CIP:13.81.10.179; CTRY:NL; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:westeu13-emailsignatures-cloud.codetwo.com; PTR:westeu13-emailsignatures-cloud.codetwo.com; CAT:NONE; SFS:(376002)(346002)(396003)(136003)(39830400003)(46966006)(36840700001)(36756003)(36860700001)(70586007)(26005)(55016002)(2906002)(7636003)(7596003)(356005)(6916009)(336012)(7696005)(16526019)(186003)(316002)(44144004)(2616005)(70206006)(21480400003)(8936002)(956004)(8886007)(82310400003)(8676002)(47076005)(5660300002)(478600001)(86362001)(2700100001); DIR:OUT; SFP:1101; X-OriginatorOrg: inett.de X-MS-Exchange-CrossTenant-OriginalArrivalTime: 06 Apr 2021 07:41:32.3372 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: ae9f9ec3-13ad-49fe-546f-08d8f8cf65dc X-MS-Exchange-CrossTenant-Id: fbb4c88a-8c06-44c8-b416-5376f93313e0 X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=fbb4c88a-8c06-44c8-b416-5376f93313e0; Ip=[13.81.10.179]; Helo=[westeu13-emailsignatures-cloud.codetwo.com] X-MS-Exchange-CrossTenant-AuthSource: DB5EUR03FT026.eop-EUR03.prod.protection.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Anonymous X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: AM0PR05MB4770 X-SPAM-LEVEL: Spam detection results: 0 DKIM_SIGNED 0.1 Message has a DKIM or DK signature, not necessarily valid DKIM_VALID -0.1 Message has at least one valid DKIM or DK signature MSGID_FROM_MTA_HEADER 0.001 Message-Id was added by a relay RCVD_IN_DNSWL_NONE -0.0001 Sender listed at https://www.dnswl.org/, no trust SPF_HELO_PASS -0.001 SPF: HELO matches SPF record SPF_PASS -0.001 SPF: sender matches SPF record Subject: Re: [PVE-User] ZFS Disk Usage unexpected high X-BeenThere: pve-user@lists.proxmox.com X-Mailman-Version: 2.1.29 Precedence: list List-Id: Proxmox VE user list List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 06 Apr 2021 07:42:11 -0000 --rtpKBBePSRxmUA2z Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Hi, I got the same issue with different RAID-Z setups lately. We worked around it, but I don't want to go into detail abaout that before I know. why that happened. Regards Maximilian Hill On Mon, Apr 05, 2021 at 10:22:56AM +0200, Konold, Martin wrote: >=20 > Hi, >=20 > I set up a single VM which currently used 15TB of data. > /dev/sdb is technically a ZFS volume on the Proxmox Host. >=20 > [root@vm ~]# df -h /data > Filesystem Size Used Avail Use% Mounted on > /dev/sdb 40T 15T 25T 37% /data > [root@vm ~]# du -s /data/ > 14874345100 /data/ >=20 > [root@host /]# zfs list zfs01/PVE-BE/vm-1-disk-1 > NAME USED AVAIL REFER MOUNTPOINT > zfs01/PVE-BE/vm-1-disk-1 31.5T 5.82T 31.5T - >=20 > Why is the usage on the host about twice as large as within the vm? > (Yes, I have given fstrim and discard a try). >=20 > --=20 > Regards > ppa. Martin Konold --rtpKBBePSRxmUA2z Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAEBCAAdFiEEC4+nzzlDLVCczVokaOY/9WPFgE8FAmBsEKYACgkQaOY/9WPF gE9MrQ/8CqlitHisYOVyhI9s2uwdJxxKxWLBfHA1+m7OSjbtO0ycjupGmvUedFZZ RivUXOXbI2CGig2LKVTE/p+xL2TUK2hALIxKK+eyWRIuRpVNQ1Bdi8acQID79vQV mz/OfxIOA6eSJ40GarS4AGfIEBA7b1nGj1cadObJH3wioTg/g+uuPVKtOZOJ6DQv pT5Qiv8yNEBNBw0m0oZXYm4OzpC/KLtVpTymVBq4tejnHqTvNe50HOFJeqLRjI/e NZqF1J8GL/yLp5kLTIaWRE+BtV5Db6TOAHSq+pstlWSEpUnmZkKxiu+eqYpD2bwl pj7ZvbsERkmPewATlZiRKYkWRW0DEYI4jGclf7/G8HDIlfy3BuSFr3nCDVVcY88q CuByDUA6S4kMKP+7RCawsyVa1maftC+K0SjI+os1DaGtc4AAjRW7DJ130801wk2L UayVnKxH7bqDuklAAdHoFb08tUXTEVSd2qI9rzoAm8BVm2l7u4MTMUOR92Mx0dr7 Wg73bwZ8Gp3Sn7+jmIa5LtxfT51AnmYcEA1QJk7BcByIiUyPPaNiND1yY2GxmXQR MgVp2t04xt0HL4fzZQNzQh0yl2nphvSKOnCF62g5L0MMQMwu/xRlbgYTRVxTmmuZ 8FoPflEsIDMy4ByHPLj+letOW7RDyGS8HS4qeTsYjqzCxP2PyU8= =MKTK -----END PGP SIGNATURE----- --rtpKBBePSRxmUA2z--