From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from firstgate.proxmox.com (firstgate.proxmox.com [212.224.123.68]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits)) (No client certificate requested) by lists.proxmox.com (Postfix) with ESMTPS id D58AF70A56 for ; Mon, 5 Apr 2021 11:55:29 +0200 (CEST) Received: from firstgate.proxmox.com (localhost [127.0.0.1]) by firstgate.proxmox.com (Proxmox) with ESMTP id C0B2A226A6 for ; Mon, 5 Apr 2021 11:54:59 +0200 (CEST) Received: from mail-yb1-xb31.google.com (mail-yb1-xb31.google.com [IPv6:2607:f8b0:4864:20::b31]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by firstgate.proxmox.com (Proxmox) with ESMTPS id CC5FA22691 for ; Mon, 5 Apr 2021 11:54:58 +0200 (CEST) Received: by mail-yb1-xb31.google.com with SMTP id l187so5768688ybl.4 for ; Mon, 05 Apr 2021 02:54:58 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to; bh=RFsxTPPMyZ4b+7QKUj51HceHmRP351ROruSFZ7nppY8=; b=kIb7zVsWFFIpcahdgJnapyjAGCAfn9dcYV7ZRqiQfs1rGEfCYjdLr1EmUFAAGUrDVq XzEr4HFkwNGAQ1QB0rk5KWj7DdFBvImFmMSS43hyCqrtC2fAKWVTd/reNSFZvvITmCh8 dvRJfQ3bTRONQIISALgsMxTzK1He/cd6VBaVxEOhbd7XB59izcRS+22P/2x5OLiIfwOn 4LlYkH2hSpXh9bBTyyczddpw+oSN1k0Jl5+s4x0L5L4KQF0IiBvSCcGVwRBnrxnBZqFh aHYQr0mWJ42DRNWnUABvtMB/C8o+Zn1ab6jr1MIzAOursdwmVfs4SKquYn1cZsY5SVCL +DFQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to; bh=RFsxTPPMyZ4b+7QKUj51HceHmRP351ROruSFZ7nppY8=; b=qUCnmwuZiManXu1ro77lfWZ82AsYBcd8ggz9NAcsZIVZnps87mgYAmmdfSWwd9RPkS l8n6V+hsvFfgqHL207dsTCbjXkPCrgrzw5gRb+8XQy5BoSSSSjS/9SwcLEelu5drbKnF PMTreRLJ8Cag0f8ZmeHkVs2ZV0mAFmxUCEJ0ZPF8XJqOVwFF4HirM50mWr58utlUfqDQ YdwSbIinHuMpa1T5Ols515GbObnPATTacWpi0U6qs1s1ofqToNytM7HuwmkzSlEeao++ n6CRh8gcxkj8xzbvQB6CYz5xTjaCBe9gxkwO4Rbj6g0LMrzkUqkjebjgynpmDSV6EUPT T27Q== X-Gm-Message-State: AOAM531Tj4ragwQXxird9bdziPP6MSIlGSFgNLhdaSfsWOi77ouoy8a2 XDq9I+1M5UVUzpGPwmpNZp9JymJftMZTzPqK4zvtpIF0pzQ= X-Google-Smtp-Source: ABdhPJypXfFzhyt2b9iBiTJN/kMd1Ctft68c62P+ZQNrmszz+esO/g2QRvgBvPzdSkBQxzCVxrZn1uimif1yWAAvbmI= X-Received: by 2002:a25:42d5:: with SMTP id p204mr37395454yba.469.1617616491219; Mon, 05 Apr 2021 02:54:51 -0700 (PDT) MIME-Version: 1.0 References: <7e9d1358dcb12b288e884547553e39b4@konsec.com> In-Reply-To: <7e9d1358dcb12b288e884547553e39b4@konsec.com> From: "Yanni M." Date: Mon, 5 Apr 2021 10:54:40 +0100 Message-ID: To: Proxmox VE user list X-SPAM-LEVEL: Spam detection results: 0 AWL 0.120 Adjusted score from AWL reputation of From: address DKIM_SIGNED 0.1 Message has a DKIM or DK signature, not necessarily valid DKIM_VALID -0.1 Message has at least one valid DKIM or DK signature DKIM_VALID_AU -0.1 Message has a valid DKIM or DK signature from author's domain DKIM_VALID_EF -0.1 Message has a valid DKIM or DK signature from envelope-from domain FREEMAIL_ENVFROM_END_DIGIT 0.25 Envelope-from freemail username ends in digit FREEMAIL_FROM 0.001 Sender email is commonly abused enduser mail provider HTML_MESSAGE 0.001 HTML included in message RCVD_IN_DNSWL_NONE -0.0001 Sender listed at https://www.dnswl.org/, no trust SPF_HELO_NONE 0.001 SPF: HELO does not publish an SPF Record SPF_PASS -0.001 SPF: sender matches SPF record Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.29 Subject: Re: [PVE-User] ZFS Disk Usage unexpected high X-BeenThere: pve-user@lists.proxmox.com X-Mailman-Version: 2.1.29 Precedence: list List-Id: Proxmox VE user list List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 05 Apr 2021 09:55:29 -0000 This is a common issue on raidz based pools. Assuming 4k sectors (ashift=3D12) and zvol with 8K volblocksize, each 8K (2-sector) block uses = a single sector (4k) of parity. So 15TB of 8KB blocks (default volblocksize=3D8k) takes up at least 22.5TB space on disk (including parity= ). You will use less parity by increasing the volblock size (e.g. volblocksize=3D32k, or the default recordsize=3D128k for filesystems) in exchange of a possible lower performance. Another solution would be using a pool of striped mirrors (RAID10). This problem does not exist in such pools (as there are no parity blocks used). On Mon, 5 Apr 2021 at 09:23, Konold, Martin wrote: > > Hi, > > I set up a single VM which currently used 15TB of data. > /dev/sdb is technically a ZFS volume on the Proxmox Host. > > [root@vm ~]# df -h /data > Filesystem Size Used Avail Use% Mounted on > /dev/sdb 40T 15T 25T 37% /data > [root@vm ~]# du -s /data/ > 14874345100 /data/ > > [root@host /]# zfs list zfs01/PVE-BE/vm-1-disk-1 > NAME USED AVAIL REFER MOUNTPOINT > zfs01/PVE-BE/vm-1-disk-1 31.5T 5.82T 31.5T - > > Why is the usage on the host about twice as large as within the vm? > (Yes, I have given fstrim and discard a try). > > -- > Regards > ppa. Martin Konold > > -- > Martin Konold - Prokurist, CTO > KONSEC GmbH -=E2=81=A0 make things real > Amtsgericht Stuttgart, HRB 23690 > Gesch=C3=A4ftsf=C3=BChrer: Andreas Mack > Im K=C3=B6ller 3, 70794 Filderstadt, Germany > > > _______________________________________________ > pve-user mailing list > pve-user@lists.proxmox.com > https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-user >