public inbox for pve-user@lists.proxmox.com
 help / color / mirror / Atom feed
From: "Óscar de Arriba" <oscar@dearriba.es>
To: "Martin Holub" <martin@holub.co.at>, pve-user@lists.proxmox.com
Subject: Re: [PVE-User] Thin LVM showing more used space than expected
Date: Mon, 02 Jan 2023 10:56:27 +0100	[thread overview]
Message-ID: <18fed6c7-94cd-4cfd-b8b5-9c7f6a92b186@app.fastmail.com> (raw)
In-Reply-To: <cae87493-98a5-4256-b9a3-8af41931afea@app.fastmail.com>

I ended up reinstalling th server and using ZFS this time. It solved all the issues - the ghost used space is back and I could restore even a VM 3x times bigger without any slowdown. 

Not sure what happened but with all that space occupied my best guess is that during the restoration of VMs LVM was getting out of blocks to use and needed to do some cleanups, which led to that slow performance at ~5Mbps. However, it is strange that I could not find anyone else facing this issue.

On Thu, Dec 29, 2022, at 17:58, Óscar de Arriba wrote:
> Update: I have enabled `Discard` option in all disks of the VMs on that server and then `fstim` did the work and freed some space.
> 
> However, even removing all VMs except one (which is hard to remove without disruption) I can see that:
> 
> root@venom:~# lvs
>   LV            VG  Attr       LSize   Pool Origin Data%  Meta%  Move Log Cpy%Sync Convert
>   data          pve twi-aotz-- 377.55g             60.65  0.67                            
>   root          pve -wi-ao----  60.00g                                                    
>   swap          pve -wi-ao----   4.00g                                                    
>   vm-201-disk-0 pve Vwi-aotz--   4.00m data        14.06                                  
>   vm-201-disk-1 pve Vwi-aotz--  40.00g data        56.58
> 
> Which means that I have about 200 GB used out of nowhere :( At least it is no longer under pressure of being almost 100% full.
> 
> On Thu, Dec 29, 2022, at 11:48, Óscar de Arriba wrote:
>> Any idea why it still has 96.23% of space used but the VMs are using way less? I'm starting to worry a lot about it (I don't kant tobe really full) and my current only hope is backup + reinstall PVE.
>> 
>> Thanks,
>> Oscar
>> 
>> On Thu, Dec 29, 2022, at 11:01, Martin Holub wrote:
>>> 
>>> 
>>> Am 28.12.2022 um 12:44 schrieb Óscar de Arriba:
>>>> Hi Martin,
>>>> 
>>>> > Did you try to run a fstrim on the VMs to regain the allocated space? At least on linux something like "fstrim -av" should do the trick.
>>>> 
>>>> I did it now and it freed ~55GiB of a running isntance (the one with 128 GiB allocated). However that should only free blocks of the LV used to store that VM disk, right? And the issue itself is that the sum of maximum allocations of those disks is much lower than the space occupied.
>>>> 
>>>> I also have the feeling that those blocks remain used by a no longer existant LVs, but I don't know how to fix it.
>>>> 
>>>> Should I also enable trim/execute trim on Proxmox itself?
>>>> 
>>>> Oscar
>>>> 
>>> 
>>> 
>>> 
>>> 
>>> Hi,
>>> 
>>> TRIM only works on a filesystem level, so you can't trim a VG or similar. On the pve host i doubt it will help, but it wouldn't harm either. 
>>> 
>>> hth
>>> Martin
>>> 
>>> 
>> 
> 


  parent reply	other threads:[~2023-01-02  9:57 UTC|newest]

Thread overview: 10+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
     [not found] <mailman.3.1672225201.17323.pve-user@lists.proxmox.com>
2022-12-28 11:44 ` Óscar de Arriba
     [not found]   ` <b462e244-86a1-eada-c50b-4361f037dc1e@holub.co.at>
2022-12-29 10:48     ` Óscar de Arriba
2022-12-29 16:58       ` Óscar de Arriba
2022-12-30  9:52         ` Tom Weber
2023-01-02  9:56         ` Óscar de Arriba [this message]
2022-12-27 17:54 Óscar de Arriba
2022-12-28 10:52 ` Alain Péan
2022-12-28 11:19   ` Óscar de Arriba
2022-12-28 12:17     ` Alain Péan
2022-12-28 18:22       ` Óscar de Arriba

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=18fed6c7-94cd-4cfd-b8b5-9c7f6a92b186@app.fastmail.com \
    --to=oscar@dearriba.es \
    --cc=martin@holub.co.at \
    --cc=pve-user@lists.proxmox.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox
Service provided by Proxmox Server Solutions GmbH | Privacy | Legal