From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from firstgate.proxmox.com (firstgate.proxmox.com [212.224.123.68]) by lore.proxmox.com (Postfix) with ESMTPS id 0E7861FF165 for ; Sun, 8 Sep 2024 14:17:19 +0200 (CEST) Received: from firstgate.proxmox.com (localhost [127.0.0.1]) by firstgate.proxmox.com (Proxmox) with ESMTP id 20ED9360B7; Sun, 8 Sep 2024 14:17:52 +0200 (CEST) Message-ID: Date: Sun, 8 Sep 2024 14:17:47 +0200 MIME-Version: 1.0 User-Agent: Mozilla Thunderbird From: Frank Thommen To: References: <49702fb5-5162-4a8d-8f8c-b7e82ac59be8@dkfz-heidelberg.de> <1bf05195-83a5-490c-a362-6af62b6bbdf3@dkfz-heidelberg.de> Content-Language: en-GB Organization: Omics IT and Data Management Core Facility (ODCF), DKFZ Heidelberg In-Reply-To: X-Originating-IP: [172.22.53.151] X-SM-outgoing: yes X-SPAM-LEVEL: Spam detection results: 0 AWL -0.121 Adjusted score from AWL reputation of From: address BAYES_00 -1.9 Bayes spam probability is 0 to 1% DMARC_MISSING 0.1 Missing DMARC policy KAM_DMARC_STATUS 0.01 Test Rule for DKIM or SPF Failure with Strict Alignment RCVD_IN_DNSWL_MED -2.3 Sender listed at https://www.dnswl.org/, medium trust RCVD_IN_VALIDITY_CERTIFIED_BLOCKED 0.001 ADMINISTRATOR NOTICE: The query to Validity was blocked. See https://knowledge.validity.com/hc/en-us/articles/20961730681243 for more information. RCVD_IN_VALIDITY_RPBL_BLOCKED 0.001 ADMINISTRATOR NOTICE: The query to Validity was blocked. See https://knowledge.validity.com/hc/en-us/articles/20961730681243 for more information. RCVD_IN_VALIDITY_SAFE_BLOCKED 0.001 ADMINISTRATOR NOTICE: The query to Validity was blocked. See https://knowledge.validity.com/hc/en-us/articles/20961730681243 for more information. SPF_HELO_NONE 0.001 SPF: HELO does not publish an SPF Record SPF_PASS -0.001 SPF: sender matches SPF record Subject: Re: [PVE-User] "nearfull" status in PVE Dashboard not consistent X-BeenThere: pve-user@lists.proxmox.com X-Mailman-Version: 2.1.29 Precedence: list List-Id: Proxmox VE user list List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Reply-To: Proxmox VE user list Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset="us-ascii"; Format="flowed" Errors-To: pve-user-bounces@lists.proxmox.com Sender: "pve-user" Hi David, I have deleted the OSDs one by one (sometimes two by two) and then recreated them, but this time with an SSD partition as DB device (previously the DB was on the OSD HDDs). So the SSDs should not have been added as OSDs. `ceph osd tree` gives me ---------------------------------- $ ceph osd tree ID CLASS WEIGHT TYPE NAME STATUS REWEIGHT PRI-AFF -1 55.66704 root default -3 18.40823 host pve01 0 hdd 3.68259 osd.0 up 1.00000 1.00000 1 hdd 3.68259 osd.1 up 1.00000 1.00000 2 hdd 3.68259 osd.2 up 1.00000 1.00000 9 hdd 1.84380 osd.9 up 1.00000 1.00000 10 hdd 1.84380 osd.10 up 1.00000 1.00000 11 hdd 1.84380 osd.11 up 1.00000 1.00000 12 hdd 1.82909 osd.12 up 1.00000 1.00000 -5 19.06548 host pve02 3 hdd 3.81450 osd.3 up 1.00000 1.00000 4 hdd 3.81450 osd.4 up 1.00000 1.00000 5 hdd 3.81450 osd.5 up 1.00000 1.00000 13 hdd 1.90720 osd.13 up 1.00000 1.00000 14 hdd 1.90720 osd.14 up 1.00000 1.00000 15 hdd 1.90720 osd.15 up 1.00000 1.00000 16 hdd 1.90039 osd.16 up 1.00000 1.00000 -7 18.19333 host pve03 6 hdd 3.63869 osd.6 up 1.00000 1.00000 7 hdd 3.63869 osd.7 up 1.00000 1.00000 8 hdd 3.63869 osd.8 up 1.00000 1.00000 17 hdd 1.81929 osd.17 up 1.00000 1.00000 18 hdd 1.81929 osd.18 up 1.00000 1.00000 19 hdd 1.81940 osd.19 up 1.00000 1.00000 20 hdd 1.81929 osd.20 up 1.00000 1.00000 $ ---------------------------------- Cheers, Frank On 07.09.24 21:27, David der Nederlanden | ITTY via pve-user wrote: > Hi Frank, > > Can you share your OSD layout too? > > My first thought is that you added the SSD's as OSD which caused that OSD to get full, with a near full pool as a result. > > You can get some insights with: > `ceph osd tree` > > And if needed you can reweight the OSD's, but that would require a good OSD layout: > `ceph osd reweight-by-utilization` > > Sources: > https://forum.proxmox.com/threads/ceph-pool-full.47810/ > https://docs.ceph.com/en/reef/rados/operations/health-checks/#pool-near-full > > Kind regards, > David der Nederlanden _______________________________________________ pve-user mailing list pve-user@lists.proxmox.com https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-user