From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from firstgate.proxmox.com (firstgate.proxmox.com [212.224.123.68]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits)) (No client certificate requested) by lists.proxmox.com (Postfix) with ESMTPS id C49F260B11 for ; Thu, 13 Jan 2022 16:01:04 +0100 (CET) Received: from firstgate.proxmox.com (localhost [127.0.0.1]) by firstgate.proxmox.com (Proxmox) with ESMTP id 8DBB6200A0 for ; Thu, 13 Jan 2022 16:00:34 +0100 (CET) Received: from relay163.nicmail.ru (relay163.nicmail.ru [91.189.117.7]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by firstgate.proxmox.com (Proxmox) with ESMTPS id 438D020089 for ; Thu, 13 Jan 2022 16:00:32 +0100 (CET) Received: from [10.28.138.151] (port=33290 helo=[192.168.8.155]) by relay.hosting.mail.nic.ru with esmtp (Exim 5.55) (envelope-from ) id 1n81aZ-000377-AM; Thu, 13 Jan 2022 18:00:31 +0300 Received: from [62.105.41.93] (account tsabolov@t8.ru HELO [192.168.8.155]) by incarp1103.int.hosting.nic.ru (Exim 5.55) with id 1n81aZ-0008Cm-3l; Thu, 13 Jan 2022 18:00:31 +0300 To: Eneko Lacunza , pve-user@lists.proxmox.com References: <37cd7904-a225-76f6-7bd3-973a75be2c74@t8.ru> <8973317e-c510-11ae-7705-af85ed3ad063@binovo.es> From: =?UTF-8?B?0KHQtdGA0LPQtdC5INCm0LDQsdC+0LvQvtCy?= Message-ID: Date: Thu, 13 Jan 2022 18:00:30 +0300 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:78.0) Gecko/20100101 Thunderbird/78.14.0 MIME-Version: 1.0 In-Reply-To: <8973317e-c510-11ae-7705-af85ed3ad063@binovo.es> Content-Language: en-US X-KLMS-AntiSpam-Auth: dkim=none X-MS-Exchange-Organization-SCL: -1 X-SPAM-LEVEL: Spam detection results: 0 AWL -0.832 Adjusted score from AWL reputation of From: address BAYES_00 -1.9 Bayes spam probability is 0 to 1% HTML_MESSAGE 0.001 HTML included in message KAM_DMARC_STATUS 0.01 Test Rule for DKIM or SPF Failure with Strict Alignment NICE_REPLY_A -0.001 Looks like a legit reply (A) RCVD_IN_DNSWL_NONE -0.0001 Sender listed at https://www.dnswl.org/, no trust SPF_HELO_NONE 0.001 SPF: HELO does not publish an SPF Record SPF_PASS -0.001 SPF: sender matches SPF record URIBL_BLOCKED 0.001 ADMINISTRATOR NOTICE: The query to URIBL was blocked. See http://wiki.apache.org/spamassassin/DnsBlocklists#dnsbl-block for more information. [binovo.es, proxmox.com] Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit X-Content-Filtered-By: Mailman/MimeDel 2.1.29 Subject: Re: [PVE-User] Remove 1-2 OSD from PVE Cluster X-BeenThere: pve-user@lists.proxmox.com X-Mailman-Version: 2.1.29 Precedence: list List-Id: Proxmox VE user list List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 13 Jan 2022 15:01:04 -0000 Hi, I not have Remove OSD in GUI. If I select OSD.X  have:  Start (if stoped)  , Stop , Restart, Out , In (if is out) and on More button: Srub , Deep Scrub. But the most important is in gui not have button to clean OSD from data. 13.01.2022 17:48, Eneko Lacunza пишет: > Hi, > > Why not use "Remove OSD" button in PVE WUI? :-) > > El 13/1/22 a las 9:13, Сергей Цаболов escribió: >> Hello to all. >> >> I have cluster with 7 node. >> >> Storage for VM disk and others pool data is on ceph version 15.2.15 >> (4b7a17f73998a0b4d9bd233cda1db482107e5908) octopus (stable) >> >> On pve-7 I have 10 OSD and for test I want to remove 2 osd from this >> node. >> >> I write some steps command how I remove this OSD from pve-7 cluster >> and ceph storage. >> >> 1) root@pve-7 ~ # ceph osd tree >> >> 2) ceph osd reweight >> 2.1) ceph osd reweight osd.${ID} 0.98 >> 2.2) ceph osd reweight osd.${ID} 0.0 can I set the 0.0 to clean osd.X >> before remove it? >> >> 3) When osd is clean from data can I? >> ceph osd down osd.${ID} >> >> 4) Remove the osd from cluster >> ceph osd out osd.${ID} >> >> 5) Stop the OSD and umount the osd >> systemctl stop ceph-osd@${ID} >> umount /var/lib/ceph/osd/ceph-${ID} >> >> 6) Remove the osd from CRUSH map: >> ceph osd crush remove osd.${ID} >> >> 7) Remove the user of OSD: >> ceph auth del osd.${ID} >> >> 8) And now full delete the OSD: >> ceph osd rm osd.${ID} >> >> 9) Last command >> >> ceph osd tree (removed OSD not showing >> >> Can some one suggest me my steps command is correct ? >> >> Or I need change some steps? >> >> Thanks . >> > > Eneko Lacunza > Zuzendari teknikoa | Director técnico > Binovo IT Human Project > > Tel. +34 943 569 206 | https://www.binovo.es > Astigarragako Bidea, 2 - 2º izda. Oficina 10-11, 20180 Oiartzun > > https://www.youtube.com/user/CANALBINOVO > https://www.linkedin.com/company/37269706/ > > Sergey TS The best Regard _______________________________________________ pve-user mailing list pve-user@lists.proxmox.com https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-user