From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from firstgate.proxmox.com (firstgate.proxmox.com [212.224.123.68]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by lists.proxmox.com (Postfix) with ESMTPS id A163D605D0 for ; Wed, 16 Feb 2022 10:55:17 +0100 (CET) Received: from firstgate.proxmox.com (localhost [127.0.0.1]) by firstgate.proxmox.com (Proxmox) with ESMTP id 813C92024 for ; Wed, 16 Feb 2022 10:54:47 +0100 (CET) Received: from relay164.nicmail.ru (relay164.nicmail.ru [91.189.117.8]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by firstgate.proxmox.com (Proxmox) with ESMTPS id 2FF3E2010 for ; Wed, 16 Feb 2022 10:54:46 +0100 (CET) Received: from [10.28.138.148] (port=12178 helo=[192.168.8.155]) by relay.hosting.mail.nic.ru with esmtp (Exim 5.55) (envelope-from ) id 1nKH1D-0006OZ-Dt; Wed, 16 Feb 2022 12:54:39 +0300 Received: from [62.105.41.93] (account tsabolov@t8.ru HELO [192.168.8.155]) by incarp1101.int.hosting.nic.ru (Exim 5.55) with id 1nKH1D-00062k-7a; Wed, 16 Feb 2022 12:54:39 +0300 Message-ID: <1f2ec805-8fe2-159a-4f59-2831a3110b89@t8.ru> Date: Wed, 16 Feb 2022 12:54:38 +0300 MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:91.0) Gecko/20100101 Thunderbird/91.5.0 Content-Language: en-US To: Eneko Lacunza , pve-user@lists.proxmox.com References: <10232bf8-ad79-e262-9861-bcc88f3c1bb9@t8.ru> <094b0da0-94b9-3b0f-3358-78d8e51561de@binovo.es> From: =?UTF-8?B?0KHQtdGA0LPQtdC5INCm0LDQsdC+0LvQvtCy?= In-Reply-To: X-KLMS-AntiSpam-Auth: dkim=none X-MS-Exchange-Organization-SCL: -1 X-SPAM-LEVEL: Spam detection results: 0 AWL 0.012 Adjusted score from AWL reputation of From: address BAYES_00 -1.9 Bayes spam probability is 0 to 1% HTML_MESSAGE 0.001 HTML included in message KAM_DMARC_STATUS 0.01 Test Rule for DKIM or SPF Failure with Strict Alignment NICE_REPLY_A -0.001 Looks like a legit reply (A) RCVD_IN_DNSWL_LOW -0.7 Sender listed at https://www.dnswl.org/, low trust SPF_HELO_NONE 0.001 SPF: HELO does not publish an SPF Record SPF_PASS -0.001 SPF: sender matches SPF record T_SCC_BODY_TEXT_LINE -0.01 - Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Content-Filtered-By: Mailman/MimeDel 2.1.29 Subject: Re: [PVE-User] New Disk on one node of Cluster. X-BeenThere: pve-user@lists.proxmox.com X-Mailman-Version: 2.1.29 Precedence: list List-Id: Proxmox VE user list List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 16 Feb 2022 09:55:17 -0000 Hi Eneko, 16.02.2022 12:33, Eneko Lacunza пишет: > > Hi Sergey, > > So, does this really make sense? If you put the new 2 disks in node7 > in a pool, that data won't be able to survive node7 failure. You are right, if 7 node is failure data won't be able. But I think about if 2 disks/2 osd ad on new pool and is shared on all nodes. > > If you're trying to benchmark the disks, that wouldn't be a good test, > because in a real deployment disk IO for only one VM would be worse > (due to replication and network latencies). Not only for one VM, I have 2 and more in future  Windows VM > > What IOPS are you getting in your 4K tests? You won't get near direct > disk IOPS... I need to test the host disk or the VM disk ? > > Did you try with multiple parallel VMs? Aggregate 4K results should be > much better :) I think about this way, maybe is work. > > Cheers > > El 16/2/22 a las 10:24, Сергей Цаболов escribió: >> >> Hi Eneko, >> >> 16.02.2022 11:58, Eneko Lacunza пишет: >>> Hi Sergey, >>> >>> El 16/2/22 a las 9:52, Сергей Цаболов escribió: >>>> >>>> I have 7 node's PVE Cluster + Ceph storage >>>> >>>> In 7 node I add new 2 disks and want to make specific new osd pool >>>> on Ceph. >>>> >>>> Is possible with new  disk create specific pool ? >>> >>> You are adding 2 additional disk in each node, right? >> No, I add the new disk on node 7, not on each node of cluster. >>> >>> You can assign them to a new pool, creating custom crush rules. >> >> Yes this I know how is make new rules >> >> In one node I for test added 2 ssd disk and make the new rules| >> | >> >> |ceph osd crush rule create-replicated replicated_ssd default host >> ssd  and with this rule I  make new pool vm.ssd >> | >>> >>> Why do you want to use those disks for a different pool? What disks >>> do you have now, and what disk are the new? (for example, are all >>> HDD or SSD...) >> >> I want make new pool with HDD - SAS for specific storage of some >> Windows Server VM. >> >> In existing pools : >> >> vm.pool  base pool for VM disks >> cephfs_data  some disks and ISO and other datas >> vm.ssd   new pool I make from 2 ssd disk >> >> I try to test the Windows Server disk speed for Read/Write and RND4K >> Q32T1 with CrystalDiskMark 8.0.4x64 >> >> If I configure the VM disk to Sata and SSD emulation,Cache: Write >> back and Discard, Speed write/read is very good something like : >> >> SEQ1M Q8T1 1797.43/1713.07 >> >> SEQ1M Q1T1 1790.77/1350.55 >> >> but the RND4K Q32T1 and RND4K Q1T1 is not good, very small. >> >> After the test I think if I add 2 new disks,  configure is for  >> specific pool maybe my speed for  RND4K Q32T1 and RND4K Q1T1 maybe >> they will get better >> >> Thank you >> >>> >>> Cheers >>> >>> Eneko Lacunza >>> Zuzendari teknikoa | Director técnico >>> Binovo IT Human Project >>> >>> Tel. +34 943 569 206 |https://www.binovo.es >>> Astigarragako Bidea, 2 - 2º izda. Oficina 10-11, 20180 Oiartzun >>> >>> https://www.youtube.com/user/CANALBINOVO >>> https://www.linkedin.com/company/37269706/ > > Eneko Lacunza > Zuzendari teknikoa | Director técnico > Binovo IT Human Project > > Tel. +34 943 569 206 |https://www.binovo.es > Astigarragako Bidea, 2 - 2º izda. Oficina 10-11, 20180 Oiartzun > > https://www.youtube.com/user/CANALBINOVO > https://www.linkedin.com/company/37269706/ Sergey TS The best Regard _______________________________________________ pve-user mailing list pve-user@lists.proxmox.com https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-user