From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from firstgate.proxmox.com (firstgate.proxmox.com [212.224.123.68]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits)) (No client certificate requested) by lists.proxmox.com (Postfix) with ESMTPS id 8FEE170E7D for ; Thu, 23 Jun 2022 08:54:32 +0200 (CEST) Received: from firstgate.proxmox.com (localhost [127.0.0.1]) by firstgate.proxmox.com (Proxmox) with ESMTP id 8683D21EAF for ; Thu, 23 Jun 2022 08:54:32 +0200 (CEST) Received: from mail2.mxhosting.eu (mail2.mxhosting.eu [5.196.214.12]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by firstgate.proxmox.com (Proxmox) with ESMTPS id 9F49021EA6 for ; Thu, 23 Jun 2022 08:54:31 +0200 (CEST) Received: from localhost (localhost [127.0.0.1]) by mail2.mxhosting.eu (Postfix) with ESMTP id 3FE5B3864FA; Thu, 23 Jun 2022 08:54:31 +0200 (CEST) Received: from mail2.mxhosting.eu ([127.0.0.1]) by localhost (mail2.mxhosting.eu [127.0.0.1]) (amavisd-new, port 10032) with ESMTP id RhGtscoiXSzw; Thu, 23 Jun 2022 08:54:30 +0200 (CEST) Received: from localhost (localhost [127.0.0.1]) by mail2.mxhosting.eu (Postfix) with ESMTP id EB6D63865F4; Thu, 23 Jun 2022 08:54:29 +0200 (CEST) DKIM-Filter: OpenDKIM Filter v2.10.3 mail2.mxhosting.eu EB6D63865F4 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=branoviest.com; s=F39BEA7E-92E5-11E7-AA57-DA56C37E8AFF; t=1655967270; bh=RFAwW9kS14up7etUf4TlKk1t8v+B81IJ2ntYx6AORw0=; h=Date:From:To:Message-ID:MIME-Version; b=R8A3OmC5r4Ym08wLbd/EWEtwLkdvjsoMr4Njlkn8jqNDKUX2QpmQ6mgc9nEUbDizn Z3NYs95mfNiLe8Hof9kpkGiciLQ0m/HWqBg2EtaVZDizGTgsslmbjupl2dMhL5sNSd OdWm1X3BFXvIZdUKsiDQiwR8CbdL4eMj32vS+H1Wr5qmeBbySiGNPgzPKt23UvcpoY uO2bEU1Q8kQvtVr6BcZd6XQuwLfgTUdTxAvstw0PRtZivkwA9lACNQOgFkqVZ/OtUc C7RdNG7SS3JHMtsrFcXpX2jcKavixeaG4FWhbpfGAf25UgIitwHdN8ThI7Q2iLdP2L xGVG/P4wifTHQ== X-Virus-Scanned: amavisd-new at mail2.mxhosting.eu Received: from mail2.mxhosting.eu ([127.0.0.1]) by localhost (mail2.mxhosting.eu [127.0.0.1]) (amavisd-new, port 10026) with ESMTP id wc289lLfjJU4; Thu, 23 Jun 2022 08:54:29 +0200 (CEST) Received: from mail2.mxhosting.eu (mail2.mxhosting.eu [5.196.214.12]) by mail2.mxhosting.eu (Postfix) with ESMTP id BDCF53865DD; Thu, 23 Jun 2022 08:54:29 +0200 (CEST) Date: Thu, 23 Jun 2022 08:54:28 +0200 (CEST) From: Branislav Viest To: Proxmox VE user list Message-ID: <1463978529.6086.1655967268966.JavaMail.zimbra@branoviest.com> In-Reply-To: References: <1918332790.5860.1655923185691.JavaMail.zimbra@branoviest.com> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Originating-IP: [78.102.251.4] X-Mailer: Zimbra 8.8.15_GA_4272 (ZimbraWebClient - FF101 (Mac)/8.8.15_GA_4257) Thread-Topic: Ceph: sudden slow ops, freezes, and slow-downs Thread-Index: gI3+yCLucHLBHpSOIbyxnaKG94pXQg== X-SPAM-LEVEL: Spam detection results: 0 AWL 0.700 Adjusted score from AWL reputation of From: address BAYES_00 -1.9 Bayes spam probability is 0 to 1% DKIM_SIGNED 0.1 Message has a DKIM or DK signature, not necessarily valid DKIM_VALID -0.1 Message has at least one valid DKIM or DK signature DKIM_VALID_AU -0.1 Message has a valid DKIM or DK signature from author's domain DKIM_VALID_EF -0.1 Message has a valid DKIM or DK signature from envelope-from domain SPF_HELO_NONE 0.001 SPF: HELO does not publish an SPF Record SPF_PASS -0.001 SPF: sender matches SPF record T_SCC_BODY_TEXT_LINE -0.01 - URIBL_BLOCKED 0.001 ADMINISTRATOR NOTICE: The query to URIBL was blocked. See http://wiki.apache.org/spamassassin/DnsBlocklists#dnsbl-block for more information. [branoviest.com, proxmox.com] Subject: Re: [PVE-User] Ceph: sudden slow ops, freezes, and slow-downs X-BeenThere: pve-user@lists.proxmox.com X-Mailman-Version: 2.1.29 Precedence: list List-Id: Proxmox VE user list List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 23 Jun 2022 06:54:32 -0000 Hello, ID CLASS WEIGHT TYPE NAME STATUS REWEIGHT PRI-AFF -1 15.52213 root default =20 -3 5.18097 host node1 =20 0 ssd 1.72699 osd.0 up 1.00000 1.00000 1 ssd 1.72699 osd.1 up 1.00000 1.00000 2 ssd 1.72699 osd.2 up 1.00000 1.00000 -5 3.45398 host node2 =20 3 ssd 1.72699 osd.3 up 1.00000 1.00000 5 ssd 1.72699 osd.5 up 1.00000 1.00000 -7 1.70740 host node3 =20 6 ssd 0.85370 osd.6 up 1.00000 1.00000 7 ssd 0.85370 osd.7 up 1.00000 1.00000 -9 5.17978 host node4 =20 8 ssd 1.72659 osd.8 up 1.00000 1.00000 9 ssd 1.72659 osd.9 up 1.00000 1.00000 10 ssd 1.72659 osd.10 up 1.00000 1.00000 Since slow ops are reported the most of the time within multiple OSDs, I di= d not try to perform tests with some OSDs out.=20 Now I check the logs from the last 2-3 days and slow ops are reported mostl= y on the 5 OSDs from total 10.=20 ------------ Best Regards Branislav Brian Viest ------------ Legal Disclaimer: This e-mail and any attached files are confidential and m= ay be legally privileged. If you are not the addressee, any disclosure, rep= roduction, copying, distribution, or other dissemination or use of this com= munication is strictly prohibited. If you have received this transmission i= n error please notify the sender immediately and then delete this e-mail. T= he sender does not accept liability for the correct and complete transmissi= on of the information, nor for any delay or interruption of the transmissio= n, nor for damages arising from the use of or reliance on the information. = All e-mail messages addressed to, received or sent by sender are deemed to = be professional in nature. Accordingly, the sender or recipient of these me= ssages agrees that they may be read by other sender employees than the offi= cial recipient or sender in order to ensure the continuity of work-related = activities and allow supervision thereof. ----- P=C3=B4vodn=C3=A1 spr=C3=A1va ----- Od: "Eneko Lacunza via pve-user" Komu: "pve-user" K=C3=B3pia: "Eneko Lacunza" Odoslan=C3=A9: =C5=A1tvrtok, 23. j=C3=BAn 2022 8:29:40 Predmet: Re: [PVE-User] Ceph: sudden slow ops, freezes, and slow-downs _______________________________________________ pve-user mailing list pve-user@lists.proxmox.com https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-user