From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from firstgate.proxmox.com (firstgate.proxmox.com [212.224.123.68]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits)) (No client certificate requested) by lists.proxmox.com (Postfix) with ESMTPS id 95E02668E7 for ; Fri, 8 Jan 2021 12:57:51 +0100 (CET) Received: from firstgate.proxmox.com (localhost [127.0.0.1]) by firstgate.proxmox.com (Proxmox) with ESMTP id 809A22AD6F for ; Fri, 8 Jan 2021 12:57:21 +0100 (CET) Received: from mout.web.de (mout.web.de [212.227.17.12]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by firstgate.proxmox.com (Proxmox) with ESMTPS id A68432AD65 for ; Fri, 8 Jan 2021 12:57:20 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=web.de; s=dbaedf251592; t=1610107034; bh=BBhOLRRScpTvtVdcz1OdOjPVcNoP6TfhG+DNCnxU624=; h=X-UI-Sender-Class:Subject:To:References:From:Date:In-Reply-To; b=mBKOvFakV+ySIOhKAmQOJnIhPu6cbpbvmzWGXP3EPmkEgUZUPGh3gmt/GefafMxFU Pa0JBqCPC45/uM08aiP1O98bokTVsg5bT9CCCCJIa+oBb4W1ptJGkRJeIu0wvtyMmV +SE2XI+96P1s85Z65RndHitegHMx4Pq+WAzsrr+c= X-UI-Sender-Class: c548c8c5-30a9-4db5-a2e7-cb6cb037b8f9 Received: from [192.168.51.91] ([91.4.25.202]) by smtp.web.de (mrweb101 [213.165.67.124]) with ESMTPSA (Nemesis) id 0MDgLi-1kk90m0zU6-00H8HG for ; Fri, 08 Jan 2021 12:57:14 +0100 To: pve-user@lists.proxmox.com References: <21dec802-c6e8-d395-1444-7b30df5620cd@dkfz-heidelberg.de> <255b8af8-8834-0f24-d9a6-819f2d2cf8c8@dkfz-heidelberg.de> <9811d98a-ebf2-8590-ddd0-3b707ede4a4e@dkfz-heidelberg.de> <89a1ad57-6f99-d422-08df-d110f10aa3b9@dkfz-heidelberg.de> <4bdfeb73-582e-2c25-e300-166283e40dc5@dkfz-heidelberg.de> <1073f776-3910-dbde-8304-e86b5f6ed4fb@web.de> <8599b7ad-0ea0-b836-4492-d80b9d43cfcb@dkfz-heidelberg.de> From: Peter Simon Message-ID: <489a78d2-bdc8-883c-a4c8-83cd470df0d7@web.de> Date: Fri, 8 Jan 2021 12:57:13 +0100 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:78.0) Gecko/20100101 Thunderbird/78.5.0 MIME-Version: 1.0 In-Reply-To: <8599b7ad-0ea0-b836-4492-d80b9d43cfcb@dkfz-heidelberg.de> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: quoted-printable Content-Language: en-US X-Provags-ID: V03:K1:1Rdzh1kHoSvOhdYkCl7uPGy3OVlRSkhhhBreZe+PwEq6xnfAX1d I1Vv6sdI6WQ9FTRmtVy4jn7lG7BRErBQ3ojSU5voFSPsSOctfmTpEN6WQdZ08s22oybVGTc wOx09zmZyfqlBiuIPS35qYGlXBH49dMWs5lspkC9uZtabpOXzkvOwDSC05KyB/JWSiin0Am RHTmyzTdQczf9JfqRjdig== X-Spam-Flag: NO X-UI-Out-Filterresults: notjunk:1;V03:K0:2Y8o/37K+yE=:9NTA3rac1Elf30hpZbgHn8 KaS1nrQfQ0x3+2cK5oiDsvV56PAsZvWdrDClqWdu1MksbUyXifg2abrbRB9vvRQ60RhyOS6dC 11jOX4blV+tIyksjCjCyL0hrxCbDIXcvrYFR9C3nxiQrcdLDdIM69n9DxwxPEtTRZTxS89t0k E9hOgYzwkQQYDM+PNg3ik+V4PzOMt9s5LA+ZzbXnpNSHvCKLv5F5PDnzaa8LsPFrZQUvVN3Ly K6yGjTZelqnbwvmlkmdaL2WVfMDnbnHqpn5WNzgfZIO7g5QbR/cQ9OmUj2KCDDLetusyYCmfI BAU1PV6AANLy4SJ7scHlYf6706Bun49FHCvYg3bE9HsQS8b3yn7wDfmhl0Pg5L1rE40O/ax63 4Mt7nmX5ZsCV87k41INDQeaUDOihAxmAAPlgqQIqovrTVF1LCYcCFFtmsrr0WjzM58eBLdpgl GqSdYnE4RsBXNtzKL2GM81jLpqNxjLxqpNOCpF6ZGV96t04TmBw9WdQfzGUcQH2LYgRCL6REv JdycWDr+K9ZucaIaiOYEjuPD0H1OfFFbzT2xTgQvf6QiEonqNlLzUL4gnPUmFJ2c32HmkTIMD VPi9JENuOcoOoQwFUqhInAqLCzlwHMAxC8bKtBVIxg6YAsWcdAHO61EXs+lf1vrA00hDAjYRn Gd5SuRy8w7uIAYUdP0VYMsmPufj8OgVdrflOC0v3QwlrcSRp0UtUGkXxbMRMar34fohN6rT5i vQEgtIm7ylwaTGP7yvRGcmKR1U7F9Kals3q2xn9s+tcizpoAHisjx5ZAOGRsj5Wjl5QWMNffy Sgl78QK4I+pxZBs98Onzo0bJ7MZvLx1V8bPpzOdClvl43x9hCtEz/sSlPJr8r5yLrrvLHet/A 2micXbISngmw6eOS5aDQ== X-SPAM-LEVEL: Spam detection results: 0 AWL -0.731 Adjusted score from AWL reputation of From: address DKIM_SIGNED 0.1 Message has a DKIM or DK signature, not necessarily valid DKIM_VALID -0.1 Message has at least one valid DKIM or DK signature DKIM_VALID_AU -0.1 Message has a valid DKIM or DK signature from author's domain DKIM_VALID_EF -0.1 Message has a valid DKIM or DK signature from envelope-from domain FREEMAIL_FROM 0.001 Sender email is commonly abused enduser mail provider KAM_ASCII_DIVIDERS 0.8 Spam that uses ascii formatting tricks NICE_REPLY_A -0.267 Looks like a legit reply (A) RCVD_IN_DNSWL_LOW -0.7 Sender listed at https://www.dnswl.org/, low trust RCVD_IN_MSPIKE_H3 0.001 Good reputation (+3) RCVD_IN_MSPIKE_WL 0.001 Mailspike good senders SPF_HELO_NONE 0.001 SPF: HELO does not publish an SPF Record SPF_PASS -0.001 SPF: sender matches SPF record URIBL_BLOCKED 0.001 ADMINISTRATOR NOTICE: The query to URIBL was blocked. See http://wiki.apache.org/spamassassin/DnsBlocklists#dnsbl-block for more information. [proxmox.com, ceph.com] Subject: Re: [PVE-User] After update Ceph monitor shows wrong version in UI and is down and out of quorum X-BeenThere: pve-user@lists.proxmox.com X-Mailman-Version: 2.1.29 Precedence: list List-Id: Proxmox VE user list List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 08 Jan 2021 11:57:51 -0000 Hi, please try : [mon.odcf-pve0X] =C2=A0host =3D hostname =C2=A0mon addr =3D 192.168.255.x:6789 seperate entry for each VG Peter Am 08.01.21 um 12:44 schrieb Frank Thommen: > yes /etc/ceph/ceph.conf is identical on all three hosts and there is a > mon_host line with the correct IPs.=C2=A0 Interestingly there is a speci= al > section for odcf-pve02: > > ----------- > [mon.odcf-pve02] > =C2=A0=C2=A0=C2=A0=C2=A0 public_addr =3D 192.168.255.2 > ----------- > > This is the same IP as in the mon_host line.=C2=A0 However there is no > equivalent section for the other two nodes. > > Frank > > > On 08.01.21 12:27, Peter Simon wrote: >> Hi Frank, >> >> your /etc/ceph/ceph.conf is the same on all hosts ? >> >> is there mon host =3D ip1, ip2, ip3 >> >> and seperate sections with [mon.x] >> host =3D hostname >> mon addr =3D ip:6789 >> >> Cheers >> Peter >> >> Am 08.01.21 um 12:05 schrieb Frank Thommen: >>> >>> >>> On 08.01.21 11:45, Uwe Sauter wrote: >>>> >>>> >>>> Am 08.01.21 um 11:36 schrieb Frank Thommen: >>>>> >>>>> On 05.01.21 21:17, Frank Thommen wrote: >>>>>> On 05.01.21 21:02, Uwe Sauter wrote: >>>>>>> There's a paragraph about probing mons on >>>>>>> >>>>>>> https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshoot= ing-mon/ >>>>>>> >>>>>>> >>>>>> >>>>>> I will check that (tomorrow :-) >>>>> >>>>> >>>>> using the monitor's admin socket on either of the three nodes I can >>>>> query the monitors of 01 and 03 (the good ones) but not of 02 (the >>>>> problematic one): >>>>> >>>>> root@odcf-pve01:~# ceph tell mon.odcf-pve02 mon_status >>>>> Error ENOENT: problem getting command descriptions from >>>>> mon.odcf-pve02 >>>>> root@odcf-pve01:~# >>>>> >>>>> The monitor daemon is running on all three and the ports are open. >>>>> >>>>> Any other ideas? >>>> >>>> You could check the permissions on the socket: >>>> >>>> ss -xln | grep ceph-mon >>>> SOCK=3D$(ss -xln | awk '/ceph-mon/ {print $5}') >>>> ls -la ${SOCK} >>>> >>>> On my host, this shows >>>> >>>> srwxr-xr-x 1 ceph ceph 0 Dec 20 23:47 >>>> /var/run/ceph/ceph-mon.px-alpha-cluster.asok >>> >>> same here >>> >>> _______________________________________________ >>> pve-user mailing list >>> pve-user@lists.proxmox.com >>> https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-user >>> >> >> _______________________________________________ >> pve-user mailing list >> pve-user@lists.proxmox.com >> https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-user >> > > _______________________________________________ > pve-user mailing list > pve-user@lists.proxmox.com > https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-user >