From mboxrd@z Thu Jan  1 00:00:00 1970
Return-Path: <rumors@web.de>
Received: from firstgate.proxmox.com (firstgate.proxmox.com [212.224.123.68])
 (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
 key-exchange X25519 server-signature RSA-PSS (2048 bits))
 (No client certificate requested)
 by lists.proxmox.com (Postfix) with ESMTPS id 95E02668E7
 for <pve-user@lists.proxmox.com>; Fri,  8 Jan 2021 12:57:51 +0100 (CET)
Received: from firstgate.proxmox.com (localhost [127.0.0.1])
 by firstgate.proxmox.com (Proxmox) with ESMTP id 809A22AD6F
 for <pve-user@lists.proxmox.com>; Fri,  8 Jan 2021 12:57:21 +0100 (CET)
Received: from mout.web.de (mout.web.de [212.227.17.12])
 (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
 key-exchange ECDHE (P-256) server-signature RSA-PSS (2048 bits) server-digest
 SHA256) (No client certificate requested)
 by firstgate.proxmox.com (Proxmox) with ESMTPS id A68432AD65
 for <pve-user@lists.proxmox.com>; Fri,  8 Jan 2021 12:57:20 +0100 (CET)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=web.de;
 s=dbaedf251592; t=1610107034;
 bh=BBhOLRRScpTvtVdcz1OdOjPVcNoP6TfhG+DNCnxU624=;
 h=X-UI-Sender-Class:Subject:To:References:From:Date:In-Reply-To;
 b=mBKOvFakV+ySIOhKAmQOJnIhPu6cbpbvmzWGXP3EPmkEgUZUPGh3gmt/GefafMxFU
 Pa0JBqCPC45/uM08aiP1O98bokTVsg5bT9CCCCJIa+oBb4W1ptJGkRJeIu0wvtyMmV
 +SE2XI+96P1s85Z65RndHitegHMx4Pq+WAzsrr+c=
X-UI-Sender-Class: c548c8c5-30a9-4db5-a2e7-cb6cb037b8f9
Received: from [192.168.51.91] ([91.4.25.202]) by smtp.web.de (mrweb101
 [213.165.67.124]) with ESMTPSA (Nemesis) id 0MDgLi-1kk90m0zU6-00H8HG for
 <pve-user@lists.proxmox.com>; Fri, 08 Jan 2021 12:57:14 +0100
To: pve-user@lists.proxmox.com
References: <21dec802-c6e8-d395-1444-7b30df5620cd@dkfz-heidelberg.de>
 <255b8af8-8834-0f24-d9a6-819f2d2cf8c8@dkfz-heidelberg.de>
 <b43df258-4cdb-49f4-5adb-a20188a908df@gmail.com>
 <9811d98a-ebf2-8590-ddd0-3b707ede4a4e@dkfz-heidelberg.de>
 <ccbcca68-59fc-944e-d90c-c26ae20b17e5@gmail.com>
 <cca8ce9d-2de2-3fb5-0522-3b7bb0f4132c@dkfz-heidelberg.de>
 <f3ca5f88-5cbd-9807-02d7-d8f24fcbefdb@gmail.com>
 <89a1ad57-6f99-d422-08df-d110f10aa3b9@dkfz-heidelberg.de>
 <4bdfeb73-582e-2c25-e300-166283e40dc5@dkfz-heidelberg.de>
 <f45c98bd-c37c-4947-9074-705d5ea2b665@gmail.com>
 <c6b77050-90b9-d556-9e5b-780aeb8e872b@dkfz-heidelberg.de>
 <1073f776-3910-dbde-8304-e86b5f6ed4fb@web.de>
 <8599b7ad-0ea0-b836-4492-d80b9d43cfcb@dkfz-heidelberg.de>
From: Peter Simon <rumors@web.de>
Message-ID: <489a78d2-bdc8-883c-a4c8-83cd470df0d7@web.de>
Date: Fri, 8 Jan 2021 12:57:13 +0100
User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:78.0) Gecko/20100101
 Thunderbird/78.5.0
MIME-Version: 1.0
In-Reply-To: <8599b7ad-0ea0-b836-4492-d80b9d43cfcb@dkfz-heidelberg.de>
Content-Type: text/plain; charset=utf-8; format=flowed
Content-Transfer-Encoding: quoted-printable
Content-Language: en-US
X-Provags-ID: V03:K1:1Rdzh1kHoSvOhdYkCl7uPGy3OVlRSkhhhBreZe+PwEq6xnfAX1d
 I1Vv6sdI6WQ9FTRmtVy4jn7lG7BRErBQ3ojSU5voFSPsSOctfmTpEN6WQdZ08s22oybVGTc
 wOx09zmZyfqlBiuIPS35qYGlXBH49dMWs5lspkC9uZtabpOXzkvOwDSC05KyB/JWSiin0Am
 RHTmyzTdQczf9JfqRjdig==
X-Spam-Flag: NO
X-UI-Out-Filterresults: notjunk:1;V03:K0:2Y8o/37K+yE=:9NTA3rac1Elf30hpZbgHn8
 KaS1nrQfQ0x3+2cK5oiDsvV56PAsZvWdrDClqWdu1MksbUyXifg2abrbRB9vvRQ60RhyOS6dC
 11jOX4blV+tIyksjCjCyL0hrxCbDIXcvrYFR9C3nxiQrcdLDdIM69n9DxwxPEtTRZTxS89t0k
 E9hOgYzwkQQYDM+PNg3ik+V4PzOMt9s5LA+ZzbXnpNSHvCKLv5F5PDnzaa8LsPFrZQUvVN3Ly
 K6yGjTZelqnbwvmlkmdaL2WVfMDnbnHqpn5WNzgfZIO7g5QbR/cQ9OmUj2KCDDLetusyYCmfI
 BAU1PV6AANLy4SJ7scHlYf6706Bun49FHCvYg3bE9HsQS8b3yn7wDfmhl0Pg5L1rE40O/ax63
 4Mt7nmX5ZsCV87k41INDQeaUDOihAxmAAPlgqQIqovrTVF1LCYcCFFtmsrr0WjzM58eBLdpgl
 GqSdYnE4RsBXNtzKL2GM81jLpqNxjLxqpNOCpF6ZGV96t04TmBw9WdQfzGUcQH2LYgRCL6REv
 JdycWDr+K9ZucaIaiOYEjuPD0H1OfFFbzT2xTgQvf6QiEonqNlLzUL4gnPUmFJ2c32HmkTIMD
 VPi9JENuOcoOoQwFUqhInAqLCzlwHMAxC8bKtBVIxg6YAsWcdAHO61EXs+lf1vrA00hDAjYRn
 Gd5SuRy8w7uIAYUdP0VYMsmPufj8OgVdrflOC0v3QwlrcSRp0UtUGkXxbMRMar34fohN6rT5i
 vQEgtIm7ylwaTGP7yvRGcmKR1U7F9Kals3q2xn9s+tcizpoAHisjx5ZAOGRsj5Wjl5QWMNffy
 Sgl78QK4I+pxZBs98Onzo0bJ7MZvLx1V8bPpzOdClvl43x9hCtEz/sSlPJr8r5yLrrvLHet/A
 2micXbISngmw6eOS5aDQ==
X-SPAM-LEVEL: Spam detection results:  0
 AWL -0.731 Adjusted score from AWL reputation of From: address
 DKIM_SIGNED               0.1 Message has a DKIM or DK signature,
 not necessarily valid
 DKIM_VALID -0.1 Message has at least one valid DKIM or DK signature
 DKIM_VALID_AU -0.1 Message has a valid DKIM or DK signature from author's
 domain
 DKIM_VALID_EF -0.1 Message has a valid DKIM or DK signature from envelope-from
 domain
 FREEMAIL_FROM 0.001 Sender email is commonly abused enduser mail provider
 KAM_ASCII_DIVIDERS        0.8 Spam that uses ascii formatting tricks
 NICE_REPLY_A           -0.267 Looks like a legit reply (A)
 RCVD_IN_DNSWL_LOW        -0.7 Sender listed at https://www.dnswl.org/,
 low trust RCVD_IN_MSPIKE_H3       0.001 Good reputation (+3)
 RCVD_IN_MSPIKE_WL       0.001 Mailspike good senders
 SPF_HELO_NONE           0.001 SPF: HELO does not publish an SPF Record
 SPF_PASS               -0.001 SPF: sender matches SPF record
 URIBL_BLOCKED 0.001 ADMINISTRATOR NOTICE: The query to URIBL was blocked. See
 http://wiki.apache.org/spamassassin/DnsBlocklists#dnsbl-block for more
 information. [proxmox.com, ceph.com]
Subject: Re: [PVE-User] After update Ceph monitor shows wrong version in UI
 and is down and out of quorum
X-BeenThere: pve-user@lists.proxmox.com
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Proxmox VE user list <pve-user.lists.proxmox.com>
List-Unsubscribe: <https://lists.proxmox.com/cgi-bin/mailman/options/pve-user>, 
 <mailto:pve-user-request@lists.proxmox.com?subject=unsubscribe>
List-Archive: <http://lists.proxmox.com/pipermail/pve-user/>
List-Post: <mailto:pve-user@lists.proxmox.com>
List-Help: <mailto:pve-user-request@lists.proxmox.com?subject=help>
List-Subscribe: <https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-user>, 
 <mailto:pve-user-request@lists.proxmox.com?subject=subscribe>
X-List-Received-Date: Fri, 08 Jan 2021 11:57:51 -0000

Hi,

please try :

[mon.odcf-pve0X]

 =C2=A0host =3D hostname
 =C2=A0mon addr =3D 192.168.255.x:6789

seperate entry for each

VG
Peter

Am 08.01.21 um 12:44 schrieb Frank Thommen:
> yes /etc/ceph/ceph.conf is identical on all three hosts and there is a
> mon_host line with the correct IPs.=C2=A0 Interestingly there is a speci=
al
> section for odcf-pve02:
>
> -----------
> [mon.odcf-pve02]
> =C2=A0=C2=A0=C2=A0=C2=A0 public_addr =3D 192.168.255.2
> -----------
>
> This is the same IP as in the mon_host line.=C2=A0 However there is no
> equivalent section for the other two nodes.
>
> Frank
>
>
> On 08.01.21 12:27, Peter Simon wrote:
>> Hi Frank,
>>
>> your /etc/ceph/ceph.conf is the same on all hosts ?
>>
>> is there mon host =3D ip1, ip2, ip3
>>
>> and seperate sections with [mon.x]
>> host =3D hostname
>> mon addr =3D ip:6789
>>
>> Cheers
>> Peter
>>
>> Am 08.01.21 um 12:05 schrieb Frank Thommen:
>>>
>>>
>>> On 08.01.21 11:45, Uwe Sauter wrote:
>>>>
>>>>
>>>> Am 08.01.21 um 11:36 schrieb Frank Thommen:
>>>>>
>>>>> On 05.01.21 21:17, Frank Thommen wrote:
>>>>>> On 05.01.21 21:02, Uwe Sauter wrote:
>>>>>>> There's a paragraph about probing mons on
>>>>>>>
>>>>>>> https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshoot=
ing-mon/
>>>>>>>
>>>>>>>
>>>>>>
>>>>>> I will check that (tomorrow :-)
>>>>>
>>>>>
>>>>> using the monitor's admin socket on either of the three nodes I can
>>>>> query the monitors of 01 and 03 (the good ones) but not of 02 (the
>>>>> problematic one):
>>>>>
>>>>> root@odcf-pve01:~# ceph tell mon.odcf-pve02 mon_status
>>>>> Error ENOENT: problem getting command descriptions from
>>>>> mon.odcf-pve02
>>>>> root@odcf-pve01:~#
>>>>>
>>>>> The monitor daemon is running on all three and the ports are open.
>>>>>
>>>>> Any other ideas?
>>>>
>>>> You could check the permissions on the socket:
>>>>
>>>> ss -xln | grep ceph-mon
>>>> SOCK=3D$(ss -xln | awk '/ceph-mon/ {print $5}')
>>>> ls -la ${SOCK}
>>>>
>>>> On my host, this shows
>>>>
>>>> srwxr-xr-x 1 ceph ceph 0 Dec 20 23:47
>>>> /var/run/ceph/ceph-mon.px-alpha-cluster.asok
>>>
>>> same here
>>>
>>> _______________________________________________
>>> pve-user mailing list
>>> pve-user@lists.proxmox.com
>>> https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-user
>>>
>>
>> _______________________________________________
>> pve-user mailing list
>> pve-user@lists.proxmox.com
>> https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-user
>>
>
> _______________________________________________
> pve-user mailing list
> pve-user@lists.proxmox.com
> https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-user
>