From mboxrd@z Thu Jan 1 00:00:00 1970
Return-Path: <rumors@web.de>
Received: from firstgate.proxmox.com (firstgate.proxmox.com [212.224.123.68])
(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256)
(No client certificate requested)
by lists.proxmox.com (Postfix) with ESMTPS id F3B4B668D1
for <pve-user@lists.proxmox.com>; Fri, 8 Jan 2021 12:40:45 +0100 (CET)
Received: from firstgate.proxmox.com (localhost [127.0.0.1])
by firstgate.proxmox.com (Proxmox) with ESMTP id E28CD2AA4F
for <pve-user@lists.proxmox.com>; Fri, 8 Jan 2021 12:40:45 +0100 (CET)
Received: from mout.web.de (mout.web.de [212.227.17.11])
(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
key-exchange ECDHE (P-256) server-signature RSA-PSS (2048 bits) server-digest
SHA256) (No client certificate requested)
by firstgate.proxmox.com (Proxmox) with ESMTPS id D64862AA30
for <pve-user@lists.proxmox.com>; Fri, 8 Jan 2021 12:40:44 +0100 (CET)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=web.de;
s=dbaedf251592; t=1610106044;
bh=RmF51GrYty7KH/8WAzAjAPxQw6VvA2ti2h/zmeif4Qo=;
h=X-UI-Sender-Class:Subject:To:References:From:Date:In-Reply-To;
b=Y8wLoMnDDwtonEo+I3x7zxZm3AAEqUpv+X7v7yBqQPynOB6124uYhu7QeAzu3eUDc
9o00UHhEK+R+RBgcojM58UUcrdTeHS95D6fCW8tDzvFux32YTQBFtb/lQogiwYbIzQ
NM95BQtdozGX3S2+VzbZZhOtqW/ak/qOE9TX1yQY=
X-UI-Sender-Class: c548c8c5-30a9-4db5-a2e7-cb6cb037b8f9
Received: from [192.168.51.91] ([91.4.25.202]) by smtp.web.de (mrweb102
[213.165.67.124]) with ESMTPSA (Nemesis) id 0M89z3-1k30351Em1-00vhwc for
<pve-user@lists.proxmox.com>; Fri, 08 Jan 2021 12:27:50 +0100
To: pve-user@lists.proxmox.com
References: <21dec802-c6e8-d395-1444-7b30df5620cd@dkfz-heidelberg.de>
<255b8af8-8834-0f24-d9a6-819f2d2cf8c8@dkfz-heidelberg.de>
<b43df258-4cdb-49f4-5adb-a20188a908df@gmail.com>
<9811d98a-ebf2-8590-ddd0-3b707ede4a4e@dkfz-heidelberg.de>
<ccbcca68-59fc-944e-d90c-c26ae20b17e5@gmail.com>
<cca8ce9d-2de2-3fb5-0522-3b7bb0f4132c@dkfz-heidelberg.de>
<f3ca5f88-5cbd-9807-02d7-d8f24fcbefdb@gmail.com>
<89a1ad57-6f99-d422-08df-d110f10aa3b9@dkfz-heidelberg.de>
<4bdfeb73-582e-2c25-e300-166283e40dc5@dkfz-heidelberg.de>
<f45c98bd-c37c-4947-9074-705d5ea2b665@gmail.com>
<c6b77050-90b9-d556-9e5b-780aeb8e872b@dkfz-heidelberg.de>
From: Peter Simon <rumors@web.de>
Message-ID: <1073f776-3910-dbde-8304-e86b5f6ed4fb@web.de>
Date: Fri, 8 Jan 2021 12:27:42 +0100
User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:78.0) Gecko/20100101
Thunderbird/78.5.0
MIME-Version: 1.0
In-Reply-To: <c6b77050-90b9-d556-9e5b-780aeb8e872b@dkfz-heidelberg.de>
Content-Type: text/plain; charset=utf-8; format=flowed
Content-Transfer-Encoding: quoted-printable
Content-Language: en-US
X-Provags-ID: V03:K1:GCiW9vdvJS6atr/VCt3JtbMSuoMsvo/JNS4rN+6kaN88xY4LAIb
UQVIxyO7liWRvzjuVAPB8na0g6lLUrZf10nMEVISsBimx6lDEMHWBTMZOlNsA7nX0CIop5Z
6Nk/o8VzxlH4z0I2wjzqOvFo1lue2lqYU0X+kyva9Gatq8cT0pw/L86+p/iv/C/qssTGeGp
d6Z9la94I/7XBseGI5V1A==
X-Spam-Flag: NO
X-UI-Out-Filterresults: notjunk:1;V03:K0:tVdhQ1Glr1o=:OJw/sOMOvth9egXxD8Zdan
vH0g2cXLdaSTO8GSXHpw5S4dxbzr50a8sPUhcjCo4OVIGN8UxSYyPyQObzeFBd28HlQP37QIw
KDtYct8epEp5713J431GP9cJOxa4ojLYAtDtNbT9x+bTdBAC02DhxUTAs0HadmaQcgwuTfic4
Eqb31DmzZr/1Yi9lrXC+/22Q2dm+avVEysPBJb4efqUz+4oREpO7QHT/pZe2YmGIZk8fjRoLg
jQlfAP3lcWoSZhLGtDScOpkNmL2hjFoRNDuGvQYiMRANR7e2NViOPWVJ67AHYNGvQGyC2SjHV
nykOF36y+rlYPTcgmRz2HMY4yfJi6W4w7EYoAQJX3Gh1P1q1H8qvKXsIoKW4NvQR7qOAYLAOy
buLROR2yajiWTCZLFdSS8Rlg0BN+EFlKsVxeMFWlkJTnrSd58r4QGtU22/zG7emgUdvWnufKz
vUWrzAW0nCzAMPlL7d0P+DMg9sBOGCYY7iBSVwm+rE6+VDjvwtnbb8YdSE4o4Qt0VEBFsXYqh
y5Mmc2h5GU/slNdClKUGhYNFfQ2aZ4ekdISBs03gAvVvNgcWowmOAePuXyYt7rAxIkoWVaSwX
iUvGDjJuGbjU4OJCJ4/f5Pha+0YZXGtlzHQZlmOHZ2q0bPT1kfXRYSWSp+/yL8bSAvR3Bt+DU
2zFHUxsd4ym34Ggh+ELFXdzNSsDUKf/A3sl2GbMKwRvYcw3pnPEFfbKXYb6zdO31qdqLyL1Ur
+hTeV1PyjN2sOkStLYeImm9l4SNKiqXCXo+9yBvpQJBo0VWKhiOB+DT4vNcLfB8D2iQ4z+NF3
uhBdiiPWcDeN/+nVbFoUE1SUi96dJBz+D/FzjPvySB4t1VYb4wZ/H7+MsEUdKIKEwKzUhVSM7
bqcKhWe/t/U6vGzaXI5A==
X-SPAM-LEVEL: Spam detection results: 0
AWL -0.497 Adjusted score from AWL reputation of From: address
DKIM_SIGNED 0.1 Message has a DKIM or DK signature,
not necessarily valid
DKIM_VALID -0.1 Message has at least one valid DKIM or DK signature
DKIM_VALID_AU -0.1 Message has a valid DKIM or DK signature from author's
domain
DKIM_VALID_EF -0.1 Message has a valid DKIM or DK signature from envelope-from
domain
FREEMAIL_FROM 0.001 Sender email is commonly abused enduser mail provider
NICE_REPLY_A -0.267 Looks like a legit reply (A)
RCVD_IN_DNSWL_LOW -0.7 Sender listed at https://www.dnswl.org/,
low trust RCVD_IN_MSPIKE_H3 0.001 Good reputation (+3)
RCVD_IN_MSPIKE_WL 0.001 Mailspike good senders
SPF_HELO_NONE 0.001 SPF: HELO does not publish an SPF Record
SPF_PASS -0.001 SPF: sender matches SPF record
URIBL_BLOCKED 0.001 ADMINISTRATOR NOTICE: The query to URIBL was blocked. See
http://wiki.apache.org/spamassassin/DnsBlocklists#dnsbl-block for more
information. [proxmox.com, ceph.com]
Subject: Re: [PVE-User] After update Ceph monitor shows wrong version in UI
and is down and out of quorum
X-BeenThere: pve-user@lists.proxmox.com
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Proxmox VE user list <pve-user.lists.proxmox.com>
List-Unsubscribe: <https://lists.proxmox.com/cgi-bin/mailman/options/pve-user>,
<mailto:pve-user-request@lists.proxmox.com?subject=unsubscribe>
List-Archive: <http://lists.proxmox.com/pipermail/pve-user/>
List-Post: <mailto:pve-user@lists.proxmox.com>
List-Help: <mailto:pve-user-request@lists.proxmox.com?subject=help>
List-Subscribe: <https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-user>,
<mailto:pve-user-request@lists.proxmox.com?subject=subscribe>
X-List-Received-Date: Fri, 08 Jan 2021 11:40:46 -0000
Hi Frank,
your /etc/ceph/ceph.conf is the same on all hosts ?
is there mon host =3D ip1, ip2, ip3
and seperate sections with [mon.x]
host =3D hostname
mon addr =3D ip:6789
Cheers
Peter
Am 08.01.21 um 12:05 schrieb Frank Thommen:
>
>
> On 08.01.21 11:45, Uwe Sauter wrote:
>>
>>
>> Am 08.01.21 um 11:36 schrieb Frank Thommen:
>>>
>>> On 05.01.21 21:17, Frank Thommen wrote:
>>>> On 05.01.21 21:02, Uwe Sauter wrote:
>>>>> There's a paragraph about probing mons on
>>>>>
>>>>> https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshootin=
g-mon/
>>>>>
>>>>
>>>> I will check that (tomorrow :-)
>>>
>>>
>>> using the monitor's admin socket on either of the three nodes I can
>>> query the monitors of 01 and 03 (the good ones) but not of 02 (the
>>> problematic one):
>>>
>>> root@odcf-pve01:~# ceph tell mon.odcf-pve02 mon_status
>>> Error ENOENT: problem getting command descriptions from mon.odcf-pve02
>>> root@odcf-pve01:~#
>>>
>>> The monitor daemon is running on all three and the ports are open.
>>>
>>> Any other ideas?
>>
>> You could check the permissions on the socket:
>>
>> ss -xln | grep ceph-mon
>> SOCK=3D$(ss -xln | awk '/ceph-mon/ {print $5}')
>> ls -la ${SOCK}
>>
>> On my host, this shows
>>
>> srwxr-xr-x 1 ceph ceph 0 Dec 20 23:47
>> /var/run/ceph/ceph-mon.px-alpha-cluster.asok
>
> same here
>
> _______________________________________________
> pve-user mailing list
> pve-user@lists.proxmox.com
> https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-user
>