From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from firstgate.proxmox.com (firstgate.proxmox.com [212.224.123.68]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by lists.proxmox.com (Postfix) with ESMTPS id A042B73487 for ; Fri, 18 Jun 2021 08:26:03 +0200 (CEST) Received: from firstgate.proxmox.com (localhost [127.0.0.1]) by firstgate.proxmox.com (Proxmox) with ESMTP id 8ECCC22FC1 for ; Fri, 18 Jun 2021 08:26:03 +0200 (CEST) Received: from mx1.xpecto.de (mx1.xpecto.de [212.102.161.249]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by firstgate.proxmox.com (Proxmox) with ESMTPS id 7419722FB5 for ; Fri, 18 Jun 2021 08:26:02 +0200 (CEST) Received: from localhost (mx1.xpecto.de [127.0.0.1]) by mx1.xpecto.de (Postfix) with ESMTP id 25DCC320FEA for ; Fri, 18 Jun 2021 08:25:56 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=xpecto.com; s=20170902; t=1623997556; bh=CE+1BEdUODXIhswKLVTw30eFs121H6CwQZvmjHCVhBo=; h=From:To:Subject:Date:References:In-Reply-To:From; b=1ojR3DKuR8lIe+oHw4K+VccdygPXUSxlhk6j6xy575xI1KLGF4z7yBc0fjjRzT4lb 6kkNGcywze3Ek4rypzaOID3zneeKdgmaX92WSzkWqgPmAhK0Zr0XtAjS6HHDH7rIOf 6fXOZGXh7UNCrKFY9hqeuwrT3+LILQtLCh0DFVoOxt0y4XWdqo2IZzBfBgNvSuZ95E N/Iw5Y+duPd+IFXp7PWGxUPOv2ABdv6I44Q/Il9l3o8pbrwclZ07pTsGB3JwfUtqc6 HJGeWimZRSLhApuJ1dsYT0eXSOK//0gXu2QGtiKcezgXhYPfAV5mbWF9tRfEsssbfS m4rDOTxSkYEgQ== X-Virus-Scanned: Debian amavisd-new at mx1.xpecto.de X-Spam-Flag: NO X-Spam-Score: -50.59 X-Spam-Status: No, score=-50.59 tagged_above=-999 required=2 tests=[BAYES_00=-1, KHOP_HELO_FCRDNS=0.399, LOCAL_RCVD=-50, SPF_HELO_NONE=0.001, T_SPF_PERMERROR=0.01] autolearn=ham autolearn_force=no Received: from mx1.xpecto.de ([127.0.0.1]) by localhost (mx1.xpecto.de [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id ka551mehEBbB for ; Fri, 18 Jun 2021 08:25:54 +0200 (CEST) Received: from postman.xpecto.de (postman.xpecto.local [10.208.30.11]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by mx1.xpecto.de (Postfix) with ESMTPS for ; Fri, 18 Jun 2021 08:25:54 +0200 (CEST) Received: from postman.xpecto.local (10.208.30.11) by postman.xpecto.local (10.208.30.11) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2242.10; Fri, 18 Jun 2021 08:25:54 +0200 Received: from postman.xpecto.local ([fe80::f965:5e8e:bcd:74f3]) by postman.xpecto.local ([fe80::f965:5e8e:bcd:74f3%4]) with mapi id 15.01.2242.010; Fri, 18 Jun 2021 08:25:54 +0200 From: Christoph Weber To: "'pve-user@lists.proxmox.com'" Thread-Topic: Problem with OSD and rrdcached (I think) Thread-Index: Addh3jonnoQPzppbRnuXpQlFBF9+kQAAyl7QAIpPKJA= Date: Fri, 18 Jun 2021 06:25:54 +0000 Message-ID: References: <1c71de3e503c4fc38b2f1965d6670264@xpecto.com> In-Reply-To: Accept-Language: de-DE, en-US Content-Language: de-DE X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [192.168.2.17] Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-SPAM-LEVEL: Spam detection results: 0 AWL 0.317 Adjusted score from AWL reputation of From: address BAYES_00 -1.9 Bayes spam probability is 0 to 1% DKIM_SIGNED 0.1 Message has a DKIM or DK signature, not necessarily valid DKIM_VALID -0.1 Message has at least one valid DKIM or DK signature DKIM_VALID_AU -0.1 Message has a valid DKIM or DK signature from author's domain DKIM_VALID_EF -0.1 Message has a valid DKIM or DK signature from envelope-from domain SPF_HELO_NONE 0.001 SPF: HELO does not publish an SPF Record T_SPF_PERMERROR 0.01 SPF: test of record failed (permerror) URIBL_BLOCKED 0.001 ADMINISTRATOR NOTICE: The query to URIBL was blocked. See http://wiki.apache.org/spamassassin/DnsBlocklists#dnsbl-block for more information. [xpecto.com] Subject: [PVE-User] WG: Problem with OSD and rrdcached (I think) X-BeenThere: pve-user@lists.proxmox.com X-Mailman-Version: 2.1.29 Precedence: list List-Id: Proxmox VE user list List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 18 Jun 2021 06:26:03 -0000 > At last I tried to destroy and recreate the OSDs. When I tried to=20 > recreate it, I got a lot of errors from rrdcached: I think the relevant error line is this the one before the rrdcached messag= es: stderr: /usr/bin/ceph-osd: error while loading shared libraries: 00881:3539= 89632:757542912 Seems there is a shared library missing for the ceph installation which is = required bei the ceph-osd binary. Try to call it directly to see more ( -h for help): /usr/bin/ceph-osd -h The rrdcache errors afterwards are either irrelevant, have the same origin = or at least a similar problem.=20 Maybe you need to fsck your root filesystem and see if apt shows any errors= . apt-get check regards christoph