From mboxrd@z Thu Jan  1 00:00:00 1970
Return-Path: <pve-user-bounces@lists.proxmox.com>
Received: from firstgate.proxmox.com (firstgate.proxmox.com [212.224.123.68])
	by lore.proxmox.com (Postfix) with ESMTPS id AC2E41FF15F
	for <inbox@lore.proxmox.com>; Mon,  7 Oct 2024 23:43:28 +0200 (CEST)
Received: from firstgate.proxmox.com (localhost [127.0.0.1])
	by firstgate.proxmox.com (Proxmox) with ESMTP id 975EAB511;
	Mon,  7 Oct 2024 23:43:49 +0200 (CEST)
DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=n7qnm.net; 
 s=default;
 h=Content-Type:MIME-Version:Message-ID:Date:Subject:To:From:
 Reply-To:Sender:Cc:Content-Transfer-Encoding:Content-ID:Content-Description:
 Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID:
 In-Reply-To:References:List-Id:List-Help:List-Unsubscribe:List-Subscribe:
 List-Post:List-Owner:List-Archive;
 bh=JaRIOJr9LQZM0I+B1IqG7Pz95fKJKxULBJMjRxtsf2Q=; b=kEIwOBTWF3Nfr9PBkElu4Qx0uX
 Vz7kx3BkW1Pl7R12EJJyQmdtWRqsCJ5JiWQF+F7378K3iXU47bv3QFJVFz5kYa/1y7eEcrutRZuvg
 CTcoY3SB9F1zpadiyh1h/Ngb4Z1zs7zf4e6suto4s7tSGHF6xZyhAKbWc5dGeqFgQ3XvtJhONoHCd
 +KOZVrGafcg/wW6UA93SBKq1IiRXlElcIsB7hxPkGriIy0+DSbNwQicV5gtoT6AofMQiUaH7p1/o6
 4Tz6+ai3tXxfSHHErGzqZt9YbmIQD9QsPbQ/VYMzDuJ5E6PBvBK3xf4jlX/Trh1x9MksD3UVRHCnZ
 rTGYW2dw==;
From: <clayj@n7qnm.net>
To: <pve-user@lists.proxmox.com>
Date: Mon, 7 Oct 2024 14:06:57 -0700
Message-ID: <6c0e01db18fc$d87ae700$8970b500$@n7qnm.net>
MIME-Version: 1.0
X-Mailer: Microsoft Outlook 16.0
Thread-Index: AdsY+wnEwJjByjJBTEKFfbVBdSrCkQ==
Content-Language: en-us
X-AntiAbuse: This header was added to track abuse,
 please include it with any abuse report
X-AntiAbuse: Primary Hostname - elderberry.viviotech.us
X-AntiAbuse: Original Domain - lists.proxmox.com
X-AntiAbuse: Originator/Caller UID/GID - [47 12] / [47 12]
X-AntiAbuse: Sender Address Domain - n7qnm.net
X-Get-Message-Sender-Via: elderberry.viviotech.us: authenticated_id:
 clayj@n7qnm.net
X-Authenticated-Sender: elderberry.viviotech.us: clayj@n7qnm.net
X-Source: 
X-Source-Args: 
X-Source-Dir: 
X-SPAM-LEVEL: Spam detection results:  1
 AWL 1.348 Adjusted score from AWL reputation of From: address
 BAYES_20               -0.001 Bayes spam probability is 5 to 20%
 DKIM_SIGNED               0.1 Message has a DKIM or DK signature,
 not necessarily valid
 DKIM_VALID -0.1 Message has at least one valid DKIM or DK signature
 DKIM_VALID_AU -0.1 Message has a valid DKIM or DK signature from author's
 domain
 DKIM_VALID_EF -0.1 Message has a valid DKIM or DK signature from envelope-from
 domain DMARC_MISSING             0.1 Missing DMARC policy
 HTML_MESSAGE            0.001 HTML included in message
 RCVD_IN_VALIDITY_CERTIFIED_BLOCKED 0.001 ADMINISTRATOR NOTICE: The query to
 Validity was blocked. See
 https://knowledge.validity.com/hc/en-us/articles/20961730681243 for more
 information.
 RCVD_IN_VALIDITY_RPBL_BLOCKED 0.001 ADMINISTRATOR NOTICE: The query to
 Validity was blocked. See
 https://knowledge.validity.com/hc/en-us/articles/20961730681243 for more
 information.
 RCVD_IN_VALIDITY_SAFE_BLOCKED 0.001 ADMINISTRATOR NOTICE: The query to
 Validity was blocked. See
 https://knowledge.validity.com/hc/en-us/articles/20961730681243 for more
 information.
 SPF_HELO_PASS          -0.001 SPF: HELO matches SPF record
 SPF_PASS               -0.001 SPF: sender matches SPF record
X-Content-Filtered-By: Mailman/MimeDel 2.1.29
Subject: [PVE-User] Change Ceph Public Network
X-BeenThere: pve-user@lists.proxmox.com
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Proxmox VE user list <pve-user.lists.proxmox.com>
List-Unsubscribe: <https://lists.proxmox.com/cgi-bin/mailman/options/pve-user>, 
 <mailto:pve-user-request@lists.proxmox.com?subject=unsubscribe>
List-Archive: <http://lists.proxmox.com/pipermail/pve-user/>
List-Post: <mailto:pve-user@lists.proxmox.com>
List-Help: <mailto:pve-user-request@lists.proxmox.com?subject=help>
List-Subscribe: <https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-user>, 
 <mailto:pve-user-request@lists.proxmox.com?subject=subscribe>
Reply-To: clayj@n7qnm.net, Proxmox VE user list <pve-user@lists.proxmox.com>
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: 7bit
Errors-To: pve-user-bounces@lists.proxmox.com
Sender: "pve-user" <pve-user-bounces@lists.proxmox.com>

I have Promox and Ceph running on 5 servers.  

 

I currently have 2 NICs in each server, a 1Gb NIC that's configured as the
Ceph "public network", 192.168.75.0/24; and a 2.5Gb NIC that's configured as
the Ceph "cluster network, 192.168.70.0/24.   The .75 net is also what
connects the servers to the "rest of the world", including some Synology NAS
servers.

 

I have a 1Tb SSD drive on 4 of the 5 servers configured as  Ceph OSDs.

 

I'd like to get better performance out of Ceph, so I added a 3rd 2Gb NIC to
each server, 192.168.71.0/24.

 

I took down all my VMs; and in ceph.conf, changed the mon entries and the
public_network entries from 192.168.75.xx to 192.168.71.xx; then did a
"restart ceph-target" on each of the Proxmox servers.

 

That was a complete disaster!   Ceph never came back up and I had to reverse
the process in order to restore.

 

Is there a "correct" way to do this; or did I just miss a step.  Is there a
config file for the OSDs that I need to change?

 

Thanks in advance!

 

Clay Jackson

clayj@n7qnm.net <mailto:clayj@n7qnm.net> 

 

_______________________________________________
pve-user mailing list
pve-user@lists.proxmox.com
https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-user