public inbox for pve-user@lists.proxmox.com
 help / color / mirror / Atom feed
From: <clayj@n7qnm.net>
To: <pve-user@lists.proxmox.com>
Subject: [PVE-User] Change Ceph Public Network
Date: Mon, 7 Oct 2024 14:06:57 -0700	[thread overview]
Message-ID: <6c0e01db18fc$d87ae700$8970b500$@n7qnm.net> (raw)

I have Promox and Ceph running on 5 servers.  

 

I currently have 2 NICs in each server, a 1Gb NIC that's configured as the
Ceph "public network", 192.168.75.0/24; and a 2.5Gb NIC that's configured as
the Ceph "cluster network, 192.168.70.0/24.   The .75 net is also what
connects the servers to the "rest of the world", including some Synology NAS
servers.

 

I have a 1Tb SSD drive on 4 of the 5 servers configured as  Ceph OSDs.

 

I'd like to get better performance out of Ceph, so I added a 3rd 2Gb NIC to
each server, 192.168.71.0/24.

 

I took down all my VMs; and in ceph.conf, changed the mon entries and the
public_network entries from 192.168.75.xx to 192.168.71.xx; then did a
"restart ceph-target" on each of the Proxmox servers.

 

That was a complete disaster!   Ceph never came back up and I had to reverse
the process in order to restore.

 

Is there a "correct" way to do this; or did I just miss a step.  Is there a
config file for the OSDs that I need to change?

 

Thanks in advance!

 

Clay Jackson

clayj@n7qnm.net <mailto:clayj@n7qnm.net> 

 

_______________________________________________
pve-user mailing list
pve-user@lists.proxmox.com
https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-user


             reply	other threads:[~2024-10-07 21:43 UTC|newest]

Thread overview: 2+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2024-10-07 21:06 clayj [this message]
2024-10-07 21:48 David der Nederlanden | ITTY via pve-user

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to='6c0e01db18fc$d87ae700$8970b500$@n7qnm.net' \
    --to=clayj@n7qnm.net \
    --cc=pve-user@lists.proxmox.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox
Service provided by Proxmox Server Solutions GmbH | Privacy | Legal