From mboxrd@z Thu Jan  1 00:00:00 1970
Return-Path: <d.alexandris@gmail.com>
Received: from firstgate.proxmox.com (firstgate.proxmox.com [212.224.123.68])
 (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
 key-exchange X25519 server-signature RSA-PSS (2048 bits))
 (No client certificate requested)
 by lists.proxmox.com (Postfix) with ESMTPS id D0DC074AD6
 for <pve-user@lists.proxmox.com>; Mon, 19 Apr 2021 22:21:36 +0200 (CEST)
Received: from firstgate.proxmox.com (localhost [127.0.0.1])
 by firstgate.proxmox.com (Proxmox) with ESMTP id BF5F019B80
 for <pve-user@lists.proxmox.com>; Mon, 19 Apr 2021 22:21:06 +0200 (CEST)
Received: from mail-yb1-xb2d.google.com (mail-yb1-xb2d.google.com
 [IPv6:2607:f8b0:4864:20::b2d])
 (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits)
 key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256)
 (No client certificate requested)
 by firstgate.proxmox.com (Proxmox) with ESMTPS id 25E5119B63
 for <pve-user@lists.proxmox.com>; Mon, 19 Apr 2021 22:21:01 +0200 (CEST)
Received: by mail-yb1-xb2d.google.com with SMTP id o10so40292691ybb.10
 for <pve-user@lists.proxmox.com>; Mon, 19 Apr 2021 13:21:01 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025;
 h=mime-version:references:in-reply-to:from:date:message-id:subject:to;
 bh=GlIwXa2aa8oTdAfO84/gQzJfFaiCXUSK4CiAzSLdOzg=;
 b=G4elnjn+LUE5RV9UAXxU50dmS8eBwfPvRo7gUW25YA6GTdTLIiFwcphTIFLq0V3gjO
 0iHfgB6NXjASYyc6PJ89ulDHGSYymnPsOsqKJRQZj3FLGBBxJUMEpBs0Qu1Ev5H05EV3
 /VdlYWXKDzDPs9psPST0oGZszTwKy1F7M5x0lKGtPgABo1IVYW93Xr++qPmNSfxkNBQJ
 tkU6wmwaWXXUlCf2Nzsa6M0w6pWcti/Pf5sziwan4jFg7Lhtc7objiYCRJVibQ1utr2z
 ksFDY6sAskznFX7RFePngpE2gSGv8KqXCAE3y34cVxWImtb/s2ANnqqUXWMxFdKeOkFT
 vPkQ==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
 d=1e100.net; s=20161025;
 h=x-gm-message-state:mime-version:references:in-reply-to:from:date
 :message-id:subject:to;
 bh=GlIwXa2aa8oTdAfO84/gQzJfFaiCXUSK4CiAzSLdOzg=;
 b=eRPbBasaDowvwWZ7ztt509Oh61tqiJNE+ccFGpnJlJNR+GrMcy0uGqlSvjwwMnYmAZ
 oGKYgJtS40YWSuc9hzk0aG9Er5rEa55qKI8JuoElbLPDhtIYwKJOTACjB1WJltbk0vFd
 tuw2IlIR/jeYAUN2TrwjnOCTPhE2G1MEqPPSurfwqcY9ZUcdj8T0XoPFe9+JxZbf8KS3
 NRlpPOfCciYo/7tlMCUcy3BndB8WlCSmDX+zS9t86WQrgMMj/ozg+Zphv35ac1XqVvCs
 cLWykVah1P4mXkhG3mJiKCSO8DdwffqBr8n29MN/TyXp6P8CDtlIAsU6EJpI78MXZRxV
 zsIw==
X-Gm-Message-State: AOAM532P9unZDijbF8RfY8sttRwyq4HT0UN1vlv55NEDIcjiF4mpn1fY
 F52l1ga0m5PpBwUPu3/7oJLJUTWAH3YesCOQfoj7YAOCD/YZdOSE
X-Google-Smtp-Source: ABdhPJzhHWolita1w/9CvsrMNKEY4mT6cuXUbCktbu/3ZfI9V9VQHksX3MXfqV+MxpQolPMYGG6PHxf/TZljTaKd/JE=
X-Received: by 2002:a25:ae0f:: with SMTP id a15mr18481183ybj.294.1618863654358; 
 Mon, 19 Apr 2021 13:20:54 -0700 (PDT)
MIME-Version: 1.0
References: <CALt2oz6qSFaWYTZMrkWrc9tVsXB1hvX+ugzDbfnE_L+Fn3q=Gw@mail.gmail.com>
 <CAO6gj4_EtDMzB4bgMoE-cTzv2U6ERCXikzq5BWndo8FhmRC4=A@mail.gmail.com>
In-Reply-To: <CAO6gj4_EtDMzB4bgMoE-cTzv2U6ERCXikzq5BWndo8FhmRC4=A@mail.gmail.com>
From: Dimitri Alexandris <d.alexandris@gmail.com>
Date: Mon, 19 Apr 2021 23:20:18 +0300
Message-ID: <CAOWoYHqzeYnZoV0HKj30uuWv4cwPKB9GCAOF5sb5879axoSPEQ@mail.gmail.com>
To: Proxmox VE user list <pve-user@lists.proxmox.com>
X-SPAM-LEVEL: Spam detection results:  0
 AWL -0.050 Adjusted score from AWL reputation of From: address
 DKIM_SIGNED               0.1 Message has a DKIM or DK signature,
 not necessarily valid
 DKIM_VALID -0.1 Message has at least one valid DKIM or DK signature
 DKIM_VALID_AU -0.1 Message has a valid DKIM or DK signature from author's
 domain
 DKIM_VALID_EF -0.1 Message has a valid DKIM or DK signature from envelope-from
 domain
 FREEMAIL_FROM 0.001 Sender email is commonly abused enduser mail provider
 HTML_MESSAGE            0.001 HTML included in message
 POISEN_SPAM_PILL_4        0.1 random spam to be learned in bayes
 RCVD_IN_DNSWL_NONE     -0.0001 Sender listed at https://www.dnswl.org/,
 no trust
 SPF_HELO_NONE           0.001 SPF: HELO does not publish an SPF Record
 SPF_PASS               -0.001 SPF: sender matches SPF record
Content-Type: text/plain; charset="UTF-8"
X-Content-Filtered-By: Mailman/MimeDel 2.1.29
Subject: Re: [PVE-User] get the most of storage for a very old dell pe 2950.
X-BeenThere: pve-user@lists.proxmox.com
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Proxmox VE user list <pve-user.lists.proxmox.com>
List-Unsubscribe: <https://lists.proxmox.com/cgi-bin/mailman/options/pve-user>, 
 <mailto:pve-user-request@lists.proxmox.com?subject=unsubscribe>
List-Archive: <http://lists.proxmox.com/pipermail/pve-user/>
List-Post: <mailto:pve-user@lists.proxmox.com>
List-Help: <mailto:pve-user-request@lists.proxmox.com?subject=help>
List-Subscribe: <https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-user>, 
 <mailto:pve-user-request@lists.proxmox.com?subject=subscribe>
X-List-Received-Date: Mon, 19 Apr 2021 20:21:36 -0000

I have an old Dell 1950 with one cpu (2 disks).  Was 1+1G ram, added 16+16
and now have 34G.  Two power supplies.

1-  Never bothered to change SAS controller mode.
2-  SATA disks (up to 2T of course) work perfectly, never used transposers.
3-  First worked with an internal SSD (at internal SATA port, plus an addon
power cable) for OS (always ZFS) + 2 SATA disks (ZFS raid) for data.  3
years, no problems.
4-  Now i bought 2 SAS 1T, with OS on them, and also works fine.
5-  Hot plugging disks is working fine.  I actually increased capacity with
bigger disks without stopping anything this way.  Had 500G SATA before 1T
SAS diks.

I configure the 2 eths in OVS (openvswitch) bond mode, with several VLANS
and internal networks (OVS IntPorts).

In your case, with many SAS disks you will be fine with any configuration,
e.g.:

3+3 x 2T = 6T ZFS raid, OS + data, the fastest combination, or
5+1 ZFS raidz, 10T space, with best capacity, or
4+2 ZFS raidz2, 8T space, also big, and safer.

Do yourself a favour, and buy some decent SAS disks, at 7200rpm are very
cheap.


On Mon, Apr 19, 2021 at 6:08 PM Kyle Schmitt <kyleaschmitt@gmail.com> wrote:

> I run on R610s, so about the same generation I think.  I use the
> hardware raid for mirrored boot drive only, and NFS over 10G for VM
> storage, which is on a seperate system running FreeBSD + ZFS.
>
> But for your case: the general rule for any storage system is don't
> mix.  You pick one and only one: hardware raid, software raid, zfs,
> ceph, etc.  The exceptions are for systems you almost definitely won't
> be using like luster and gluster.
>
> You can still do hotplug with JBOD mode, at least on the dell hardware
> I've used.  I have no idea if it's officially supported or not.  I do
> know that I sometimes have to use the raid tools to bring in a new
> drive when it's NOT in JBOD mode.
>
> In the 6ish years I've run ZFS I've only had one drive fail (pure
> luck, not skill), and it was trivial to swap out and replace.
>
> --Kyle
>
> On Mon, Apr 19, 2021 at 7:59 AM Leandro Roggerone
> <leandro@tecnetmza.com.ar> wrote:
> >
> > Hi guys , I received a very old del pe 2950 box.
> > Fortunately it has 64 GB and a double power supply, so i'm thinking about
> > using it with pve.
> > After confirm with dell support about storage capacity:
> > Max physical storage support is 2TB.
> > Max virtual storage support is also 2TB.
> > ##
> > I was reading on previous emails at this mail list , about storage:
> >  "putting the controller in JBOD mode
> > and install directly with ZFS software RAID."
> >
> > I always thought that raid hardware controller was the best option but ,
> > perhaps I can give it a try to ZFS software RAID with this old server
> ....
> > what do you think ?
> > I have a bunch of 3.5" with odd capacities  unused drives.
> > I readed that zfs can merge them to get a more efficient use.
> > What about hot replace / remove or insert a new drive ?
> > Will it work without service disruption in production environments ?
> >
> > Regards,
> > Leandro.
> >
> > <
> https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=webmail
> >
> > Libre
> > de virus. www.avast.com
> > <
> https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=webmail
> >
> > <#DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2>
> > _______________________________________________
> > pve-user mailing list
> > pve-user@lists.proxmox.com
> > https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-user
> >
>
> _______________________________________________
> pve-user mailing list
> pve-user@lists.proxmox.com
> https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-user
>
>