From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: <gianni.milo22@gmail.com> Received: from firstgate.proxmox.com (firstgate.proxmox.com [212.224.123.68]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by lists.proxmox.com (Postfix) with ESMTPS id 531AF69607 for <pve-user@lists.proxmox.com>; Mon, 26 Jul 2021 23:35:23 +0200 (CEST) Received: from firstgate.proxmox.com (localhost [127.0.0.1]) by firstgate.proxmox.com (Proxmox) with ESMTP id 38BDE12512 for <pve-user@lists.proxmox.com>; Mon, 26 Jul 2021 23:35:23 +0200 (CEST) Received: from mail-yb1-xb29.google.com (mail-yb1-xb29.google.com [IPv6:2607:f8b0:4864:20::b29]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by firstgate.proxmox.com (Proxmox) with ESMTPS id 2BF86124D5 for <pve-user@lists.proxmox.com>; Mon, 26 Jul 2021 23:35:21 +0200 (CEST) Received: by mail-yb1-xb29.google.com with SMTP id d73so17155153ybc.10 for <pve-user@lists.proxmox.com>; Mon, 26 Jul 2021 14:35:21 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to; bh=ui3+r9VhZ39mL/Uf77PXIGhZuuLIDEGAl8L2H5M24Fo=; b=ICF1awJEYIXztwfdGrkvRQUptagp/k3IKKgUS+Pnc0aGWACQzhjh9SXbAE/OlAS6vD jWi5/ZrLt4COhRhFOlCFUfy4t6JcfTxQ5L3tF91qzTHJS8r0PjCaKS9+y5swOWK844N3 Z/OZ8XxPUVpctNleh7t05dD4o1w+IK189yRzKig32O32/q6t0W0pVt2GBaeLgYflv292 wLK6tyK/Csxpk3qHsGyORDeGvJ6iIA9auOdpNkhV/ESR6Xx+D77mSLQ9f3GLBkUsm2jW sWngg3VvDKJQj2PTxBAH8ofiOMIj80lFbSDCFwIqZuDzftv3jSiMTb9G3OyTuOiACC/r PA5w== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to; bh=ui3+r9VhZ39mL/Uf77PXIGhZuuLIDEGAl8L2H5M24Fo=; b=OVQnN2s2DUfOpbl+LnIGYyrV0V92WHzC+K07NnsiiibsjWaoj0GzQzvi1hJY2rnpAy tfDQIWGmGF83qt5Bk0HR7TwqomitpQEkqUlVx/iGi+wauXvHHlEjr+4rVKN7O5/+TPXk wyo40vDfk5pIp6jvF+qp6EiqOYOGZKPSHk30e67jF91WX810AX9q8adV06gqzny5YaqZ XMlieJrojY7WJIC8U/uflszrKQ49iwRVR7EiBUSBrJ3joLSjRQoIxSd69xy0OBSelDfY vdJ78nWkkdxMAgRJ4yVEOnvUoY6Ruk+0eykfDMlQ59sgEFe40vzQlEVvYzytuIMGwIe6 W1Og== X-Gm-Message-State: AOAM530G+xfUNRoiiARt1Ds4NA9Ymp56WByUx2GVJPKLbEJbQcm5+zKF YswJXWdchs2r0BvDwNxsBKdiWVq0IJxuevjYXu/lhAso X-Google-Smtp-Source: ABdhPJwWo1z26ChG4y3QmQdHBsrZfn+t1Pxhueh1a9XBwXW+tttI8k3pqq0lHc+wfyAeMGUd7z8CHMSPx/vEdrgCZYw= X-Received: by 2002:a25:31c5:: with SMTP id x188mr27424335ybx.291.1627335313281; Mon, 26 Jul 2021 14:35:13 -0700 (PDT) MIME-Version: 1.0 References: <20210726093746.GB3289@sv.lnf.it> In-Reply-To: <20210726093746.GB3289@sv.lnf.it> From: "Yanni M." <gianni.milo22@gmail.com> Date: Mon, 26 Jul 2021 22:35:02 +0100 Message-ID: <CACzVk9VcwNAio_QTEaaK-5veLw8VE_xvQDVdR0FnRAG97iaMRw@mail.gmail.com> To: Proxmox VE user list <pve-user@lists.proxmox.com> X-SPAM-LEVEL: Spam detection results: 0 AWL 0.857 Adjusted score from AWL reputation of From: address BAYES_00 -1.9 Bayes spam probability is 0 to 1% DKIM_SIGNED 0.1 Message has a DKIM or DK signature, not necessarily valid DKIM_VALID -0.1 Message has at least one valid DKIM or DK signature DKIM_VALID_AU -0.1 Message has a valid DKIM or DK signature from author's domain DKIM_VALID_EF -0.1 Message has a valid DKIM or DK signature from envelope-from domain FREEMAIL_ENVFROM_END_DIGIT 0.25 Envelope-from freemail username ends in digit FREEMAIL_FROM 0.001 Sender email is commonly abused enduser mail provider HTML_MESSAGE 0.001 HTML included in message POISEN_SPAM_PILL_4 0.1 random spam to be learned in bayes RCVD_IN_DNSWL_NONE -0.0001 Sender listed at https://www.dnswl.org/, no trust SPF_HELO_NONE 0.001 SPF: HELO does not publish an SPF Record SPF_PASS -0.001 SPF: sender matches SPF record Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.29 Subject: Re: [PVE-User] ZFS configurations, performance and optimization... X-BeenThere: pve-user@lists.proxmox.com X-Mailman-Version: 2.1.29 Precedence: list List-Id: Proxmox VE user list <pve-user.lists.proxmox.com> List-Unsubscribe: <https://lists.proxmox.com/cgi-bin/mailman/options/pve-user>, <mailto:pve-user-request@lists.proxmox.com?subject=unsubscribe> List-Archive: <http://lists.proxmox.com/pipermail/pve-user/> List-Post: <mailto:pve-user@lists.proxmox.com> List-Help: <mailto:pve-user-request@lists.proxmox.com?subject=help> List-Subscribe: <https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-user>, <mailto:pve-user-request@lists.proxmox.com?subject=subscribe> X-List-Received-Date: Mon, 26 Jul 2021 21:35:23 -0000 In my opinion, you are not doing something wrong but likely are the limitations of relatively small raidz1 array (3 disks) and the parity calculation overhead which both are leading to lower performance compared to that of the mirrored array. Wherever possible, choose multiple mirrored vdev configuration (raid10) rather than raidz, as VMs in general tend to be more interested in IOPS rather than bandwidth (streaming) performance. If you decide to keep raidz1, then try adding more disks onto it. If you use zvols for the VMs, try increasing volblocksize from 8k which is the default, to 16k or 32k. Personally, I'd add one more disk into the mix and go for 2 vdev mirrored setup (raid10) and keep the zfs defaults. On Mon, 26 Jul 2021 at 10:37, Marco Gaiarin <gaio@sv.lnf.it> wrote: > > Consider two rather equal servers, both with equal disks (2TB > rotational drives); one server have a ZFS mirror (two disk), the other > have a ZFS RAIDZ1, with 3 disks. > > Both server are unload, we are moving data in, via single > Gigabit connection. > > > Moving data into the ZFS mirror lead to a impressive 120 Mbyte/s > writing speed, with little or no iodelay (1-2 %). > > Moving data into ZRAID1 lead to an 60-70 Mbyte/s writing speed, no > more, and a decent iodelay on the system (8-10 %). > > Both seems to me configured equally (eg, for example, no compression). > > > I've read: > > > https://pve.proxmox.com/wiki/ZFS_on_Linux#sysadmin_zfs_raid_consideration= s > > but really i'm got a bit lost... there's somewhere a more clear > explanation of the 'effect', and i hope some parameters to tackle with? > > > Thanks. > > > PS: it is not a problem 'per se', the RAIDZ1 pool could be 'slow', but > i've the doubt to have done somthing wrong... > > -- > dott. Marco Gaiarin GNUPG Key ID: > 240A3D66 > Associazione ``La Nostra Famiglia'' > http://www.lanostrafamiglia.it/ > Polo FVG - Via della Bont=C3=A0, 7 - 33078 - San Vito al Taglia= mento > (PN) > marco.gaiarin(at)lanostrafamiglia.it t +39-0434-842711 f > +39-0434-842797 > > Dona il 5 PER MILLE a LA NOSTRA FAMIGLIA! > http://www.lanostrafamiglia.it/index.php/it/sostienici/5x1000 > (cf 00307430132, categoria ONLUS oppure RICERCA SANITARIA) > > _______________________________________________ > pve-user mailing list > pve-user@lists.proxmox.com > https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-user > >