From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from firstgate.proxmox.com (firstgate.proxmox.com [212.224.123.68]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits)) (No client certificate requested) by lists.proxmox.com (Postfix) with ESMTPS id 3CD989DAD4 for ; Fri, 24 Nov 2023 15:25:04 +0100 (CET) Received: from firstgate.proxmox.com (localhost [127.0.0.1]) by firstgate.proxmox.com (Proxmox) with ESMTP id AFB6910D3C for ; Fri, 24 Nov 2023 15:25:03 +0100 (CET) Received: from gmmr-4.centrum.cz (gmmr-4.centrum.cz [46.255.227.205]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by firstgate.proxmox.com (Proxmox) with ESMTPS for ; Fri, 24 Nov 2023 15:25:02 +0100 (CET) Received: from gmmr-4.centrum.cz (localhost [127.0.0.1]) by gmmr-4.centrum.cz (Postfix) with ESMTP id A6E7530E33 for ; Fri, 24 Nov 2023 15:24:56 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=volny.cz; s=mail; t=1700835896; bh=lYEC++scZmknCfjFBgl+7h3eIkLZ/RDuACeQ9f98IPo=; h=From:Subject:Date:References:To:In-Reply-To:From; b=Ptf1Gn5WGch1BuPuYJ/Ie++fkTNoY9Dlfm3LXz27yhw90MdpAYtF0CqNDeuFCbN2K 72rOZe0rkAkMFK9Fo/7gH8nFFDGo+P5q4+Oz0gmNBYYTshciDxN48S2c0zRv+vPbiC SPBJbbrHkRCraRj8oTQfr4h/sg+owLV2Ql3NGw+0= Received: from antispam64.centrum.cz (unknown [10.30.208.64]) by gmmr-4.centrum.cz (Postfix) with ESMTP id 8AA2B202880F for ; Fri, 24 Nov 2023 15:24:56 +0100 (CET) X-IPAS-Result: =?us-ascii?q?A2E2AADWsWBl/03h/y5aHQEBAQEJARIBBQUBQAmBMggBC?= =?us-ascii?q?wGDMoFdCYxnjgCNX4UUhlCBJQMYPg8BAQEBAQEBAQEJPQcEAQEDBIR/AocqJ?= =?us-ascii?q?zQJDgECBAEBAQEDAgMBAQEBAQEDAQEGAQEBAQEBBgUBAoEZhS85DYJcEYEMX?= =?us-ascii?q?wk2AQEBAQEBAQEBAQEBAQEBAQEBFwINfAIBA4EJCwQIATlXBoMTAYJeFAava?= =?us-ascii?q?4E0GgJlswofgWIGgUgBiAwBgU6IQEKCDYE8G4IwOD6CShcCAoVygi8EiSAHM?= =?us-ascii?q?oIig1KOeF0iR1oWGwMHA1YpDysHBDAbBwYJFBgVIwZRBBcRIQkTEj4EgWCBU?= =?us-ascii?q?QqBAj8PDhGCQCICBzY2GUiBIoE5FQY6SnYQKgQUF4EJCARqGxMeNxESFw0DC?= =?us-ascii?q?HQdAhEjPAMFAwQzChINCyEFEwFCA0UGSQsDAhoFAwMEgTMFDR4CEBoGDCcDA?= =?us-ascii?q?xJNAhAUAzsDAwYDCzEDMFVEDE8Dbh8aHAk8DwwfAhseDSclAjJCAxEFEgIWA?= =?us-ascii?q?yQWBDgRCQsrAy8GOAITDAYGCTADCQMHBSwdQAMLGA1IESw1FBsGPyhLB55+D?= =?us-ascii?q?yyEG1cCIoF+KMUShBeBYIJnhzuVIgQvl0wDkjaYQI1nlhOEWoFjggMMB004Z?= =?us-ascii?q?QGCPRIsExmSJ4JkjRZ1AjkCBwsBAQMJiSKBQAEB?= IronPort-PHdr: A9a23:QHexuBavy1de/BXh60pGzEf/LTFF14qcDmcuAnoPtbtCf+yZ8oj4O wSHvLMx1g+PBNiGoKwew8Pt8IneGkU4oqy9+EgYd5JNUxJXwe43pCcHRPC/NEvgMfTxZDY7F skRHHVs/nW8LFQHUJ2mPw6arXK99yMdFQviPgRpOOv1BpTSj8Oq3Oyu5pHfeQpFiCS+bL9oM Rm7rQXcusYXjId8N6081gbHrnxUdutZwm9lOUidkxHg6Mmu4ZVt6T5Qu/Uv985BVaX1YaE1R qFGATolLm44+tTluQHMQgWT6HQcVH4WkgdTDAje8B76RJbxvTDkued7xSKXINf5TbEwWTSl8 qdrVBrlgzoJOjIl7G3ajNF7gblFqxy9uRNw34/UYJmUNPVgeKPdYcgaTndFUspISiBNHp+wY 44JAuUGIOhYspL9p0MQohSiGQmiCuTvyjpSiX/3260xzuAtHA7C0QAlGd8FrXbao8jvNKoKU e660KbHwyjNYfNYxzny6ovGfBc6rP6WQb5wdNDcyUkzGw/biFibtIzrPymS1uQIq2WV6/BvV eSygGEorwF+uCSgxscxgYTOhIIa0FbE9ThiwIsuO924T0p7YdikEZdKqy6bNpJ7T8U/SG5np Cg00KcJuYKnfCcU0pQnwQbSZvyafoWM/h7vSemcLSpmiX95er+yhgq+/Em+x+DzSMW630hHo yVLnNTRtn4ByxLd5tWER/dg/Uqs2iqD2x7d5+xCPEs6m63bK5s7zb4xkJoeqUvDHi7qmEX2k a+ZbV8o9fSv6+TiernmqZ6cN5N0igHjKasigM2/AeM+PwMTXGab4fyx2bLi8EHjXrlHjv07n rPHvJzEJckXvKy0Dg1T340+9Ru/Cyqm0M8EnXYZNlJLZROHjon3NFzWPPz1C+q0jU62nzdx3 f/GO6XsApDKLnfejrjsZa1960tAyAorytBf+o5UBqkBIP3tXk/xs8TVDhA8MwCt2ObnDcl91 psDVW6TGKOWLL3dsVmU5uI1PumMYZUZtyr8KvQ95v7ui2E2mUMFcKSm3JYbcm60E/RmLkmDf 3bgnNcMHX0Iswc8VODqjUeNUT9XZ3a8RaI84TQ7BZqkDYjZQICtnaeB0TylHp1RYmBGDFCNH W30eISFQ/sMbjmdLdd7kjMYTbihV5Mh1Ra2uQPn07ZnNPbb+jUEtZL/09h4//XTlQ8s+jBtE sSdyH+CT3tvk2MMRj82x7x/oVdnxleby6h4hPNZFdlU5/JGSAs1KZncz+kpQ+z1DzrbeceMT 0bufPjuHCo8VJo1wsQSKxJlBdjnkwvOxQKuAqQJjPqTHpsk96XMmXP2IpAu5WzB0fwDhl9uf M9GPm3u0qx28RXIL5DOl0OI0a24I/dPlBXR/XuOmDLd9HpTVxR9BOCYBBgi IronPort-Data: A9a23:lUmHqqL7ClRsQnxmFE+Rc5clxSXFcZb7ZxGr2PjKsXjdYENS0GMHz DZLXWqDM/2CazbyfY9wYYrnoE5U7MSGmt42Glcd+CA2RRqmiyZk6fd1jKvUF3nPRiEWZBs/t 63yUvGZcIZuCCa0Si6FatDJtWN72byDWo3yAevFPjEZbQJ/QU/Nszo68wICqtAu2YTR7z+l4 4uo+JSGYgP9gVaYD0pNg069gEIy1BjNkGxA1rAOTagjlEPTkXATEKUeKcmZR5cvatQ88kaSH o4v/Znhlo/r105F5uCNzt4XRnY3rov6ZmBivFINAvT/3UISzsAF+v1T2PI0MS+7gtgS9jx74 I0lWZeYEW/FMkBQ8Qi0vtYx/yxWZMV7FLH7zXeXj4+/xVDJQ2DW469qDVEIN4cz9ctzHjQbn RAYAGhlghGriOfz27enUrA0wM8uKtXxIYZZsWMIITPxUahgG82eBf+QuJkHg1/chegXdRraT 8gQbyd0RArHZxtefFwFYH47tLvz2iOiIm0JwL6Tjak+/0/J8yNc6bjOCP3NeZ/VQZVFl1nN8 woq+Ey8WHn2Lue30SSIt2+3i/XnmSLgRJlUDKe/5vttkBuYwWl7NfENfQfl56Pk1wjkAY8Zd BN8FjcSkJXePXeDFrHVNyBUalbe4nbwh/I4/zUG1Tyw IronPort-HdrOrdr: A9a23:RuKK2KGX52Kac4M0pLqE+ceALOsnbusQ8zAXPiFKJCC9Hfb3qy nDpp4mPFrP+VUssQ8b6LK90di7LU80nKQdieIs1PWZPTUO01HGEGgN1+vfKkXbakjDytI= X-Talos-CUID: =?us-ascii?q?9a23=3AYgYCuWpiCsdEsSkXeVUB9ijmUf5mXnfAw0fLGW/?= =?us-ascii?q?iDWd5drefYlC9/Lwxxg=3D=3D?= X-Talos-MUID: =?us-ascii?q?9a23=3AhDcYlQ1DCfgbkuQkhzjdqG0r/zUj4K2yL1oyvrg?= =?us-ascii?q?/u+q8EjRzeGiZ3CS+Xdpy?= X-IronPort-Anti-Spam-Filtered: true X-IronPort-AV: E=Sophos;i="6.04,224,1695679200"; d="scan'208,217";a="43425989" Received: from unknown (HELO gm-smtp10.centrum.cz) ([46.255.225.77]) by antispam64.centrum.cz with ESMTP; 24 Nov 2023 15:24:24 +0100 Received: from smtpclient.apple (unknown [10.128.64.66]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by gm-smtp10.centrum.cz (Postfix) with ESMTPSA id BB0BDB8A55 for ; Fri, 24 Nov 2023 15:24:24 +0100 (CET) From: Jan Vlach Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3696.120.41.1.4\)) Date: Fri, 24 Nov 2023 15:24:24 +0100 References: <6b9a818d-1256-435e-bce3-c3a8dbcd6671@proxmox.com> <969ADBB0-ACE4-4136-AAB5-DC02802A4CA8@volny.cz> <18793296-4C84-4345-B1D5-35E472D9278F@volny.cz> <1624311989.1471.1700813540249@webmail.proxmox.com> To: Proxmox VE user list In-Reply-To: Message-Id: <03B4A4F0-747A-4E11-A487-237E85624710@volny.cz> X-Mailer: Apple Mail (2.3696.120.41.1.4) X-SPAM-LEVEL: Spam detection results: 0 AWL 0.082 Adjusted score from AWL reputation of From: address BAYES_00 -1.9 Bayes spam probability is 0 to 1% DKIM_SIGNED 0.1 Message has a DKIM or DK signature, not necessarily valid DKIM_VALID -0.1 Message has at least one valid DKIM or DK signature DKIM_VALID_AU -0.1 Message has a valid DKIM or DK signature from author's domain DKIM_VALID_EF -0.1 Message has a valid DKIM or DK signature from envelope-from domain DMARC_PASS -0.1 DMARC pass policy HTML_MESSAGE 0.001 HTML included in message SPF_HELO_NONE 0.001 SPF: HELO does not publish an SPF Record SPF_PASS -0.001 SPF: sender matches SPF record T_SCC_BODY_TEXT_LINE -0.01 - URIBL_BLOCKED 0.001 ADMINISTRATOR NOTICE: The query to URIBL was blocked. See http://wiki.apache.org/spamassassin/DnsBlocklists#dnsbl-block for more information. [volny.cz, github.io] Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.29 Subject: Re: [PVE-User] Proxmox VE 8.1 released! X-BeenThere: pve-user@lists.proxmox.com X-Mailman-Version: 2.1.29 Precedence: list List-Id: Proxmox VE user list List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 24 Nov 2023 14:25:04 -0000 as per https://github.com/openzfs/zfs/issues/15526 = discussion, this is the workaround for the silent data corruption:=10 echo 0 > /sys/module/zfs/parameters/zfs_dmu_offset_next_sync TL;DR version: this parameter = (https://openzfs.github.io/openzfs-docs/Performance%20and%20Tuning/Module%= 20Parameters.html#zfs-dmu-offset-next-sync = ) has been switched to 1 in = 2.1.5 to trade safety for performance.=20 reproducer script is here: https://github.com/openzfs/zfs/issues/15526#issuecomment-1824966856 = I've managed to hit the data corruption with 8 simultaneous instances of = the script. Allegedly, one needs a beefy computer to hit the bug, but = I've managed to hit it on 2 core AMD fujitsu futro thin client running = opnsense too. (after couple tries) I didn't hit the behavior on debian 11 (PVE8), but managed to reproduce = it in debian 12 (PVE8), FreeBSD 13 and 14. Illumos' ZFS is fine. It seems that the bug gets more exposed, because both freebsd's and = coreutils's >8.32 cp uses 'file_copy_range'. JV=