From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from firstgate.proxmox.com (firstgate.proxmox.com [212.224.123.68]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits)) (No client certificate requested) by lists.proxmox.com (Postfix) with ESMTPS id E51A169A31 for ; Wed, 24 Feb 2021 20:04:19 +0100 (CET) Received: from firstgate.proxmox.com (localhost [127.0.0.1]) by firstgate.proxmox.com (Proxmox) with ESMTP id CF64E2D4C0 for ; Wed, 24 Feb 2021 20:03:49 +0100 (CET) Received: from proxmox-new.maurer-it.com (proxmox-new.maurer-it.com [212.186.127.180]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits)) (No client certificate requested) by firstgate.proxmox.com (Proxmox) with ESMTPS id 3EF792D4B2 for ; Wed, 24 Feb 2021 20:03:48 +0100 (CET) Received: from proxmox-new.maurer-it.com (localhost.localdomain [127.0.0.1]) by proxmox-new.maurer-it.com (Proxmox) with ESMTP id 0250C46311; Wed, 24 Feb 2021 20:03:48 +0100 (CET) Message-ID: <06a2bbdd-8496-14b0-472d-ce74c59abbcb@proxmox.com> Date: Wed, 24 Feb 2021 20:03:46 +0100 MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:86.0) Gecko/20100101 Thunderbird/86.0 Content-Language: en-US To: Eneko Lacunza , Stefan Reiter , pve-user@lists.proxmox.com References: <748aba12-573f-0bc8-17d7-b94b9b9b8cef@proxmox.com> <6120d3f8-67c8-873f-164c-1913c2016a54@binovo.es> From: Thomas Lamprecht In-Reply-To: <6120d3f8-67c8-873f-164c-1913c2016a54@binovo.es> Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-SPAM-LEVEL: Spam detection results: 0 AWL -0.056 Adjusted score from AWL reputation of From: address KAM_DMARC_STATUS 0.01 Test Rule for DKIM or SPF Failure with Strict Alignment NICE_REPLY_A -0.001 Looks like a legit reply (A) RCVD_IN_DNSWL_MED -2.3 Sender listed at https://www.dnswl.org/, medium trust SPF_HELO_NONE 0.001 SPF: HELO does not publish an SPF Record SPF_PASS -0.001 SPF: sender matches SPF record URIBL_BLOCKED 0.001 ADMINISTRATOR NOTICE: The query to URIBL was blocked. See http://wiki.apache.org/spamassassin/DnsBlocklists#dnsbl-block for more information. [proxmox.com] Subject: Re: [PVE-User] PBS backup/restore issue X-BeenThere: pve-user@lists.proxmox.com X-Mailman-Version: 2.1.29 Precedence: list List-Id: Proxmox VE user list List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 24 Feb 2021 19:04:19 -0000 Hi! On 24.02.21 12:53, Eneko Lacunza wrote: > El 24/2/21 a las 11:34, Stefan Reiter escribi=C3=B3: >> On 2/23/21 8:46 AM, Eneko Lacunza wrote: >>> Yesterday I hit a problem with PBS. My sequence of actions was: >>> >>> 1.a Install debian 10 VM (updated to latest, only system utilities an= d SSH server) >>> 1.b Add SSH access key to root >>> 1.c Shutdown VM >>> 1.d Backup to PBS and to NFS v=C3=ADa regular backup. >>> 1.e Start VM and install various packages - all OK. >>> 1.f Stop VM >>> >>> 2.a Restore VM from PBS backup >>> 2.b Start VM and install various packages - apt complains about no ne= wline in linux-image-amd64 file manifest, can't install new packages. >>> 2.c Stop VM >>> >>> 3.a Restore VM from NFS regular backup >>> 3.b Start VM and install various packages - all OK. >>> [snip] > My original restores were to a ceph storage (r2 on HDD with SSD journal= /DB). So i have restored again both, to that ceph storage: [snip] >=20 > Hope this info helps you to replicate the issue. FYI: Stefan could replicate it and send a patch[0] which is included now.= It boiled down to caches not being flushed to disk for storage attached t= hrough user-space libraries (vs. kernel) by QEMU in the PBS restore case. In your case you probably do not have the "KRBD" checkbox ticked for the = Ceph storage entry in PVE, so the user-space librbd is used for accessing that= storage through QEMU, where this issue then hit on restore. If you want to try the fix out, there's a new QEMU package available on p= vetest: http://download.proxmox.com/debian/pve/dists/buster/pvetest/binary-amd64/= pve-qemu-kvm_5.2.0-2_amd64.deb sha256sum: 6a086e0b669447f0b8a7899f9194a26785e6b0070f3dec1be4f95067bc707c= 7a cheers, Thomas [0]: https://lists.proxmox.com/pipermail/pve-devel/2021-February/047131.h= tml