From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from firstgate.proxmox.com (firstgate.proxmox.com [212.224.123.68]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits)) (No client certificate requested) by lists.proxmox.com (Postfix) with ESMTPS id 5131D72208 for ; Mon, 12 Apr 2021 03:58:06 +0200 (CEST) Received: from firstgate.proxmox.com (localhost [127.0.0.1]) by firstgate.proxmox.com (Proxmox) with ESMTP id 401361880A for ; Mon, 12 Apr 2021 03:58:06 +0200 (CEST) Received: from mail-pj1-x102d.google.com (mail-pj1-x102d.google.com [IPv6:2607:f8b0:4864:20::102d]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by firstgate.proxmox.com (Proxmox) with ESMTPS id DEF83187F1 for ; Mon, 12 Apr 2021 03:58:04 +0200 (CEST) Received: by mail-pj1-x102d.google.com with SMTP id x21-20020a17090a5315b029012c4a622e4aso6201103pjh.2 for ; Sun, 11 Apr 2021 18:58:04 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=subject:to:references:from:message-id:date:user-agent:mime-version :in-reply-to:content-language; bh=6pBRZXumPdYRnkKqLmvYJeUeiF4o2SFpAS/2GoX1tBM=; b=ZCq8LWp4J2gTNkIpJjl2blJnL1YqJebBaA1e40vEgEEnyEqHw6ISH874qZlthKNftG PcrLydmTxCMZhRNhLiNPkGGDdsCQwvlrj1SXaSevTWRyhmcjkm3FTe1Eg2tuvcdQtKxh jHbHhfqpKJfqTwtCa6KtEuNyHISZAYdpNU9daB/L8q51Q9hEi/K9nepM4CbuxystP3NM nuFIQ6qne2FtHfrIgBlPGcwDUzvUihChovcyuOcry+0Y45BKZ3oWRbSV+wmX65y0/eIJ sDEM0NQmoYrgsPlzAdEdxZpUqTo6iL3MF5eo5GjjmRAasvjg7x5IX1g4hlZBMI0LdzKN hUKA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:to:references:from:message-id:date :user-agent:mime-version:in-reply-to:content-language; bh=6pBRZXumPdYRnkKqLmvYJeUeiF4o2SFpAS/2GoX1tBM=; b=SgftAbgFUCTIzJgYYMaZA8P/oy/XT+J38sMq3m7f3UJP26h/04yrvFF73bzu669lo5 PPHoeYkBvrAufLOqQ49/VbfwRO4hsoxJ0Tsm9+AdQk3b/IB0RYrpHFY8TZbDY7xCbSol Zu0oGsWYa40lO4zNI0XVn6nRfZT55A7tKA9mH1+nlgS1VKWdjsyc7sG1cNoAHeqGRnll S+CmPjmrs0kDKNjlHBk6hD4eW42/o8KvMDiUjsmizpm91+ttcLD/xPsRtmuHh7l1Xeob 0Yod80+9PGb8dsAJjJ7dVrycaR7NkVaVEJnbyq3qhi6HfyzhraLv8lLH5JTzB1WvRc9A 2IlA== X-Gm-Message-State: AOAM531UkP+0q+B/zMLjoclarulNVELn4sgwWvoxLzQB7y0DZWoHSt1L pXvYwHXbiJwbTYISskEQ5ZOAF/iBF0Xhuw== X-Google-Smtp-Source: ABdhPJwAb7vKTgKPx8vCL1+0EGvaRHayVEwVKwzgS+UL1qEwxW72EIv2zWXMCFKOpxmItFwI1rxxuw== X-Received: by 2002:a17:902:7c0d:b029:e6:f006:fd02 with SMTP id x13-20020a1709027c0db02900e6f006fd02mr23122803pll.46.1618192676974; Sun, 11 Apr 2021 18:57:56 -0700 (PDT) Received: from [192.168.1.11] (167-179-176-9.a7b3b0.bne.nbn.aussiebb.net. [167.179.176.9]) by smtp.gmail.com with ESMTPSA id t17sm6316280pfe.35.2021.04.11.18.57.54 for (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Sun, 11 Apr 2021 18:57:55 -0700 (PDT) To: pve-user@lists.proxmox.com References: <15e5bfd5-7458-fdbe-5079-ce78a19e0099@gmail.com> From: Lindsay Mathieson Message-ID: <33f7cf57-9ca2-1c05-89db-9fceaf5e4cc5@gmail.com> Date: Mon, 12 Apr 2021 11:57:50 +1000 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:78.0) Gecko/20100101 Thunderbird/78.9.1 MIME-Version: 1.0 In-Reply-To: Content-Language: en-US X-SPAM-LEVEL: Spam detection results: 0 AWL 0.041 Adjusted score from AWL reputation of From: address DKIM_SIGNED 0.1 Message has a DKIM or DK signature, not necessarily valid DKIM_VALID -0.1 Message has at least one valid DKIM or DK signature DKIM_VALID_AU -0.1 Message has a valid DKIM or DK signature from author's domain DKIM_VALID_EF -0.1 Message has a valid DKIM or DK signature from envelope-from domain FREEMAIL_FROM 0.001 Sender email is commonly abused enduser mail provider HTML_MESSAGE 0.001 HTML included in message NICE_REPLY_A -0.001 Looks like a legit reply (A) RCVD_IN_DNSWL_NONE -0.0001 Sender listed at https://www.dnswl.org/, no trust SPF_HELO_NONE 0.001 SPF: HELO does not publish an SPF Record SPF_PASS -0.001 SPF: sender matches SPF record Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-Content-Filtered-By: Mailman/MimeDel 2.1.29 Subject: Re: [PVE-User] Revisited: External disk backup using PBS - Requesting Criticism/Advice? X-BeenThere: pve-user@lists.proxmox.com X-Mailman-Version: 2.1.29 Precedence: list List-Id: Proxmox VE user list List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 12 Apr 2021 01:58:06 -0000 On 10/04/2021 5:10 pm, Arjen via pve-user wrote: > Don't expect to be able to backup the PBS container with 4TB to a 2TB external drive. The Datastore of a PSB does not compress much further and Proxmox VE Backup will only backup virtual disks and not mountpoints or storages passed from host, if I understand correctly. > I suggest adding a virtual disk of 2TB to the PBS container (and format it with ext4) which can be backed up by the Proxmox VE Backup. > I would also run the PBS container (with virtual disk) on the cluster instead on separate hardware which is a single point of failure. The local PBS would be then just as reliable as your cluster. > > Regarding safeness: I suggest doing a automated disaster recovery every week to make sure it works as expected. Or at least partially, like restoring the PBS from an external drive. > Regarding practicality: I would have a remote PBS sync with your local PBS instead of moving physical disks (but you mentioned before that that was not really possible). Did some testing over the weekend. * Setup a PBS Container with a 2TB root disk * Backed up 6 VM's to it. * Backed up the PBS Container to a external disk using vzdump (using the std proxmox gui) o Slooow process at 30MB/s :) * Deleted the PBS Container * Deleted the backup VM's * Restored the PBS container from the external hard disk o Much faster - averaged around 100MB/s * Restored PBS Container started fine and verified. * Restored the backed up VM's from the PBS Container o Worked as expected o All backup and running. All in all, worked as I wanted and seems a viable option for full image offsite backups via external hard disks. The process of backing up the PBS container to the external drive is *very* slow :( I estimate 11 hours for a full cluster backup copy. But since its on a independent node, it doesn't load the main cluster and can just happen over the weekend. -- Lindsay