From mboxrd@z Thu Jan  1 00:00:00 1970
Return-Path: <lindsay.mathieson@gmail.com>
Received: from firstgate.proxmox.com (firstgate.proxmox.com [212.224.123.68])
 (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
 key-exchange X25519 server-signature RSA-PSS (2048 bits))
 (No client certificate requested)
 by lists.proxmox.com (Postfix) with ESMTPS id 5131D72208
 for <pve-user@lists.proxmox.com>; Mon, 12 Apr 2021 03:58:06 +0200 (CEST)
Received: from firstgate.proxmox.com (localhost [127.0.0.1])
 by firstgate.proxmox.com (Proxmox) with ESMTP id 401361880A
 for <pve-user@lists.proxmox.com>; Mon, 12 Apr 2021 03:58:06 +0200 (CEST)
Received: from mail-pj1-x102d.google.com (mail-pj1-x102d.google.com
 [IPv6:2607:f8b0:4864:20::102d])
 (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits)
 key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256)
 (No client certificate requested)
 by firstgate.proxmox.com (Proxmox) with ESMTPS id DEF83187F1
 for <pve-user@lists.proxmox.com>; Mon, 12 Apr 2021 03:58:04 +0200 (CEST)
Received: by mail-pj1-x102d.google.com with SMTP id
 x21-20020a17090a5315b029012c4a622e4aso6201103pjh.2
 for <pve-user@lists.proxmox.com>; Sun, 11 Apr 2021 18:58:04 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025;
 h=subject:to:references:from:message-id:date:user-agent:mime-version
 :in-reply-to:content-language;
 bh=6pBRZXumPdYRnkKqLmvYJeUeiF4o2SFpAS/2GoX1tBM=;
 b=ZCq8LWp4J2gTNkIpJjl2blJnL1YqJebBaA1e40vEgEEnyEqHw6ISH874qZlthKNftG
 PcrLydmTxCMZhRNhLiNPkGGDdsCQwvlrj1SXaSevTWRyhmcjkm3FTe1Eg2tuvcdQtKxh
 jHbHhfqpKJfqTwtCa6KtEuNyHISZAYdpNU9daB/L8q51Q9hEi/K9nepM4CbuxystP3NM
 nuFIQ6qne2FtHfrIgBlPGcwDUzvUihChovcyuOcry+0Y45BKZ3oWRbSV+wmX65y0/eIJ
 sDEM0NQmoYrgsPlzAdEdxZpUqTo6iL3MF5eo5GjjmRAasvjg7x5IX1g4hlZBMI0LdzKN
 hUKA==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
 d=1e100.net; s=20161025;
 h=x-gm-message-state:subject:to:references:from:message-id:date
 :user-agent:mime-version:in-reply-to:content-language;
 bh=6pBRZXumPdYRnkKqLmvYJeUeiF4o2SFpAS/2GoX1tBM=;
 b=SgftAbgFUCTIzJgYYMaZA8P/oy/XT+J38sMq3m7f3UJP26h/04yrvFF73bzu669lo5
 PPHoeYkBvrAufLOqQ49/VbfwRO4hsoxJ0Tsm9+AdQk3b/IB0RYrpHFY8TZbDY7xCbSol
 Zu0oGsWYa40lO4zNI0XVn6nRfZT55A7tKA9mH1+nlgS1VKWdjsyc7sG1cNoAHeqGRnll
 S+CmPjmrs0kDKNjlHBk6hD4eW42/o8KvMDiUjsmizpm91+ttcLD/xPsRtmuHh7l1Xeob
 0Yod80+9PGb8dsAJjJ7dVrycaR7NkVaVEJnbyq3qhi6HfyzhraLv8lLH5JTzB1WvRc9A
 2IlA==
X-Gm-Message-State: AOAM531UkP+0q+B/zMLjoclarulNVELn4sgwWvoxLzQB7y0DZWoHSt1L
 pXvYwHXbiJwbTYISskEQ5ZOAF/iBF0Xhuw==
X-Google-Smtp-Source: ABdhPJwAb7vKTgKPx8vCL1+0EGvaRHayVEwVKwzgS+UL1qEwxW72EIv2zWXMCFKOpxmItFwI1rxxuw==
X-Received: by 2002:a17:902:7c0d:b029:e6:f006:fd02 with SMTP id
 x13-20020a1709027c0db02900e6f006fd02mr23122803pll.46.1618192676974; 
 Sun, 11 Apr 2021 18:57:56 -0700 (PDT)
Received: from [192.168.1.11] (167-179-176-9.a7b3b0.bne.nbn.aussiebb.net.
 [167.179.176.9])
 by smtp.gmail.com with ESMTPSA id t17sm6316280pfe.35.2021.04.11.18.57.54
 for <pve-user@lists.proxmox.com>
 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128);
 Sun, 11 Apr 2021 18:57:55 -0700 (PDT)
To: pve-user@lists.proxmox.com
References: <15e5bfd5-7458-fdbe-5079-ce78a19e0099@gmail.com>
 <mailman.235.1618038675.359.pve-user@lists.proxmox.com>
From: Lindsay Mathieson <lindsay.mathieson@gmail.com>
Message-ID: <33f7cf57-9ca2-1c05-89db-9fceaf5e4cc5@gmail.com>
Date: Mon, 12 Apr 2021 11:57:50 +1000
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:78.0) Gecko/20100101
 Thunderbird/78.9.1
MIME-Version: 1.0
In-Reply-To: <mailman.235.1618038675.359.pve-user@lists.proxmox.com>
Content-Language: en-US
X-SPAM-LEVEL: Spam detection results:  0
 AWL 0.041 Adjusted score from AWL reputation of From: address
 DKIM_SIGNED               0.1 Message has a DKIM or DK signature,
 not necessarily valid
 DKIM_VALID -0.1 Message has at least one valid DKIM or DK signature
 DKIM_VALID_AU -0.1 Message has a valid DKIM or DK signature from author's
 domain
 DKIM_VALID_EF -0.1 Message has a valid DKIM or DK signature from envelope-from
 domain
 FREEMAIL_FROM 0.001 Sender email is commonly abused enduser mail provider
 HTML_MESSAGE            0.001 HTML included in message
 NICE_REPLY_A           -0.001 Looks like a legit reply (A)
 RCVD_IN_DNSWL_NONE     -0.0001 Sender listed at https://www.dnswl.org/,
 no trust
 SPF_HELO_NONE           0.001 SPF: HELO does not publish an SPF Record
 SPF_PASS               -0.001 SPF: sender matches SPF record
Content-Type: text/plain; charset=windows-1252; format=flowed
Content-Transfer-Encoding: 7bit
X-Content-Filtered-By: Mailman/MimeDel 2.1.29
Subject: Re: [PVE-User] Revisited: External disk backup using PBS -
 Requesting Criticism/Advice?
X-BeenThere: pve-user@lists.proxmox.com
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Proxmox VE user list <pve-user.lists.proxmox.com>
List-Unsubscribe: <https://lists.proxmox.com/cgi-bin/mailman/options/pve-user>, 
 <mailto:pve-user-request@lists.proxmox.com?subject=unsubscribe>
List-Archive: <http://lists.proxmox.com/pipermail/pve-user/>
List-Post: <mailto:pve-user@lists.proxmox.com>
List-Help: <mailto:pve-user-request@lists.proxmox.com?subject=help>
List-Subscribe: <https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-user>, 
 <mailto:pve-user-request@lists.proxmox.com?subject=subscribe>
X-List-Received-Date: Mon, 12 Apr 2021 01:58:06 -0000

On 10/04/2021 5:10 pm, Arjen via pve-user wrote:
> Don't expect to be able to backup the PBS container with 4TB to a 2TB external drive. The Datastore of a PSB does not compress much further and Proxmox VE Backup will only backup virtual disks and not mountpoints or storages passed from host, if I understand correctly.
> I suggest adding a virtual disk of 2TB to the PBS container (and format it with ext4) which can be backed up by the Proxmox VE Backup.
> I would also run the PBS container (with virtual disk) on the cluster instead on separate hardware which is a single point of failure. The local PBS would be then just as reliable as your cluster.
>
> Regarding safeness: I suggest doing a automated disaster recovery every week to make sure it works as expected. Or at least partially, like restoring the PBS from an external drive.
> Regarding practicality: I would have a remote PBS sync with your local PBS instead of moving physical disks (but you mentioned before that that was not really possible).


Did some testing over the weekend.

  * Setup a PBS Container with a 2TB root disk
  * Backed up 6 VM's to it.
  * Backed up the PBS Container to a external disk using vzdump (using
    the std proxmox gui)
      o Slooow process at 30MB/s :)
  * Deleted the PBS Container
  * Deleted the backup VM's
  * Restored the PBS container from the external hard disk
      o Much faster - averaged around 100MB/s
  * Restored PBS Container started fine and verified.
  * Restored the backed up VM's from the PBS Container
      o Worked as expected
      o All backup and running.

All in all, worked as I wanted and seems a viable option for full image 
offsite backups via external hard disks.

The process of backing up the PBS container to the external drive is 
*very* slow :( I estimate 11 hours for a full cluster backup copy. But 
since its on a independent node, it doesn't load the main cluster and 
can just happen over the weekend.



-- 
Lindsay