From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from firstgate.proxmox.com (firstgate.proxmox.com [212.224.123.68]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits)) (No client certificate requested) by lists.proxmox.com (Postfix) with ESMTPS id A28B87646F for ; Thu, 15 Jul 2021 15:06:33 +0200 (CEST) Received: from firstgate.proxmox.com (localhost [127.0.0.1]) by firstgate.proxmox.com (Proxmox) with ESMTP id 90FDE23771 for ; Thu, 15 Jul 2021 15:06:03 +0200 (CEST) Received: from proxmox-new.maurer-it.com (proxmox-new.maurer-it.com [94.136.29.106]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits)) (No client certificate requested) by firstgate.proxmox.com (Proxmox) with ESMTPS id B9D3023762 for ; Thu, 15 Jul 2021 15:06:01 +0200 (CEST) Received: from proxmox-new.maurer-it.com (localhost.localdomain [127.0.0.1]) by proxmox-new.maurer-it.com (Proxmox) with ESMTP id 05FC3419E9; Thu, 15 Jul 2021 14:55:23 +0200 (CEST) To: Proxmox VE user list , Marco Gaiarin References: <20210715124856.GC3399@sv.lnf.it> From: Aaron Lauterer Message-ID: <8bde01da-f8fc-8d1f-bd5e-616dce26e989@proxmox.com> Date: Thu, 15 Jul 2021 14:55:22 +0200 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:78.0) Gecko/20100101 Thunderbird/78.11.0 MIME-Version: 1.0 In-Reply-To: <20210715124856.GC3399@sv.lnf.it> Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-SPAM-LEVEL: Spam detection results: 0 AWL 0.473 Adjusted score from AWL reputation of From: address BAYES_00 -1.9 Bayes spam probability is 0 to 1% KAM_DMARC_STATUS 0.01 Test Rule for DKIM or SPF Failure with Strict Alignment NICE_REPLY_A -0.001 Looks like a legit reply (A) POISEN_SPAM_PILL 0.1 Meta: its spam POISEN_SPAM_PILL_1 0.1 random spam to be learned in bayes POISEN_SPAM_PILL_3 0.1 random spam to be learned in bayes SPF_HELO_NONE 0.001 SPF: HELO does not publish an SPF Record SPF_PASS -0.001 SPF: sender matches SPF record Subject: Re: [PVE-User] 'asymmetrix storage' and migration... X-BeenThere: pve-user@lists.proxmox.com X-Mailman-Version: 2.1.29 Precedence: list List-Id: Proxmox VE user list List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 15 Jul 2021 13:06:33 -0000 See inline On 7/15/21 2:48 PM, Marco Gaiarin wrote: > > I'm a bit puzzled. > > > A little 'ZFS' cluster, with two asymmetrical nodes; second node is > there only, just in case, to run some little VMs (PBX, firewall, ...). > > First node have a second RAIDZ volume called 'rpool-data', that does > not exist on second node; eg, storage.conf is: > > dir: local > path /var/lib/vz > content iso,vztmpl,backup > > zfspool: local-zfs > pool rpool/data > content images,rootdir > sparse 1 > > zfspool: rpool-data > pool rpool-data > content images,rootdir > mountpoint /rpool-data > sparse 1 > > Clearly on node 2 'rpool-data' have a question mark. > > > I've tried to migrate a VMs from node 2 to 1 that have disks only on 'local-zfs': > > root@brpve1:~# grep ^scsi /etc/pve/nodes/brpve2/qemu-server/100.conf > scsi0: local-zfs:vm-100-disk-0,size=100G > scsi1: local-zfs:vm-100-disk-1,backup=0,size=1000G > scsi2: local-zfs:vm-100-disk-2,backup=0,size=500G > scsihw: virtio-scsi-pci > > but i get: > > 2021-07-15 14:14:54 starting migration of VM 100 to node 'brpve1' (10.15.5.21) > zfs error: cannot open 'rpool-data': no such pool > zfs error: cannot open 'rpool-data': no such pool > 2021-07-15 14:14:54 ERROR: Problem found while scanning volumes - could not activate storage 'rpool-data', zfs error: cannot import 'rpool-data': no such pool available > 2021-07-15 14:14:54 aborting phase 1 - cleanup resources > 2021-07-15 14:14:54 ERROR: migration aborted (duration 00:00:00): Problem found while scanning volumes - could not activate storage 'rpool-data', zfs error: cannot import 'rpool-data': no such pool available > TASK ERROR: migration aborted > > > Because in 'rpool-data' currently we have no data, i've simply disabled > storage 'rpool-data', migrate the machine and then re-enabled back. > > > Why migration does not work, even if there's no disks in 'rpool-data'? > > Thre's some way to 'fake' an 'rpool-data' on the second node, only to > have PVE not to complain? You can limit storages to certain nodes. To do this via the GUI, edit the storage and in the top right of that dialog, you should be able to select the nodes on which the storage exists. Otherwise you will run into certain problems as Proxmox VE expects the underlying storage to be present on the nodes. > > > Thanks. >