From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from firstgate.proxmox.com (firstgate.proxmox.com [212.224.123.68]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits)) (No client certificate requested) by lists.proxmox.com (Postfix) with ESMTPS id 9D9FB94E33 for ; Mon, 27 Feb 2023 17:50:32 +0100 (CET) Received: from firstgate.proxmox.com (localhost [127.0.0.1]) by firstgate.proxmox.com (Proxmox) with ESMTP id 776E72E062 for ; Mon, 27 Feb 2023 17:50:02 +0100 (CET) Received: from mail-ed1-x535.google.com (mail-ed1-x535.google.com [IPv6:2a00:1450:4864:20::535]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by firstgate.proxmox.com (Proxmox) with ESMTPS for ; Mon, 27 Feb 2023 17:50:00 +0100 (CET) Received: by mail-ed1-x535.google.com with SMTP id i34so28413187eda.7 for ; Mon, 27 Feb 2023 08:50:00 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=suma-informatika.hr; s=google; h=content-transfer-encoding:in-reply-to:from:references:to :content-language:subject:user-agent:mime-version:date:message-id :from:to:cc:subject:date:message-id:reply-to; bh=I4x8hB+g/TSogaIcU64kyUGzEbdeqA5dma031Z5LcZQ=; b=bsV/mNexm9XXqZHh0mTdzmPPz5OWycWQ7Q5HZgFUWMLGfJgLBuc1gtXf/s887ZSyN6 CtE6meQWkXRXn/jLSHJqjQkMG4QtlbyL4DZIU4BhXLmIVWPganJk9pSrcm+HldcmbxB4 b/jps64GyD2UiGfSqPlUkmBogB/q6FeiTCi8kdNHfo6GRHWoXs/RRU9RSf3GKyFVWtqT jfsC496Ti/60QEH779HwGSN3m7ONGPJXwKjrvgN4WaKiKCf4yuLQb+f77844QjBExf1X 7ECSWgOlvR5Wv8yB8YdP3o0RZqnDcV03fqjmPu2uNQuovZg5zjxwRJx9n9C73wvuG4DQ zOZg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=content-transfer-encoding:in-reply-to:from:references:to :content-language:subject:user-agent:mime-version:date:message-id :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=I4x8hB+g/TSogaIcU64kyUGzEbdeqA5dma031Z5LcZQ=; b=jZFUFapM3UggwDOdKIdVuRE9WKF+TlWrc0u7PQdtzyfZcp4CbY8+RdFS4GhpGufvRY Lpz0Kh49H6AnhVsl0SQTgM3h3enKV6UHjbFEUXfPMOO2vtwklJMXYrb/dG0x84u2cPn4 0kbWGexajBS6uafGnBbxECAeUFt+yP2Bd3UyOW5Ubi/KMqPlUqfCbz8Dy7rYdidqB+W0 O6lUiZZzMFprGOxijWfunKSWlyeKGPvdtFKkaWJQmRma2U5nLx7Tt3S88KHzYVHvT8Pl 83neyNa3Q2c2FvZu+zpzDnR2vyOxqjPs7OscEG68tLWg13SMsct3nDTSV1kg9RBn03+t IDVw== X-Gm-Message-State: AO0yUKUcUeuF63qnVV3bkS/pEapMsM9fqGeIJQNfgPYcecCLOqNP76Te YLejoO7YGEcuBiRGeFElbahTOVwyOhBXP8RT X-Google-Smtp-Source: AK7set8/tx78qQqLkL3NH2sbpOh0LPZoXEF3dJuNqZnBjK8nrLk1g/G4Zz+MF9upwRoiMYeUHxJBXw== X-Received: by 2002:a17:907:d092:b0:8f4:732e:40bf with SMTP id vc18-20020a170907d09200b008f4732e40bfmr13215736ejc.16.1677516594037; Mon, 27 Feb 2023 08:49:54 -0800 (PST) Received: from [10.10.21.51] (93-137-133-63.adsl.net.t-com.hr. [93.137.133.63]) by smtp.gmail.com with ESMTPSA id d23-20020a1709064c5700b008d92897cc29sm3425432ejw.37.2023.02.27.08.49.52 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Mon, 27 Feb 2023 08:49:53 -0800 (PST) Message-ID: <986da5da-b2cc-521d-fed3-41e5aacd2665@suma-informatika.hr> Date: Mon, 27 Feb 2023 17:49:52 +0100 MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:102.0) Gecko/20100101 Thunderbird/102.7.1 Content-Language: en-US To: Aaron Lauterer , Proxmox VE user list , PVE User List References: <03515357-9a0b-e556-92aa-37decb9cb20c@proxmox.com> From: =?UTF-8?B?VG9uxI1pIFN0aXBpxI1ldmnEhw==?= In-Reply-To: <03515357-9a0b-e556-92aa-37decb9cb20c@proxmox.com> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-SPAM-LEVEL: Spam detection results: 0 AWL -0.083 Adjusted score from AWL reputation of From: address BAYES_00 -1.9 Bayes spam probability is 0 to 1% DKIM_SIGNED 0.1 Message has a DKIM or DK signature, not necessarily valid DKIM_VALID -0.1 Message has at least one valid DKIM or DK signature DKIM_VALID_AU -0.1 Message has a valid DKIM or DK signature from author's domain DKIM_VALID_EF -0.1 Message has a valid DKIM or DK signature from envelope-from domain KAM_NUMSUBJECT 0.5 Subject ends in numbers excluding current years NICE_REPLY_A -0.001 Looks like a legit reply (A) RCVD_IN_DNSWL_NONE -0.0001 Sender listed at https://www.dnswl.org/, no trust SPF_HELO_NONE 0.001 SPF: HELO does not publish an SPF Record SPF_PASS -0.001 SPF: sender matches SPF record Subject: Re: [PVE-User] add disk back to raid10 X-BeenThere: pve-user@lists.proxmox.com X-Mailman-Version: 2.1.29 Precedence: list List-Id: Proxmox VE user list List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 27 Feb 2023 16:50:32 -0000 Thank you very much .... I already did the preparation with sgdisk and after "attach" proxmox-boot-tool command did the rest srdačan pozdrav / best regards Tonči Stipičević, dipl. ing. elektr. direktor / manager SUMA Informatika d.o.o., Badalićeva 27, OIB 93926415263 Podrška / Upravljanje IT sustavima za male i srednje tvrtke Small & Medium Business IT Support / Management mob: 091 1234003 www.suma-informatika.hr On 27. 02. 2023. 16:14, Aaron Lauterer wrote: > I see that the zpool is on the third partition on the disk > ata-WDC_WD2000F9YZ-09N20L1_WD-WMC5C0D7E3DU-part3. > > If you created the raid 10 from the installer, please follow the steps > in the admin guide [0] in the section "Changing a failed bootable > device". > > But instead of "zpool replace" you should run > > zpool attach rpool ata-WDC_WD2000F9YZ-09N20L1_WD-WMC5C0D7E3DU-part3 > /dev/disk/by-id/{new disk}-part3 > > The man page for the 'zpool attach' command can be viewed with 'man > zpool-attach' > > > > [0] https://pve.proxmox.com/pve-docs/pve-admin-guide.html#chapter_zfs > > On 2/27/23 15:45, Tonči Stipičević wrote: >> Hello to all, >> >> I'm playing with zfs arrays. Here you can see former RAID10 because >> there is mirror-0 missing as such , because I unintentionally >> detached all disk references from this mirror-0 that used to be >> 2-disk mirror vdev for this raid10. >> >> 1. raid10 was OK  .... this is also boot raid10 >> >> 2.  I physically removed one disk disk and mirror-0 became degraded >> >> 3. after lot of steps in order to replace one disk, put another-new >> and get all boot staff needed  and after lot of unsuccessful tries I >> unintentionally ended up detaching all references of old "faulted" >> disk and mirror-0 was gone >> >> 4. Now I have unnormal raid with two striped vdevs (see below), but >> one of them is just one disk , and the other one is regular mirror(-1) >> >> So, now I'm trying to attach/add new disk to this raid10 but in order >> to get mirror-0 like it was before  ....   How can I reference "add" >> or "attach" to make mirror-0 again (consisting of >> ata-WDC_WD2000F9YZ-09N20L1_WD-WMC5C0D7E3DU-part3  and the new disk )  ? >> >> >> Thank you very much in advance >> >> BR >> >> Tonci >> >> >>    pool: rpool >>   state: ONLINE >>    scan: resilvered 2.34G in 01:22:54 with 0 errors on Sun Feb 26 >> 14:13:11 2023 >> config: >> >>          NAME STATE     READ WRITE CKSUM >>          rpool ONLINE       0     0     0 >>            ata-WDC_WD2000F9YZ-09N20L1_WD-WMC5C0D7E3DU-part3 ONLINE >> 0     0     0 >>            mirror-1 ONLINE       0     0     0 >>              ata-WDC_WD2000F9YZ-09N20L1_WD-WMC1P0F7KHZM-part3 >> ONLINE       0     0     0 >>              ata-WDC_WD2000F9YZ-09N20L1_WD-WMC5C0D6WZT4-part3 >> ONLINE       0     0     0 >>          special >>            mirror-2 ONLINE       0     0     0 >>              sde ONLINE       0     0     0 >>              sdf ONLINE       0     0     0 >> >> errors: No known data errors >> >