From mboxrd@z Thu Jan  1 00:00:00 1970
Return-Path: <uwe.sauter.de@gmail.com>
Received: from firstgate.proxmox.com (firstgate.proxmox.com [212.224.123.68])
 (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
 key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256)
 (No client certificate requested)
 by lists.proxmox.com (Postfix) with ESMTPS id 2FAAAED99
 for <pve-user@pve.proxmox.com>; Thu, 20 Jul 2023 14:21:14 +0200 (CEST)
Received: from firstgate.proxmox.com (localhost [127.0.0.1])
 by firstgate.proxmox.com (Proxmox) with ESMTP id 130DE1279E
 for <pve-user@pve.proxmox.com>; Thu, 20 Jul 2023 14:21:14 +0200 (CEST)
Received: from mail-lf1-x136.google.com (mail-lf1-x136.google.com
 [IPv6:2a00:1450:4864:20::136])
 (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits)
 key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256)
 (No client certificate requested)
 by firstgate.proxmox.com (Proxmox) with ESMTPS
 for <pve-user@pve.proxmox.com>; Thu, 20 Jul 2023 14:21:13 +0200 (CEST)
Received: by mail-lf1-x136.google.com with SMTP id
 2adb3069b0e04-4fcd615d7d6so1119548e87.3
 for <pve-user@pve.proxmox.com>; Thu, 20 Jul 2023 05:21:13 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
 d=gmail.com; s=20221208; t=1689855667; x=1690460467;
 h=content-transfer-encoding:subject:from:to:content-language:reply-to
 :user-agent:mime-version:date:message-id:from:to:cc:subject:date
 :message-id:reply-to;
 bh=G/FED2Y9KZF2n0v6HnAUlq/G4W3hS4P57jB99ANe93M=;
 b=ZziclB3jnHZBlSg1g3SyP4n3WXlgjnnVbj5LbK3qke1C7igMLfETUiSHI4pkGyZUYq
 jKcpemu2g7U8OCDCNC5fR+hb2RGkiXzgsATWBbTYm8N/v+OeFL3d/AYq0LjUB6k6MG5M
 aeRL59SB9V4Ab6gRdO6VvlJcR8H+O77b6QvXx5TSbpjZhb95QahsqYOKUbgbg55+yh6d
 X9SFWwOSZQhdcWEo3kz/REC55F+kestZQYf4JhBT4kFFNqnpkuQgEb3p26wySSFpSEym
 C4hWpjxbjyglV+4OA2ZGWPLZzBRGCI5QTbeey2pHie2pYq6v6QN0Jf9TAhXPnqrCTRE3
 F9kQ==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
 d=1e100.net; s=20221208; t=1689855667; x=1690460467;
 h=content-transfer-encoding:subject:from:to:content-language:reply-to
 :user-agent:mime-version:date:message-id:x-gm-message-state:from:to
 :cc:subject:date:message-id:reply-to;
 bh=G/FED2Y9KZF2n0v6HnAUlq/G4W3hS4P57jB99ANe93M=;
 b=X+WM+YeOBPE8tBaWkEbPpGjmDuhbcoolwZ3gbkagQ5cCi6TKKyrTV0VOK8kIrWwGfn
 ZBaMtzMIpw7pBtlPpKqwKIQWaFn27vffgyTTJxylGux0xwzAnW5sdEuZWSQabav6HMvO
 Ihl286UkuBB9HDFGKSBD/ZMCaqvfyfWsaLGYq/t4eQPVKy4ky50SgsNCUL8nATusRaYd
 ZRxYzMHVFmDCOfV5oMJsApL1JgoURyf99k7YjaVxH6HfGZSw7C6aTD7vb3AI1E2duGJf
 T6L5Kn/33Ib5TMYiWiYsLVCBYvyonKSnhLCj7iIZ/yIm7g37IGJOpKPsF/3ngwDXsV21
 be0A==
X-Gm-Message-State: ABy/qLZqxaM+e7/dFM1aicY2TcUKIkpwvp532DHlk1pMosRtQ5WkYyd1
 i8n5oAc5v+7NHtwo1UNxyIGVOlLdU1g=
X-Google-Smtp-Source: APBJJlFNNSZNtexfuAiMWpG+0U7iCrqioQIHd8LS2ZRVAxmcmMaC2SpQOLZcGyXB+xY5uIsV4wIeGA==
X-Received: by 2002:a19:4f4b:0:b0:4f8:74b5:b4ec with SMTP id
 a11-20020a194f4b000000b004f874b5b4ecmr2013104lfk.41.1689855666620; 
 Thu, 20 Jul 2023 05:21:06 -0700 (PDT)
Received: from ?IPV6:2a02:8070:a280:2d80:5605:dbff:fe76:161d?
 ([2a02:8070:a280:2d80:5605:dbff:fe76:161d])
 by smtp.googlemail.com with ESMTPSA id
 x21-20020a05600c21d500b003fb41491670sm3788793wmj.24.2023.07.20.05.21.05
 for <pve-user@pve.proxmox.com>
 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128);
 Thu, 20 Jul 2023 05:21:06 -0700 (PDT)
Message-ID: <2b5b83bb-c90e-b6dd-4b15-a57414b42542@gmail.com>
Date: Thu, 20 Jul 2023 14:21:05 +0200
MIME-Version: 1.0
User-Agent: Mozilla Thunderbird
Reply-To: uwe.sauter.de@gmail.com
Content-Language: de-DE, en-US
To: PVE User List <pve-user@pve.proxmox.com>
From: Uwe Sauter <uwe.sauter.de@gmail.com>
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: 8bit
X-SPAM-LEVEL: Spam detection results:  0
 AWL 0.187 Adjusted score from AWL reputation of From: address
 BAYES_00                 -1.9 Bayes spam probability is 0 to 1%
 DKIM_SIGNED               0.1 Message has a DKIM or DK signature,
 not necessarily valid
 DKIM_VALID -0.1 Message has at least one valid DKIM or DK signature
 DKIM_VALID_AU -0.1 Message has a valid DKIM or DK signature from author's
 domain
 DKIM_VALID_EF -0.1 Message has a valid DKIM or DK signature from envelope-from
 domain DMARC_PASS               -0.1 DMARC pass policy
 FREEMAIL_FROM 0.001 Sender email is commonly abused enduser mail provider
 RCVD_IN_DNSWL_NONE     -0.0001 Sender listed at https://www.dnswl.org/,
 no trust
 SPF_HELO_NONE           0.001 SPF: HELO does not publish an SPF Record
 SPF_PASS               -0.001 SPF: sender matches SPF record
 T_SCC_BODY_TEXT_LINE    -0.01 -
Subject: [PVE-User] DeviceMapper devices get filtered by Proxmox
X-BeenThere: pve-user@lists.proxmox.com
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Proxmox VE user list <pve-user.lists.proxmox.com>
List-Unsubscribe: <https://lists.proxmox.com/cgi-bin/mailman/options/pve-user>, 
 <mailto:pve-user-request@lists.proxmox.com?subject=unsubscribe>
List-Archive: <http://lists.proxmox.com/pipermail/pve-user/>
List-Post: <mailto:pve-user@lists.proxmox.com>
List-Help: <mailto:pve-user-request@lists.proxmox.com?subject=help>
List-Subscribe: <https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-user>, 
 <mailto:pve-user-request@lists.proxmox.com?subject=subscribe>
X-List-Received-Date: Thu, 20 Jul 2023 12:21:14 -0000

Dear all,

I'd like to use some existing hardware to create a Ceph cluster. Unfortunately, all my external
disks are filtered by the WebUI and by pceceph command which prevents using them as OSD disks.

My servers are connected to a SAS-JBOD containing 60 SAS-HDDs. The connection is done via 2
dual-port SAS-HBAs, each port connecting to both of the JBOD controllers.
This means that all my external disks can be reached via four SAS-path and thus I see 240 disks in
/dev. (Actually, I see 244 /dev/sd* devices as there are also 4 internal disks for the OS…)
Using multipathd, each disk with its four entries in /dev is available a fifth time in
/dev/mapper/${WWN} which is a symlink to /dev/dm-${NUMBER}.

Both /dev/dm-${NUMBER} and /dev/mapper/${WWN} entries are filtered by Proxmox.

Is there a way to remove this filter or to define my own set of filters?

Using the /dev/sd* entries would be possible but I would loose the redundancy provided by multipathd.

Regards,

	Uwe