From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from firstgate.proxmox.com (firstgate.proxmox.com [212.224.123.68]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by lists.proxmox.com (Postfix) with ESMTPS id 48623824BF for ; Mon, 29 Nov 2021 09:48:51 +0100 (CET) Received: from firstgate.proxmox.com (localhost [127.0.0.1]) by firstgate.proxmox.com (Proxmox) with ESMTP id 3AD012D38D for ; Mon, 29 Nov 2021 09:48:51 +0100 (CET) Received: from mail-wr1-x433.google.com (mail-wr1-x433.google.com [IPv6:2a00:1450:4864:20::433]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by firstgate.proxmox.com (Proxmox) with ESMTPS id 8E0002D382 for ; Mon, 29 Nov 2021 09:48:49 +0100 (CET) Received: by mail-wr1-x433.google.com with SMTP id a18so35031179wrn.6 for ; Mon, 29 Nov 2021 00:48:49 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linbit-com.20210112.gappssmtp.com; s=20210112; h=date:from:to:subject:message-id:references:mime-version :content-disposition:content-transfer-encoding:in-reply-to :user-agent; bh=4G5laIw03ipOrHTNpTLfT3lLuigo4AFZBn0HktpYugw=; b=2HvQnGI511ZYE/vtx/fh9NkEK7aswZnLlqGfcWnR409hWWEh8xzvVkOMRv6KONOSNr 14w6/uCBtXp8qDbH2Hl1Z+2zxcN+TI9bG6PNFpp6UnDH/cgVxF/F6jdZeIYkcAp7qEaZ dW4kq4Roxz/OWDNKf5wpAsaRQ2a8YSphu/fJnSopP4JkBRuweQ3kiPn+l4A2jiXMQlL2 nvQNvKwcfoar253ohbrKl8zqZ5XXkBfDS39O6GZrweSB0vaKWFhcHBxVZzulX3v6a39M I2DckH+1W4KBx+xH6+076jbVPSSHxX/bLBQ0KUl4+nqFP0iGC/LyHQJbjxmZrJvycw6R 0CZw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:date:from:to:subject:message-id:references :mime-version:content-disposition:content-transfer-encoding :in-reply-to:user-agent; bh=4G5laIw03ipOrHTNpTLfT3lLuigo4AFZBn0HktpYugw=; b=v3+OmK34orr17c2cfzYrP/TUjN7o/5qoHW90LeG7RDcI8kEdwbX4KxInjqIOewh7aO fXm+mIxto8DW1cBSiLJJ6EB3MzNQz1wV1jHoHv2tQx3oykZJ8MZ8iGD7P5gZqhI91Jug ntC436VqMx0vm8mv65KvOK0pXbfMFWYbYJR1tU/P6s1pbzSd3qF+LKviWtXlLbJ7Ay8o o+OTgjcXcpzIrsYWjoVbcHNaCyGDEeMOTIKTyqHCktE/SXanTPepESsnTt3hKpUzGK+y /9tuNZ96LlbRg9n38Lf2kkCoE6o5DAWvcsbfS30OvaRIdnKJ+GpHNSuU7We8wz7Q0srn D4Rw== X-Gm-Message-State: AOAM532unMQkjugLbgmsnKT/SkzsAt2aNgcmU+P2nK6Ey8WcsqFZ8kdH ag2eMUgGq9TnGiisNHLMP6O44v/IY7Sc8Dzx X-Google-Smtp-Source: ABdhPJwySKXS0A7mW8ARD/RlF7J6t0sqVE9F4TKsfAGX9hDQTIqziAAAPbiTgG782bwM/xzPrVPlsw== X-Received: by 2002:a5d:62c5:: with SMTP id o5mr32249731wrv.408.1638175722474; Mon, 29 Nov 2021 00:48:42 -0800 (PST) Received: from localhost (static.20.139.203.116.clients.your-server.de. [116.203.139.20]) by smtp.gmail.com with ESMTPSA id t8sm16233506wmq.32.2021.11.29.00.48.41 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Mon, 29 Nov 2021 00:48:41 -0800 (PST) Date: Mon, 29 Nov 2021 09:48:41 +0100 From: Roland Kammerer To: pve-devel@lists.proxmox.com Message-ID: <20211129084841.GU1745@rck.sh> References: <20211126130357.GS1745@rck.sh> <1637941727.qelq78do1a.astroid@nora.none> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: <1637941727.qelq78do1a.astroid@nora.none> User-Agent: Mutt/1.10.1 (2018-07-13) X-SPAM-LEVEL: Spam detection results: 0 BAYES_00 -1.9 Bayes spam probability is 0 to 1% DKIM_SIGNED 0.1 Message has a DKIM or DK signature, not necessarily valid DKIM_VALID -0.1 Message has at least one valid DKIM or DK signature RCVD_IN_DNSWL_NONE -0.0001 Sender listed at https://www.dnswl.org/, no trust SPF_HELO_NONE 0.001 SPF: HELO does not publish an SPF Record SPF_PASS -0.001 SPF: sender matches SPF record Subject: Re: [pve-devel] migrate local -> drbd fails with vanished job X-BeenThere: pve-devel@lists.proxmox.com X-Mailman-Version: 2.1.29 Precedence: list List-Id: Proxmox VE development discussion List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 29 Nov 2021 08:48:51 -0000 Hi Fabian, thanks for the walk through, that clears things up a bit. On Fri, Nov 26, 2021 at 05:06:05PM +0100, Fabian Grünbichler wrote: > are there any messages on either end in the journal? I'm afraid they are not too useful, but maybe you see something that rings any bells. Some notes: - The first DRBD Primary is us forcing one node to be Primary (and switching it back to Secondary immediately), just so that we kick off the initial sync. The second Primary then might very well be starting the VM as you explained. - The destination disk is about 500 MB larger than the source, which was just me adding some extra space in my debug code in the plugin to avoid any rounding errors/disk slightly too small errors. What could be a problem here? Different sizes? Different block size? If it does not fail somewhere else/earlier, what should make nbd writes special? Strange. Regards, rck source node (.119/pve): Nov 29 09:06:01 pve Controller[1213]: 09:06:01.628 [MainWorkerPool-1] INFO LINSTOR/Controller - SYSTEM - Drbd-auto-verify-Algo for vm-100-disk-1 automatically set to crct10dif-pclmul Nov 29 09:06:12 pve pmxcfs[982]: [status] notice: received log Nov 29 09:06:12 pve pvedaemon[3660]: Use of uninitialized value $qga in concatenation (.) or string at /usr/share/perl5/PVE/QemuServer.pm line 7393. Nov 29 09:06:12 pve pvedaemon[3660]: VM 100 qmp command failed - VM 100 qmp command 'block-job-cancel' failed - Block job 'drive-scsi0' not found Nov 29 09:06:13 pve pmxcfs[982]: [status] notice: received log Nov 29 09:06:13 pve pmxcfs[982]: [status] notice: received log Nov 29 09:06:14 pve pmxcfs[982]: [status] notice: received log Nov 29 09:06:15 pve pmxcfs[982]: [status] notice: received log Nov 29 09:06:16 pve pvedaemon[3660]: migration problems Nov 29 09:06:16 pve pvedaemon[1198]: end task UPID:pve:00000E4C:00008799:61A489E7:qmigrate:100:root@pam: migration problems Nov 29 09:10:14 pve pvedaemon[1198]: starting task UPID:pve:000013D6:0000EAFA:61A48AE6:qmigrate:100:root@pam: Nov 29 09:10:15 pve pmxcfs[982]: [status] notice: received log Nov 29 09:10:15 pve Controller[1213]: 09:10:15.579 [MainWorkerPool-1] INFO LINSTOR/Controller - SYSTEM - Volume definition with number '0' successfully created in resource definition 'vm-100-disk-1'. Nov 29 09:10:15 pve Controller[1213]: 09:10:15.651 [MainWorkerPool-1] INFO LINSTOR/Controller - SYSTEM - Drbd-auto-verify-Algo for vm-100-disk-1 automatically set to crct10dif-pclmul Nov 29 09:10:25 pve pmxcfs[982]: [status] notice: received log Nov 29 09:10:26 pve pvedaemon[5078]: Use of uninitialized value $qga in concatenation (.) or string at /usr/share/perl5/PVE/QemuServer.pm line 7393. Nov 29 09:10:26 pve pvedaemon[5078]: VM 100 qmp command failed - VM 100 qmp command 'block-job-cancel' failed - Block job 'drive-scsi0' not found Nov 29 09:10:27 pve pmxcfs[982]: [status] notice: received log Nov 29 09:10:27 pve pmxcfs[982]: [status] notice: received log Nov 29 09:10:28 pve pmxcfs[982]: [status] notice: received log Nov 29 09:10:28 pve pmxcfs[982]: [status] notice: received log Nov 29 09:10:29 pve pvedaemon[5078]: migration problems Nov 29 09:10:29 pve pvedaemon[1198]: end task UPID:pve:000013D6:0000EAFA:61A48AE6:qmigrate:100:root@pam: migration problems target node (.120/pvf): Nov 29 09:06:16 pvf sshd[2645]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) Nov 29 09:06:16 pvf systemd[1]: Started Session 8 of user root. Nov 29 09:06:16 pvf systemd-logind[711]: New session 8 of user root. Nov 29 09:06:16 pvf sshd[2645]: Received disconnect from 10.43.8.119 port 60698:11: disconnected by user Nov 29 09:06:16 pvf sshd[2645]: Disconnected from user root 10.43.8.119 port 60698 Nov 29 09:06:16 pvf sshd[2645]: pam_unix(sshd:session): session closed for user root Nov 29 09:06:16 pvf systemd-logind[711]: Session 8 logged out. Waiting for processes to exit. Nov 29 09:06:16 pvf systemd[1]: session-8.scope: Succeeded. Nov 29 09:06:16 pvf systemd-logind[711]: Removed session 8. Nov 29 09:06:16 pvf pmxcfs[897]: [status] notice: received log Nov 29 09:10:14 pvf pmxcfs[897]: [status] notice: received log Nov 29 09:10:14 pvf sshd[3188]: Accepted publickey for root from 10.43.8.119 port 60700 ssh2: RSA SHA256:3YNHg8CC3M6IPFUA9PlP5B7wnm2nbFLpnXd09j6k5yU Nov 29 09:10:14 pvf sshd[3188]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) Nov 29 09:10:14 pvf systemd[1]: Started Session 9 of user root. Nov 29 09:10:14 pvf systemd-logind[711]: New session 9 of user root. Nov 29 09:10:14 pvf sshd[3188]: Received disconnect from 10.43.8.119 port 60700:11: disconnected by user Nov 29 09:10:14 pvf sshd[3188]: Disconnected from user root 10.43.8.119 port 60700 Nov 29 09:10:14 pvf sshd[3188]: pam_unix(sshd:session): session closed for user root Nov 29 09:10:14 pvf systemd-logind[711]: Session 9 logged out. Waiting for processes to exit. Nov 29 09:10:14 pvf systemd[1]: session-9.scope: Succeeded. Nov 29 09:10:14 pvf systemd-logind[711]: Removed session 9. Nov 29 09:10:14 pvf sshd[3195]: Accepted publickey for root from 10.43.8.119 port 60702 ssh2: RSA SHA256:3YNHg8CC3M6IPFUA9PlP5B7wnm2nbFLpnXd09j6k5yU Nov 29 09:10:14 pvf sshd[3195]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) Nov 29 09:10:14 pvf systemd[1]: Started Session 10 of user root. Nov 29 09:10:14 pvf systemd-logind[711]: New session 10 of user root. Nov 29 09:10:15 pvf qm[3201]: starting task UPID:pvf:00000C82:0000EA8E:61A48AE7:qmstart:100:root@pam: Nov 29 09:10:15 pvf qm[3202]: start VM 100: UPID:pvf:00000C82:0000EA8E:61A48AE7:qmstart:100:root@pam: Nov 29 09:10:15 pvf Satellite[812]: 09:10:15.686 [MainWorkerPool-1] INFO LINSTOR/Satellite - SYSTEM - Resource 'vm-100-disk-1' created for node 'pvf'. Nov 29 09:10:19 pvf kernel: drbd vm-100-disk-1: Starting worker thread (from drbdsetup [3254]) Nov 29 09:10:19 pvf kernel: drbd vm-100-disk-1/0 drbd1001: meta-data IO uses: blk-bio Nov 29 09:10:19 pvf kernel: drbd vm-100-disk-1/0 drbd1001: rs_discard_granularity feature disabled Nov 29 09:10:19 pvf kernel: drbd vm-100-disk-1/0 drbd1001: disk( Diskless -> Attaching ) Nov 29 09:10:19 pvf kernel: drbd vm-100-disk-1/0 drbd1001: Maximum number of peer devices = 7 Nov 29 09:10:19 pvf kernel: drbd vm-100-disk-1: Method to ensure write ordering: flush Nov 29 09:10:19 pvf kernel: drbd vm-100-disk-1/0 drbd1001: drbd_bm_resize called with capacity == 3128600 Nov 29 09:10:19 pvf kernel: drbd vm-100-disk-1/0 drbd1001: resync bitmap: bits=391075 words=42777 pages=84 Nov 29 09:10:19 pvf kernel: drbd1001: detected capacity change from 0 to 3128600 Nov 29 09:10:19 pvf kernel: drbd vm-100-disk-1/0 drbd1001: size = 1528 MB (1564300 KB) Nov 29 09:10:19 pvf kernel: drbd vm-100-disk-1/0 drbd1001: recounting of set bits took additional 0ms Nov 29 09:10:19 pvf kernel: drbd vm-100-disk-1/0 drbd1001: disk( Attaching -> Inconsistent ) Nov 29 09:10:19 pvf kernel: drbd vm-100-disk-1/0 drbd1001: attached to current UUID: 0000000000000004 Nov 29 09:10:19 pvf Satellite[812]: 09:10:19.270 [MainWorkerPool-1] INFO LINSTOR/Satellite - SYSTEM - Primary Resource vm-100-disk-1 Nov 29 09:10:19 pvf Satellite[812]: 09:10:19.271 [MainWorkerPool-1] INFO LINSTOR/Satellite - SYSTEM - Primary bool set on Resource vm-100-disk-1 Nov 29 09:10:19 pvf Satellite[812]: 09:10:19.293 [MainWorkerPool-1] INFO LINSTOR/Satellite - SYSTEM - Resource 'vm-100-disk-1' updated for node 'pvf'. Nov 29 09:10:19 pvf kernel: drbd vm-100-disk-1/0 drbd1001: rs_discard_granularity feature disabled Nov 29 09:10:19 pvf kernel: drbd vm-100-disk-1: Preparing cluster-wide state change 126926591 (0->-1 7683/4609) Nov 29 09:10:19 pvf kernel: drbd vm-100-disk-1: Committing cluster-wide state change 126926591 (0ms) Nov 29 09:10:19 pvf kernel: drbd vm-100-disk-1: role( Secondary -> Primary ) Nov 29 09:10:19 pvf kernel: drbd vm-100-disk-1/0 drbd1001: disk( Inconsistent -> UpToDate ) Nov 29 09:10:19 pvf kernel: drbd vm-100-disk-1/0 drbd1001: size = 1528 MB (1564300 KB) Nov 29 09:10:19 pvf kernel: drbd vm-100-disk-1: Forced to consider local data as UpToDate! Nov 29 09:10:19 pvf kernel: drbd vm-100-disk-1/0 drbd1001: new current UUID: E1541A8E1BAC0761 weak: FFFFFFFFFFFFFFFE Nov 29 09:10:19 pvf kernel: drbd vm-100-disk-1: role( Primary -> Secondary ) Nov 29 09:10:19 pvf kernel: drbd vm-100-disk-1: Preparing cluster-wide state change 594297135 (0->-1 3/1) Nov 29 09:10:19 pvf kernel: drbd vm-100-disk-1: Committing cluster-wide state change 594297135 (0ms) Nov 29 09:10:19 pvf kernel: drbd vm-100-disk-1: role( Secondary -> Primary ) Nov 29 09:10:19 pvf kernel: drbd vm-100-disk-1: role( Primary -> Secondary ) Nov 29 09:10:19 pvf Satellite[812]: 09:10:19.589 [MainWorkerPool-1] INFO LINSTOR/Satellite - SYSTEM - Resource 'vm-100-disk-1' updated for node 'pvf'. Nov 29 09:10:19 pvf kernel: drbd vm-100-disk-1/0 drbd1001: rs_discard_granularity feature disabled Nov 29 09:10:24 pvf systemd[1]: Started 100.scope. Nov 29 09:10:24 pvf systemd-udevd[3410]: Using default interface naming scheme 'v247'. Nov 29 09:10:24 pvf systemd-udevd[3410]: ethtool: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 29 09:10:25 pvf kernel: device tap100i0 entered promiscuous mode Nov 29 09:10:25 pvf systemd-udevd[3419]: Using default interface naming scheme 'v247'. Nov 29 09:10:25 pvf systemd-udevd[3419]: ethtool: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 29 09:10:25 pvf systemd-udevd[3410]: ethtool: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 29 09:10:25 pvf systemd-udevd[3434]: ethtool: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 29 09:10:25 pvf systemd-udevd[3434]: Using default interface naming scheme 'v247'. Nov 29 09:10:25 pvf kernel: fwbr100i0: port 1(fwln100i0) entered blocking state Nov 29 09:10:25 pvf kernel: fwbr100i0: port 1(fwln100i0) entered disabled state Nov 29 09:10:25 pvf kernel: device fwln100i0 entered promiscuous mode Nov 29 09:10:25 pvf kernel: fwbr100i0: port 1(fwln100i0) entered blocking state Nov 29 09:10:25 pvf kernel: fwbr100i0: port 1(fwln100i0) entered forwarding state Nov 29 09:10:25 pvf kernel: vmbr0: port 2(fwpr100p0) entered blocking state Nov 29 09:10:25 pvf kernel: vmbr0: port 2(fwpr100p0) entered disabled state Nov 29 09:10:25 pvf kernel: device fwpr100p0 entered promiscuous mode Nov 29 09:10:25 pvf kernel: vmbr0: port 2(fwpr100p0) entered blocking state Nov 29 09:10:25 pvf kernel: vmbr0: port 2(fwpr100p0) entered forwarding state Nov 29 09:10:25 pvf kernel: fwbr100i0: port 2(tap100i0) entered blocking state Nov 29 09:10:25 pvf kernel: fwbr100i0: port 2(tap100i0) entered disabled state Nov 29 09:10:25 pvf kernel: fwbr100i0: port 2(tap100i0) entered blocking state Nov 29 09:10:25 pvf kernel: fwbr100i0: port 2(tap100i0) entered forwarding state Nov 29 09:10:25 pvf kernel: drbd vm-100-disk-1: Preparing cluster-wide state change 523588126 (0->-1 3/1) Nov 29 09:10:25 pvf kernel: drbd vm-100-disk-1: Committing cluster-wide state change 523588126 (0ms) Nov 29 09:10:25 pvf kernel: drbd vm-100-disk-1: role( Secondary -> Primary ) Nov 29 09:10:25 pvf qm[3201]: end task UPID:pvf:00000C82:0000EA8E:61A48AE7:qmstart:100:root@pam: OK Nov 29 09:10:25 pvf sshd[3195]: Received disconnect from 10.43.8.119 port 60702:11: disconnected by user Nov 29 09:10:25 pvf sshd[3195]: Disconnected from user root 10.43.8.119 port 60702 Nov 29 09:10:25 pvf sshd[3195]: pam_unix(sshd:session): session closed for user root Nov 29 09:10:25 pvf systemd-logind[711]: Session 10 logged out. Waiting for processes to exit. Nov 29 09:10:25 pvf systemd[1]: session-10.scope: Succeeded. Nov 29 09:10:25 pvf systemd-logind[711]: Removed session 10. Nov 29 09:10:25 pvf sshd[3463]: Accepted publickey for root from 10.43.8.119 port 60706 ssh2: RSA SHA256:3YNHg8CC3M6IPFUA9PlP5B7wnm2nbFLpnXd09j6k5yU Nov 29 09:10:25 pvf sshd[3463]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) Nov 29 09:10:25 pvf systemd[1]: Started Session 11 of user root. Nov 29 09:10:25 pvf systemd-logind[711]: New session 11 of user root. Nov 29 09:10:26 pvf sshd[3470]: Accepted publickey for root from 10.43.8.119 port 60708 ssh2: RSA SHA256:3YNHg8CC3M6IPFUA9PlP5B7wnm2nbFLpnXd09j6k5yU Nov 29 09:10:26 pvf sshd[3470]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) Nov 29 09:10:26 pvf systemd[1]: Started Session 12 of user root. Nov 29 09:10:26 pvf systemd-logind[711]: New session 12 of user root. Nov 29 09:10:27 pvf qm[3476]: starting task UPID:pvf:00000D95:0000EF22:61A48AF3:qmstop:100:root@pam: Nov 29 09:10:27 pvf qm[3477]: stop VM 100: UPID:pvf:00000D95:0000EF22:61A48AF3:qmstop:100:root@pam: Nov 29 09:10:27 pvf QEMU[3406]: kvm: terminating on signal 15 from pid 3477 (task UPID:pvf:00000D95:0000EF22:61A48AF3:qmstop:100:root@pam:) Nov 29 09:10:27 pvf kernel: drbd vm-100-disk-1: role( Primary -> Secondary ) Nov 29 09:10:27 pvf qm[3476]: end task UPID:pvf:00000D95:0000EF22:61A48AF3:qmstop:100:root@pam: OK Nov 29 09:10:27 pvf sshd[3470]: Received disconnect from 10.43.8.119 port 60708:11: disconnected by user Nov 29 09:10:27 pvf sshd[3470]: Disconnected from user root 10.43.8.119 port 60708 Nov 29 09:10:27 pvf sshd[3470]: pam_unix(sshd:session): session closed for user root Nov 29 09:10:27 pvf systemd[1]: session-12.scope: Succeeded. Nov 29 09:10:27 pvf systemd-logind[711]: Session 12 logged out. Waiting for processes to exit. Nov 29 09:10:27 pvf systemd-logind[711]: Removed session 12. Nov 29 09:10:27 pvf sshd[3479]: Accepted publickey for root from 10.43.8.119 port 60710 ssh2: RSA SHA256:3YNHg8CC3M6IPFUA9PlP5B7wnm2nbFLpnXd09j6k5yU Nov 29 09:10:27 pvf sshd[3479]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) Nov 29 09:10:27 pvf systemd[1]: Started Session 13 of user root. Nov 29 09:10:27 pvf systemd-logind[711]: New session 13 of user root. Nov 29 09:10:27 pvf kernel: fwbr100i0: port 2(tap100i0) entered disabled state Nov 29 09:10:27 pvf kernel: fwbr100i0: port 1(fwln100i0) entered disabled state Nov 29 09:10:27 pvf kernel: vmbr0: port 2(fwpr100p0) entered disabled state Nov 29 09:10:27 pvf kernel: device fwln100i0 left promiscuous mode Nov 29 09:10:27 pvf kernel: fwbr100i0: port 1(fwln100i0) entered disabled state Nov 29 09:10:27 pvf kernel: device fwpr100p0 left promiscuous mode Nov 29 09:10:27 pvf kernel: vmbr0: port 2(fwpr100p0) entered disabled state Nov 29 09:10:27 pvf qmeventd[719]: read: Connection reset by peer Nov 29 09:10:27 pvf systemd[1]: 100.scope: Succeeded. Nov 29 09:10:28 pvf pvesm[3485]: starting task UPID:pvf:00000DA8:0000EF87:61A48AF4:imgdel:100@drbdstorage:root@pam: Nov 29 09:10:28 pvf Satellite[812]: 09:10:28.144 [MainWorkerPool-1] INFO LINSTOR/Satellite - SYSTEM - Resource 'vm-100-disk-1' updated for node 'pvf'. Nov 29 09:10:28 pvf kernel: drbd vm-100-disk-1/0 drbd1001: disk( UpToDate -> Detaching ) Nov 29 09:10:28 pvf kernel: drbd vm-100-disk-1/0 drbd1001: disk( Detaching -> Diskless ) Nov 29 09:10:28 pvf kernel: drbd vm-100-disk-1/0 drbd1001: drbd_bm_resize called with capacity == 0 Nov 29 09:10:28 pvf kernel: drbd vm-100-disk-1: Terminating worker thread Nov 29 09:10:28 pvf pvesm[3485]: end task UPID:pvf:00000DA8:0000EF87:61A48AF4:imgdel:100@drbdstorage:root@pam: OK Nov 29 09:10:28 pvf sshd[3479]: Received disconnect from 10.43.8.119 port 60710:11: disconnected by user Nov 29 09:10:28 pvf sshd[3479]: Disconnected from user root 10.43.8.119 port 60710 Nov 29 09:10:28 pvf sshd[3479]: pam_unix(sshd:session): session closed for user root Nov 29 09:10:28 pvf systemd-logind[711]: Session 13 logged out. Waiting for processes to exit. Nov 29 09:10:28 pvf systemd[1]: session-13.scope: Succeeded. Nov 29 09:10:28 pvf systemd-logind[711]: Removed session 13. Nov 29 09:10:28 pvf sshd[3463]: Received disconnect from 10.43.8.119 port 60706:11: disconnected by user Nov 29 09:10:28 pvf sshd[3463]: Disconnected from user root 10.43.8.119 port 60706 Nov 29 09:10:28 pvf sshd[3463]: pam_unix(sshd:session): session closed for user root Nov 29 09:10:28 pvf systemd-logind[711]: Session 11 logged out. Waiting for processes to exit. Nov 29 09:10:28 pvf systemd[1]: session-11.scope: Succeeded. Nov 29 09:10:28 pvf systemd-logind[711]: Removed session 11. Nov 29 09:10:29 pvf sshd[3534]: Accepted publickey for root from 10.43.8.119 port 60712 ssh2: RSA SHA256:3YNHg8CC3M6IPFUA9PlP5B7wnm2nbFLpnXd09j6k5yU Nov 29 09:10:29 pvf sshd[3534]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) Nov 29 09:10:29 pvf systemd[1]: Started Session 14 of user root. Nov 29 09:10:29 pvf systemd-logind[711]: New session 14 of user root. Nov 29 09:10:29 pvf sshd[3534]: Received disconnect from 10.43.8.119 port 60712:11: disconnected by user Nov 29 09:10:29 pvf sshd[3534]: Disconnected from user root 10.43.8.119 port 60712 Nov 29 09:10:29 pvf sshd[3534]: pam_unix(sshd:session): session closed for user root Nov 29 09:10:29 pvf systemd-logind[711]: Session 14 logged out. Waiting for processes to exit. Nov 29 09:10:29 pvf systemd[1]: session-14.scope: Succeeded. Nov 29 09:10:29 pvf systemd-logind[711]: Removed session 14. Nov 29 09:10:29 pvf pmxcfs[897]: [status] notice: received log