From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from firstgate.proxmox.com (firstgate.proxmox.com [212.224.123.68]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits)) (No client certificate requested) by lists.proxmox.com (Postfix) with ESMTPS id 518679FD2 for ; Tue, 29 Aug 2023 23:04:54 +0200 (CEST) Received: from firstgate.proxmox.com (localhost [127.0.0.1]) by firstgate.proxmox.com (Proxmox) with ESMTP id 3308AD184 for ; Tue, 29 Aug 2023 23:04:54 +0200 (CEST) Received: from NAM10-MW2-obe.outbound.protection.outlook.com (mail-mw2nam10on2060f.outbound.protection.outlook.com [IPv6:2a01:111:f400:7e89::60f]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by firstgate.proxmox.com (Proxmox) with ESMTPS for ; Tue, 29 Aug 2023 23:04:51 +0200 (CEST) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=HsqtTBKY/3qdEMFia9HFx6+Zemc7cTgMpNA0pdBoCd+mVb/m4GNWd63QyLRLE0CyUju1breJsX2Q+hfX5e/Kth65s7U0HCMzHQ5xRPPdAszR3v4/vSBmfEj7u9vL/xYVvp9Y2/JDIJ2zuXC6SUX9KRJYUEiYm6/9gwM+Eo9J3LuXemk4+a26Up8lMNRBN15iww3iSodNkJTGjhyQc3ucAy6URvm47dNwcML9Yk7sjHHXbGZa/AoK1eUN/QSSh1oeW3V99dwHEDTf78LyGwVnEkLfc+VOtM01fgy4nafMpJzLFRlSa5GdPyhuIM89PujrcEdRu+eG+KC5Ny496XDA2w== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=GYoZGW7WsV1otkKqVMtL9++VksEt5HfBIyb1roWwz+g=; b=ChliER2hJOTVkifGFvfD/g5P2n/xI6kSZAPlxxEghMvDj6R6gxSfx+wCNZ7ZviPsNXDio3cVBDu14Bi8qdo/WgypyXCRjcXDS5NqnoQFH0HoHHgMEgbc/4+e2YOMJIQcbJvTdCYlv9JRAnEemYHNjlY94wWrTODROIIv1qb2TSnD9/Nh9mgJMJ+xqMDISJpPNqod0r4dK8gFQ1rViVL3zKlV35GAPmFNFZ2yUdq66v1KqBKqO9aplEJ+3w7f50C84lxnMnKzlsbU75yBGT5PenJqOvlaP+B4x+Wq4PTNiqRqKuxYIQT7w1Y4ygjA26DF96krSzic2scT6wapXVDugQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=caltech.edu; dmarc=pass action=none header.from=caltech.edu; dkim=pass header.d=caltech.edu; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=caltech.edu; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=GYoZGW7WsV1otkKqVMtL9++VksEt5HfBIyb1roWwz+g=; b=Ub/TQJ7IJgpvtqtf3RgU1ImoAHVzkNNlmszKQXV57L4HIVNrYMXEj/BYHOjcN+vbbISjVDdIi0FPVKNdEyeRKisVtrrFE+bz22+DWwFk+PSj8L7SdF4VS6dhb2P5CXRNNPbUHZWRJ2QomnNhhPbBAO0kT6tkG4pTgQzQZwytrRfsYyr5KH5LP+JT3luBkYMhK4iraI22FZbAggw2FaMbiCuis5SoBZk/pHG6Zr5eXkULl7WaHuO7kEtcO4hnrDs+GbRlWs3OPyzf/UK1BeKH2CcPg2fTI/fQ2yyVW6mWO6kIh7ELtvNI/wOWbawWzmiOj4VS221Fkys5V53m9siNdg== Received: from SJ0PR03MB6303.namprd03.prod.outlook.com (2603:10b6:a03:3bc::22) by SA0PR03MB5387.namprd03.prod.outlook.com (2603:10b6:806:b3::9) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6745.18; Tue, 29 Aug 2023 21:04:41 +0000 Received: from SJ0PR03MB6303.namprd03.prod.outlook.com ([fe80::8310:3804:7a09:33ca]) by SJ0PR03MB6303.namprd03.prod.outlook.com ([fe80::8310:3804:7a09:33ca%4]) with mapi id 15.20.6699.034; Tue, 29 Aug 2023 21:04:41 +0000 From: "Anderson, Stuart B." To: "pve-user@lists.proxmox.com" Thread-Topic: [PVE-User] Hotplug Memory and default Linux kernel Thread-Index: AQHZ2rxtPLUcyjZS3Uab8SKhww/r5A== Date: Tue, 29 Aug 2023 21:04:41 +0000 Message-ID: <0C0F5E3A-6D17-4097-A068-C06ADBA40E90@caltech.edu> References: In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-mailer: Apple Mail (2.3731.700.6) authentication-results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=caltech.edu; x-ms-publictraffictype: Email x-ms-traffictypediagnostic: SJ0PR03MB6303:EE_|SA0PR03MB5387:EE_ x-ms-office365-filtering-correlation-id: ab14c764-6631-46ec-8020-08dba8d39001 x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: 7qIKiysiXvvKw7hGwPva/odPs2Usb4DRM31ZuuBPw1ktpxR0qO7vYN/Qum9sdmNS1Bdc/+NaGlBQqRgdcnNg9PSby0tGqkIiqQCwXTlghTvo/wBhY/qljTldXKBqAsZsp+tOZXheOpL7j0I7Jg9ddesJaVWPuYweHOxJRE0bd9nrrSP6DAl0JBEIu5PancdYdwmxt+4E/dsunBF5ARECPv8MwgxutLrNt8kXc/CLJLU/sfJCycoByYnFvxffl9kZOvD/ErhjrQZEBT5uB4zcLxjERnGgA+e+2AAbQOUFeQ3+ORQ5XXWvUiIurAV4BRPigX05D3UPj3cBCNaX0FUFztR2kbOq1VA7QmwA1TP9mlS4PsGk2/RUWJn/B82sy5+CemjEpH2NhvWda92WjCpUSk2oC3hKbJjGgvaVNI484F8gVPt16uVcnnP6/LzaoFCj+sPSFhUBFvMLVNJfQFZ7hxP7LHiQv+5U+pda4WdwCak0nFRJo1NJBQyis5OpCJKU0VIzDLvBME8PTtMu+gVqvDHk6MI9SK1z8aIAUTDrC3XgGcAqk8f7er3mGi0IC0RcGJTtS5vfRk/JPAa7i/9oc9fUPy7Y6/BPYX4WwVnmaD3cyegDwaB9DOfSCrFC8Bqa x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:SJ0PR03MB6303.namprd03.prod.outlook.com; PTR:; CAT:NONE; SFS:(13230031)(39860400002)(366004)(136003)(346002)(396003)(376002)(451199024)(1800799009)(186009)(6512007)(75432002)(38100700002)(38070700005)(316002)(41300700001)(6916009)(786003)(4326008)(33656002)(83380400001)(2906002)(86362001)(2616005)(26005)(8676002)(5660300002)(36756003)(8936002)(71200400001)(6506007)(66556008)(6486002)(966005)(66446008)(66476007)(66946007)(64756008)(53546011)(76116006)(478600001)(122000001)(45980500001); DIR:OUT; SFP:1101; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?us-ascii?Q?H1RJAxOURmSIZ7Zwkk3qAT0T/In43ieVfu7Q2sMreZwdwPYoYoapO1rAKakl?= =?us-ascii?Q?nihSOr8mUeoSIHc6poiXdSqCFyLTSyJBdq7n53k9aEsWFRA56F6hITDzTd1j?= =?us-ascii?Q?1+WmkOq+dxVjMLEauXxuL6aQFalfZbxv9ZavjUsy4kQpr5kjFeqZ32Jd/aNg?= =?us-ascii?Q?Bkzc1mNXVOirndjaa8ttkCFn3dDoVSK07UeCkAlmusbWlWdhUSOOG9UJmjv5?= =?us-ascii?Q?7SJXNbkkGlZCbs1V++Q7GlWYb5v4OuY9RiM1MO7bmiZDrfBqJJ0+Jz8kf719?= =?us-ascii?Q?hl1TjwvCpVsQZDLK+YXO7s9os8LTP3QZLuc8PMEa4+h0hPPinxA+iWZ49J1J?= =?us-ascii?Q?UG8DK7DhIOTKnMfvP9fbh9AMzt/A78Z/7jgG3wRqe/R7E20fhjkVX7EdO3js?= =?us-ascii?Q?EkwsdjC0ssJEck5yej6xqN5Lpy5PJUaM/fmLpaMNTrkkupDK4Uf/TQuhzFPG?= =?us-ascii?Q?fPJcrodtfmZ4HLYyg+akpTLrporu5MfC5iN8y2XQrOKs3tB2/x83v3PQ/IH+?= =?us-ascii?Q?9+HgG3B7DOHwvmjmkE//X/GZ6mcuy1K0aIQ8aiLRlYDq0Y+JWj+Xr8C1ZqEI?= =?us-ascii?Q?HijD5v2X+YSQrDHCBbLkgq4vGc03Z6+69UbzGFyy7H7agMz1uEAkmy9EtAqj?= =?us-ascii?Q?M5eU8Sk/QOdzL472eLJxN1Er4aIWeAkW5wA4U4lzUx/dSS83W5qlZ1N5AVyH?= =?us-ascii?Q?Ej2PVhmJ0M0h5HBnkHzpfMuCxam3FQWrgyvDLLn/tbipu+IpGxjkXruVNq97?= =?us-ascii?Q?12+6jFgn0vduqT0d+n4s3QMj44kFR6z0tTP2wGUGraJEgtNPu82SyiwCX2tS?= =?us-ascii?Q?RuLatt6/E0fOA4lagPlsbiuU5VOyPwktCf2WB3gA+HeFqvEaIcbcki8PXZzl?= =?us-ascii?Q?t4g1nl4MW6ym5K5IS1rT0B+0sX8hVpRKfde8SH1RN3FnkXySuwhuva12O1yB?= =?us-ascii?Q?Srzn0FkqZ4BmUZalDQuwhWtlwbU3HQjkAzl1N22dwDA3Gy0lGVzScEMCPL8S?= =?us-ascii?Q?bCoDzTuuGubFZtSXdGSX+ZBiHe713wKC0eltPxCFnYDQFyJl/rRICtX0j3AB?= =?us-ascii?Q?kWtJ9zYzDvErDNEw8UuWJzfVj+4LqcGY3uC2S+RTMX8HDs/GeNdb4mzDCJZp?= =?us-ascii?Q?dRBz34eKl4zK4UK03cEuGNuUoaskY+bUe7/xtyfotn8jMHgIskJalK0DAOcr?= =?us-ascii?Q?v/Xwk0HYG+0RPjeplSnX9eXE+jjTNnAfnOMUeRM2ZDVS5aAUKAuMuWfCc+Ch?= =?us-ascii?Q?elXnbU8Gih/h1WolA3oobUVIDOBM4brMEunKo6+Wps/ELhMIKr22OCCTH7B4?= =?us-ascii?Q?Z1CauDeM53k1LYFUUFza0oUets6rlZLW5lGvC9e7FMH4PfgYZ8Fs7RJqprat?= =?us-ascii?Q?dpLkZq23HBeuhogjFv1EsTjjDElp1dZ1qpuzRJcTdCSvIBUdIm7nP0EX1Ubx?= =?us-ascii?Q?CAHrz0xmDv5mXAz2YAk63bEGjylC5BunO76C/gdu0ECsAyvSWM97KZe36T8p?= =?us-ascii?Q?Ezzt4eWJvJvAj1wE03hTxEtubKQTiV24DXDqBIbUgE5GW1rDZHstOVBQCRIL?= =?us-ascii?Q?55TdsHHBysFkED+I24ohy+SEfH09gHLXzfYX2utB?= Content-Type: text/plain; charset="us-ascii" Content-ID: <0BD123FFBFBC634289412DC82F660604@namprd03.prod.outlook.com> Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-OriginatorOrg: caltech.edu X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: SJ0PR03MB6303.namprd03.prod.outlook.com X-MS-Exchange-CrossTenant-Network-Message-Id: ab14c764-6631-46ec-8020-08dba8d39001 X-MS-Exchange-CrossTenant-originalarrivaltime: 29 Aug 2023 21:04:41.0400 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: fd5be9d9-7b72-4df9-830e-b1f9cc5b44bd X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: 6zIemEltJJKsJbCJNiBjKaB7rz1cCrz7CYV9WnxDZzLCPnB6WYC1ak8bk7RvBb9i X-MS-Exchange-Transport-CrossTenantHeadersStamped: SA0PR03MB5387 X-SPAM-LEVEL: Spam detection results: 0 ARC_SIGNED 0.001 Message has a ARC signature ARC_VALID 0.001 Message has a valid ARC signature BAYES_00 -1.9 Bayes spam probability is 0 to 1% DKIM_SIGNED 0.1 Message has a DKIM or DK signature, not necessarily valid DKIM_VALID -0.1 Message has at least one valid DKIM or DK signature DKIM_VALID_AU -0.1 Message has a valid DKIM or DK signature from author's domain DKIM_VALID_EF -0.1 Message has a valid DKIM or DK signature from envelope-from domain DMARC_PASS -0.1 DMARC pass policy JMQ_SPF_NEUTRAL 0.5 SPF set to ?all SPF_HELO_PASS -0.001 SPF: HELO matches SPF record SPF_PASS -0.001 SPF: sender matches SPF record URIBL_BLOCKED 0.001 ADMINISTRATOR NOTICE: The query to URIBL was blocked. See http://wiki.apache.org/spamassassin/DnsBlocklists#dnsbl-block for more information. [qemu.org, proxmox.com, caltech.edu] Subject: Re: [PVE-User] Hotplug Memory and default Linux kernel X-BeenThere: pve-user@lists.proxmox.com X-Mailman-Version: 2.1.29 Precedence: list List-Id: Proxmox VE user list List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 29 Aug 2023 21:04:54 -0000 That looks so promising, but it is not working for PVE8+EL9 or PVE7+EL8. Pe= rhaps there is an additional qemu setting that is needed? [root@pcdev15 ~]# grep memhp /proc/cmdline=20 BOOT_IMAGE=3D(hd0,msdos1)/vmlinuz-5.14.0-284.25.1.el9_2.x86_64 root=3D/dev/= mapper/system-root ro crashkernel=3D1G-4G:192M,4G-64G:256M,64G-:512M rd.lvm= .lv=3Dsystem/root selinux=3D0 memhp_default_state=3Donline # # which did change the value of, # [root@pcdev15 ~]# cat /sys/devices/system/memory/auto_online_blocks online # # but leaves lshw reporting a single 1GB bank of memory, # [root@pcdev15 ~]# lshw -class memory *-firmware description: BIOS vendor: SeaBIOS physical id: 0 version: rel-1.16.2-0-gea1b7a073390-prebuilt.qemu.org date: 04/01/2014 size: 96KiB *-memory description: System Memory physical id: 1000 size: 32GiB capabilities: ecc configuration: errordetection=3Dmulti-bit-ecc *-bank description: DIMM RAM vendor: QEMU physical id: 0 slot: DIMM 0 size: 1GiB # # and the kernel running with small default parameters, # [root@pcdev15 ~]# grep processes /proc/$(pgrep systemd-logind)/limits Max processes 2659 2659 process= es=20 Note, the above is running with the suggested udev rule as well, but that a= ppears to be for cpu rather than memory, [root@pcdev15 ~]# cat /lib/udev/rules.d/80-hotplug-cpu.rules SUBSYSTEM=3D=3D"cpu", ACTION=3D=3D"add", TEST=3D=3D"online", ATTR{online}= =3D=3D"0", ATTR{online}=3D"1" Thanks. > On Aug 29, 2023, at 3:00 AM, pve-user-request@lists.proxmox.com wrote: >=20 > Hi, >=20 > see > https://pve.proxmox.com/wiki/Hotplug_(qemu_disk,nic,cpu,memory)#Memory_Ho= tplug >=20 >=20 > 2 possiblity: >=20 > add "memhp_default_state=3Donline" to grub >=20 > or >=20 > add udev script > /lib/udev/rules.d/80-hotplug-cpu.rules >=20 > SUBSYSTEM=3D=3D"cpu", ACTION=3D=3D"add", TEST=3D=3D"online", ATTR{online}= =3D=3D"0", > ATTR{online}=3D"1" >=20 >=20 >=20 > When hotplug is enabled, only 1GB of "static" memory is enabled (to > boot the kernel,...). > Then the other memory modules, are hotpluggable, and by default are > offline.=20 -- Stuart Anderson sba@caltech.edu