From mboxrd@z Thu Jan  1 00:00:00 1970
Return-Path: <pve-devel-bounces@lists.proxmox.com>
Received: from firstgate.proxmox.com (firstgate.proxmox.com [IPv6:2a01:7e0:0:424::9])
	by lore.proxmox.com (Postfix) with ESMTPS id BD9A41FF15D
	for <inbox@lore.proxmox.com>; Thu, 19 Sep 2024 08:56:21 +0200 (CEST)
Received: from firstgate.proxmox.com (localhost [127.0.0.1])
	by firstgate.proxmox.com (Proxmox) with ESMTP id 6EA32E6A9;
	Thu, 19 Sep 2024 08:56:21 +0200 (CEST)
To: pve-devel@lists.proxmox.com
Date: Tue, 17 Sep 2024 07:50:17 +0200
X-Mailman-Approved-At: Thu, 19 Sep 2024 08:56:19 +0200
MIME-Version: 1.0
Message-ID: <mailman.5.1726728980.332.pve-devel@lists.proxmox.com>
List-Id: Proxmox VE development discussion <pve-devel.lists.proxmox.com>
List-Post: <mailto:pve-devel@lists.proxmox.com>
From: Sascha Westermann via pve-devel <pve-devel@lists.proxmox.com>
Precedence: list
Cc: Sascha Westermann <sascha.westermann@hl-services.de>
X-Mailman-Version: 2.1.29
X-BeenThere: pve-devel@lists.proxmox.com
List-Subscribe: <https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-devel>, 
 <mailto:pve-devel-request@lists.proxmox.com?subject=subscribe>
List-Unsubscribe: <https://lists.proxmox.com/cgi-bin/mailman/options/pve-devel>, 
 <mailto:pve-devel-request@lists.proxmox.com?subject=unsubscribe>
List-Archive: <http://lists.proxmox.com/pipermail/pve-devel/>
Reply-To: Proxmox VE development discussion <pve-devel@lists.proxmox.com>
List-Help: <mailto:pve-devel-request@lists.proxmox.com?subject=help>
Subject: [pve-devel] [PATCH pve-common/pve-manager/qemu-server 0/3] Fix
 #5708: Add CPU raw counters
Content-Type: multipart/mixed; boundary="===============1865458912098108913=="
Errors-To: pve-devel-bounces@lists.proxmox.com
Sender: "pve-devel" <pve-devel-bounces@lists.proxmox.com>

--===============1865458912098108913==
Content-Type: message/rfc822
Content-Disposition: inline

Return-Path: <sascha.westermann@hl-services.de>
X-Original-To: pve-devel@lists.proxmox.com
Delivered-To: pve-devel@lists.proxmox.com
Received: from firstgate.proxmox.com (firstgate.proxmox.com [212.224.123.68])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (2048 bits))
	(No client certificate requested)
	by lists.proxmox.com (Postfix) with ESMTPS id 3811AC3659
	for <pve-devel@lists.proxmox.com>; Tue, 17 Sep 2024 08:05:39 +0200 (CEST)
Received: from firstgate.proxmox.com (localhost [127.0.0.1])
	by firstgate.proxmox.com (Proxmox) with ESMTP id 08B6410D04
	for <pve-devel@lists.proxmox.com>; Tue, 17 Sep 2024 08:05:09 +0200 (CEST)
Received: from EUR03-DBA-obe.outbound.protection.outlook.com (mail-dbaeur03on20707.outbound.protection.outlook.com [IPv6:2a01:111:f403:260d::707])
	(using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits))
	(No client certificate requested)
	by firstgate.proxmox.com (Proxmox) with ESMTPS
	for <pve-devel@lists.proxmox.com>; Tue, 17 Sep 2024 08:05:06 +0200 (CEST)
ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none;
 b=LJ4uCBhk+Bz+5heDc+kApm7yCG1cMSfp6xTv+Es0EOESJ4Enfxv7Q97uHXkaXX6E0GwiOIOITWLjoaOjYwx+K5UD+0vMnR4HZjsteKdSl9w5eP/1lQ+iEfwK5c7WKCiuJBgBH+iklWqU2zQO/bJHWMhLdP5OSu8gleYwSmqXF6qI7mMPc2uYhQUhDK5pY0TIdiQ/0CF+EhWoTRMAcZpzKTs9hRv6chCilQVl+CpJU9GBvM3P9qy4ONrqFtTEsv34zH6Qa7xw//RKfrtP8CR3Vb0LzhIQq9UxAK9IQW8kJCgR12tA/jCgHmpwxh9yuLIYnsjjMIjwXG8t+ZhOkxhO2A==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com;
 s=arcselector10001;
 h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1;
 bh=tmgjZuvZN3xVm6/0TFt+34T/xTn863ragovK+1umWXo=;
 b=u5Toy9WvxXRVJdaX06QTgjH48gY8MwXGsEOcgiJirGTwbCPzDLubBNe1lusoeMqEYMmT84Gstr+Otb8MHhKRzQlod2ydZh+HkoFvTYbG8i6hCvuI+IiWWN5dSLkPERutg+LgFUSL0sE9ff0TPgqkTNj4piwfaUhKwJw+JImnwnCbVwdQJvcsJxFDgm0vJutArtshIOqVEGCMTZZoX7PrHEizsk2jBJDaqaGzmB8m9aK/MoVzcdklRM3JKJQEVLPOFwyshWyMWdkrK+MaKnFsZZT+RA1bnsBww1VFL0g1admzYKpGmzxG5OGMGEF2QuGJnC/fuXxK6DRiqutLohgubw==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass
 smtp.mailfrom=hl-services.de; dmarc=pass action=none
 header.from=hl-services.de; dkim=pass header.d=hl-services.de; arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=hl-services.de;
 s=selector1;
 h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck;
 bh=tmgjZuvZN3xVm6/0TFt+34T/xTn863ragovK+1umWXo=;
 b=Hy9VnNBF73FPPk1n1yanoZg2eMFN+a9KKmBBDm5/przGPsE08v3edrMa9z8v4kwXlMGF+SLtl3vdzAbAmQLLlKqWBBRTxE0RpWnpRkbJyCxqbfxMa2JDzWSQz4zJs1sjnIeKs0ozNM3yv74uzvPFkNzVdgUMLX4RRP+zjcCzitzm7RMVhLy1FnDZgw+mEraG0Gcz85lSwQjzYTXFpcvPzEo7PYNy5qw8rpe+k72ROcnj0nAY0ucnFk2+e6mIURAXdC5cDUUqzhTS0//Jah5HnUZHUECbWqsMEw51y/b6C56WBJmWYNzgfEn2useGZg8qTuRhin8+ngBFO7QegNffeg==
Authentication-Results: dkim=none (message not signed)
 header.d=none;dmarc=none action=none header.from=hl-services.de;
Received: from AM9PR10MB4885.EURPRD10.PROD.OUTLOOK.COM (2603:10a6:20b:419::5)
 by GV2PR10MB7031.EURPRD10.PROD.OUTLOOK.COM (2603:10a6:150:d3::21) with
 Microsoft SMTP Server (version=TLS1_2,
 cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.7962.24; Tue, 17 Sep
 2024 05:50:31 +0000
Received: from AM9PR10MB4885.EURPRD10.PROD.OUTLOOK.COM
 ([fe80::69f0:b468:92e7:7210]) by AM9PR10MB4885.EURPRD10.PROD.OUTLOOK.COM
 ([fe80::69f0:b468:92e7:7210%6]) with mapi id 15.20.7962.022; Tue, 17 Sep 2024
 05:50:31 +0000
From: Sascha Westermann <sascha.westermann@hl-services.de>
To: pve-devel@lists.proxmox.com
Cc: Sascha Westermann <sascha.westermann@hl-services.de>
Subject: [PATCH pve-common/pve-manager/qemu-server 0/3] Fix #5708: Add CPU raw counters
Date: Tue, 17 Sep 2024 07:50:17 +0200
Message-ID: <20240917055020.10507-1-sascha.westermann@hl-services.de>
X-Mailer: git-send-email 2.46.0
Content-Transfer-Encoding: 8bit
Content-Type: text/plain
X-ClientProxiedBy: AM0PR03CA0045.eurprd03.prod.outlook.com (2603:10a6:208::22)
 To AM9PR10MB4885.EURPRD10.PROD.OUTLOOK.COM (2603:10a6:20b:419::5)
MIME-Version: 1.0
X-MS-PublicTrafficType: Email
X-MS-TrafficTypeDiagnostic: AM9PR10MB4885:EE_|GV2PR10MB7031:EE_
X-MS-Office365-Filtering-Correlation-Id: b0567e3c-2f22-4d44-8be9-08dcd6dca453
X-MS-Exchange-SenderADCheck: 1
X-MS-Exchange-AntiSpam-Relay: 0
X-Microsoft-Antispam: BCL:0;ARA:13230040|10070799003|376014|1800799024|366016;
X-Microsoft-Antispam-Message-Info: 	=?us-ascii?Q?WssiMQz5uHMwmF8UZZ43TV8WL2zUu2u0XumZJ3JdaSp20TCEOjHPuGMwxKFN?=
 =?us-ascii?Q?jcdyZd/nldI4Df7osRq9YH3BB7JyQceu4D+3PtzKISiDdU5oFRopNauovG5f?=
 =?us-ascii?Q?aCdTNfCLec/QzMSWS3X3PPDx+ZDmfDRQCDxi5h8F7ASI3yMllCC+yCkc4xOr?=
 =?us-ascii?Q?gLF9fC3fB+KAIQuf2YJXwCXWzCyHX1+2kmzDlh6zd63Q65SEP5ElK+cbPviz?=
 =?us-ascii?Q?GBbVWmbenkshDJ8boUkCqstXBm4n9JXMVw4mFGeNnLJastoolxgxr/xkQFZs?=
 =?us-ascii?Q?lN3PoDLerCWDmisyaNKLpxKXeEwWsbDMuaKKYVWUvkCe8lArl3SBvrXBs6K+?=
 =?us-ascii?Q?nG2aGyMUfk+efoQcG16IRP6VWp64hBwOuaXHSKAwe9vwycW0k2ZGCbqinsVh?=
 =?us-ascii?Q?n3BosRBASN4Ue0y8D0zocryaiZvTARRMHL7r2LGM/+jW9qKy8prBRdeS3xIz?=
 =?us-ascii?Q?lL+XmzyDDOYrbCK90fYtE4x3GFr/Lior84kNyuN2u+gJRd6ASTV+wR2Tr97p?=
 =?us-ascii?Q?l4pCyVfSmeNbv8eoIqsLZ6SDATjwgcwjCkxAqro0eM8yrFQAIf4Ljw98NDxU?=
 =?us-ascii?Q?xLs1xUvX7LG8Dx9W8d1iFCFaHAALFEmlU32gwcSfn3EwvETa/HWRL4mgB63K?=
 =?us-ascii?Q?KyY8iqhTxSIptLWl77RicD5NqOzpEEIBLRJ/I/X66BNFcjC8CK1ME536RTD/?=
 =?us-ascii?Q?ms1t68AWZUmI0FvxzFQQSXKAVcm/3ZU5nNN6968a9bzfxMTCfTXCzYEkXdM1?=
 =?us-ascii?Q?88vmKP99AVBPkkxBTLOXMU1/NwOLXKQ9RpZmQFJKnU/m7HMQWbSX+KU/V3qK?=
 =?us-ascii?Q?ZvVSwh261P0b6YA5Zgkqr/9LzIb1aIXDYUPuu6MKHj1lV/MmyticLN3sH4W8?=
 =?us-ascii?Q?8wnAXvQFzjLhq4w33Y7bjw6lp2r8nQpB3su1ovKci0S85VFkA6W1rn3ktyVu?=
 =?us-ascii?Q?1VwmQcatN3mUbivQQEWDZtbsNXqL0eERT1X/bU5jeGs5FMHK3Knqsibb/qif?=
 =?us-ascii?Q?EdFy8IKYeMKsE2lEAXg5hhl4c7ElV50PkuOPrqt/fFJVP09Cmmsql+TWWz57?=
 =?us-ascii?Q?EF2xIn9ySwzrFVtJLpg806gLh+UmvLaaia9G+hTzfsaKv80t6Tv5swbjGAD2?=
 =?us-ascii?Q?3nFfKlT+wxpgTuw0V01hNJIez5cCbu5L+/cguxSUu/SPsea1Rha97KdysjAZ?=
 =?us-ascii?Q?bF7dl/Vr7I9vQdfggakaXlPW4CJrTbZ/iJEB1QkLNrH3Z9VnyEtUhZoxKAA5?=
 =?us-ascii?Q?A4GosHEb00O7ddt+QCN7ThdRlaPPtuN8Df28ssd3uoW1AUcNjghLF+bPSeZV?=
 =?us-ascii?Q?JVeELsmOrB1fLJxs66nGUWH1MiE0XTkRKMBTAfWmnRwT0w=3D=3D?=
X-Forefront-Antispam-Report: 	CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:AM9PR10MB4885.EURPRD10.PROD.OUTLOOK.COM;PTR:;CAT:NONE;SFS:(13230040)(10070799003)(376014)(1800799024)(366016);DIR:OUT;SFP:1102;
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: 	=?us-ascii?Q?AvlkM7Y5P3wDG3qqXoTpuibRD2QKrD6NGUpQKT+DcoiNVyRKuRDSWb2mF+Dm?=
 =?us-ascii?Q?eqY7IjF/Cs7ugQgAj2wA7wQoB+DRudjbihFObget0zFzempldfd/Ot5AB3rN?=
 =?us-ascii?Q?O8I+pYap0Oci0lb8FvDJXnYcYjnzO+tliDjb39Fll3+UBq/GQ7u9rL2xnFoj?=
 =?us-ascii?Q?wYg8HRedlXMwXF20uvFHWMc75fh9LeheYO5WO6eM64QntHt5oqEV8FNn6AOc?=
 =?us-ascii?Q?kaBJweGYKe9lBKD0fS0KUh3kLcmQ3p7htq4WCNq8ulx/Uu6AqgEvKAO4cdq/?=
 =?us-ascii?Q?raBNNZbqQBahopGenNq4PhS60+44SZRswjAG943Je0Q1x9EolmatFMQg9Bux?=
 =?us-ascii?Q?SeOzAmQ2A4JyLlbXDSXqqCVO2NFbDV29bKcil5bDJtGcTbpLmvzmSx44lpiW?=
 =?us-ascii?Q?ZRO3s0b8tNQGKvl9X+bK9ZcUVoEzlojAUczGRqpVaW6rRzWoAxAkFN0u1aV8?=
 =?us-ascii?Q?24VwndJwkcqSsLD3O4ayC4pcZlMmhejSWrUGNNtcHdnYJwVSRBDafxytrMJz?=
 =?us-ascii?Q?CNf9FwO/QM2/ngHJvXCcixoOKtPztjrGRAFo5iBUohsnwFjQpRukKjJDATbs?=
 =?us-ascii?Q?1t5a9TE3200+M0ZSUwV620iFOrMeP19Vr+eIyv1h+zFeIVJrwl1oVy5Rgv7D?=
 =?us-ascii?Q?ialdJ+mu9zCL4Uyv1ZZI/rR3fm3rkrF5BTftG89KjmbHWK1dl67kAa3zlxXC?=
 =?us-ascii?Q?yxEhxidkcl3ew69cWBaFPNcdThXENLEWcxigccu0AIkt3dUD2TBpF0hTar2v?=
 =?us-ascii?Q?2APTZ8Kgd59EzI8vzUSplC5Bf5tF87Zfk6ANMEyhe9+fxnVN9/aq8m9nfv+Q?=
 =?us-ascii?Q?tzANn8Xtpnd/Q1S4KXSsVZxurRYwHBB7/dAHLVqX7LCfMpXItpoRaFSDq4uS?=
 =?us-ascii?Q?R+QsfvL58Tyn83Fx/SO2FKyJABvriKreG4+VER9I0LxJzxQVs9uPO7Bb6/aC?=
 =?us-ascii?Q?qm3ALjTiBDOglCUTvPUUbJuLdEnvgP9C3t2bXi8MS1v2afbzYx9u6nNRo9P/?=
 =?us-ascii?Q?xwXThtpRo46yLqFP0bMwDaQjtgqp3s+Ti1gdt922Ic/c7Qf/xJX87/su1seL?=
 =?us-ascii?Q?w0JF5Gh77P7iUQIpe5/+iVNkrru9L9WJhx7o0ZN/0eu2T0/z5KOgp9543j5K?=
 =?us-ascii?Q?ZiiLEk0CzuYfKlJ9WWwktwT6bATQr4xs4chHEif5CHsCNjXuAPNEkplG3xIG?=
 =?us-ascii?Q?Ay0l3vnx70vffrQo5SNQdxdbxcdhylrmMzSwvsfksgl27HmfJbmJCvSSk3r3?=
 =?us-ascii?Q?U3+OOO18xm3NlotS8HAE/2aitc/QtLLSKC5N8rRBzffk03bF7Dw3vMqK5ewi?=
 =?us-ascii?Q?bZ+mRYPeHi4yZAOUpwIjtqv2OB4w+NS7OJLXgT1DBzuJYpHaWQaU6dqqwYjh?=
 =?us-ascii?Q?NBrNlohKJPKs5LryFTZrN5zQ/MVpuYAGVCPmWBQrJGcNcvpb8BlwDBc51Dxa?=
 =?us-ascii?Q?h6NXuYnjMT/0VYwtfJlgQUHYeYG0kigSLoz5taGOUcihBMGCvLNLumE280ll?=
 =?us-ascii?Q?fedHHcPUu+3l271KolcL0t1oQ8JxRpmpWvrh7M74N+F8pP3RBFJoCI082X3I?=
 =?us-ascii?Q?HOQ/vk83glj+iiJ/kRJhIL4V7Na38ByhKGEbadFlJR+4d0xjZQ9fPJW8QVPs?=
 =?us-ascii?Q?hKHwBbEUWKZ8WM2ooZgr6bAWPIDxux85rlL/EoiSd9mG2gpXpOV8UZu4Oyox?=
 =?us-ascii?Q?e/fmhvRI6QNQxoKYlb7UjSxVtVk=3D?=
X-OriginatorOrg: hl-services.de
X-MS-Exchange-CrossTenant-Network-Message-Id: b0567e3c-2f22-4d44-8be9-08dcd6dca453
X-MS-Exchange-CrossTenant-AuthSource: AM9PR10MB4885.EURPRD10.PROD.OUTLOOK.COM
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 17 Sep 2024 05:50:31.9005
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 996ee4f0-343c-4038-abc8-fd1e1094eeb5
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: 3zzOg06JHwtr678haW7vwGmX9fqrBhZg/UiMF2YMRsuALZM6sDCVZgl8P0OGgFl8feKIfGqz/MSW+yZY/DHF3pTa9pwrUGlbdD195vU51/47e4K/QoRW99tZ1MFfijVu
X-MS-Exchange-Transport-CrossTenantHeadersStamped: GV2PR10MB7031
X-SPAM-LEVEL: Spam detection results:  0
	ARC_SIGNED              0.001 Message has a ARC signature
	ARC_VALID               0.001 Message has a valid ARC signature
	BAYES_00                 -1.9 Bayes spam probability is 0 to 1%
	DKIM_SIGNED               0.1 Message has a DKIM or DK signature, not necessarily valid
	DKIM_VALID               -0.1 Message has at least one valid DKIM or DK signature
	DKIM_VALID_AU            -0.1 Message has a valid DKIM or DK signature from author's domain
	DKIM_VALID_EF            -0.1 Message has a valid DKIM or DK signature from envelope-from domain
	DMARC_PASS               -0.1 DMARC pass policy
	RCVD_IN_DNSWL_NONE     -0.0001 Sender listed at https://www.dnswl.org/, no trust
	SPF_HELO_NONE           0.001 SPF: HELO does not publish an SPF Record
	SPF_PASS               -0.001 SPF: sender matches SPF record
	URIBL_BLOCKED           0.001 ADMINISTRATOR NOTICE: The query to URIBL was blocked.  See http://wiki.apache.org/spamassassin/DnsBlocklists#dnsbl-block for more information. [procfstools.pm,hl-services.de,nodes.pm,qemuserver.pm]
X-Mailman-Approved-At: Thu, 19 Sep 2024 08:56:19 +0200

To monitor the CPU utilization of nodes and Qemu VMs at arbitrary
intervals (e.g. every 30 seconds) via the Proxmox API, there are no
suitable endpoints right now:

/api2/json/nodes/{node}/status (cpu): Instant value
/api2/json/nodes/{node}/rrddata?timeframe=hour (cpu): Average values 
per minute

/api2/json/nodes/{node}/qemu (cpu): Instant value
/api2/json/nodes/{node}/qemu/{vmid}/rrddata?timeframe=hour (cpu):
Average values per minute

Instant values have the disadvantage that short-term peaks distort the
value. The average values from rrddata provide usable average values,
but you are restricted to a minute time window and the values can be
up to one minute old.

The following patches add raw counter values to a "cpustat" map in
the corresponding endpoints.

pve-common:

Sascha Westermann (1):
  Add CPU raw counters

 src/PVE/ProcFSTools.pm | 3 ++-
 1 file changed, 2 insertions(+), 1 deletion(-)

pve-manager:

Sascha Westermann (1):
  Add CPU raw counters

 PVE/API2/Nodes.pm | 32 ++++++++++++++++++++++++++++++++
 1 file changed, 32 insertions(+)

qemu-server:

Sascha Westermann (1):
  Add CPU raw counters

 PVE/QemuServer.pm | 55 +++++++++++++++++++++++++++++++++++++++++++++--
 1 file changed, 53 insertions(+), 2 deletions(-)

-- 
2.46.0



--===============1865458912098108913==
Content-Type: text/plain; charset="us-ascii"
MIME-Version: 1.0
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

_______________________________________________
pve-devel mailing list
pve-devel@lists.proxmox.com
https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-devel

--===============1865458912098108913==--