From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from firstgate.proxmox.com (firstgate.proxmox.com [IPv6:2a01:7e0:0:424::9]) by lore.proxmox.com (Postfix) with ESMTPS id BD9A41FF15D for ; Thu, 19 Sep 2024 08:56:21 +0200 (CEST) Received: from firstgate.proxmox.com (localhost [127.0.0.1]) by firstgate.proxmox.com (Proxmox) with ESMTP id 6EA32E6A9; Thu, 19 Sep 2024 08:56:21 +0200 (CEST) To: pve-devel@lists.proxmox.com Date: Tue, 17 Sep 2024 07:50:17 +0200 X-Mailman-Approved-At: Thu, 19 Sep 2024 08:56:19 +0200 MIME-Version: 1.0 Message-ID: List-Id: Proxmox VE development discussion List-Post: From: Sascha Westermann via pve-devel Precedence: list Cc: Sascha Westermann X-Mailman-Version: 2.1.29 X-BeenThere: pve-devel@lists.proxmox.com List-Subscribe: , List-Unsubscribe: , List-Archive: Reply-To: Proxmox VE development discussion List-Help: Subject: [pve-devel] [PATCH pve-common/pve-manager/qemu-server 0/3] Fix #5708: Add CPU raw counters Content-Type: multipart/mixed; boundary="===============1865458912098108913==" Errors-To: pve-devel-bounces@lists.proxmox.com Sender: "pve-devel" --===============1865458912098108913== Content-Type: message/rfc822 Content-Disposition: inline Return-Path: X-Original-To: pve-devel@lists.proxmox.com Delivered-To: pve-devel@lists.proxmox.com Received: from firstgate.proxmox.com (firstgate.proxmox.com [212.224.123.68]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits)) (No client certificate requested) by lists.proxmox.com (Postfix) with ESMTPS id 3811AC3659 for ; Tue, 17 Sep 2024 08:05:39 +0200 (CEST) Received: from firstgate.proxmox.com (localhost [127.0.0.1]) by firstgate.proxmox.com (Proxmox) with ESMTP id 08B6410D04 for ; Tue, 17 Sep 2024 08:05:09 +0200 (CEST) Received: from EUR03-DBA-obe.outbound.protection.outlook.com (mail-dbaeur03on20707.outbound.protection.outlook.com [IPv6:2a01:111:f403:260d::707]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by firstgate.proxmox.com (Proxmox) with ESMTPS for ; Tue, 17 Sep 2024 08:05:06 +0200 (CEST) ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=LJ4uCBhk+Bz+5heDc+kApm7yCG1cMSfp6xTv+Es0EOESJ4Enfxv7Q97uHXkaXX6E0GwiOIOITWLjoaOjYwx+K5UD+0vMnR4HZjsteKdSl9w5eP/1lQ+iEfwK5c7WKCiuJBgBH+iklWqU2zQO/bJHWMhLdP5OSu8gleYwSmqXF6qI7mMPc2uYhQUhDK5pY0TIdiQ/0CF+EhWoTRMAcZpzKTs9hRv6chCilQVl+CpJU9GBvM3P9qy4ONrqFtTEsv34zH6Qa7xw//RKfrtP8CR3Vb0LzhIQq9UxAK9IQW8kJCgR12tA/jCgHmpwxh9yuLIYnsjjMIjwXG8t+ZhOkxhO2A== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=tmgjZuvZN3xVm6/0TFt+34T/xTn863ragovK+1umWXo=; b=u5Toy9WvxXRVJdaX06QTgjH48gY8MwXGsEOcgiJirGTwbCPzDLubBNe1lusoeMqEYMmT84Gstr+Otb8MHhKRzQlod2ydZh+HkoFvTYbG8i6hCvuI+IiWWN5dSLkPERutg+LgFUSL0sE9ff0TPgqkTNj4piwfaUhKwJw+JImnwnCbVwdQJvcsJxFDgm0vJutArtshIOqVEGCMTZZoX7PrHEizsk2jBJDaqaGzmB8m9aK/MoVzcdklRM3JKJQEVLPOFwyshWyMWdkrK+MaKnFsZZT+RA1bnsBww1VFL0g1admzYKpGmzxG5OGMGEF2QuGJnC/fuXxK6DRiqutLohgubw== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=hl-services.de; dmarc=pass action=none header.from=hl-services.de; dkim=pass header.d=hl-services.de; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=hl-services.de; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=tmgjZuvZN3xVm6/0TFt+34T/xTn863ragovK+1umWXo=; b=Hy9VnNBF73FPPk1n1yanoZg2eMFN+a9KKmBBDm5/przGPsE08v3edrMa9z8v4kwXlMGF+SLtl3vdzAbAmQLLlKqWBBRTxE0RpWnpRkbJyCxqbfxMa2JDzWSQz4zJs1sjnIeKs0ozNM3yv74uzvPFkNzVdgUMLX4RRP+zjcCzitzm7RMVhLy1FnDZgw+mEraG0Gcz85lSwQjzYTXFpcvPzEo7PYNy5qw8rpe+k72ROcnj0nAY0ucnFk2+e6mIURAXdC5cDUUqzhTS0//Jah5HnUZHUECbWqsMEw51y/b6C56WBJmWYNzgfEn2useGZg8qTuRhin8+ngBFO7QegNffeg== Authentication-Results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=hl-services.de; Received: from AM9PR10MB4885.EURPRD10.PROD.OUTLOOK.COM (2603:10a6:20b:419::5) by GV2PR10MB7031.EURPRD10.PROD.OUTLOOK.COM (2603:10a6:150:d3::21) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.7962.24; Tue, 17 Sep 2024 05:50:31 +0000 Received: from AM9PR10MB4885.EURPRD10.PROD.OUTLOOK.COM ([fe80::69f0:b468:92e7:7210]) by AM9PR10MB4885.EURPRD10.PROD.OUTLOOK.COM ([fe80::69f0:b468:92e7:7210%6]) with mapi id 15.20.7962.022; Tue, 17 Sep 2024 05:50:31 +0000 From: Sascha Westermann To: pve-devel@lists.proxmox.com Cc: Sascha Westermann Subject: [PATCH pve-common/pve-manager/qemu-server 0/3] Fix #5708: Add CPU raw counters Date: Tue, 17 Sep 2024 07:50:17 +0200 Message-ID: <20240917055020.10507-1-sascha.westermann@hl-services.de> X-Mailer: git-send-email 2.46.0 Content-Transfer-Encoding: 8bit Content-Type: text/plain X-ClientProxiedBy: AM0PR03CA0045.eurprd03.prod.outlook.com (2603:10a6:208::22) To AM9PR10MB4885.EURPRD10.PROD.OUTLOOK.COM (2603:10a6:20b:419::5) MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: AM9PR10MB4885:EE_|GV2PR10MB7031:EE_ X-MS-Office365-Filtering-Correlation-Id: b0567e3c-2f22-4d44-8be9-08dcd6dca453 X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0;ARA:13230040|10070799003|376014|1800799024|366016; X-Microsoft-Antispam-Message-Info: =?us-ascii?Q?WssiMQz5uHMwmF8UZZ43TV8WL2zUu2u0XumZJ3JdaSp20TCEOjHPuGMwxKFN?= =?us-ascii?Q?jcdyZd/nldI4Df7osRq9YH3BB7JyQceu4D+3PtzKISiDdU5oFRopNauovG5f?= =?us-ascii?Q?aCdTNfCLec/QzMSWS3X3PPDx+ZDmfDRQCDxi5h8F7ASI3yMllCC+yCkc4xOr?= =?us-ascii?Q?gLF9fC3fB+KAIQuf2YJXwCXWzCyHX1+2kmzDlh6zd63Q65SEP5ElK+cbPviz?= =?us-ascii?Q?GBbVWmbenkshDJ8boUkCqstXBm4n9JXMVw4mFGeNnLJastoolxgxr/xkQFZs?= =?us-ascii?Q?lN3PoDLerCWDmisyaNKLpxKXeEwWsbDMuaKKYVWUvkCe8lArl3SBvrXBs6K+?= =?us-ascii?Q?nG2aGyMUfk+efoQcG16IRP6VWp64hBwOuaXHSKAwe9vwycW0k2ZGCbqinsVh?= =?us-ascii?Q?n3BosRBASN4Ue0y8D0zocryaiZvTARRMHL7r2LGM/+jW9qKy8prBRdeS3xIz?= =?us-ascii?Q?lL+XmzyDDOYrbCK90fYtE4x3GFr/Lior84kNyuN2u+gJRd6ASTV+wR2Tr97p?= =?us-ascii?Q?l4pCyVfSmeNbv8eoIqsLZ6SDATjwgcwjCkxAqro0eM8yrFQAIf4Ljw98NDxU?= =?us-ascii?Q?xLs1xUvX7LG8Dx9W8d1iFCFaHAALFEmlU32gwcSfn3EwvETa/HWRL4mgB63K?= =?us-ascii?Q?KyY8iqhTxSIptLWl77RicD5NqOzpEEIBLRJ/I/X66BNFcjC8CK1ME536RTD/?= =?us-ascii?Q?ms1t68AWZUmI0FvxzFQQSXKAVcm/3ZU5nNN6968a9bzfxMTCfTXCzYEkXdM1?= =?us-ascii?Q?88vmKP99AVBPkkxBTLOXMU1/NwOLXKQ9RpZmQFJKnU/m7HMQWbSX+KU/V3qK?= =?us-ascii?Q?ZvVSwh261P0b6YA5Zgkqr/9LzIb1aIXDYUPuu6MKHj1lV/MmyticLN3sH4W8?= =?us-ascii?Q?8wnAXvQFzjLhq4w33Y7bjw6lp2r8nQpB3su1ovKci0S85VFkA6W1rn3ktyVu?= =?us-ascii?Q?1VwmQcatN3mUbivQQEWDZtbsNXqL0eERT1X/bU5jeGs5FMHK3Knqsibb/qif?= =?us-ascii?Q?EdFy8IKYeMKsE2lEAXg5hhl4c7ElV50PkuOPrqt/fFJVP09Cmmsql+TWWz57?= =?us-ascii?Q?EF2xIn9ySwzrFVtJLpg806gLh+UmvLaaia9G+hTzfsaKv80t6Tv5swbjGAD2?= =?us-ascii?Q?3nFfKlT+wxpgTuw0V01hNJIez5cCbu5L+/cguxSUu/SPsea1Rha97KdysjAZ?= =?us-ascii?Q?bF7dl/Vr7I9vQdfggakaXlPW4CJrTbZ/iJEB1QkLNrH3Z9VnyEtUhZoxKAA5?= =?us-ascii?Q?A4GosHEb00O7ddt+QCN7ThdRlaPPtuN8Df28ssd3uoW1AUcNjghLF+bPSeZV?= =?us-ascii?Q?JVeELsmOrB1fLJxs66nGUWH1MiE0XTkRKMBTAfWmnRwT0w=3D=3D?= X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:AM9PR10MB4885.EURPRD10.PROD.OUTLOOK.COM;PTR:;CAT:NONE;SFS:(13230040)(10070799003)(376014)(1800799024)(366016);DIR:OUT;SFP:1102; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?us-ascii?Q?AvlkM7Y5P3wDG3qqXoTpuibRD2QKrD6NGUpQKT+DcoiNVyRKuRDSWb2mF+Dm?= =?us-ascii?Q?eqY7IjF/Cs7ugQgAj2wA7wQoB+DRudjbihFObget0zFzempldfd/Ot5AB3rN?= =?us-ascii?Q?O8I+pYap0Oci0lb8FvDJXnYcYjnzO+tliDjb39Fll3+UBq/GQ7u9rL2xnFoj?= =?us-ascii?Q?wYg8HRedlXMwXF20uvFHWMc75fh9LeheYO5WO6eM64QntHt5oqEV8FNn6AOc?= =?us-ascii?Q?kaBJweGYKe9lBKD0fS0KUh3kLcmQ3p7htq4WCNq8ulx/Uu6AqgEvKAO4cdq/?= =?us-ascii?Q?raBNNZbqQBahopGenNq4PhS60+44SZRswjAG943Je0Q1x9EolmatFMQg9Bux?= =?us-ascii?Q?SeOzAmQ2A4JyLlbXDSXqqCVO2NFbDV29bKcil5bDJtGcTbpLmvzmSx44lpiW?= =?us-ascii?Q?ZRO3s0b8tNQGKvl9X+bK9ZcUVoEzlojAUczGRqpVaW6rRzWoAxAkFN0u1aV8?= =?us-ascii?Q?24VwndJwkcqSsLD3O4ayC4pcZlMmhejSWrUGNNtcHdnYJwVSRBDafxytrMJz?= =?us-ascii?Q?CNf9FwO/QM2/ngHJvXCcixoOKtPztjrGRAFo5iBUohsnwFjQpRukKjJDATbs?= =?us-ascii?Q?1t5a9TE3200+M0ZSUwV620iFOrMeP19Vr+eIyv1h+zFeIVJrwl1oVy5Rgv7D?= =?us-ascii?Q?ialdJ+mu9zCL4Uyv1ZZI/rR3fm3rkrF5BTftG89KjmbHWK1dl67kAa3zlxXC?= =?us-ascii?Q?yxEhxidkcl3ew69cWBaFPNcdThXENLEWcxigccu0AIkt3dUD2TBpF0hTar2v?= =?us-ascii?Q?2APTZ8Kgd59EzI8vzUSplC5Bf5tF87Zfk6ANMEyhe9+fxnVN9/aq8m9nfv+Q?= =?us-ascii?Q?tzANn8Xtpnd/Q1S4KXSsVZxurRYwHBB7/dAHLVqX7LCfMpXItpoRaFSDq4uS?= =?us-ascii?Q?R+QsfvL58Tyn83Fx/SO2FKyJABvriKreG4+VER9I0LxJzxQVs9uPO7Bb6/aC?= =?us-ascii?Q?qm3ALjTiBDOglCUTvPUUbJuLdEnvgP9C3t2bXi8MS1v2afbzYx9u6nNRo9P/?= =?us-ascii?Q?xwXThtpRo46yLqFP0bMwDaQjtgqp3s+Ti1gdt922Ic/c7Qf/xJX87/su1seL?= =?us-ascii?Q?w0JF5Gh77P7iUQIpe5/+iVNkrru9L9WJhx7o0ZN/0eu2T0/z5KOgp9543j5K?= =?us-ascii?Q?ZiiLEk0CzuYfKlJ9WWwktwT6bATQr4xs4chHEif5CHsCNjXuAPNEkplG3xIG?= =?us-ascii?Q?Ay0l3vnx70vffrQo5SNQdxdbxcdhylrmMzSwvsfksgl27HmfJbmJCvSSk3r3?= =?us-ascii?Q?U3+OOO18xm3NlotS8HAE/2aitc/QtLLSKC5N8rRBzffk03bF7Dw3vMqK5ewi?= =?us-ascii?Q?bZ+mRYPeHi4yZAOUpwIjtqv2OB4w+NS7OJLXgT1DBzuJYpHaWQaU6dqqwYjh?= =?us-ascii?Q?NBrNlohKJPKs5LryFTZrN5zQ/MVpuYAGVCPmWBQrJGcNcvpb8BlwDBc51Dxa?= =?us-ascii?Q?h6NXuYnjMT/0VYwtfJlgQUHYeYG0kigSLoz5taGOUcihBMGCvLNLumE280ll?= =?us-ascii?Q?fedHHcPUu+3l271KolcL0t1oQ8JxRpmpWvrh7M74N+F8pP3RBFJoCI082X3I?= =?us-ascii?Q?HOQ/vk83glj+iiJ/kRJhIL4V7Na38ByhKGEbadFlJR+4d0xjZQ9fPJW8QVPs?= =?us-ascii?Q?hKHwBbEUWKZ8WM2ooZgr6bAWPIDxux85rlL/EoiSd9mG2gpXpOV8UZu4Oyox?= =?us-ascii?Q?e/fmhvRI6QNQxoKYlb7UjSxVtVk=3D?= X-OriginatorOrg: hl-services.de X-MS-Exchange-CrossTenant-Network-Message-Id: b0567e3c-2f22-4d44-8be9-08dcd6dca453 X-MS-Exchange-CrossTenant-AuthSource: AM9PR10MB4885.EURPRD10.PROD.OUTLOOK.COM X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 17 Sep 2024 05:50:31.9005 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 996ee4f0-343c-4038-abc8-fd1e1094eeb5 X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: 3zzOg06JHwtr678haW7vwGmX9fqrBhZg/UiMF2YMRsuALZM6sDCVZgl8P0OGgFl8feKIfGqz/MSW+yZY/DHF3pTa9pwrUGlbdD195vU51/47e4K/QoRW99tZ1MFfijVu X-MS-Exchange-Transport-CrossTenantHeadersStamped: GV2PR10MB7031 X-SPAM-LEVEL: Spam detection results: 0 ARC_SIGNED 0.001 Message has a ARC signature ARC_VALID 0.001 Message has a valid ARC signature BAYES_00 -1.9 Bayes spam probability is 0 to 1% DKIM_SIGNED 0.1 Message has a DKIM or DK signature, not necessarily valid DKIM_VALID -0.1 Message has at least one valid DKIM or DK signature DKIM_VALID_AU -0.1 Message has a valid DKIM or DK signature from author's domain DKIM_VALID_EF -0.1 Message has a valid DKIM or DK signature from envelope-from domain DMARC_PASS -0.1 DMARC pass policy RCVD_IN_DNSWL_NONE -0.0001 Sender listed at https://www.dnswl.org/, no trust SPF_HELO_NONE 0.001 SPF: HELO does not publish an SPF Record SPF_PASS -0.001 SPF: sender matches SPF record URIBL_BLOCKED 0.001 ADMINISTRATOR NOTICE: The query to URIBL was blocked. See http://wiki.apache.org/spamassassin/DnsBlocklists#dnsbl-block for more information. [procfstools.pm,hl-services.de,nodes.pm,qemuserver.pm] X-Mailman-Approved-At: Thu, 19 Sep 2024 08:56:19 +0200 To monitor the CPU utilization of nodes and Qemu VMs at arbitrary intervals (e.g. every 30 seconds) via the Proxmox API, there are no suitable endpoints right now: /api2/json/nodes/{node}/status (cpu): Instant value /api2/json/nodes/{node}/rrddata?timeframe=hour (cpu): Average values per minute /api2/json/nodes/{node}/qemu (cpu): Instant value /api2/json/nodes/{node}/qemu/{vmid}/rrddata?timeframe=hour (cpu): Average values per minute Instant values have the disadvantage that short-term peaks distort the value. The average values from rrddata provide usable average values, but you are restricted to a minute time window and the values can be up to one minute old. The following patches add raw counter values to a "cpustat" map in the corresponding endpoints. pve-common: Sascha Westermann (1): Add CPU raw counters src/PVE/ProcFSTools.pm | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-) pve-manager: Sascha Westermann (1): Add CPU raw counters PVE/API2/Nodes.pm | 32 ++++++++++++++++++++++++++++++++ 1 file changed, 32 insertions(+) qemu-server: Sascha Westermann (1): Add CPU raw counters PVE/QemuServer.pm | 55 +++++++++++++++++++++++++++++++++++++++++++++-- 1 file changed, 53 insertions(+), 2 deletions(-) -- 2.46.0 --===============1865458912098108913== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ pve-devel mailing list pve-devel@lists.proxmox.com https://lists.proxmox.com/cgi-bin/mailman/listinfo/pve-devel --===============1865458912098108913==--