Chapter 6. Monitoring performance with Performance Co-Pilot
Performance Co-Pilot (PCP) is a suite of tools, services, and libraries for monitoring, visualizing, storing, and analyzing system-level performance measurements. As a system administrator, you can monitor the system’s performance by using PCP in Red Hat Enterprise Linux.
6.1. Monitoring postfix with pmda-postfix
You can monitor performance metrics of the postfix mail server with pmda-postfix
. It helps to check how many emails are received per second.
Prerequisites
- PCP is installed. For more information, see Installing and enabling PCP.
-
The
pmlogger
service is enabled. For more information, see Enabling the pmlogger service.
Procedure
Install the following packages:
Install the
pcp-system-tools
:dnf install pcp-system-tools
# dnf install pcp-system-tools
Copy to Clipboard Copied! Install the
pmda-postfix
package to monitor postfix:dnf install pcp-pmda-postfix postfix
# dnf install pcp-pmda-postfix postfix
Copy to Clipboard Copied! Install the
logging
daemon:dnf install rsyslog
# dnf install rsyslog
Copy to Clipboard Copied! Install the mail client for testing:
dnf install mutt
# dnf install mutt
Copy to Clipboard Copied!
Enable the
postfix
andrsyslog
services:systemctl enable postfix rsyslog systemctl restart postfix rsyslog
# systemctl enable postfix rsyslog # systemctl restart postfix rsyslog
Copy to Clipboard Copied! Enable the SELinux boolean, so that
pmda-postfix
can access the required log files:setsebool -P pcp_read_generic_logs=on
# setsebool -P pcp_read_generic_logs=on
Copy to Clipboard Copied! Install the PMDA:
cd /var/lib/pcp/pmdas/postfix/ ./Install
# cd /var/lib/pcp/pmdas/postfix/ # ./Install Updating the Performance Metrics Name Space (PMNS) ... Terminate PMDA if already installed ... Updating the PMCD control file, and notifying PMCD ... Waiting for pmcd to terminate ... Starting pmcd ... Check postfix metrics have appeared ... 7 metrics and 58 values
Copy to Clipboard Copied!
Verification
Verify the
pmda-postfix
operation:echo testmail | mutt root Verify the available metrics: # pminfo postfix postfix.received postfix.sent postfix.queues.incoming postfix.queues.maildrop postfix.queues.hold postfix.queues.deferred postfix.queues.active
echo testmail | mutt root Verify the available metrics: # pminfo postfix postfix.received postfix.sent postfix.queues.incoming postfix.queues.maildrop postfix.queues.hold postfix.queues.deferred postfix.queues.active
Copy to Clipboard Copied!
6.2. Visually tracing PCP log archives with the PCP Charts application
After recording metric data, you can replay the PCP log archives as graphs. The metrics are sourced from one or more live hosts with alternative options to use metric data from PCP log archives as a source of historical data. To customize the PCP Charts application interface to display the data from the performance metrics, you can use line plot, bar graphs, or utilization graphs.
By using the PCP Charts application, you can:
- Replay the data in the PCP Charts application application and use graphs to visualize the retrospective data alongside live data of the system.
- Plot performance metric values into graphs.
- Display multiple charts simultaneously.
Prerequisites
- PCP is installed. For more information, see Installing and enabling PCP.
-
Logged performance data with the
pmlogger
. For more information, see Logging performance data with pmlogger. Installed the
pcp-gui
package.dnf install pcp-gui
# dnf install pcp-gui
Copy to Clipboard Copied!
Procedure
Launch the PCP Charts application from the command line:
pmchart
# pmchart
Copy to Clipboard Copied! The
pmtime
server settings are located at the bottom. With start and pause buttons you can control:- The interval in which PCP polls the metric data
- The date and time for the metrics of historical data
- Click File and then New Chart to select metric from both the local machine and remote machines by specifying their host name or address. Advanced configuration options include the ability to manually set the axis values for the chart, and to manually choose the color of the plots.
Record the views created in the PCP Charts application:
Following are the options to take images or record the views created in the PCP Charts application:
- Click File and then Export to save an image of the current view.
- Click Record and then Start to start a recording.
- Click Record and then Stop to stop the recording. After stopping the recording, the recorded metrics are archived to be viewed later.
- Optional: In the PCP Charts application, the main configuration file, known as the view, allows the metadata associated with one or more charts to be saved. This metadata describes all chart aspects, including the metrics used and the chart columns.
Optional: Save the custom view configuration by clicking File and then Save View, and load the view configuration later.
The following example of the PCP Charts application view configuration file describes a stacking chart graph showing the total number of bytes read and written to the given XFS file system
loop1
:pmchart
# pmchart version 1 chart title "Filesystem Throughput /loop1" style stacking antialiasing off plot legend Read rate metric xfs.read_bytes instance loop1 plot legend Write rate metric xfs.write_bytes instance loop1
Copy to Clipboard Copied!
6.3. Collecting data from SQL server by using PCP
The SQL Server agent in PCP helps you monitor and analyze database performance issues. You can collect data for Microsoft SQL Server via PCP on your system.
Prerequisites
-
You have installed Microsoft SQL Server for Red Hat Enterprise Linux and established a
trusted
connection to an SQL server. - You have installed the Microsoft ODBC driver for SQL Server for Red Hat Enterprise Linux.
Procedure
Install PCP:
dnf install pcp-zeroconf
# dnf install pcp-zeroconf
Copy to Clipboard Copied! Install packages required for the
pyodbc
driver:dnf install gcc-c++ python3-devel unixODBC-devel dnf install python3-pyodbc
# dnf install gcc-c++ python3-devel unixODBC-devel # dnf install python3-pyodbc
Copy to Clipboard Copied! Install the
mssql
agent:Install the Microsoft SQL Server domain agent for PCP:
dnf install pcp-pmda-mssql
# dnf install pcp-pmda-mssql
Copy to Clipboard Copied! Edit the
/etc/pcp/mssql/mssql.conf
file to configure the SQL server account’s username and password for the mssql agent. Ensure that the account you configure has access rights to performance data.username: user_name password: user_password
username: user_name password: user_password
Copy to Clipboard Copied! Replace user_name with the SQL Server account username and user_password with the SQL Server user password for this account.
Install the agent:
cd /var/lib/pcp/pmdas/mssql ./Install
# cd /var/lib/pcp/pmdas/mssql # ./Install Updating the Performance Metrics Name Space (PMNS) ... Terminate PMDA if already installed ... Updating the PMCD control file, and notifying PMCD ... Check mssql metrics have appeared ... 168 metrics and 598 values [...]
Copy to Clipboard Copied! Verification
Using the pcp command, verify if the SQL Server PMDA (
mssql
) is loaded and running:pcp
$ pcp Performance Co-Pilot configuration on rhel.local: platform: Linux rhel.local 4.18.0-167.el8.x86_64 #1 SMP Sun Dec 15 01:24:23 UTC 2019 x86_64 hardware: 2 cpus, 1 disk, 1 node, 2770MB RAM timezone: PDT+7 services: pmcd pmproxy pmcd: Version 5.0.2-1, 12 agents, 4 clients pmda: root pmcd proc pmproxy xfs linux nfsclient mmv kvm mssql jbd2 dm pmlogger: primary logger: /var/log/pcp/pmlogger/rhel.local/20200326.16.31 pmie: primary engine: /var/log/pcp/pmie/rhel.local/pmie.log
Copy to Clipboard Copied! View the complete list of metrics that PCP can collect from the SQL Server:
pminfo mssql
# pminfo mssql
Copy to Clipboard Copied! After viewing the list of metrics, you can report the rate of transactions. For example, to report on the overall transaction count per second, over a five second time window:
pmval -t 1 -T 5 mssql.databases.transactions
# pmval -t 1 -T 5 mssql.databases.transactions
Copy to Clipboard Copied! - View the graphical chart of these metrics on your system by using the pmchart command. For more information, see Visually tracing PCP log archives with the PCP Charts application.