Support
Using support tools for MicroShift
Abstract
Chapter 1. The etcd service Copy linkLink copied to clipboard!
The etcd service is delivered as part of the Red Hat build of MicroShift RPM. The etcd service is run as a separate process and the etcd lifecycle is managed automatically by MicroShift.
1.1. Observe and debug the MicroShift etcd server Copy linkLink copied to clipboard!
You can gather journalctl
logs to observe and debug the etcd server logs.
Prerequisites
- The MicroShift service is running.
Procedure
To get the logs for etcd, run the following command:
sudo journalctl -u microshift-etcd.scope
$ sudo journalctl -u microshift-etcd.scope
Copy to Clipboard Copied! Toggle word wrap Toggle overflow NoteMicroShift logs can be accessed separately from etcd logs using the
journalctl -u microshift
command.
1.2. Checking the etcd version Copy linkLink copied to clipboard!
You can get the version information for the etcd database included with your MicroShift by using one or both of the following methods, depending on the level of information that you need.
Procedure
To display the base database version information, run the following command:
microshift-etcd version
$ microshift-etcd version
Copy to Clipboard Copied! Toggle word wrap Toggle overflow Example output
microshift-etcd Version: 4.17.1 Base etcd Version: 3.5.13
microshift-etcd Version: 4.17.1 Base etcd Version: 3.5.13
Copy to Clipboard Copied! Toggle word wrap Toggle overflow To display the full database version information, run the following command:
microshift-etcd version -o json
$ microshift-etcd version -o json
Copy to Clipboard Copied! Toggle word wrap Toggle overflow Example output
Copy to Clipboard Copied! Toggle word wrap Toggle overflow
1.3. Troubleshooting etcd Copy linkLink copied to clipboard!
To troubleshoot etcd and improve performance, configure the memory allowance for the service.
1.4. Configuring the memoryLimitMB value to set parameters for the etcd server Copy linkLink copied to clipboard!
By default, etcd uses as much memory as necessary to handle the load on the system. In memory-constrained systems, you might need to limit the amount of memory etcd uses.
Procedure
Edit the
/etc/microshift/config.yaml
file to set thememoryLimitMB
value.etcd: memoryLimitMB: 128
etcd: memoryLimitMB: 128
Copy to Clipboard Copied! Toggle word wrap Toggle overflow NoteThe minimum required value for
memoryLimitMB
on MicroShift is 128 MB. Values close to the minimum value are more likely to impact etcd performance. The lower the limit, the longer etcd takes to respond to queries. If the limit is too low or the etcd usage is high, queries time out.
Verification
After modifying the
memoryLimitMB
value in/etc/microshift/config.yaml
, restart MicroShift by running the following command:sudo systemctl restart microshift
$ sudo systemctl restart microshift
Copy to Clipboard Copied! Toggle word wrap Toggle overflow Verify the new
memoryLimitMB
value is in use by running the following command:systemctl show --property=MemoryHigh microshift-etcd.scope
$ systemctl show --property=MemoryHigh microshift-etcd.scope
Copy to Clipboard Copied! Toggle word wrap Toggle overflow
Chapter 2. Using sos reports Copy linkLink copied to clipboard!
You can use the sos
tool to collect troubleshooting information about a host. The sos report
command generates a detailed report that shows all of the enabled plugins and data from the different components and applications in a system.
2.1. About sos reports Copy linkLink copied to clipboard!
The sos
tool is composed of different plugins that help you gather information from different applications. A MicroShift-specific plugin from sos version 4.5.1 can gather the following data:
- MicroShift configuration and version
- YAML output for node and system namespaced resources
- OVN-Kubernetes information
2.2. Gathering data from an sos report Copy linkLink copied to clipboard!
Prerequisites
-
You must have the
sos
package installed.
Procedure
- Log in to the failing host as a root user.
Perform the debug report creation procedure by running the following command:
microshift-sos-report
$ microshift-sos-report
Copy to Clipboard Copied! Toggle word wrap Toggle overflow Example output
Copy to Clipboard Copied! Toggle word wrap Toggle overflow
Chapter 3. Getting your node ID Copy linkLink copied to clipboard!
When providing information to Red Hat Support, it is helpful to provide the unique identifier of your node. For MicroShift, you can get your node ID manually by using the OpenShift CLI (oc
) or by retrieving the ID from a file.
A node ID is created only after the MicroShift service runs for the first time after installation.
3.1. Getting the node ID of a running node Copy linkLink copied to clipboard!
Use either the of the following steps to get the ID of a running node.
Procedure
Get the ID of a running node using
oc get
by entering the following command:oc get namespaces kube-system -o jsonpath={.metadata.uid}
$ oc get namespaces kube-system -o jsonpath={.metadata.uid}
Copy to Clipboard Copied! Toggle word wrap Toggle overflow Example output
7cf13853-68f4-454e-8f5c-1af748cbfb1a
7cf13853-68f4-454e-8f5c-1af748cbfb1a
Copy to Clipboard Copied! Toggle word wrap Toggle overflow Get the ID of a running node by retrieving it from the
cluster-id
file by entering the following command:sudo cat /var/lib/microshift/cluster-id
$ sudo cat /var/lib/microshift/cluster-id
Copy to Clipboard Copied! Toggle word wrap Toggle overflow Example output
7cf13853-68f4-454e-8f5c-1af748cbfb1a
7cf13853-68f4-454e-8f5c-1af748cbfb1a
Copy to Clipboard Copied! Toggle word wrap Toggle overflow
3.2. Getting the node ID of a stopped node Copy linkLink copied to clipboard!
For a node that ran before, but is not running now, you can get the node ID from the cluster-id
file in the /var/lib/microshift
directory.
Procedure
Get the ID of a stopped node by retrieving it from the
cluster-id
file by entering the following command:sudo cat /var/lib/microshift/cluster-id
$ sudo cat /var/lib/microshift/cluster-id
Copy to Clipboard Copied! Toggle word wrap Toggle overflow Example output
7cf13853-68f4-454e-8f5c-1af748cbfb1a
7cf13853-68f4-454e-8f5c-1af748cbfb1a
Copy to Clipboard Copied! Toggle word wrap Toggle overflow
Chapter 4. Getting support Copy linkLink copied to clipboard!
Use the following information to get more help with Red Hat Device Edge, including Red Hat build of MicroShift or Red Hat Enterprise Linux for Edge (RHEL for Edge).
4.1. Getting support Copy linkLink copied to clipboard!
If you experience difficulty with a procedure described in this documentation, or with Red Hat build of MicroShift in general, visit the Red Hat Customer Portal.
From the Customer Portal, you can:
- Search or browse through the Red Hat Knowledgebase of articles and solutions relating to Red Hat products.
- Submit a support case to Red Hat Support.
- Access other product documentation.
4.2. Providing documentation feedback Copy linkLink copied to clipboard!
To report an error or to improve our documentation, log in to your Red Hat Jira account and submit a Jira issue.
4.3. About the Red Hat Knowledgebase Copy linkLink copied to clipboard!
The Red Hat Knowledgebase provides rich content aimed at helping you make the most of Red Hat’s products and technologies. The Red Hat Knowledgebase consists of articles, product documentation, and videos outlining best practices on installing, configuring, and using Red Hat products. In addition, you can search for solutions to known issues, each providing concise root cause descriptions and remedial steps.
4.4. Searching the Red Hat Knowledgebase Copy linkLink copied to clipboard!
In the event of an Red Hat build of MicroShift issue, you can perform an initial search to determine if a solution already exists within the Red Hat Knowledgebase.
Prerequisites
- You have a Red Hat Customer Portal account.
Procedure
- Log in to the Red Hat Customer Portal.
- Click Search.
In the search field, input keywords and strings relating to the problem, including:
- Red Hat build of MicroShift components (such as etcd)
- Related procedure (such as installation)
- Warnings, error messages, and other outputs related to explicit failures
- Click the Enter key.
- Optional: Select the Red Hat build of MicroShift product filter.
- Optional: Select the Documentation content type filter.
4.5. Submitting a support case Copy linkLink copied to clipboard!
Prerequisites
- The MicroShift service is running.
-
You have installed the OpenShift CLI (
oc
). - You have a Red Hat Customer Portal account.
- You have a Red Hat Standard or Premium subscription.
Procedure
- Log in to the Customer Support page of the Red Hat Customer Portal.
- Click Get support.
On the Cases tab of the Customer Support page:
- Optional: Change the pre-filled account and owner details if needed.
- Select the appropriate category for your issue, such as Bug or Defect, and click Continue.
Enter the following information:
- In the Summary field, enter a concise but descriptive problem summary and further details about the symptoms being experienced, as well as your expectations.
- Select Red Hat Device Edge from the Product drop-down menu.
- Select 4 from the Version drop-down.
- Review the list of suggested Red Hat Knowledgebase solutions for a potential match against the problem that is being reported. If the suggested articles do not address the issue, click Continue.
- Review the updated list of suggested Red Hat Knowledgebase solutions for a potential match against the problem that is being reported. The list is refined as you provide more information during the case creation process. If the suggested articles do not address the issue, click Continue.
- Ensure that the account information presented is as expected, and if not, amend accordingly.
Complete the following questions where prompted. Include which type of install type you are using, either RPM or embedded-image. Click Continue:
- What are you experiencing? What are you expecting to happen?
- Define the value or impact to you or the business.
- Where are you experiencing this behavior? What environment?
- When does this behavior occur? Frequency? Repeatedly? At certain times?
-
Upload relevant diagnostic data files and click Continue. Include data gathered using the
sos
tool or etcd as a starting point, plus any issue-specific data that is not collected in those logs. - Add relevant case management details and click Continue.
- Preview the case details and click Submit.
Chapter 5. Remote health monitoring with a connected node Copy linkLink copied to clipboard!
Telemetry and configuration data about your node can be collected and reported to Red Hat.
5.1. About remote health monitoring with MicroShift Copy linkLink copied to clipboard!
Remote health monitoring is conducted in MicroShift by the collection of telemetry and configuration data about your node that is reported to Red Hat with the Telemeter API. A node that reports Telemetry to Red Hat is considered a connected node.
Telemetry is the term that Red Hat uses to describe the information being sent to Red Hat by the MicroShift Telemeter API. Lightweight attributes are sent from a connected node to Red Hat to monitor the health of a node.
Telemetry benefits
Telemetry provides the following benefits:
- Enhanced identification and resolution of issues. Events that might seem normal to an end-user can be observed by Red Hat from a broader perspective. Some issues can be more rapidly identified from this point of view and resolved without an end-user needing to open a support case or file a Jira issue.
- Targeted prioritization of new features and functionality. The data collected provides information about system capabilities and usage characteristics. With this information, Red Hat can focus on developing the new features and functionality that have the greatest impact for our customers.
Telemetry sends a carefully chosen subset of the node monitoring metrics to Red Hat. The Telemeter API fetches the metrics values every hour and uploads the data to Red Hat. This stream of data is used by Red Hat to monitor nodes over time.
This debugging information is available to Red Hat Support and Engineering teams with the same restrictions as accessing data reported through support cases. All connected node information is used by Red Hat to help make MicroShift better.
MicroShift does not support Prometheus. To view the Telemetry gathered from your node, you must contact Red Hat Support.
5.2. Information collected by the MicroShift Telemetry API Copy linkLink copied to clipboard!
All metrics combined are generally under 2KB and not expected to consume node resources.
The following information is collected by Telemetry:
5.2.1. System information Copy linkLink copied to clipboard!
The system information describes the basic configuration of your MicroShift node and where it is running, for example:
- Version information, including the MicroShift node version.
- The Red Hat Enterprise Linux (RHEL) version.
- The RHEL deployment type.
5.2.2. Sizing information Copy linkLink copied to clipboard!
Sizing information details the node capacity, for example:
- The CPU cores MicroShift can use.
- Architecture information.
- The usable bytes of memory.
5.2.3. Usage information Copy linkLink copied to clipboard!
Usage information outlines what is happening in the node, for example:
- The CPU usage in percentage.
- The memory usage in percentage.
- The number of Kubernetes objects by resource type (CRDs).
- The number of running containers, namespaces, and running pods.
- The number of routes, ingress, services.
Telemetry does not collect identifying information such as usernames or passwords. Red Hat does not intend to collect personal information. If Red Hat discovers that personal information has been inadvertently received, Red Hat deletes such information. To the extent that any Telemetry constitutes personal data, refer to the Red Hat Privacy Statement for more information about Red Hat’s privacy practices.
5.2.4. Additional details about how remote health monitoring data is used Copy linkLink copied to clipboard!
Red Hat collects data about your use of the Red Hat product(s) for purposes such as providing support and troubleshooting, improving the offerings and user experience, responding to issues, and for billing purposes if applicable.
Collection safeguards
Red Hat employs technical and organizational measures designed to protect Telemetry data.
Sharing
Red Hat might share the data collected through the Telemetry API internally within Red Hat to improve your user experience. Red Hat might share Telemetry data with its business partners in an aggregated form that does not identify customers to help the partners better understand their markets and their customers' use of Red Hat offerings, or to ensure the successful integration of products jointly supported by those partners.
Third parties
Red Hat might engage certain third parties to assist in the collection, analysis, and storage of Telemetry data.
User control: Disabling Telemetry data collection
You can disable MicroShift Telemetry by following the instructions in the "Opting out of remote health reporting for MicroShift" section.
5.3. Opting out of Telemetry for MicroShift Copy linkLink copied to clipboard!
If your node is not connected to a network, or you do not want Telemetry gathered, you can opt out of Telemetry by disabling the parameter in the MicroShift configuration file.
Prerequisties
-
You installed OpenShift CLI (
oc
). - You have root access to the node.
Procedure
-
If you have not done so, make a copy of the provided
config.yaml.default
file in the/etc/microshift/
directory, renaming itconfig.yaml
. Keep the new MicroShift
config.yaml
in the/etc/microshift/
directory. Yourconfig.yaml
file is read every time the MicroShift service starts.NoteAfter you create it, the
config.yaml
file takes precedence over built-in settings.- Optional: Use a configuration snippet if you are using an existing MicroShift YAML. See "Using configuration snippets" in the Additional resources section for more information.
Set the
telemetry.status
section of the MicroShift YAML with theDisabled
value.Example disabled Telemetry configuration
Copy to Clipboard Copied! Toggle word wrap Toggle overflow