5.3. 自动扩展故障排除

流程

1. 访问 openstack 客户端 pod:

   $ oc rsh openstackclient

   Copy to Clipboard Toggle word wrap

2. 要检索状态转换的信息，请列出堆栈事件记录：

   $ openstack stack event list example
   2017-03-06 11:12:43Z [example]: CREATE_IN_PROGRESS  Stack CREATE started
   2017-03-06 11:12:43Z [example.scaleup_group]: CREATE_IN_PROGRESS  state changed
   2017-03-06 11:13:04Z [example.scaleup_group]: CREATE_COMPLETE  state changed
   2017-03-06 11:13:04Z [example.scaledown_policy]: CREATE_IN_PROGRESS  state changed
   2017-03-06 11:13:05Z [example.scaleup_policy]: CREATE_IN_PROGRESS  state changed
   2017-03-06 11:13:05Z [example.scaledown_policy]: CREATE_COMPLETE  state changed
   2017-03-06 11:13:05Z [example.scaleup_policy]: CREATE_COMPLETE  state changed
   2017-03-06 11:13:05Z [example.cpu_alarm_low]: CREATE_IN_PROGRESS  state changed
   2017-03-06 11:13:05Z [example.cpu_alarm_high]: CREATE_IN_PROGRESS  state changed
   2017-03-06 11:13:06Z [example.cpu_alarm_low]: CREATE_COMPLETE  state changed
   2017-03-06 11:13:07Z [example.cpu_alarm_high]: CREATE_COMPLETE  state changed
   2017-03-06 11:13:07Z [example]: CREATE_COMPLETE  Stack CREATE completed successfully
   2017-03-06 11:19:34Z [example.scaleup_policy]: SIGNAL_COMPLETE  alarm state changed from alarm to alarm (Remaining as alarm due to 1 samples outside threshold, most recent: 95.4080102993)
   2017-03-06 11:25:43Z [example.scaleup_policy]: SIGNAL_COMPLETE  alarm state changed from alarm to alarm (Remaining as alarm due to 1 samples outside threshold, most recent: 95.8869217299)
   2017-03-06 11:33:25Z [example.scaledown_policy]: SIGNAL_COMPLETE  alarm state changed from ok to alarm (Transition to alarm due to 1 samples outside threshold, most recent: 2.73931707966)
   2017-03-06 11:39:15Z [example.scaledown_policy]: SIGNAL_COMPLETE  alarm state changed from alarm to alarm (Remaining as alarm due to 1 samples outside threshold, most recent: 2.78110858552)

   Copy to Clipboard Toggle word wrap

3. 读取警报历史记录日志：

   $ openstack alarm-history show 022f707d-46cc-4d39-a0b2-afd2fc7ab86a
   +----------------------------+------------------+-----------------------------------------------------------------------------------------------------+--------------------------------------+
   | timestamp                  | type             | detail                                                                                              | event_id                             |
   +----------------------------+------------------+-----------------------------------------------------------------------------------------------------+--------------------------------------+
   | 2017-03-06T11:32:35.510000 | state transition | {"transition_reason": "Transition to ok due to 1 samples inside threshold, most recent:             | 25e0e70b-3eda-466e-abac-42d9cf67e704 |
   |                            |                  | 2.73931707966", "state": "ok"}                                                                      |                                      |
   | 2017-03-06T11:17:35.403000 | state transition | {"transition_reason": "Transition to alarm due to 1 samples outside threshold, most recent:         | 8322f62c-0d0a-4dc0-9279-435510f81039 |
   |                            |                  | 95.0964497325", "state": "alarm"}                                                                   |                                      |
   | 2017-03-06T11:15:35.723000 | state transition | {"transition_reason": "Transition to ok due to 1 samples inside threshold, most recent:             | 1503bd81-7eba-474e-b74e-ded8a7b630a1 |
   |                            |                  | 3.59330523447", "state": "ok"}                                                                      |                                      |
   | 2017-03-06T11:13:06.413000 | creation         | {"alarm_actions": ["trust+http://fca6e27e3d524ed68abdc0fd576aa848:delete@192.168.122.126:8004/v1/fd | 224f15c0-b6f1-4690-9a22-0c1d236e65f6 |
   |                            |                  | 1c345135be4ee587fef424c241719d/stacks/example/d9ef59ed-b8f8-4e90-bd9b-                              |                                      |
   |                            |                  | ae87e73ef6e2/resources/scaleup_policy/signal"], "user_id": "a85f83b7f7784025b6acdc06ef0a8fd8",      |                                      |
   |                            |                  | "name": "example-cpu_alarm_high-odj77qpbld7j", "state": "insufficient data", "timestamp":           |                                      |
   |                            |                  | "2017-03-06T11:13:06.413455", "description": "Scale up if CPU > 80%", "enabled": true,              |                                      |
   |                            |                  | "state_timestamp": "2017-03-06T11:13:06.413455", "rule": {"evaluation_periods": 1, "metric":        |                                      |
   |                            |                  | "cpu_util", "aggregation_method": "mean", "granularity": 300, "threshold": 80.0, "query": "{\"=\":   |                                      |
   |                            |                  | {\"server_group\": \"d9ef59ed-b8f8-4e90-bd9b-ae87e73ef6e2\"}}", "comparison_operator": "gt",        |                                      |
   |                            |                  | "resource_type": "instance"}, "alarm_id": "022f707d-46cc-4d39-a0b2-afd2fc7ab86a",                   |                                      |
   |                            |                  | "time_constraints": [], "insufficient_data_actions": null, "repeat_actions": true, "ok_actions":    |                                      |
   |                            |                  | null, "project_id": "fd1c345135be4ee587fef424c241719d", "type":                                     |                                      |
   |                            |                  | "gnocchi_aggregation_by_resources_threshold", "severity": "low"}                                    |                                      |
   +----------------------------+------------------+-----------------------------------------------------------------------------------------------------+-------------------------------------

   Copy to Clipboard Toggle word wrap

4. 退出 openstack 客户端 pod:

   $ exit

   Copy to Clipboard Toggle word wrap

5. 要查看编排服务(heat)为现有堆栈收集的 scale-out 或 scale-down 操作的记录，您可以使用 awk 命令解析 heat pod 日志。

   $ oc logs -l component=engine,service=heat --tail=-1 | awk '/Updating stack/,/Stack CREATE completed successfully/ {print $0}'

   Copy to Clipboard Toggle word wrap

6. 要查看关于 Alarming 服务(aodh)的信息，请检查 aodh-evaluator 容器的日志。

   $ oc logs aodh-0 -c aodh-evaluator | grep -i alarm | grep -i transition | grep -v DEBUG

   Copy to Clipboard Toggle word wrap