2.11. OpenStack Integration Test Suite Service
This section outlines the top new features for the OpenStack Integration Test Suite (tempest) service.
- Overall Tempest Cleanup
- This update includes an overall
tempest
cleanup including remote client debuggability, documentation review, client and manager aliases, and refactored test base class setup and teardown steps. - Refactored Tempest CLI
- This update adds a domain-specific
tempest run
command that can be used as the primary entry point for runningtempest
tests. - Updates to Negative Test Guidelines
- While the existing negative tests remain, this update adds support to the negative tests at the component level.
- Migrated Python Repository
- With this update, the
tempest-lib
Python repository is now migrated to thetempest/lib
directory in thetempest
repository. - Client Manager Refactor
- Previously, the client managers instantiated all available clients at
_init_
time regardless of the `tempest` configuration about the available services, extensions and API versions and exposed the clients using the class attributes. With this release, clients are only instantiated on demand, and the manager internally caches instances of clients and serves them from the cache where applicable. - Test Resource Management
- With this release, all test resources are managed in a dedicated YAML file, which allows for the
tempest
configuration to happen with the same amount of configuration a deployer system uses to configure the OpenStack services. This also ensures that the test can select resources to be used by the logical name or properties (for example, use whatever image that would fit in the 'smallest' flavor), or run against all combinations of certain resources. - Microversion Tests
- This release adds some Compute Microversion tests to the Microversion testing framework.