Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Create standard for mandatory and supported IaaS services #587

Open
wants to merge 27 commits into
base: main
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
27 commits
Select commit Hold shift + click to select a range
5d94f74
Create scs-XXXX-vN-mandatory-and-supported-IaaS-services.md
josephineSei May 7, 2024
7d8a514
Apply suggestions from code review
josephineSei May 17, 2024
bd52305
Update scs-XXXX-vN-mandatory-and-supported-IaaS-services.md
josephineSei May 17, 2024
1c3a6ad
Create test to check for mandatory services
josephineSei May 17, 2024
99a2434
Update mandatory-iaas-services.py
josephineSei May 17, 2024
7ed642f
Apply suggestions from code review
josephineSei May 28, 2024
1abf35b
Update scs-XXXX-vN-mandatory-and-supported-IaaS-services.md
josephineSei Jun 6, 2024
2008cab
Update mandatory-iaas-services.py
josephineSei Jun 6, 2024
d2e0a6f
Update scs-XXXX-vN-mandatory-and-supported-IaaS-services.md
josephineSei Jun 17, 2024
9b97d9a
Apply suggestions from code review
josephineSei Jun 18, 2024
8d5200c
Update scs-XXXX-vN-mandatory-and-supported-IaaS-services.md
josephineSei Jun 19, 2024
3b00013
Apply suggestions from code review
josephineSei Jul 1, 2024
bbbf13f
Re-arranging APIs to alphabetical order
josephineSei Jul 1, 2024
9ca339c
Name a specific standard (role standard) that requires knowledge abou…
josephineSei Aug 15, 2024
d10574c
Merge branch 'main' into mandatory-and-supported-IaaS-services
josephineSei Aug 15, 2024
7858db1
Update scs-XXXX-vN-mandatory-and-supported-IaaS-services.md
josephineSei Aug 30, 2024
a07b718
Update mandatory-iaas-services.py
josephineSei Aug 30, 2024
aebc1c2
Update mandatory-iaas-services.py
josephineSei Sep 24, 2024
12b88a9
Update scs-XXXX-vN-mandatory-and-supported-IaaS-services.md
josephineSei Sep 24, 2024
2795cbb
Update mandatory-iaas-services.py
josephineSei Sep 24, 2024
78d6852
Merge branch 'main' into mandatory-and-supported-IaaS-services
josephineSei Sep 24, 2024
673f0e5
Update mandatory-iaas-services.py
josephineSei Sep 24, 2024
2077e5f
Merge branch 'main' into mandatory-and-supported-IaaS-services
josephineSei Sep 25, 2024
9e4fb38
Update mandatory-iaas-services.py
josephineSei Sep 26, 2024
c1c4009
Update mandatory-iaas-services.py
josephineSei Sep 30, 2024
68e147b
Merge branch 'main' into mandatory-and-supported-IaaS-services
josephineSei Sep 30, 2024
30a5eb0
Create README.md
josephineSei Sep 30, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
82 changes: 82 additions & 0 deletions Standards/scs-XXXX-vN-mandatory-and-supported-IaaS-services.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,82 @@
---
title: Mandatory and Supported IaaS Services
type: Standard
status: Draft
track: IaaS
---

## Introduction

To be SCS-compliant a Cloud Service Provider (CSP) has to fulfill all SCS standards.
Some of those standards are broad and consider all APIs of all services on the IaaS-Layer like the consideration of a [role standard](https://github.com/SovereignCloudStack/issues/issues/396).
There exist many services on that layer and for a first step they need to be limited to have a clear scope for the standards and the Cloud Service Providers following them.
For this purpose, this standard will establish lists for mandatory services whose APIs have to be present in a SCS cloud as well as supported services, which APIs are considered by some standards and may even be tested for their integration but are optional in a sense that their omission will not violate SCS conformance.

## Motivation

There are many OpenStack APIs and their corresponding services that can be deployed on the IaaS level.
These services have differences in the quality of their implementation and liveness and some of them may be easily omitted when creating an IaaS deployment.
To fulfill all SCS-provided standards only a subset of these APIs are required.
Some more but not all remaining OpenStack APIs are also supported additionally by the SCS project and may be part of its reference implementation.
josephineSei marked this conversation as resolved.
Show resolved Hide resolved
This results in different levels of support for specific services.
This document will give readers insight about how the SCS classifies the OpenStack APIs accordingly.
If a cloud provides all mandatory and any number of supported OpenStack APIs, it can be tested for SCS-compliance.
Any unsupported APIs will not be tested.

## Mandatory IaaS APIs

The following IaaS APIs MUST be present in SCS-compliant IaaS deployments and could be implemented with the corresponding OpenStack services:

| Mandatory API | corresponding OpenStack Service | description |
|-----|-----|-----|
| **block-storage** | Cinder | Block Storage service |
| **compute** | Nova | Compute service |
| **identity** | Keystone | Identity service |
| **image** | Glance | Image service |
| **load-balancer** | Octavia | Load-balancer service |
| **network** | Neutron | Networking service |
| **s3** | S3 API object storage | Object Storage service |

:::caution

S3 API implementations may differ in certain offered features.
CSPs must publicly describe, which implementation they use in their deployment.
artificial-intelligence marked this conversation as resolved.
Show resolved Hide resolved
Users should always research whether a needed feature is supported in the offered implementation.

:::

The endpoints of services MUST be findable through the `catalog list` of the identity API[^1].

[^1]: [Integrate into the service catalog of Keystone](https://docs.openstack.org/keystone/latest/contributor/service-catalog.html)

## Supported IaaS APIs

The following IaaS APIs MAY be present in SCS-compliant IaaS deployment, e.g. implemented thorugh the corresponding OpenStack services, and are considered in the SCS standards.
josephineSei marked this conversation as resolved.
Show resolved Hide resolved

| Supported API | corresponding OpenStack Service | description |
|-----|-----|-----|
| **bare-metal** | Ironic | Bare Metal provisioning service |
| **billing** | Cloudkitty | Rating/Billing service |
| **dns** | Designate | DNS service |
| **ha** | Masakari | Instances High Availability service |
| **key-manager** | Barbican | Key Manager service |
| **object-store** | Swift | Object Store with different possible backends |
| **orchestration** | Heat | Orchestration service |
| **shared-file-systems** | Manila | Shared File Systems service |
| **telemetry** | Ceilometer | Telemetry service |
| **time-series-databse** | Gnocchi | Time Series Database service |

## Unsupported IaaS APIs

All other OpenStack services, whose APIs are not mentioned in the mandatory or supported lists will not be tested for their compatibility and conformance in SCS clouds by the SCS community.
Those services MAY be integrated into IaaS deployments by a Cloud Service Provider on their own responsibility but the SCS will not assume they are present and potential issues that occur during deployment or usage have to be handled by the CSP on their own accord.
The SCS standard offers no guarantees for compatibility or reliability of services categorized as unsupported.

## Related Documents

[The OpenStack Services](https://www.openstack.org/software/)

## Conformance Tests

The presence of the mandatory OpenStack APIs will be tested in [this test-script](https://github.com/SovereignCloudStack/standards/blob/mandatory-and-supported-IaaS-services/Tests/iaas/mandatory-services/mandatory-iaas-services.py).
The test will further check, whether the object store endpoint is compatible to s3.
66 changes: 66 additions & 0 deletions Tests/iaas/mandatory-services/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,66 @@
# Mandatory IaaS Service APIs Test Suite

## Test Environment Setup

### Test Execution Environment

> **NOTE:** The test execution procedure does not require cloud admin rights.

To execute the test suite a valid cloud configuration for the OpenStack SDK in the shape of "`clouds.yaml`" is mandatory[^1].
**The file is expected to be located in the current working directory where the test script is executed unless configured otherwise.**

[^1]: [OpenStack Documentation: Configuring OpenStack SDK Applications](https://docs.openstack.org/openstacksdk/latest/user/config/configuration.html)

The test execution environment can be located on any system outside of the cloud infrastructure that has OpenStack API access.
Make sure that the API access is configured properly in "`clouds.yaml`".

It is recommended to use a Python virtual environment[^2].
Next, install the OpenStack SDK and boto3 required by the test suite:

```bash
pip3 install openstacksdk
pip3 install boto3
```

Within this environment execute the test suite.

[^2]: [Python 3 Documentation: Virtual Environments and Packages](https://docs.python.org/3/tutorial/venv.html)

## Test Execution

The test suite is executed as follows:

```bash
python3 mandatory-iaas-services.py --os-cloud mycloud
```

As an alternative to "`--os-cloud`", the "`OS_CLOUD`" environment variable may be specified instead.
The parameter is used to look up the correct cloud configuration in "`clouds.yaml`".
For the example command above, this file should contain a `clouds.mycloud` section like this:

```yaml
---
clouds:
mycloud:
auth:
auth_url: ...
...
...
```

If the deployment uses s3 only and does not have the object store endpoint specified in the service catalog, the "`--s3-endpoint`" flag may be used to specify the s3 endpoint.
In that case the "`--s3-access`" and "`--s3-access-secret`" flags must also be set, to give all necessery credentials to the test suite:

```bash
python3 mandatory-iaas-services3.py --os-cloud mycloud2 --s3-endpoint "http://s3-endpoint:9000" --s3-access test-user --s3-access-secret test-user-secret
```

For any further options consult the output of "`python3 volume-backup-tester.py --help`".

### Script Behavior & Test Results

If all tests pass, the script will return with an exit code of `0`.

If any test fails, the script will halt, print the exact error to `stderr` and return with a non-zero exit code.

There is no cleanup done by this test as it mainly only inspect the service catalog and only for the object store creates a bucket, which is then promptly deleted.
Loading