Add test commands and expected results (#50)

Add a table with the test result from each product. Also add the
commands used to test each product.
This commit is contained in:
Russ Butler 2021-10-07 16:27:40 -05:00 committed by GitHub
parent b86506d766
commit a5a3998ee9
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
2 changed files with 64 additions and 0 deletions

View File

@ -21,6 +21,8 @@ See official documentation on:
See [this example repo](https://github.com/os-autoinst/os-autoinst-distri-example) on how tests should be structured.
See the [results readme](RESULTS.md) for the expected test commands and results for Rocky
### FIF template format
The test templates in this repository (files ending in `fif.json`) are not in the same format as expected by and are not directly compatible with the upstream template loader. They are in a format referred to as 'FIF' ('Fedora Intermediate Format') which is parsed into the upstream format by the `fifloader.py` utility found in this repository. This format is intended to be more convenient for human reading and editing. It is more fully explained in the docstring at the top of `fifloader.py`. Please refer to this when adding new tests to the templates. A command like `./fifloader.py --load templates.fif.json templates-updates.fif.json` can be used to load templates in the FIF format (this converts them to the upstream format, and calls the upstream template loader on the converted data). See `./fifloader.py -h` for further details on `fifloader.py`.

62
RESULTS.md Normal file
View File

@ -0,0 +1,62 @@
Product Test result Summary
---
Product test results from be2fc0baeda69cad7480e29aa6714b2e5d916c8e tested on 2021-09-30
| Product | Passing | Failing | Skipped | Unfinished | Total |
|-----------------------------------|---------|---------|---------|------------|-------|
| rocky-boot-iso-x86_64-* | 0 | 2 | 0 | 0 | 2 |
| rocky-minimal-iso-x86_64-* | 2 | 0 | 0 | 0 | 2 |
| rocky-dvd-iso-x86_64-* | 5 | 8 | 14 | 0 | 27 |
| rocky-universal-x86_64-* | 23 | 22 | 0 | 2* | 47 |
\* install_pxeboot and install_pxeboot@uefi can't run due to misssing `support_server@64bit`
Product test commands
---
rocky-boot-iso-x86_64-*
```
sudo openqa-cli api -X POST isos \
ISO=Rocky-8.4-x86_64-boot.iso \
DISTRI=rocky \
VERSION=8.4 \
FLAVOR=boot-iso \
ARCH=x86_64 \
BUILD="-boot-iso-$(date +%Y%m%d.%H%M%S).0"
```
rocky-minimal-iso-x86_64-*
```
sudo openqa-cli api -X POST isos \
ISO=Rocky-8.4-x86_64-minimal.iso \
DISTRI=rocky \
VERSION=8.4 \
FLAVOR=minimal-iso \
ARCH=x86_64 \
BUILD="-minimal-iso-$(date +%Y%m%d.%H%M%S).0"
```
rocky-dvd-iso-x86_64-*
```
sudo openqa-cli api -X POST isos \
ISO=Rocky-8.4-x86_64-dvd1.iso \
DISTRI=rocky \
VERSION=8.4 \
FLAVOR=dvd-iso \
ARCH=x86_64 \
BUILD="-dvd-iso-$(date +%Y%m%d.%H%M%S).0"
```
rocky-universal-x86_64-*
```
sudo openqa-cli api -X POST isos \
ISO=Rocky-8.4-x86_64-dvd1.iso \
DISTRI=rocky \
VERSION=8.4 \
FLAVOR=universal \
ARCH=x86_64 \
BUILD="-universal-$(date +%Y%m%d.%H%M%S).0"
```