Add test commands and expected results #50
@ -21,6 +21,8 @@ See official documentation on:
|
||||
|
||||
See [this example repo](https://github.com/os-autoinst/os-autoinst-distri-example) on how tests should be structured.
|
||||
|
||||
See the [results readme](RESULTS.md) for the expected test commands and results for Rocky
|
||||
|
||||
### FIF template format
|
||||
|
||||
The test templates in this repository (files ending in `fif.json`) are not in the same format as expected by and are not directly compatible with the upstream template loader. They are in a format referred to as 'FIF' ('Fedora Intermediate Format') which is parsed into the upstream format by the `fifloader.py` utility found in this repository. This format is intended to be more convenient for human reading and editing. It is more fully explained in the docstring at the top of `fifloader.py`. Please refer to this when adding new tests to the templates. A command like `./fifloader.py --load templates.fif.json templates-updates.fif.json` can be used to load templates in the FIF format (this converts them to the upstream format, and calls the upstream template loader on the converted data). See `./fifloader.py -h` for further details on `fifloader.py`.
|
||||
|
||||
62
RESULTS.md
Normal file
@ -0,0 +1,62 @@
|
||||
|
|
||||
Product Test result Summary
|
||||
Note - This is currently not real data, I need to update it when my machine finishes running tests. Note - This is currently not real data, I need to update it when my machine finishes running tests.
Updated this to reflect real test data Updated this to reflect real test data
|
||||
---
|
||||
|
Note - This is currently not real data, I need to update it when my machine finishes running tests. Note - This is currently not real data, I need to update it when my machine finishes running tests.
Updated this to reflect real test data Updated this to reflect real test data
|
||||
|
||||
|
Note - This is currently not real data, I need to update it when my machine finishes running tests. Note - This is currently not real data, I need to update it when my machine finishes running tests.
Updated this to reflect real test data Updated this to reflect real test data
|
||||
Product test results from be2fc0baeda69cad7480e29aa6714b2e5d916c8e tested on 2021-09-30
|
||||
|
Note - This is currently not real data, I need to update it when my machine finishes running tests. Note - This is currently not real data, I need to update it when my machine finishes running tests.
Updated this to reflect real test data Updated this to reflect real test data
|
||||
|
||||
|
Note - This is currently not real data, I need to update it when my machine finishes running tests. Note - This is currently not real data, I need to update it when my machine finishes running tests.
Updated this to reflect real test data Updated this to reflect real test data
|
||||
| Product | Passing | Failing | Skipped | Unfinished | Total |
|
||||
|
Note - This is currently not real data, I need to update it when my machine finishes running tests. Note - This is currently not real data, I need to update it when my machine finishes running tests.
Updated this to reflect real test data Updated this to reflect real test data
|
||||
|-----------------------------------|---------|---------|---------|------------|-------|
|
||||
|
Note - This is currently not real data, I need to update it when my machine finishes running tests. Note - This is currently not real data, I need to update it when my machine finishes running tests.
Updated this to reflect real test data Updated this to reflect real test data
|
||||
| rocky-boot-iso-x86_64-* | 0 | 2 | 0 | 0 | 2 |
|
||||
|
Note - This is currently not real data, I need to update it when my machine finishes running tests. Note - This is currently not real data, I need to update it when my machine finishes running tests.
Updated this to reflect real test data Updated this to reflect real test data
|
||||
| rocky-minimal-iso-x86_64-* | 2 | 0 | 0 | 0 | 2 |
|
||||
|
Note - This is currently not real data, I need to update it when my machine finishes running tests. Note - This is currently not real data, I need to update it when my machine finishes running tests.
Updated this to reflect real test data Updated this to reflect real test data
|
||||
| rocky-dvd-iso-x86_64-* | 5 | 8 | 14 | 0 | 27 |
|
||||
|
Note - This is currently not real data, I need to update it when my machine finishes running tests. Note - This is currently not real data, I need to update it when my machine finishes running tests.
Updated this to reflect real test data Updated this to reflect real test data
|
||||
| rocky-universal-x86_64-* | 23 | 22 | 0 | 2* | 47 |
|
||||
|
Note - This is currently not real data, I need to update it when my machine finishes running tests. Note - This is currently not real data, I need to update it when my machine finishes running tests.
Updated this to reflect real test data Updated this to reflect real test data
|
||||
|
||||
|
Note - This is currently not real data, I need to update it when my machine finishes running tests. Note - This is currently not real data, I need to update it when my machine finishes running tests.
Updated this to reflect real test data Updated this to reflect real test data
|
||||
\* install_pxeboot and install_pxeboot@uefi can't run due to misssing `support_server@64bit`
|
||||
|
Note - This is currently not real data, I need to update it when my machine finishes running tests. Note - This is currently not real data, I need to update it when my machine finishes running tests.
Updated this to reflect real test data Updated this to reflect real test data
|
||||
|
||||
|
Note - This is currently not real data, I need to update it when my machine finishes running tests. Note - This is currently not real data, I need to update it when my machine finishes running tests.
Updated this to reflect real test data Updated this to reflect real test data
|
||||
Product test commands
|
||||
|
Are there any other configurations that should be here, such as Are there any other configurations that should be here, such as `PACKAGE_SET=server` as mentioned in
[OpenQA-Fedora-Installation notes](https://github.com/rocky-linux/OpenQA-Fedora-Installation/blob/develop/NOTES.md)?
Note - This is currently not real data, I need to update it when my machine finishes running tests. Note - This is currently not real data, I need to update it when my machine finishes running tests.
Updated this to reflect real test data Updated this to reflect real test data
To make dvd-iso fully working you actually need a To make dvd-iso fully working you actually need a `PACKAGE_SET`, either `minimal`, `server` or `virtualization-host` is available right now 👍🏻
|
||||
---
|
||||
|
Note - This is currently not real data, I need to update it when my machine finishes running tests. Note - This is currently not real data, I need to update it when my machine finishes running tests.
Updated this to reflect real test data Updated this to reflect real test data
|
||||
|
||||
|
Note - This is currently not real data, I need to update it when my machine finishes running tests. Note - This is currently not real data, I need to update it when my machine finishes running tests.
Updated this to reflect real test data Updated this to reflect real test data
|
||||
rocky-boot-iso-x86_64-*
|
||||
|
Note - This is currently not real data, I need to update it when my machine finishes running tests. Note - This is currently not real data, I need to update it when my machine finishes running tests.
Updated this to reflect real test data Updated this to reflect real test data
|
||||
```
|
||||
|
Note - This is currently not real data, I need to update it when my machine finishes running tests. Note - This is currently not real data, I need to update it when my machine finishes running tests.
Updated this to reflect real test data Updated this to reflect real test data
|
||||
sudo openqa-cli api -X POST isos \
|
||||
|
Note - This is currently not real data, I need to update it when my machine finishes running tests. Note - This is currently not real data, I need to update it when my machine finishes running tests.
Updated this to reflect real test data Updated this to reflect real test data
|
||||
ISO=Rocky-8.4-x86_64-boot.iso \
|
||||
|
Note - This is currently not real data, I need to update it when my machine finishes running tests. Note - This is currently not real data, I need to update it when my machine finishes running tests.
Updated this to reflect real test data Updated this to reflect real test data
|
||||
DISTRI=rocky \
|
||||
|
Note - This is currently not real data, I need to update it when my machine finishes running tests. Note - This is currently not real data, I need to update it when my machine finishes running tests.
Updated this to reflect real test data Updated this to reflect real test data
|
||||
VERSION=8.4 \
|
||||
|
Note - This is currently not real data, I need to update it when my machine finishes running tests. Note - This is currently not real data, I need to update it when my machine finishes running tests.
Updated this to reflect real test data Updated this to reflect real test data
|
||||
FLAVOR=boot-iso \
|
||||
|
Note - This is currently not real data, I need to update it when my machine finishes running tests. Note - This is currently not real data, I need to update it when my machine finishes running tests.
Updated this to reflect real test data Updated this to reflect real test data
|
||||
ARCH=x86_64 \
|
||||
|
Note - This is currently not real data, I need to update it when my machine finishes running tests. Note - This is currently not real data, I need to update it when my machine finishes running tests.
Updated this to reflect real test data Updated this to reflect real test data
|
||||
BUILD="-boot-iso-$(date +%Y%m%d.%H%M%S).0"
|
||||
|
Note - This is currently not real data, I need to update it when my machine finishes running tests. Note - This is currently not real data, I need to update it when my machine finishes running tests.
Updated this to reflect real test data Updated this to reflect real test data
|
||||
```
|
||||
|
Note - This is currently not real data, I need to update it when my machine finishes running tests. Note - This is currently not real data, I need to update it when my machine finishes running tests.
Updated this to reflect real test data Updated this to reflect real test data
|
||||
|
||||
|
Note - This is currently not real data, I need to update it when my machine finishes running tests. Note - This is currently not real data, I need to update it when my machine finishes running tests.
Updated this to reflect real test data Updated this to reflect real test data
|
||||
rocky-minimal-iso-x86_64-*
|
||||
|
Note - This is currently not real data, I need to update it when my machine finishes running tests. Note - This is currently not real data, I need to update it when my machine finishes running tests.
Updated this to reflect real test data Updated this to reflect real test data
|
||||
```
|
||||
|
Note - This is currently not real data, I need to update it when my machine finishes running tests. Note - This is currently not real data, I need to update it when my machine finishes running tests.
Updated this to reflect real test data Updated this to reflect real test data
|
||||
sudo openqa-cli api -X POST isos \
|
||||
|
Note - This is currently not real data, I need to update it when my machine finishes running tests. Note - This is currently not real data, I need to update it when my machine finishes running tests.
Updated this to reflect real test data Updated this to reflect real test data
|
||||
ISO=Rocky-8.4-x86_64-minimal.iso \
|
||||
|
Note - This is currently not real data, I need to update it when my machine finishes running tests. Note - This is currently not real data, I need to update it when my machine finishes running tests.
Updated this to reflect real test data Updated this to reflect real test data
|
||||
DISTRI=rocky \
|
||||
|
Note - This is currently not real data, I need to update it when my machine finishes running tests. Note - This is currently not real data, I need to update it when my machine finishes running tests.
Updated this to reflect real test data Updated this to reflect real test data
|
||||
VERSION=8.4 \
|
||||
|
Note - This is currently not real data, I need to update it when my machine finishes running tests. Note - This is currently not real data, I need to update it when my machine finishes running tests.
Updated this to reflect real test data Updated this to reflect real test data
|
||||
FLAVOR=minimal-iso \
|
||||
|
Note - This is currently not real data, I need to update it when my machine finishes running tests. Note - This is currently not real data, I need to update it when my machine finishes running tests.
Updated this to reflect real test data Updated this to reflect real test data
|
||||
ARCH=x86_64 \
|
||||
|
Note - This is currently not real data, I need to update it when my machine finishes running tests. Note - This is currently not real data, I need to update it when my machine finishes running tests.
Updated this to reflect real test data Updated this to reflect real test data
|
||||
BUILD="-minimal-iso-$(date +%Y%m%d.%H%M%S).0"
|
||||
|
Note - This is currently not real data, I need to update it when my machine finishes running tests. Note - This is currently not real data, I need to update it when my machine finishes running tests.
Updated this to reflect real test data Updated this to reflect real test data
|
||||
```
|
||||
|
Note - This is currently not real data, I need to update it when my machine finishes running tests. Note - This is currently not real data, I need to update it when my machine finishes running tests.
Updated this to reflect real test data Updated this to reflect real test data
|
||||
|
||||
|
Note - This is currently not real data, I need to update it when my machine finishes running tests. Note - This is currently not real data, I need to update it when my machine finishes running tests.
Updated this to reflect real test data Updated this to reflect real test data
|
||||
rocky-dvd-iso-x86_64-*
|
||||
|
Note - This is currently not real data, I need to update it when my machine finishes running tests. Note - This is currently not real data, I need to update it when my machine finishes running tests.
Updated this to reflect real test data Updated this to reflect real test data
|
||||
```
|
||||
|
Note - This is currently not real data, I need to update it when my machine finishes running tests. Note - This is currently not real data, I need to update it when my machine finishes running tests.
Updated this to reflect real test data Updated this to reflect real test data
|
||||
sudo openqa-cli api -X POST isos \
|
||||
|
Note - This is currently not real data, I need to update it when my machine finishes running tests. Note - This is currently not real data, I need to update it when my machine finishes running tests.
Updated this to reflect real test data Updated this to reflect real test data
|
||||
ISO=Rocky-8.4-x86_64-dvd1.iso \
|
||||
|
Note - This is currently not real data, I need to update it when my machine finishes running tests. Note - This is currently not real data, I need to update it when my machine finishes running tests.
Updated this to reflect real test data Updated this to reflect real test data
|
||||
DISTRI=rocky \
|
||||
|
Note - This is currently not real data, I need to update it when my machine finishes running tests. Note - This is currently not real data, I need to update it when my machine finishes running tests.
Updated this to reflect real test data Updated this to reflect real test data
|
||||
VERSION=8.4 \
|
||||
|
Note - This is currently not real data, I need to update it when my machine finishes running tests. Note - This is currently not real data, I need to update it when my machine finishes running tests.
Updated this to reflect real test data Updated this to reflect real test data
|
||||
FLAVOR=dvd-iso \
|
||||
|
Note - This is currently not real data, I need to update it when my machine finishes running tests. Note - This is currently not real data, I need to update it when my machine finishes running tests.
Updated this to reflect real test data Updated this to reflect real test data
|
||||
ARCH=x86_64 \
|
||||
|
Note - This is currently not real data, I need to update it when my machine finishes running tests. Note - This is currently not real data, I need to update it when my machine finishes running tests.
Updated this to reflect real test data Updated this to reflect real test data
|
||||
BUILD="-dvd-iso-$(date +%Y%m%d.%H%M%S).0"
|
||||
|
Note - This is currently not real data, I need to update it when my machine finishes running tests. Note - This is currently not real data, I need to update it when my machine finishes running tests.
Updated this to reflect real test data Updated this to reflect real test data
|
||||
```
|
||||
|
Note - This is currently not real data, I need to update it when my machine finishes running tests. Note - This is currently not real data, I need to update it when my machine finishes running tests.
Updated this to reflect real test data Updated this to reflect real test data
|
||||
|
||||
|
Note - This is currently not real data, I need to update it when my machine finishes running tests. Note - This is currently not real data, I need to update it when my machine finishes running tests.
Updated this to reflect real test data Updated this to reflect real test data
|
||||
rocky-universal-x86_64-*
|
||||
|
Note - This is currently not real data, I need to update it when my machine finishes running tests. Note - This is currently not real data, I need to update it when my machine finishes running tests.
Updated this to reflect real test data Updated this to reflect real test data
|
||||
```
|
||||
|
Note - This is currently not real data, I need to update it when my machine finishes running tests. Note - This is currently not real data, I need to update it when my machine finishes running tests.
Updated this to reflect real test data Updated this to reflect real test data
|
||||
sudo openqa-cli api -X POST isos \
|
||||
|
Note - This is currently not real data, I need to update it when my machine finishes running tests. Note - This is currently not real data, I need to update it when my machine finishes running tests.
Updated this to reflect real test data Updated this to reflect real test data
|
||||
ISO=Rocky-8.4-x86_64-dvd1.iso \
|
||||
|
Note - This is currently not real data, I need to update it when my machine finishes running tests. Note - This is currently not real data, I need to update it when my machine finishes running tests.
Updated this to reflect real test data Updated this to reflect real test data
|
||||
DISTRI=rocky \
|
||||
|
Note - This is currently not real data, I need to update it when my machine finishes running tests. Note - This is currently not real data, I need to update it when my machine finishes running tests.
Updated this to reflect real test data Updated this to reflect real test data
|
||||
VERSION=8.4 \
|
||||
|
Note - This is currently not real data, I need to update it when my machine finishes running tests. Note - This is currently not real data, I need to update it when my machine finishes running tests.
Updated this to reflect real test data Updated this to reflect real test data
|
||||
FLAVOR=universal \
|
||||
|
Note - This is currently not real data, I need to update it when my machine finishes running tests. Note - This is currently not real data, I need to update it when my machine finishes running tests.
Updated this to reflect real test data Updated this to reflect real test data
|
||||
ARCH=x86_64 \
|
||||
|
Note - This is currently not real data, I need to update it when my machine finishes running tests. Note - This is currently not real data, I need to update it when my machine finishes running tests.
Updated this to reflect real test data Updated this to reflect real test data
|
||||
BUILD="-universal-$(date +%Y%m%d.%H%M%S).0"
|
||||
|
Note - This is currently not real data, I need to update it when my machine finishes running tests. Note - This is currently not real data, I need to update it when my machine finishes running tests.
Updated this to reflect real test data Updated this to reflect real test data
|
||||
```
|
||||
|
Note - This is currently not real data, I need to update it when my machine finishes running tests. Note - This is currently not real data, I need to update it when my machine finishes running tests.
Updated this to reflect real test data Updated this to reflect real test data
|
||||
|
||||
|
Note - This is currently not real data, I need to update it when my machine finishes running tests. Note - This is currently not real data, I need to update it when my machine finishes running tests.
Updated this to reflect real test data Updated this to reflect real test data
|
||||
|
||||
|
Note - This is currently not real data, I need to update it when my machine finishes running tests. Note - This is currently not real data, I need to update it when my machine finishes running tests.
Updated this to reflect real test data Updated this to reflect real test data
|
||||
Note - This is currently not real data, I need to update it when my machine finishes running tests.
Note - This is currently not real data, I need to update it when my machine finishes running tests.
Updated this to reflect real test data
Updated this to reflect real test data