From a5a3998ee9ef82c8e5cbcdd37988c4e4c10afbc3 Mon Sep 17 00:00:00 2001 From: Russ Butler Date: Thu, 7 Oct 2021 16:27:40 -0500 Subject: [PATCH] Add test commands and expected results (#50) Add a table with the test result from each product. Also add the commands used to test each product. --- README.md | 2 ++ RESULTS.md | 62 ++++++++++++++++++++++++++++++++++++++++++++++++++++++ 2 files changed, 64 insertions(+) create mode 100644 RESULTS.md diff --git a/README.md b/README.md index 5e9da14f..ecdbf7eb 100644 --- a/README.md +++ b/README.md @@ -21,6 +21,8 @@ See official documentation on: See [this example repo](https://github.com/os-autoinst/os-autoinst-distri-example) on how tests should be structured. +See the [results readme](RESULTS.md) for the expected test commands and results for Rocky + ### FIF template format The test templates in this repository (files ending in `fif.json`) are not in the same format as expected by and are not directly compatible with the upstream template loader. They are in a format referred to as 'FIF' ('Fedora Intermediate Format') which is parsed into the upstream format by the `fifloader.py` utility found in this repository. This format is intended to be more convenient for human reading and editing. It is more fully explained in the docstring at the top of `fifloader.py`. Please refer to this when adding new tests to the templates. A command like `./fifloader.py --load templates.fif.json templates-updates.fif.json` can be used to load templates in the FIF format (this converts them to the upstream format, and calls the upstream template loader on the converted data). See `./fifloader.py -h` for further details on `fifloader.py`. diff --git a/RESULTS.md b/RESULTS.md new file mode 100644 index 00000000..c9e53ad8 --- /dev/null +++ b/RESULTS.md @@ -0,0 +1,62 @@ +Product Test result Summary +--- + +Product test results from be2fc0baeda69cad7480e29aa6714b2e5d916c8e tested on 2021-09-30 + +| Product | Passing | Failing | Skipped | Unfinished | Total | +|-----------------------------------|---------|---------|---------|------------|-------| +| rocky-boot-iso-x86_64-* | 0 | 2 | 0 | 0 | 2 | +| rocky-minimal-iso-x86_64-* | 2 | 0 | 0 | 0 | 2 | +| rocky-dvd-iso-x86_64-* | 5 | 8 | 14 | 0 | 27 | +| rocky-universal-x86_64-* | 23 | 22 | 0 | 2* | 47 | + +\* install_pxeboot and install_pxeboot@uefi can't run due to misssing `support_server@64bit` + +Product test commands +--- + +rocky-boot-iso-x86_64-* +``` +sudo openqa-cli api -X POST isos \ + ISO=Rocky-8.4-x86_64-boot.iso \ + DISTRI=rocky \ + VERSION=8.4 \ + FLAVOR=boot-iso \ + ARCH=x86_64 \ + BUILD="-boot-iso-$(date +%Y%m%d.%H%M%S).0" +``` + +rocky-minimal-iso-x86_64-* +``` +sudo openqa-cli api -X POST isos \ + ISO=Rocky-8.4-x86_64-minimal.iso \ + DISTRI=rocky \ + VERSION=8.4 \ + FLAVOR=minimal-iso \ + ARCH=x86_64 \ + BUILD="-minimal-iso-$(date +%Y%m%d.%H%M%S).0" +``` + +rocky-dvd-iso-x86_64-* +``` +sudo openqa-cli api -X POST isos \ + ISO=Rocky-8.4-x86_64-dvd1.iso \ + DISTRI=rocky \ + VERSION=8.4 \ + FLAVOR=dvd-iso \ + ARCH=x86_64 \ + BUILD="-dvd-iso-$(date +%Y%m%d.%H%M%S).0" +``` + +rocky-universal-x86_64-* +``` +sudo openqa-cli api -X POST isos \ + ISO=Rocky-8.4-x86_64-dvd1.iso \ + DISTRI=rocky \ + VERSION=8.4 \ + FLAVOR=universal \ + ARCH=x86_64 \ + BUILD="-universal-$(date +%Y%m%d.%H%M%S).0" +``` + +