Commit Graph

2048 Commits

Author SHA1 Message Date
lumarel
74142ebffd
Switch anaconda needles to once from the actual RC 2022-06-17 15:44:17 +02:00
akatch
e208d3eabd
Merge pull request #107 from lumarel/fix/9.0-anaconda-part-2
[9.0 Release Issues] Test Suite: Missing Anaconda needles - the 2nd
2022-06-12 16:47:29 -05:00
Lukas Magauer
3a7749d5c7
Merge pull request #106 from akatch/topbar_generic
fix: update topbar_generic needle
2022-06-12 23:40:43 +02:00
lumarel
d9c50efa68
Kdump needles 2022-06-12 21:41:25 +02:00
lumarel
7fccab847c
Package selection needles 2022-06-12 21:41:18 +02:00
Al Bowles
4d39b4b3df
fix: update topbar_generic needle 2022-06-12 14:01:06 -05:00
akatch
6c7a9be3cc
Merge pull request #104 from lumarel/fix/9.0-anaconda
[9.0 Release Issues] Test Suite: Missing Anaconda needles
2022-06-12 10:46:50 -05:00
lumarel
d70b4263fa
Install lang needle 2022-06-12 14:32:36 +02:00
lumarel
0156f4def8
Anaconda needles 2022-06-12 14:32:21 +02:00
lumarel
0be3b5d32f
Bootloader look and feel changes 2022-06-12 14:31:46 +02:00
akatch
2c427618ac
8.6 release fixes (#92)
* Handle the "reclaim space" dialog

Adds handling for the "Reclaim Space" dialog, which can appear after the
user clicks "Done" in the partitioning spoke.

* Fix indentations

* Set default HDD size to 15GB

* Remove redundant HDDSIZEGB definitions

* Add more GiBs

* Workaround for #82

* Needle with new security policy spoke icon

* Add new needles to fix cockpit tests in 8.6

* Add contribution SOP to README

* Words

* Script fixes (#99)

* Increment version

* Fix this header

* Fix URL for updates.img (#98)

* ---
title: [8.6 Release Issues] Test Suite: install_delete_partial and install_custom_gui_lvm_ext4 on rocky 8.6
labels: 'test suite'
assignees: '@akatch'

---

# Description

Running openQA test suite `install_delete_partial` as above throws `Test died: no candidate needle with tag(s) 'anaconda_install_destination_reclaim_space_btn' matched` at module `disk_guided_delete_partial`.

At this stage, the "Reclaim Space" button in the lower right corner of the dialog is disabled.

Additionally, the dialog shows that 5GB will be reclaimed by the steps taken to that point in the test, but installation requires around 9GB. Do we need to reclaim enough space for installation in order to enable that button?
_Yes, the button is enabled when enough space to install is reclaimed._

Just adding HDDSIZEGB=20 to `templates.fif.json` did not increase volume size shown in the dialog. Do we need to recreate the img file?
_Yes, recreating the img file using createhdds.py against a larger size in hdds.json resolved this error._

The Reclaim Space dialog claimed 9.06GB was required to perform installation, and after doubling the size of disk_full_XXX.img we got past the Reclaim Space dialog. However, `_do_install_and_reboot` failed to install citing not enough disk space.

Fixes #80 when merged.

# How Has This Been Tested?

```
# NOTE: was not able to reproduce for install_custom_gui_lvm_ext4
openqa-cli api -X POST isos ISO=Rocky-8.6-x86_64-dvd1.iso ARCH=x86_64 DISTRI=rocky FLAVOR=dvd-iso VERSION=8.6 BUILD=8.6_dvd-iso_$(date +%Y%m%d.%H%M%S).0 TEST=install_custom_gui_lvm_ext4 PACKAGE_SET=graphical-server

openqa-cli api -X POST isos ISO=Rocky-8.6-x86_64-dvd1.iso ARCH=x86_64 DISTRI=rocky FLAVOR=universal VERSION=8.6 BUILD=8.6_universal_$(date +%Y%m%d.%H%M%S).0 TEST=install_delete_partial PACKAGE_SET=graphical-server
```

All tests must pass `_do_install_and_reboot`.
NOTE: These tests will fail at `_console_wait_login` with the issue in #81.

# Checklist:

- [x] My code follows the style guidelines of this project
- [x] I have performed a self-review of my own code
- [x] I have commented my code, particularly in hard-to-understand areas
- [x] I have made corresponding changes to the documentation
- [ ] My changes generate no new warnings
- [ ] Any dependent changes have been merged and published in downstream modules

* Add new needle to mitigate the changed default
for install source on the network from http to https

Co-authored-by: lumarel <lumarel@users.noreply.github.com>
2022-06-09 18:15:17 -05:00
1443e22345
Feat run openqa tests (#100)
* support default override with ENV var on command line

* output PS4 as # character instead of +

* support additional options for POST via commandline ENV var
2022-05-19 19:37:35 -07:00
akatch
ff8ce569c7
Test Suite: install_default on rocky-8.5-[minimal|boot|dvd]-iso-x86_64 (#77)
Merging per testing team conversation meeting.

* Correctly check for default packagesets for each flavor

* FIF updates for default packagesets

- Set DESKTOP=gnome to trigger graphical_wait_login instead of
  console_wait_login
- Increase virtual disk size to account for default packagesets

* Correctly check for minimal-iso default packageset

* Updated needles for issue 16

* Update templates.fif.json with package set test suites

Package sets tested per ISO will follow these conventions:
- Test suites will not be duplicated between the boot and dvd ISOs
- All default package sets will be tested against dvd-iso
- Boot ISO will be considered valid if `minimal` package set installs
  cleanly

* Do not add updated needle with changed hostname
2022-03-31 18:23:01 -05:00
049f5f4ba2
Add needles and code to complete anaconda_help test suite (#76)
* remove conflicting/incorrect needles

* mods for ananonda_help test suite
- support Rocky help content in anaconda.pm

* workaround software_selection failure

* add needles for anaconda_help
2022-02-03 18:25:03 -06:00
316e7d2c7a
add needles to complete tests requiring HDD_1 inputs (#75) 2022-02-01 07:58:57 -08:00
ad00919d13
extend timeouts for Rocky (#71) 2021-12-16 16:57:51 -06:00
afc67da20d
correct needle to properly detect network connected (#69)
Per Testing Meeting today. Merging.
2021-12-09 18:11:18 -06:00
33dd37fdea
connect network during boot (#66)
- updated configuration for boot-iso in templates.fif.json. NOTE: If you 
provide GRUB="value" during POST you must include "ip=dhcp" along with 
your custom GRUB settings.
- short circuit _anaconda_network_enable.pm to check for connection at 
start of test.
- provide needle to detect connected network interface using Network 
Spoke icon instead of Installation Source text.

NOTE: While not required with minimal-iso or dvd-iso flavors specifying 
GRUB="ip=dhcp" will also connect the network interface at boot and 
bypass _anaconda_network_enable.
2021-12-02 18:18:43 -06:00
akatch
dd209f70e3
Add wrapper script (#63)
* Add wrapper script

* Default build name uses ROCKY_VERSION

* Wrapper script to print simple build report in Markdown format

* Some openqa-cli example commands

* Include BUILD_NAME in report header

* Additional columns

* Extra hyphen

* Added @tcooper's suggestion
2021-11-20 10:29:01 -08:00
Lukas Magauer
539555deef
Changes to support 8.5 (#64)
* Change identification to major releases
because the that should never change on minors

* Text got changed from connectée to connecté

* Japanse character got changed

* Filter box got realligned and looks to also have changed the font

Co-authored-by: lumarel <lumarel@users.noreply.github.com>
2021-11-15 23:00:48 -08:00
Lukas Magauer
44e8a76c56
Fixes multiple tests in regard of the PACKAGE_SETs graphical-server and workstation (#61)
tcooper confirmed on the call. Merging it.

* Extend product test commands

* Increase disk size for `install_standard_partition_ext4` because some PACKAGE_SETs are too big

* Limit the license acceptance to only run on tests which run for ISO installations
It is unfortunately not that easy to limit this to ISOs due to that the misterous
limit to HDD_1 and not `custom_resize_lvm`

* Make sure that the disk post installs run in a shell
it happens that the previous test ends in the GUI

Co-authored-by: lumarel <lumarel@users.noreply.github.com>
2021-11-11 19:39:34 -06:00
30d7affe38
Fixes needle with invalid JSON and adds pre-commit configuration (#59)
* add pre-commit configuration

* repair broken needle
2021-11-10 18:47:42 -06:00
75904407ad
Fixes install_anaconda_text@64bit on rocky-8.4-universal-x86_64 (#56)
* remove Fedora needles we are replacing

* do not expect VNC vs Text Mode menu during text install

* Rocky has kdump which changes text mode main hub install menu

* enable network and redo software selection

* do not disable password for user

* extend timeout for install

* add needles for install_anaconda_text

* fix console_password_required needles
2021-11-10 18:47:10 -06:00
akatch
b5a08825e4
Replace blivet tests with custom GUI tests (#51)
* Our default partitioning scheme includes swap, so omit these tests

* Remove redundant test suites

The suites removed from this commit are functionally identical to the
test suites with the same name but omitting the word "blivet".

* Add needles for custom partitioning GUI

* Replace install_blivet_lvm_ext4 with install_custom_gui_lvm_ext4

- Add subroutine for adding a partition using the "Custom" GUI
- Replace references to blivet with custom_gui in FIF template
- Define test suite for the "Custom" GUI

* syntax fix

* Needle fixes per feedback from lumarel

* Needle reorg

* Replace mouse actions with keypresses

* A few comments

* Replace blivet_standard_partition suites with custom_gui_standard_partition suites

* Rewrite XFS partitioning suite for custom-gui

* Fix filesystem for swap

* Add test suite and needles for RAID using the custom-gui partitioner

* Make raidlevel parameter less confusing

* Fix needles
2021-10-26 08:56:01 -07:00
Lukas Magauer
6e30b07e1c
Add new Cockpit needle as Firefox design changed (#55)
Co-authored-by: lumarel <lumarel@users.noreply.github.com>
2021-10-22 12:39:06 -07:00
Lukas Magauer
68818270db
Fix mirrorlist not getting recognized with double apply (#53)
Co-authored-by: lumarel <lumarel@users.noreply.github.com>
2021-10-21 16:46:48 -07:00
Russ Butler
a5a3998ee9
Add test commands and expected results (#50)
Add a table with the test result from each product. Also add the
commands used to test each product.
2021-10-07 16:27:40 -05:00
Russ Butler
b86506d766
Add aarch64 to templates (#41)
* Add aarch64 to templates

* Fix _do_install_and_reboot on aarch64

On aarch64 the _do_install_and_reboot test runs the "consoletty0"
action, which has a command with the string "fedora". This causes the
command to fail with "No such file or directory". This patch changes
"fedora" to "rocky" to which allows _do_install_and_reboot to pass.
2021-10-07 16:26:42 -05:00
be2fc0baed
Needles for _graphical_wait_login allowing English language Gnome environments to Getting Started (#49)
* add needles for _graphical_wait_login
* remove install_package_set_kde
* add new test suites and job group to simplify package_set testing
* modify _software_selection for pre-selected graphical-server case
* restore non-Gnome installs to package-set test suite
2021-09-29 19:18:45 -07:00
ddd5bf5f6a
Fixes for server_cockpit_updates@64bit on rocky-8.4-dvd-iso-x86_64 (#47)
* add needles for Rocky cockpit_updates test suite
* modify server_cockpit_updates test for Rocky
* remove bad needle for cockpit_autoupdates
* add needles for Rocky server_cockpit_updates test suite
2021-09-29 19:16:17 -07:00
be579e5c60
Fixes for modularity_tests on rocky-8.4-dvd-iso-x86_64 (#46)
* package_selection needle updates

* canonicalize needles JSON and fix conflict

* updates for modularity_tests
- currently passes when _console_wait_login follows 
_do_install_and_reboot
- when _graphical_wait_login is fixed for 
PACKAGE_SET={graphical-server|workstation} then 
modularity_module_list.pm must be validated
2021-09-23 18:04:25 -05:00
f142b1e9b7
add addition data collection (#45) 2021-09-09 18:12:46 -05:00
367d263bee
Add default bug report and feature request issue templates (#44)
* Add default bug report and feature request issue templates

Using admin privs and settings->features->issue templates per [Github documentation](https://docs.github.com/en/communities/using-templates-to-encourage-useful-issues-and-pull-requests/configuring-issue-templates-for-your-repository) add default Issue templates to the repository.

* Rename openqa-test-suite-needle-update.md

Rename openqa-test-suite-needle-update.md to openqa_update.md as attempt to restore issue template picker.  This rename both shortens the name of the template and replaces `-` characters with `_`. Likely won't make a difference but it's worth a try.
2021-09-09 18:11:54 -05:00
2e07ec8809
Create config.yml (#42)
Per Github [documentation](https://docs.github.com/articles/configuring-issue-templates-for-your-repository#configuring-the-template-chooser) add `config.yaml` for template chooser.

This is an attempt to resolve the loss of the Issue template chooser.
2021-09-01 17:51:28 -05:00
Lukas Magauer
4f26a2cd84
Fix install multiple languages (#40)
* All generic language updates

* Add japanese needles

* Add arabic needles

* Add french needles

* Add russian needles

* Add right-to-left needles

* More arabic needles

* More french needles

* More japanese needles

* More russian needles

* More generic/english needles

* Add license accept to setup test

Co-authored-by: lumarel <lumarel@users.noreply.github.com>
2021-08-26 14:58:46 -05:00
Lukas Magauer
1188c63aa4
Fix select root needle (#33)
* Fix Select Root needle

* Fix selecting RAID for root needle

Co-authored-by: lumarel <lumarel@users.noreply.github.com>
2021-08-24 16:51:39 -05:00
Trevor Cooper
867c834571
Update issue and add pull request template (#39)
* rename template for clarity

* update template to incorporate suggestion from @akatch

* add pull request template

* request issue creation before pull request

* Update openqa-test-suite-pull-request-template.md

Adding akatch's suggestion.

Co-authored-by: StackKorora <42156355+StackKorora@users.noreply.github.com>
2021-08-24 15:49:03 -05:00
Lukas Magauer
9138a28738
Fix Install Destination needle for already selected case (#28)
* Fix Install Destination needle for already select case

* Fix Encrypt Data needle

* Fix Encryption Passphrase needle

* Correct position of the Save Passphrase needle

Co-authored-by: lumarel <lumarel@users.noreply.github.com>
2021-08-24 09:23:42 -05:00
Lukas Magauer
42aa17310c
Fix Network Install selection Needle (#27)
* Fix Network Install selection Needle

* Fix Network install http needle

* Fix mirrorlist URL

* Fix mirrorlist option selection

Co-authored-by: lumarel <lumarel@users.noreply.github.com>
2021-08-24 08:41:44 -05:00
Lukas Magauer
ee903aa6be
Fix select disk needles (#26)
* Fix Select Disk Needle

* Fix needle for disk 2

Co-authored-by: lumarel <lumarel@users.noreply.github.com>
2021-08-24 08:03:25 -05:00
Lukas Magauer
3e680195f2
Fix Install LVM Thin Needle (#25)
Co-authored-by: lumarel <lumarel@users.noreply.github.com>
2021-08-23 22:58:09 -05:00
Lukas Magauer
a166ecd8ca
Fix cockpit services entry needle (#17)
* fix cockpit services_entry needle
* recreate cockpit services_detail requires needle

Co-authored-by: lumarel <lumarel@users.noreply.github.com>
2021-08-21 22:30:54 -07:00
Trevor Cooper
d201732392
Update issue templates (#24)
Provide sample issue template for test suite issues. Note this was created from the Insights/Community tab of the Github Web UI. May need to moved later to allow more than one template.
2021-08-21 20:42:50 -05:00
Trevor Cooper
7c2421b353
increase partition count and add test for swap (#15) 2021-08-21 20:39:48 -05:00
StackKorora
8d56f19945
Merge pull request #7 from tcooper/templates
Per testing meeting today, merging.
2021-08-19 18:15:44 -05:00
StackKorora
77afba129a
Merge pull request #5 from tcooper/kdump_enable_disable
Per testing meeting today, merging.
2021-08-19 18:13:48 -05:00
StackKorora
8dea5a3eb3
Merge pull request #3 from tcooper/connect_network
Per testing meeting today, merging.
2021-08-19 18:13:32 -05:00
StackKorora
799014418c
Merge pull request #1 from tcooper/develop
Per testing meeting today, merging.
2021-08-19 18:13:15 -05:00
071aeba904 add updates-minimal flavor 2021-08-17 18:26:11 -07:00
c8bcbbc8bf add install_minimal_upload test suite 2021-08-17 18:23:52 -07:00