Commit Graph

926 Commits

Author SHA1 Message Date
Adam Williamson
5905546f6e Update Evince needles
These all failed to match first time the test was run in
production. I guess Lukas was working from an older release.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-29 11:46:32 -07:00
Lukáš Růžička
e0d9409c74 Create a test suite for Evince.
This PR fixes issue . It adds a test suite to test basic
functionality of Evince and brings the following features:

* test scripts for various Evince functions.
* needles to support the Evince test scripts
* new template variables `TESTPATH` and `POSTINSTALL_LOAD_ALL` (see
  below)
* new logic in `main.py` (see below)

The new variables and the new logic make it easier to create test
suites for post-installation tests. If TESTPATH is used, OpenQA
will take all tests mentioned in POSTINSTALL from that specified
TESTPATH. If both TESTPATH and POSTINSTALL_LOAD_ALL are used, then
OpenQA will run all tests it can find at the TESTPATH location.
If POSTINSTALL and POSTINSTALL_LOAD_ALL are set simultaneously,
then only POSTINSTALL will be taken into account and OpenQA will
only load tests mentioned there.
2021-07-28 08:58:23 +02:00
Adam Williamson
420205bd5e Update a desktop update test needle
Dunno if this is os-autoinst or what.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-23 15:36:18 -07:00
Adam Williamson
a75e040062 Update a few more needles for os-autoinst
Also move all kde_next needles to the same dir.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-22 13:15:17 -07:00
Adam Williamson
fa94d92433 OK, fine, we need one more kernel.org patch needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-20 16:53:06 -07:00
Adam Williamson
04654f0d09 Add a few more updated needles missed in recent commit
Missed a few needles from the recent big commit of updates for
new os-autoinst behaviour.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-20 10:47:22 -07:00
Adam Williamson
df8d08db6f Update zezere needles for upstream/os-autoinst changes
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-19 15:59:07 -07:00
Adam Williamson
db19350db2 Update akonadi migration needle for newer KDE/os-autoinst
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-19 15:58:47 -07:00
Adam Williamson
2a7787c1da Update lots of needles for os-autoinst behaviour change
Recent git os-autoinst no longer downsamples screenshots as far
as it did before comparison. This makes a lot of needles where
colors have changed slightly no longer match, so they all needed
updating.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-19 13:03:11 -07:00
Adam Williamson
86c34ca063 Drop match level for kernel.org "patch" needles to 92
Again, to combat os-autoinst's new behaviour without adding yet
more needles. We're getting 96% match on stg.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-19 11:13:14 -07:00
Adam Williamson
d5ebaaa756 Drop match level to 90 for all background needles
Also delete ones for F32 and earlier. This should hopefully help
us not need to have too many needles for the newer stricter
matching.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-17 12:46:07 -07:00
Adam Williamson
2f4ef74def Avoid a needle duplication in KDE vault test
"show_hidden_icons" is the same thing as "desktop_expand_systray".

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-17 12:40:15 -07:00
Adam Williamson
1cf779fa20 Update Cockpit login needle for "Fedora Linux" change
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-14 14:11:52 -07:00
Adam Williamson
46c04c6a03 Update printing_check_sentence needle for a Pango change
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-14 14:11:35 -07:00
Adam Williamson
a7504441de Tighten match area to fix matching against trivial change
Latest Firefox has moved the underline down slightly for some
dumb reason. This tweaks the match area to only the text, so it
matches wherever the underline is.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-12 16:16:45 -07:00
Lukáš Růžička
6d1d549941 Introduce a resize check and a postinstall test for custom and blivet
tests.

This PR fixes .
2021-06-30 11:01:50 +02:00
Adam Williamson
a24da1ef63 Update Firefox addon_install needle for new release
Existing needle matched 95% on F33 and F34 tests of a new version.
Not suer what changed.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-06-25 10:26:29 -07:00
Adam Williamson
6a79565afa Fix up KDE 'plasma-disks' test stuff
In  we accidentally included an entire disks.pm test that
wasn't meant to be there - the infocenter module test is the
right thing to exercise plasma-disks, there is no standalone
app, running 'disks' just gets you the KDE Partition Manager,
which we already test. So this removes that test and renames a
needle that looks like it's for that test but is actually for
the kinfocenter module, to make this clearer.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-06-21 15:16:40 -07:00
Lukáš Růžička
9f0103a95f Enhance the Infocenter test to test the presence of Disks module. 2021-06-18 11:39:28 -07:00
Lukáš Růžička
2c366cc7a4 Add startstop test for Plasma Vault. 2021-06-18 11:39:24 -07:00
Lukáš Růžička
395ed61a1a Automate the Anaconda_Save_Traceback_to_Bugzilla_Text test case.
This PR adds a new test that automates the above mentioned test case.
It starts the installation in text mode using the `install_text` test
case, which it interrupts using the Anaconda crash trigger.
When the crash happens, it goes through the process of reporting
the bug to Bugzilla, checks that Bugzilla sends a positive
confirmation of the action, but also performs some REST API
calls to do a proper check and then it closes the bug to clean up.
2021-06-17 16:28:29 -07:00
Lukáš Růžička
b87049217c Add testcase for Memtest. 2021-06-16 18:11:01 +00:00
Adam Williamson
526042b0a5 Manually add Japanese input source for install_asian_language
GNOME dropped the g-i-s new user mode in F34, so on a Japanese
install with user created in the installer, you don't get an
input source configured out of the box or on first boot. So
we'll just have to do it manually after booting, before we test
if it works.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-06-15 16:19:31 -07:00
Adam Williamson
9d499eb5e1 Handle KDE having a permanent update notification again
Looks like the latest Rawhide got a permanent update notification
for KDE again. F34 is still around, though, so we can't just
revert to the old code, I don't think.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-06-15 13:56:00 -07:00
Adam Williamson
50947f8ba5 Update KDE desktop_icon_notifications needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-06-14 13:05:50 -07:00
Adam Williamson
0b45cd4adc Try and clean up desktop update needles a bit
The 'desktop_pacakge_tool_update-kde-detected' needles and
'desktop_update_notification_systray-kde' needles are actually
matching on exactly the same thing, so drop the redundancy. We
need to have the desktop_package_tool_update tag on the older
(F33) version of this needle because on F33 we click on it to
launch the update tool in the desktop_update_graphical test; from
F34 onwards this is *not* what we want to do so the needle should
not have that tag to avoid throwing the test off. When F33 goes
EOL we can drop that tag from the needle and simplify the
destop_update_graphical test. Also add a needle for the Discover
app's 'update' icon when no updates are found.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-06-14 12:32:27 -07:00
Adam Williamson
c28785afec Add F33 KDE variant Firefox 89 needles
KDE on F33 uses a different font, so needs its own needles...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-06-10 14:13:32 -07:00
Lukáš Růžička
9fdc63d4e2 Delete needles reported as unused by the check_needles script. 2021-06-10 12:13:41 +02:00
Adam Williamson
2f73b7302b Add another Firefox 'close tabs' needle
Not sure why. Some font difference in different tests.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-06-08 16:36:52 -07:00
Adam Williamson
2961a06dbd Update cockpit auto-updates needle
Radio button style change.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-06-08 16:36:20 -07:00
Adam Williamson
4fd395ff74 Update KDE Spectacle app runs needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-06-08 15:40:53 -07:00
Adam Williamson
bb9eb7d60e Update Firefox close tabs needle for GNOME
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-06-08 15:40:14 -07:00
Adam Williamson
59fbfcaa91 Update Firefox needles for new version
They did a UI refresh, it seems.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-06-08 11:36:49 -07:00
Adam Williamson
fcf96f73b7 Tweak Blivet LVM device type needles
There's some cheating/sloppiness going on here, with the same tag
and sometimes same needle being used to match "LVM2 Volume Group"
and "LVM2 Logical Volume". Today this caused us to pick the thin
pool entry instead in a test, so let's just clean this up and do
it right, with separate needles for matching each thing.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-06-07 18:16:46 -07:00
Adam Williamson
6c52a1c1dd Update Konsole runs needle, maximize Konsole in desktop_terminal
The needle match seems to have changed when bug  showed
up, but it's actually just a text rendering change in the window
title, it's not exactly caused by the tiny window. So not marking
as a workaround needle.

Maximizing the window makes the test work faster when we hit that
bug, as type_safely needs to be able to see the results of its
typing.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-06-02 11:07:49 -07:00
Adam Williamson
3364732110 anaconda_help: tweak nonlive needle handling, add waits, tabs
Some fixups for anaconda_help. Two runs of it failed today around
handoff from the root password screen to the install progress
screen; add a couple of wait_still_screens there to make it
safer. Drop the added nonlive needles, because they're too
permissive, causing problems for other tests (they're matching
before they should); instead we solve the problem of spokes being
highlighted by just pressing shift-tab a few times. And fix some
tabs to be spaces.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-05-31 16:17:06 -07:00
Lukáš Růžička
c6d443a20f Automate the QA:Testcase_Anaconda_help.
This PR automates the mentioned testcase to test that Help can be
displayed in Anaconda during the installation. It navigates through
the available Help screens and if it can see it, it finishes.

This test runs after `install_default_upload` to override the
installation defaults defined for all primary tests.

Delete a duplicated needle.

Reformat list extensions to make it nicer.

Get rid of wrong export and an empty line.

Delete empty line.

Use _boot_to_anaconda for booting and move subroutine accordingly.

Add variable to templates.fif.json

Delete trailing whitespace.

Fix calling the pretest.

Move help checking to another place.
2021-05-27 21:39:26 +00:00
Adam Williamson
5b15979f54 Update KDE system-settings runs needle (some font change)
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-05-19 12:09:09 -07:00
Adam Williamson
1b28976f49 Update several GNOME app test needles
Not sure why these changed, but oh well. Utilities menu was
highlighted in a test run for some reason, so let's just handle
that. Other needles changed very slightly.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-05-14 14:26:10 -07:00
Adam Williamson
875a817977 Drop Boxes/Connections needles for now
We're not using them, so they fail the unused needles check. We
can just revert this commit when we want them back.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-05-14 12:53:49 -07:00
Adam Williamson
65eef45cda Update Firefox addon_add needle, icon on button disappeared
I think this is in upstream page source, not on our end.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-05-13 18:08:59 -07:00
Adam Williamson
143f553ec4 Update kparted-runs needle
Font rendering changed slightly, dunno why.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-05-10 15:52:56 -07:00
Adam Williamson
8dc1bc7a8a Update leftbar generic needle, add rhbz#1959160 workaround
The background color of the generic left bar needle has changed
to match the new logo base color. The top bar's background color
has similarly changed, but this also caused us to notice a bug
in fedora-logos - that topbar image file seems to be basically
empty (just a transparent rectangle) so we see no 'image' in the
top bar, just solid electric blue. This needle matches that.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-05-10 13:57:38 -07:00
Adam Williamson
35660bb4ed Use Vinagre instead of Boxes as VNC client, prepare Connections
Boxes dropped VNC functionality. It's supposed to be replaced by
Connections, but we can't use that until it has fullscreen:
https://gitlab.gnome.org/GNOME/connections/-/issues/5
so use Vinagre for now. We do also prepare some needles for
Connections in anticipation of being able to use it later (since
I already did the work and don't want to waste it...)

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-05-06 16:28:49 -07:00
Adam Williamson
b1e28d4e77 Update Cockpit log entry detail needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-05-03 15:04:02 -07:00
Adam Williamson
28b1126c95 Update Japanese install_done-reboot needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-05-03 15:03:12 -07:00
Adam Williamson
f73ff0968c Update KDE addon install Firefox needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-05-03 15:02:05 -07:00
Adam Williamson
1a613fc8c2 Restore the cockput updated "Reboot" needle
OK, so sometimes we have a Reboot button, sometimes a Restart
button, sometimes both, but never *always* one or the other. So
we need both needles. Sigh.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-04-30 14:37:35 -07:00
Adam Williamson
92d17499c0 Update Firefox close tabs needles for font changes
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-04-30 11:34:19 -07:00
Adam Williamson
87a2477c31 Update KDE live installer needle for new logo
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-04-29 15:34:06 -07:00
Adam Williamson
efe793a465 Update some Cockpit needles for cockpit 243
There's a spurious warning on the Updates page, but we don't
want to fail tests for non-related updates on that, and I've
already reported it so it should get fixed.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-04-29 15:32:37 -07:00
Adam Williamson
571d7c2efe Update KDE app needles once again for Noto with grey background
...sigh.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-04-22 17:00:21 -07:00
Adam Williamson
6f6e84f65e Update a couple of Firefox needles for changes in 88
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-04-22 15:01:14 -07:00
Adam Williamson
533264900f Replace cockput updated 'reboot' needle with 'restart' needle
The 'reboot' button isn't always there in this case, it seems,
but the 'restart services' one is more likely to be. So let's
switch.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-04-22 14:52:52 -07:00
Adam Williamson
d6ac2126e2 Add another Cockpit log entry detail needle
Stupid Firefox survey means the thing we usually check isn't
always on the screen. This one checks for PRIORITY.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-04-22 14:51:53 -07:00
Adam Williamson
24e1bfef24 Update konsole_runs needle again for Noto-on-grey
I sense another fun day updating a zillion KDE app needles in my
future.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-04-15 16:53:30 -07:00
Adam Williamson
c97c704ff1 Update login_sddm_input for KDE font change
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-04-14 15:05:20 -07:00
Adam Williamson
4962f9c628 Update a few more needles for Noto in KDE
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-04-08 08:37:20 -07:00
Adam Williamson
772a47c012 Tweak KDE lock screen needle for underlining
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-04-08 08:33:49 -07:00
Adam Williamson
9e08112ae9 Update a lot of needles for KDE switch to Noto fonts
KDE switched to using Noto fonts by default (and title bars seem
to be blue again), many needles need to be updated.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-04-07 19:44:41 -07:00
Adam Williamson
c7173ef0e2 Tweak KDE update notification handling again
On current F34 we get no permanent update notification in the
notifications view, we only get a *transient* one plus the
systray icon. This tweaks things so on F34 we check both of
those things correctly, behaviour on <F34 should be unchanged.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-04-02 17:23:53 -07:00
Adam Williamson
de87c3f28e Update gedit needle for recent change
It now calls new files "Untitled File", not "Untitled Document".

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-04-01 15:46:34 -07:00
Adam Williamson
eefacf0e05 Add a needle for cut-off Firefox 'close tabs' button
This dialog gets cut off sometimes, it seems. That's a bug, but
we just want to handle it, because we want to quit cleanly.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-04-01 15:45:18 -07:00
Adam Williamson
609a0b04e6 Update arabic, japanese, russian needles for recent GNOME changes
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-04-01 15:42:46 -07:00
Adam Williamson
16ded56935 Add KDE package refresh needle, tweak retry logic a bit
KDE update was still often failing on , so this tries a
bit harder to work around it. We add a 'refresh' needle for KDE,
and tweak the 'retry' logic to click it if we get to that point.
Note adding the needle also changes behaviour slightly - we may
click this needle if we see it on first entering the screen. So
either change may be helping. Either way, this does make the test
more reliable.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-03-30 12:27:34 -07:00
Lukáš Růžička
57cd0cb3c6 Fix a typo in the needle file.
There was a typo in the apps_menu_button_french_20161215 which
prevented the `check_needles.py` from exiting gracefully.
The fix solves the situation.
2021-03-30 12:06:29 +02:00
Adam Williamson
ed9136225d Shorten the leftbar newlogo needle a bit for KDE live
KDE lives cut this off a bit because the taskbar is under it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-03-29 12:50:03 -07:00
Adam Williamson
1fc2edfda4 Fix desktop update test for KDE in F34+
We now have to run Plasma Discover, not use the systray thing.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-03-27 23:44:12 -07:00
Adam Williamson
10af8015ea Update anaconda newlogo identification icon for tweaked logo
Design team tweaked the new logo a bit in anaconda. We probably
won't need the old needle any more, but I'll take that out later.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-03-26 21:06:30 -07:00
Adam Williamson
0c0e25873d Another apps_menu_button French needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-03-26 20:43:30 -07:00
Adam Williamson
4c623f61f9 Update getting_started tour needle
Not sure if this difference is 40 stable vs. 40 beta or just
different in French for some reason.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-03-26 18:25:25 -07:00
Adam Williamson
106006cbc1 Update login input and GNOME app menu needles for non-English
We'll need a couple more needles too, but this is a start.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-03-26 18:24:42 -07:00
Adam Williamson
1819a9c2e1 Update locked screen user switch needle for GNOME 40 change
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-03-25 23:47:51 -07:00
Adam Williamson
29f75788e9 Update a bunch of GNOME app needles for GNOME 40 final
Some apps moved around, others the needles stopped matching for
some reason, some kind of slight scale change or something.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-03-24 18:36:38 -07:00
Adam Williamson
cde370bf1b Update several needles for new Fedora logo
The package with the new logo is not submitted as an update yet,
but we ran the tests on the Koji build and these are the new
needles. We'll need more when we run the full set of compose
tests on the change.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-03-24 12:58:30 -07:00
Adam Williamson
a8f7d3639f Remove kgpg_tips_close needles
I tweaked the test to no longer require these.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-03-23 18:23:25 -07:00
Adam Williamson
36ad08868c Remove Calligra needles
KDE has LibreOffice now.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-03-23 18:22:56 -07:00
Adam Williamson
25210463c5 Add more needles for console passphrase entry
Now we have plymouth not installed by default, we have more
different cases of hitting this.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-03-23 16:40:03 -07:00
Adam Williamson
805d303511 Add alternative cockpit "updated" needle
When we have to restart Cockpit during the update, we don't get
the usual "successful" screen after logging back in, we'll have
to match on something indicating an update did happen. I wanted
to use the little icon next to the package count but it seems to
have some kind of problem with anti-aliasing or something, I've
created two needles for it and neither matched on the next run
of the test. So let's match on this "reboot needed" text instead,
I hope it'll always be there when we hit this case.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-03-23 16:35:24 -07:00
Adam Williamson
05dfbef1a8 Update Activities button handling for latest GNOME
Make the 'deactivate overview if it's active' thing a bit more
robust by asserting the inactive state after deactivating it,
and add new needles for the new RC (text got a bit brighter).

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-03-16 17:24:08 -07:00
Adam Williamson
eec43a4e2b Add another version of KDE desktop update notification needle
Darn transparency. This is for F33 respin testing.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-03-12 18:39:53 -08:00
Adam Williamson
3ee11c2ac5 Update user_logged_in-noprofile-sh needle for bash 5.1
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-03-12 18:39:03 -08:00
Adam Williamson
c0cced6a3f Update GNOME login needles for darker GDM
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-03-12 18:38:14 -08:00
Adam Williamson
1b6181b4af Update Cockpit log entry details needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-03-12 18:36:33 -08:00
Adam Williamson
ac9edb4cfb GNOME apps: drop Archiver test
The app was dropped from Workstation's default package set a few
days ago. See:
https://pagure.io/fedora-workstation/issue/167

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-03-05 18:25:29 -08:00
Adam Williamson
b349e7cb1a Update GNOME update notification needle for GNOME 40
The icon looks a bit different now.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-03-05 17:53:36 -08:00
Adam Williamson
a32a205e7a Update kgpg_runs needle for latest Plasma
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-03-05 17:50:22 -08:00
Adam Williamson
3c92696d98 Convert ksysguard test to Plasma system monitor test
These were switched out in comps recently.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-03-05 17:20:59 -08:00
Adam Williamson
f6fa89f2cf Remove falkon, k3b, krusader, ktorrent from KDE app startstop
They have all been dropped from the spin recently. Remove all
related needles too.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-03-05 15:58:37 -08:00
Adam Williamson
1e5d767fa3 Handle GNOME 40 now starting at overview, not desktop
For consistency, let's just return to the desktop right away. We
also need to handle closing the overview before running installer
on live image boot.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-03-04 16:03:21 -08:00
Adam Williamson
4758782d56 KDE apps: replace Calligra with LibreOffice
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-03-04 08:58:55 -08:00
Adam Williamson
51341dc2ff Update several GNOME app needles for overview change
The icons in the dash got a bit smaller again, so all these
needles need updating.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-03-03 18:59:16 -08:00
Adam Williamson
4bc0ac79da Update a few more KDE app needles for newer Plasma
Missed these in the last round.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-03-03 18:57:51 -08:00
Adam Williamson
50e03ce691 Add several needles for F34 background transitions
Sigh, I hate animated backgrounds.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-03-02 17:46:16 -08:00
Adam Williamson
481b0aaf38 Remove all workaround needles
We worked around it in a different way (installing a Plymouth
theme in the base disk image) so these shouldn't be needed any
more.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-03-02 17:45:22 -08:00
Adam Williamson
dda86c52a6 Add several workaround needles for RHBZ#1933378
There's a bug in F34/Rawhide lately where the bootsplash isn't
fully cleared when displaying text consoles, this causes all the
login needles not to match. Add several workarounds to make the
most common cases at least work with the bug, failing on it is
not much use.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-03-01 16:39:07 -08:00
Adam Williamson
274a8f1b47 Update a ton of KDE app needles for UI changes
KDE changed the color of the window title background, so all
these need redoing.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-02-26 13:54:46 -08:00
Adam Williamson
216537d734 Update GNOME launcher needle for GNOME 40 tweak
It got a bit bigger!

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-02-26 13:51:46 -08:00
Adam Williamson
e1a6d2c22b Handle KDE defaulting to offline updates in F34+
We need to hit 'restart' after applying updates, and we also
need the 'done' needle *not* to match the restart message, so
change that to match on the text (unfortunately). That also
means we have to add another variant of the needle for F32 as
the background of the text is a different color there.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-02-25 16:10:20 -08:00
Adam Williamson
6658740b2a Update the GNOME app run test needles for GNOME 40
Overview changed a lot, so all these needles need updating.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-02-22 17:04:22 -08:00
Adam Williamson
548e350e47 Update cockpit updates updated needle again
Update update update. Update. Update!

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-02-22 13:54:16 -08:00
Adam Williamson
784962c96e Fix btrfs_preserve_home for UEFI
When running this test on UEFI, we need to preserve /boot/efi.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-02-19 14:48:47 -08:00
Lukáš Růžička
866a8efa72 Add a new testcase to test creation of LVM with ext4 using Blivet.
This PR adds a test that uses the Blivet interface to create an LVM
layout with ext4 filesystem as well as a postinstall test that checks
that the LVM layout has been created correctly.
2021-02-19 13:42:20 -08:00
Adam Williamson
13e5f176fe Add workaround logged_in needles for CoreOS white prompt
CoreOS currently sets the prompt to solid white (accidentally),
these needles work around that.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-02-19 10:28:33 -08:00
Adam Williamson
9f0451574d Update printing_check_sentence needle for some font change
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-02-19 10:26:57 -08:00
Adam Williamson
1cd0529785 cockpit: set log priority to 'info' before looking for entry
We finally saw a test where there were *no* errors logged by the
time Cockpit reached the log screen, so there were no entries to
click. Let's just make the test set log level to info before
looking for entries - I prefer this to 'click entry if found,
otherwise change log level' as that's twice as many branches to
look after. Of course, it means the warning triangle entry needle
is useless now :(

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-02-19 10:24:50 -08:00
Adam Williamson
011b98961b Update KDE update needles for F34/Rawhide backgrounds etc.
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-02-18 15:28:02 -08:00
Adam Williamson
619f64b353 Update cockpit update needles for Cockpit 238
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-02-18 15:26:22 -08:00
Adam Williamson
45ecd40834 Update several needles for GNOME 40
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-02-18 14:18:12 -08:00
Adam Williamson
436e9cfdf2 Update GNOME 'getting started' needle and dismissal key
The new one isn't an app, so alt-f4 doesn't work. Esc does.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-02-18 09:38:52 -08:00
Adam Williamson
79c27e347f Add F35 IoT identification needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-02-17 18:02:02 -08:00
Adam Williamson
652cc6298c Add another KDE no notifications needle
Dang translucency.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-02-17 18:01:21 -08:00
Adam Williamson
da653dfd22 Yet another Cockpit log entry needle
Let's just match on the warning triangle. Hopefully that stays
consistent.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-02-17 17:23:43 -08:00
Adam Williamson
1275819015 Add second F34 background needle (day)
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-02-12 15:06:11 -08:00
Adam Williamson
db151d4172 Update a couple more needles for grimdark KDE
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-02-12 14:24:52 -08:00
Adam Williamson
4243932d09 Adjust desktop_login and needles for KDE power option changes
KDE in F34+ is now placing sleep, restart and shutdown buttons
right on the system menu, not in a submenu. So we need to sort of
tweak this logic. The approach here is: we count the GNOME
submenu as both a "power" and "leave" menu, so the needle to
enter it has both tags. KDE still has a "leave" submenu, but the
power options are not in a submenu any more, so the new "leave"
needle only has the leave tag, not the power tag. For "leave"
actions we just unconditionally expect the "leave" tag; for
power actions we first match on *either* the submenu tag (for
GNOME and earlier KDE) *or* the action tag, click whatever we
found, and then if we matched the submenu (not the action), we
assert and click the action. After that all paths should be in
sync again and we can continue.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-02-12 13:34:04 -08:00
Adam Williamson
818bacfb60 Update several needles for KDE going all grimdark
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-02-12 12:02:05 -08:00
Adam Williamson
3a3a6ecd2d Add a workaround needle for a cockpit radio button alignment bug
Cockpit 237 has misaligned radio buttons here. We know about the
issue and want the test to not fail on unrelated updates, so let's
make it a soft fail.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-02-10 16:29:16 -08:00
Adam Williamson
33cb8ae368 Add initial F34 background needles
Looks like this one's animated too, so we'll need more :(

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-02-10 16:28:32 -08:00
Adam Williamson
19c2a5dae7 Add version_34 identification needles, now we branched
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-02-10 11:01:37 -08:00
Adam Williamson
670fc8c306 Add another cockpit login screen variant
More space between "Fedora" and the text below it...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-02-05 15:01:02 -08:00
Adam Williamson
845cfca12d Add more cockpit log needle variants
We're getting different log messages these days.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-02-04 14:52:21 -08:00
Adam Williamson
c32b1d03dd Update several layout needles for GNOME overview changing color
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-02-04 14:47:22 -08:00
Adam Williamson
aebabc706e Update some GNOME-related needles for changes in GNOME 40
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-02-04 14:06:11 -08:00
Adam Williamson
429f58bd31 Update some needles for KDE appearance change in Rawhide
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-02-04 13:58:59 -08:00
Adam Williamson
2a2473b4bb Crop layout needles to not include down carets
...since GNOME doesn't have them any more in Rawhide.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-02-03 17:47:30 -08:00
Lukáš Růžička
ecca7d3c01 Create testcase to recreate Btrfs layout using Blivet and preserve home.
This PR uses the Anaconda Blivet partitioning to recreate a partition
layout while preserving the content of the /home subvolume.

It also adds the postinstall test to check that the home has been
preserved.
2021-01-28 09:51:32 +01:00
Adam Williamson
7eb7689f59 Add another F33 background variant
Hit this re-running some tests at an unusual time.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-01-25 16:30:48 -08:00
Adam Williamson
179ab45bca Update various needles for GNOME down caret changing a bit
This affected apps_run_terminal and a ton of layout needles.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-01-25 16:27:39 -08:00
Lukáš Růžička
ba90c70c8a Add several tests to test QA:Testcase_partitioning_custom_btrfs_preserve_home.
This PR adds the `install_btrfs_upload` to install the btrfs based
image, the `btrfs_preserve_home_extras` to prepare and test the data
on the home partition, as well as the `custom_btrfs_preserve_home` that
uses the preinstalled btrfs image and uses its current partitioning to
preserve the home partition and the data on it.
2021-01-20 16:50:39 +00:00
Adam Williamson
adac5323f0 Update Cockpit log entry needle
We don't always get a smartd error any more, so add one for a
different error that's more consistent ATM.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-01-19 16:07:56 -08:00
Adam Williamson
fdc4a51e2a Add new Cockpit login needle using the text box area
The background seems to be different in different tests, even
the reduced area I tried most recently seems to be different in
some runs. So let's just match in the text area instead. This
captures some "Fedora" text so it should still notice if branding
is broken.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-01-15 16:52:40 -08:00
Michel Normand
e9c15a502a ppc64le changes in disk_custom_blivet_resize_lvm.pm
Required because ppc64le has a PReP partition
before boot partition.
PReP partition must not be changed by this script.

Signed-off-by: Michel Normand <normand@linux.vnet.ibm.com>
2021-01-12 11:14:17 +01:00
Adam Williamson
18e15f983a Update root_logged_in-noprofile for bash 5.1
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-01-11 15:47:19 -08:00
Adam Williamson
d0a53abda0 Update cockpit log entry details screen for Cockpit 235
The font of the identifier text got a bit smaller. I think it
looks kinda bad now, but it's not an outright bug, so just
living with it. I did file an upstream issue:
https://github.com/cockpit-project/cockpit/issues/15111

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-01-07 11:16:13 -08:00
Adam Williamson
fba4a82587 Make g-i-s Start Setup button needle its own thing
There's a race issue with just treating it as a next button: it's
not in the same place as a next button. Sometimes in the g-i-s
code we actually get ahead of ourselves and click early, which
isn't really a problem when the buttons are all in the same
place, but if we click "Start Setup" in the middle of transition
to the Privacy screen - as in
https://openqa.fedoraproject.org/tests/745034#step/_graphical_wait_login/4
 - the click effectively gets lost. So let's make it its own tag
and have the initial assert look for it too. That way we won't
match on it again in the main loop over "@nexts".

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-12-21 09:16:40 -08:00
Adam Williamson
9adfeb449d Make leftbar_generic match area a bit shorter
KDE menu bar got a bit taller lately.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-12-17 09:00:24 -08:00
Adam Williamson
61bd4cb310 Update GNOME printing_check_sentence needle
Font rendering changed a bit again.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-12-16 09:42:18 -08:00
Adam Williamson
1f757325a6 Reduce login_cockpit needle match area
There seem to be some weird shenanigans going on with the pipe
bit here (it looks different on different test runs? what?) so
let's just match on the plain grey area. Should still be enough.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-12-15 16:52:35 -08:00
Adam Williamson
dc86780a13 Update Cockpit FreeIPA "join complete" needle for new domain
Left this out of previous commit, oops.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-12-15 14:45:02 -08:00
Adam Williamson
0de57180ee Update cockpit needles and autoupdate test for 234
Auto-update time is shown as '6:00' not '06:00' now, so trim the
needle to match both.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-12-15 11:20:43 -08:00
Adam Williamson
2b12be440e Drop match threshold on KDE update detected needle
Got a 95% match in
https://openqa.fedoraproject.org/tests/736374#step/desktop_update_graphical/26

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-12-07 09:33:04 -08:00
Adam Williamson
d065974cc6 apps_run_terminal: match window area too
Just matching the Overview entry isn't really enough, the app
hasn't really run yet. This makes the test more robust and also
helps out on aarch64 desktop tests where the app window takes a
long time to appear.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-12-04 11:55:36 -08:00
Adam Williamson
a038423920 Add a workaround needle for Konsole running with wrong font
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-12-02 14:50:59 -08:00
Adam Williamson
387f8dd679 Update Arabic needles for some kind of font change
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-12-02 14:47:20 -08:00
Adam Williamson
f88fde4a73 Verbose boot_enter_passphrase needle for current IoT state
Currently we get the prompt, but buried in a bunch of other text.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-12-02 14:43:35 -08:00
Lukáš Růžička
5718c7f1d4 Add an installation test using LVM partitioning as asset for resize tests.
When Fedora went to BTRFS as a default, we lost the LVM based image to
run LVM resize tests with.

This PR introduces the `install_lvm.pm` installation test that creates
an LVM based qcow2 image to be used by follow-up tests.
2020-11-26 09:55:19 +01:00
Adam Williamson
4f30b59077 Add workaround needles for KDE printing test
Styling on the KDE base disk image seems to have gone wrong
again, which throws this test off. We need to figure out what's
gone wrong in the base image, but it's a Friday night and I don't
want the test failing all weekend, and there's nothing wrong in
the *test itself*, so let's create some workaround needles and
figure it out next week.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-11-20 20:06:33 -08:00
Adam Williamson
9df165c1a9 Yet another variant of the KDE printing check sentence needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-11-18 13:59:27 -08:00
Adam Williamson
7c31adbf7c Update KDE package update needles
Seems KDE changed the tool that installs updates again. New
needles for new tools!

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-11-18 12:17:19 -08:00