Commit graph

680 commits

Author SHA1 Message Date
Lukáš Růžička
5718c7f1d4 Add an installation test using LVM partitioning as asset for resize tests.
When Fedora went to BTRFS as a default, we lost the LVM based image to
run LVM resize tests with.

This PR introduces the `install_lvm.pm` installation test that creates
an LVM based qcow2 image to be used by follow-up tests.
2020-11-26 09:55:19 +01:00
Adam Williamson
4f30b59077 Add workaround needles for KDE printing test
Styling on the KDE base disk image seems to have gone wrong
again, which throws this test off. We need to figure out what's
gone wrong in the base image, but it's a Friday night and I don't
want the test failing all weekend, and there's nothing wrong in
the *test itself*, so let's create some workaround needles and
figure it out next week.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-11-20 20:06:33 -08:00
Adam Williamson
9df165c1a9 Yet another variant of the KDE printing check sentence needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-11-18 13:59:27 -08:00
Adam Williamson
7c31adbf7c Update KDE package update needles
Seems KDE changed the tool that installs updates again. New
needles for new tools!

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-11-18 12:17:19 -08:00
Adam Williamson
762f259333 Drop match level of a KDE notifcations needle
Sigh, transparency or something. See:
https://openqa.fedoraproject.org/tests/723120#step/desktop_notifications/19

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-11-16 11:27:38 -08:00
Adam Williamson
649fcc51f1 Cockpit 232 fixes
Update a needle with slightly different text rendering, and add
a workaround to hit tab three times rather than once on entering
the "Join a domain" screen, see
https://github.com/cockpit-project/cockpit/issues/14895 .

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-11-11 12:55:42 -08:00
Adam Williamson
fde492aa5d Update a few desktop needles
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-11-10 13:00:46 -08:00
Adam Williamson
d2e6c11c7b Update GNOME printing sentence needle
Seems sometimes we now get the document at fit width, not fit
page.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-10-31 11:26:32 -07:00
Adam Williamson
f51a804357 Handle emergency console entry with no password
This happens on ARM disk images.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-10-28 15:21:03 -07:00
Adam Williamson
9be79d3dc7 Drop match level on KDE update detected needle
Got a 93% match at
https://openqa.fedoraproject.org/tests/708115#step/desktop_update_graphical/22

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-10-27 08:53:59 -07:00
Adam Williamson
d8f5d3fd0b Update several KDE needles for font rendering / button changes
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-10-26 12:38:08 -07:00
Adam Williamson
d20f64967c Update a couple of KDE needles
Font rendering change, or transparency, or some damn thing.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-10-23 23:07:10 -07:00
Adam Williamson
d3569dbf37 Update anaconda rescue select needle
"Rescue" was downcased to "rescue".

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-10-23 22:48:51 -07:00
Adam Williamson
0d8ceec820 Try to make desktop_browser more robust
We've been getting failures lately on the first page load, I
think because Firefox is getting even more grindy on startup. So
turn the 'sleep' into a 'wait_still_screen', extend another wait,
and tweak the 'browser' needle so it only matches after the
bookmark bar has loaded rather than as soon as half the chrome
appears. Also make all the wait_still_screens use similarity 45
for consistency (flashing cursor could be there on any of them).

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-10-23 09:48:09 -07:00
Adam Williamson
33c290d15a Remove now-unused desktop_network_notification needle
Dropped the use of this in the recent notification simplification,
but forgot to remove the needle. Should've run tox...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-10-15 15:36:37 -07:00
Adam Williamson
1c33d07d38 Drop workaround_ble26, bug was fixed months ago
https://pagure.io/background-logo-extension/issue/26 was fixed
months back, we don't need this any more.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-10-15 15:36:04 -07:00
Adam Williamson
a008ffb8be Simplify desktop notification checks (#195)
This is the best option I can come up with to deal with #195.
Update notifications seem to have become transient in KDE lately
(even in F31 and F32, if I'm looking at these screenshots right).
This actually simplifies things a lot to do more or less the
same in the KDE and GNOME paths: open the 'permanent' store of
notifications (in GNOME you get to it by clicking on the clock,
in KDE via the systray) and then look for no notifications (live
path) or only an update notification (post-install path). We
only run this test for composes so we shouldn't need to worry
about anything older than F32, and I believe this should work
for KDE in F32 and F33. I left out click_unwanted_notifications
for now as I'm hoping it should be unnecessary, but we can add
it back in if necessary.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-10-14 23:30:00 -07:00
Adam Williamson
656e1f6856 Add another F33 background needle
Yeesh, this background is fun.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-10-11 10:04:37 -07:00
Adam Williamson
da0b079686 Update KDE desktop no notifications needle
Probably changed with the background, darn translucency.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-10-09 18:06:19 -07:00
Adam Williamson
415dabd92e Update Firefox addon_install alt needle too (for F31)
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-10-09 17:53:22 -07:00
Adam Williamson
10f7e7a7d2 Update Firefox addon_install needle for 81.0.1
Seems to have changed.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-10-09 17:25:10 -07:00
Adam Williamson
92f5bf90c0 Update Krusader settings close needle
The button changed a bit.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-10-08 16:22:44 -07:00
Adam Williamson
40e07b487d Add another F33 background needle
For the transition between dawn and day. This is right in the
middle of it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-10-08 16:21:59 -07:00
Adam Williamson
40974c2f94 Simplify Krusader app test
We don't need a separate 'welcome' needle because it just matches
on an OK button anyway. So turn that needle into an OK needle
(we don't have any existing 'blue OK button' needle) and simplify
the logic to a single loop for kde_ok and krusader_settings_close.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-10-08 14:47:46 -07:00
Adam Williamson
5e5dbac636 Add updated cockpit_updates_reconnect needle
We only use this one rarely. Font rendering on it changed at
some point.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-10-07 14:42:26 -07:00
Adam Williamson
d2adecf03d Add some more updated F33 background needles
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-10-07 14:41:54 -07:00
Adam Williamson
36fd4c10b1 Correct tag for new kde_ok needle
It had krusader_settings_close as its tag, not kde_ok. That's
why the krusader test module was failing weirdly.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-10-07 14:39:08 -07:00
Adam Williamson
ea0dc63fc3 Add updated F33 day background needle
The backgrounds were tweaked so I get to take a bunch more
screenshots, fun fun fun.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-10-06 14:54:58 -07:00
Lukáš Růžička
b5a7b49f6e Correct the misconfigured needle from the previous commit and add a proper one. 2020-10-01 12:42:56 +02:00
Lukáš Růžička
3986984eb3 Fix needles for Krusader and Notifications. 2020-09-30 09:08:20 +02:00
Dan Čermák
3316e04d20
Update live_anaconda_icon KDE needle 2020-09-20 11:59:16 +02:00
Adam Williamson
fba3a3a290 Update Cheese and Videos app needles, icons changed
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-09-18 13:40:23 -07:00
Adam Williamson
f69e627dc3 Update some cockpit needles for version 228
They dropped Title Case from various things, some of which we
have needles for.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-09-16 12:27:54 -07:00
Adam Williamson
a2bbd5ecfb Add some needles for universal tests with btrfs default
The 'universal' tests have quite a few failures if you run them
on an image where btrfs is the default (currently they usually
run on the Server DVD, where xfs-on-LVM is still the default).
This fixes some of them, the others would need code fixes.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-09-11 16:20:12 -07:00
Adam Williamson
8e794a6c30 Update a Cockpit needle that changed in the latest release
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-09-03 15:13:54 -07:00
Adam Williamson
9ae60e4a1e Update GDM/GNOME keyboard layout needles
The down caret changed size, again...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-09-01 12:12:25 -07:00
Adam Williamson
461d9cc7b9 New getting started needle is language-agnostic
We're matching on the icon, so it should work for all languages.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-09-01 10:40:41 -07:00
Adam Williamson
041b8ca2fe Add F33 'dawn' background needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-08-31 13:30:20 -07:00
Adam Williamson
9a90a06328 Add new 'getting_started' needle for GNOME Tour
Replaces the old Yelp-based thing.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-08-31 12:43:56 -07:00
Adam Williamson
a5aa72da73 Remove new KDE log out entry needle again
Turns out we don't need it, the failed test was run before I
dropped the match level.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-08-25 17:00:31 -07:00
Adam Williamson
cbb817fd14 Add new KDE log out entry needle
Rawhide doesn't match the existing one even with the lowered
threshold, so whatever.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-08-25 16:43:20 -07:00
Adam Williamson
3c1c9f3436 Rename log_out_entry needles to be unique
Even though we have subdirs, we actually usually make needle
names unique across subdirs due to limitations of openQA's UI
upstream.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-08-25 16:42:46 -07:00
Adam Williamson
9d3ac55607 Update printing 'check sentence' needle for latest Rawhide KDE
Rendering seems to have changed/improved a bit.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-08-25 16:21:17 -07:00
Adam Williamson
09cd628f46 Add some more Firefox addon install needle variants
I have no idea why the rendering of this text keeps changing
slightly. Sigh.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-08-25 16:09:42 -07:00
Adam Williamson
0220334a57 Drop stray match area from cockpit_leftbar_scroll
That's not supposed to be there...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-08-25 16:08:51 -07:00
Adam Williamson
11320dad16 Add another F33 background needle
Oh animated wallpapers, how do we love thee

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-08-24 17:10:23 -07:00
Adam Williamson
b29b05a359 Drop match threshold on KDE log out entry needle
OK, reducing the match area didn't help. So let's drop the
threshold instead.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-08-24 12:53:52 -07:00
Adam Williamson
d87d61df4d Update Zezere submit provision request needle
Dunno what changed.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-08-24 12:50:40 -07:00
Adam Williamson
86c881db80 Add IoT version "34" needles
IoT is still versioning its 'rawhide' composes, so here.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-08-24 12:49:56 -07:00
Adam Williamson
82ebfe37f0 Tighten KDE log_out_entry area
See if this helps it match more reliably.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-08-24 12:43:00 -07:00