Commit Graph

942 Commits

Author SHA1 Message Date
Adam Williamson
ac9edb4cfb GNOME apps: drop Archiver test
The app was dropped from Workstation's default package set a few
days ago. See:
https://pagure.io/fedora-workstation/issue/167

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-03-05 18:25:29 -08:00
Adam Williamson
b349e7cb1a Update GNOME update notification needle for GNOME 40
The icon looks a bit different now.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-03-05 17:53:36 -08:00
Adam Williamson
a32a205e7a Update kgpg_runs needle for latest Plasma
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-03-05 17:50:22 -08:00
Adam Williamson
3c92696d98 Convert ksysguard test to Plasma system monitor test
These were switched out in comps recently.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-03-05 17:20:59 -08:00
Adam Williamson
f6fa89f2cf Remove falkon, k3b, krusader, ktorrent from KDE app startstop
They have all been dropped from the spin recently. Remove all
related needles too.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-03-05 15:58:37 -08:00
Adam Williamson
1e5d767fa3 Handle GNOME 40 now starting at overview, not desktop
For consistency, let's just return to the desktop right away. We
also need to handle closing the overview before running installer
on live image boot.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-03-04 16:03:21 -08:00
Adam Williamson
4758782d56 KDE apps: replace Calligra with LibreOffice
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-03-04 08:58:55 -08:00
Adam Williamson
51341dc2ff Update several GNOME app needles for overview change
The icons in the dash got a bit smaller again, so all these
needles need updating.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-03-03 18:59:16 -08:00
Adam Williamson
4bc0ac79da Update a few more KDE app needles for newer Plasma
Missed these in the last round.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-03-03 18:57:51 -08:00
Adam Williamson
50e03ce691 Add several needles for F34 background transitions
Sigh, I hate animated backgrounds.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-03-02 17:46:16 -08:00
Adam Williamson
481b0aaf38 Remove all #1933378 workaround needles
We worked around it in a different way (installing a Plymouth
theme in the base disk image) so these shouldn't be needed any
more.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-03-02 17:45:22 -08:00
Adam Williamson
dda86c52a6 Add several workaround needles for RHBZ#1933378
There's a bug in F34/Rawhide lately where the bootsplash isn't
fully cleared when displaying text consoles, this causes all the
login needles not to match. Add several workarounds to make the
most common cases at least work with the bug, failing on it is
not much use.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-03-01 16:39:07 -08:00
Adam Williamson
274a8f1b47 Update a ton of KDE app needles for UI changes
KDE changed the color of the window title background, so all
these need redoing.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-02-26 13:54:46 -08:00
Adam Williamson
216537d734 Update GNOME launcher needle for GNOME 40 tweak
It got a bit bigger!

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-02-26 13:51:46 -08:00
Adam Williamson
e1a6d2c22b Handle KDE defaulting to offline updates in F34+
We need to hit 'restart' after applying updates, and we also
need the 'done' needle *not* to match the restart message, so
change that to match on the text (unfortunately). That also
means we have to add another variant of the needle for F32 as
the background of the text is a different color there.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-02-25 16:10:20 -08:00
Adam Williamson
6658740b2a Update the GNOME app run test needles for GNOME 40
Overview changed a lot, so all these needles need updating.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-02-22 17:04:22 -08:00
Adam Williamson
548e350e47 Update cockpit updates updated needle again
Update update update. Update. Update!

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-02-22 13:54:16 -08:00
Adam Williamson
784962c96e Fix btrfs_preserve_home for UEFI
When running this test on UEFI, we need to preserve /boot/efi.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-02-19 14:48:47 -08:00
Lukáš Růžička
866a8efa72 Add a new testcase to test creation of LVM with ext4 using Blivet.
This PR adds a test that uses the Blivet interface to create an LVM
layout with ext4 filesystem as well as a postinstall test that checks
that the LVM layout has been created correctly.
2021-02-19 13:42:20 -08:00
Adam Williamson
13e5f176fe Add workaround logged_in needles for CoreOS white prompt
CoreOS currently sets the prompt to solid white (accidentally),
these needles work around that.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-02-19 10:28:33 -08:00
Adam Williamson
9f0451574d Update printing_check_sentence needle for some font change
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-02-19 10:26:57 -08:00
Adam Williamson
1cd0529785 cockpit: set log priority to 'info' before looking for entry
We finally saw a test where there were *no* errors logged by the
time Cockpit reached the log screen, so there were no entries to
click. Let's just make the test set log level to info before
looking for entries - I prefer this to 'click entry if found,
otherwise change log level' as that's twice as many branches to
look after. Of course, it means the warning triangle entry needle
is useless now :(

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-02-19 10:24:50 -08:00
Adam Williamson
011b98961b Update KDE update needles for F34/Rawhide backgrounds etc.
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-02-18 15:28:02 -08:00
Adam Williamson
619f64b353 Update cockpit update needles for Cockpit 238
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-02-18 15:26:22 -08:00
Adam Williamson
45ecd40834 Update several needles for GNOME 40
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-02-18 14:18:12 -08:00
Adam Williamson
436e9cfdf2 Update GNOME 'getting started' needle and dismissal key
The new one isn't an app, so alt-f4 doesn't work. Esc does.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-02-18 09:38:52 -08:00
Adam Williamson
79c27e347f Add F35 IoT identification needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-02-17 18:02:02 -08:00
Adam Williamson
652cc6298c Add another KDE no notifications needle
Dang translucency.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-02-17 18:01:21 -08:00
Adam Williamson
da653dfd22 Yet another Cockpit log entry needle
Let's just match on the warning triangle. Hopefully that stays
consistent.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-02-17 17:23:43 -08:00
Adam Williamson
1275819015 Add second F34 background needle (day)
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-02-12 15:06:11 -08:00
Adam Williamson
db151d4172 Update a couple more needles for grimdark KDE
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-02-12 14:24:52 -08:00
Adam Williamson
4243932d09 Adjust desktop_login and needles for KDE power option changes
KDE in F34+ is now placing sleep, restart and shutdown buttons
right on the system menu, not in a submenu. So we need to sort of
tweak this logic. The approach here is: we count the GNOME
submenu as both a "power" and "leave" menu, so the needle to
enter it has both tags. KDE still has a "leave" submenu, but the
power options are not in a submenu any more, so the new "leave"
needle only has the leave tag, not the power tag. For "leave"
actions we just unconditionally expect the "leave" tag; for
power actions we first match on *either* the submenu tag (for
GNOME and earlier KDE) *or* the action tag, click whatever we
found, and then if we matched the submenu (not the action), we
assert and click the action. After that all paths should be in
sync again and we can continue.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-02-12 13:34:04 -08:00
Adam Williamson
818bacfb60 Update several needles for KDE going all grimdark
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-02-12 12:02:05 -08:00
Adam Williamson
3a3a6ecd2d Add a workaround needle for a cockpit radio button alignment bug
Cockpit 237 has misaligned radio buttons here. We know about the
issue and want the test to not fail on unrelated updates, so let's
make it a soft fail.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-02-10 16:29:16 -08:00
Adam Williamson
33cb8ae368 Add initial F34 background needles
Looks like this one's animated too, so we'll need more :(

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-02-10 16:28:32 -08:00
Adam Williamson
19c2a5dae7 Add version_34 identification needles, now we branched
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-02-10 11:01:37 -08:00
Adam Williamson
670fc8c306 Add another cockpit login screen variant
More space between "Fedora" and the text below it...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-02-05 15:01:02 -08:00
Adam Williamson
845cfca12d Add more cockpit log needle variants
We're getting different log messages these days.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-02-04 14:52:21 -08:00
Adam Williamson
c32b1d03dd Update several layout needles for GNOME overview changing color
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-02-04 14:47:22 -08:00
Adam Williamson
aebabc706e Update some GNOME-related needles for changes in GNOME 40
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-02-04 14:06:11 -08:00
Adam Williamson
429f58bd31 Update some needles for KDE appearance change in Rawhide
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-02-04 13:58:59 -08:00
Adam Williamson
2a2473b4bb Crop layout needles to not include down carets
...since GNOME doesn't have them any more in Rawhide.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-02-03 17:47:30 -08:00
Lukáš Růžička
ecca7d3c01 Create testcase to recreate Btrfs layout using Blivet and preserve home.
This PR uses the Anaconda Blivet partitioning to recreate a partition
layout while preserving the content of the /home subvolume.

It also adds the postinstall test to check that the home has been
preserved.
2021-01-28 09:51:32 +01:00
Adam Williamson
7eb7689f59 Add another F33 background variant
Hit this re-running some tests at an unusual time.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-01-25 16:30:48 -08:00
Adam Williamson
179ab45bca Update various needles for GNOME down caret changing a bit
This affected apps_run_terminal and a ton of layout needles.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-01-25 16:27:39 -08:00
Lukáš Růžička
ba90c70c8a Add several tests to test QA:Testcase_partitioning_custom_btrfs_preserve_home.
This PR adds the `install_btrfs_upload` to install the btrfs based
image, the `btrfs_preserve_home_extras` to prepare and test the data
on the home partition, as well as the `custom_btrfs_preserve_home` that
uses the preinstalled btrfs image and uses its current partitioning to
preserve the home partition and the data on it.
2021-01-20 16:50:39 +00:00
Adam Williamson
adac5323f0 Update Cockpit log entry needle
We don't always get a smartd error any more, so add one for a
different error that's more consistent ATM.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-01-19 16:07:56 -08:00
Adam Williamson
fdc4a51e2a Add new Cockpit login needle using the text box area
The background seems to be different in different tests, even
the reduced area I tried most recently seems to be different in
some runs. So let's just match in the text area instead. This
captures some "Fedora" text so it should still notice if branding
is broken.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-01-15 16:52:40 -08:00
Michel Normand
e9c15a502a ppc64le changes in disk_custom_blivet_resize_lvm.pm
Required because ppc64le has a PReP partition
before boot partition.
PReP partition must not be changed by this script.

Signed-off-by: Michel Normand <normand@linux.vnet.ibm.com>
2021-01-12 11:14:17 +01:00
Adam Williamson
18e15f983a Update root_logged_in-noprofile for bash 5.1
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-01-11 15:47:19 -08:00
Adam Williamson
d0a53abda0 Update cockpit log entry details screen for Cockpit 235
The font of the identifier text got a bit smaller. I think it
looks kinda bad now, but it's not an outright bug, so just
living with it. I did file an upstream issue:
https://github.com/cockpit-project/cockpit/issues/15111

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-01-07 11:16:13 -08:00
Adam Williamson
fba4a82587 Make g-i-s Start Setup button needle its own thing
There's a race issue with just treating it as a next button: it's
not in the same place as a next button. Sometimes in the g-i-s
code we actually get ahead of ourselves and click early, which
isn't really a problem when the buttons are all in the same
place, but if we click "Start Setup" in the middle of transition
to the Privacy screen - as in
https://openqa.fedoraproject.org/tests/745034#step/_graphical_wait_login/4
 - the click effectively gets lost. So let's make it its own tag
and have the initial assert look for it too. That way we won't
match on it again in the main loop over "@nexts".

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-12-21 09:16:40 -08:00
Adam Williamson
9adfeb449d Make leftbar_generic match area a bit shorter
KDE menu bar got a bit taller lately.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-12-17 09:00:24 -08:00
Adam Williamson
61bd4cb310 Update GNOME printing_check_sentence needle
Font rendering changed a bit again.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-12-16 09:42:18 -08:00
Adam Williamson
1f757325a6 Reduce login_cockpit needle match area
There seem to be some weird shenanigans going on with the pipe
bit here (it looks different on different test runs? what?) so
let's just match on the plain grey area. Should still be enough.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-12-15 16:52:35 -08:00
Adam Williamson
dc86780a13 Update Cockpit FreeIPA "join complete" needle for new domain
Left this out of previous commit, oops.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-12-15 14:45:02 -08:00
Adam Williamson
0de57180ee Update cockpit needles and autoupdate test for 234
Auto-update time is shown as '6:00' not '06:00' now, so trim the
needle to match both.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-12-15 11:20:43 -08:00
Adam Williamson
2b12be440e Drop match threshold on KDE update detected needle
Got a 95% match in
https://openqa.fedoraproject.org/tests/736374#step/desktop_update_graphical/26

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-12-07 09:33:04 -08:00
Adam Williamson
d065974cc6 apps_run_terminal: match window area too
Just matching the Overview entry isn't really enough, the app
hasn't really run yet. This makes the test more robust and also
helps out on aarch64 desktop tests where the app window takes a
long time to appear.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-12-04 11:55:36 -08:00
Adam Williamson
a038423920 Add a workaround needle for Konsole running with wrong font
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-12-02 14:50:59 -08:00
Adam Williamson
387f8dd679 Update Arabic needles for some kind of font change
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-12-02 14:47:20 -08:00
Adam Williamson
f88fde4a73 Verbose boot_enter_passphrase needle for current IoT state
Currently we get the prompt, but buried in a bunch of other text.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-12-02 14:43:35 -08:00
Lukáš Růžička
5718c7f1d4 Add an installation test using LVM partitioning as asset for resize tests.
When Fedora went to BTRFS as a default, we lost the LVM based image to
run LVM resize tests with.

This PR introduces the `install_lvm.pm` installation test that creates
an LVM based qcow2 image to be used by follow-up tests.
2020-11-26 09:55:19 +01:00
Adam Williamson
4f30b59077 Add workaround needles for KDE printing test
Styling on the KDE base disk image seems to have gone wrong
again, which throws this test off. We need to figure out what's
gone wrong in the base image, but it's a Friday night and I don't
want the test failing all weekend, and there's nothing wrong in
the *test itself*, so let's create some workaround needles and
figure it out next week.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-11-20 20:06:33 -08:00
Adam Williamson
9df165c1a9 Yet another variant of the KDE printing check sentence needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-11-18 13:59:27 -08:00
Adam Williamson
7c31adbf7c Update KDE package update needles
Seems KDE changed the tool that installs updates again. New
needles for new tools!

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-11-18 12:17:19 -08:00
Adam Williamson
762f259333 Drop match level of a KDE notifcations needle
Sigh, transparency or something. See:
https://openqa.fedoraproject.org/tests/723120#step/desktop_notifications/19

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-11-16 11:27:38 -08:00
Adam Williamson
649fcc51f1 Cockpit 232 fixes
Update a needle with slightly different text rendering, and add
a workaround to hit tab three times rather than once on entering
the "Join a domain" screen, see
https://github.com/cockpit-project/cockpit/issues/14895 .

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-11-11 12:55:42 -08:00
Adam Williamson
fde492aa5d Update a few desktop needles
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-11-10 13:00:46 -08:00
Adam Williamson
d2e6c11c7b Update GNOME printing sentence needle
Seems sometimes we now get the document at fit width, not fit
page.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-10-31 11:26:32 -07:00
Adam Williamson
f51a804357 Handle emergency console entry with no password
This happens on ARM disk images.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-10-28 15:21:03 -07:00
Adam Williamson
9be79d3dc7 Drop match level on KDE update detected needle
Got a 93% match at
https://openqa.fedoraproject.org/tests/708115#step/desktop_update_graphical/22

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-10-27 08:53:59 -07:00
Adam Williamson
d8f5d3fd0b Update several KDE needles for font rendering / button changes
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-10-26 12:38:08 -07:00
Adam Williamson
d20f64967c Update a couple of KDE needles
Font rendering change, or transparency, or some damn thing.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-10-23 23:07:10 -07:00
Adam Williamson
d3569dbf37 Update anaconda rescue select needle
"Rescue" was downcased to "rescue".

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-10-23 22:48:51 -07:00
Adam Williamson
0d8ceec820 Try to make desktop_browser more robust
We've been getting failures lately on the first page load, I
think because Firefox is getting even more grindy on startup. So
turn the 'sleep' into a 'wait_still_screen', extend another wait,
and tweak the 'browser' needle so it only matches after the
bookmark bar has loaded rather than as soon as half the chrome
appears. Also make all the wait_still_screens use similarity 45
for consistency (flashing cursor could be there on any of them).

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-10-23 09:48:09 -07:00
Adam Williamson
33c290d15a Remove now-unused desktop_network_notification needle
Dropped the use of this in the recent notification simplification,
but forgot to remove the needle. Should've run tox...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-10-15 15:36:37 -07:00
Adam Williamson
1c33d07d38 Drop workaround_ble26, bug was fixed months ago
https://pagure.io/background-logo-extension/issue/26 was fixed
months back, we don't need this any more.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-10-15 15:36:04 -07:00
Adam Williamson
a008ffb8be Simplify desktop notification checks (#195)
This is the best option I can come up with to deal with #195.
Update notifications seem to have become transient in KDE lately
(even in F31 and F32, if I'm looking at these screenshots right).
This actually simplifies things a lot to do more or less the
same in the KDE and GNOME paths: open the 'permanent' store of
notifications (in GNOME you get to it by clicking on the clock,
in KDE via the systray) and then look for no notifications (live
path) or only an update notification (post-install path). We
only run this test for composes so we shouldn't need to worry
about anything older than F32, and I believe this should work
for KDE in F32 and F33. I left out click_unwanted_notifications
for now as I'm hoping it should be unnecessary, but we can add
it back in if necessary.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-10-14 23:30:00 -07:00
Adam Williamson
656e1f6856 Add another F33 background needle
Yeesh, this background is fun.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-10-11 10:04:37 -07:00
Adam Williamson
da0b079686 Update KDE desktop no notifications needle
Probably changed with the background, darn translucency.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-10-09 18:06:19 -07:00
Adam Williamson
415dabd92e Update Firefox addon_install alt needle too (for F31)
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-10-09 17:53:22 -07:00
Adam Williamson
10f7e7a7d2 Update Firefox addon_install needle for 81.0.1
Seems to have changed.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-10-09 17:25:10 -07:00
Adam Williamson
92f5bf90c0 Update Krusader settings close needle
The button changed a bit.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-10-08 16:22:44 -07:00
Adam Williamson
40e07b487d Add another F33 background needle
For the transition between dawn and day. This is right in the
middle of it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-10-08 16:21:59 -07:00
Adam Williamson
40974c2f94 Simplify Krusader app test
We don't need a separate 'welcome' needle because it just matches
on an OK button anyway. So turn that needle into an OK needle
(we don't have any existing 'blue OK button' needle) and simplify
the logic to a single loop for kde_ok and krusader_settings_close.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-10-08 14:47:46 -07:00
Adam Williamson
5e5dbac636 Add updated cockpit_updates_reconnect needle
We only use this one rarely. Font rendering on it changed at
some point.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-10-07 14:42:26 -07:00
Adam Williamson
d2adecf03d Add some more updated F33 background needles
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-10-07 14:41:54 -07:00
Adam Williamson
36fd4c10b1 Correct tag for new kde_ok needle
It had krusader_settings_close as its tag, not kde_ok. That's
why the krusader test module was failing weirdly.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-10-07 14:39:08 -07:00
Adam Williamson
ea0dc63fc3 Add updated F33 day background needle
The backgrounds were tweaked so I get to take a bunch more
screenshots, fun fun fun.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-10-06 14:54:58 -07:00
Lukáš Růžička
b5a7b49f6e Correct the misconfigured needle from the previous commit and add a proper one. 2020-10-01 12:42:56 +02:00
Lukáš Růžička
3986984eb3 Fix needles for Krusader and Notifications. 2020-09-30 09:08:20 +02:00
Dan Čermák
3316e04d20
Update live_anaconda_icon KDE needle 2020-09-20 11:59:16 +02:00
Adam Williamson
fba3a3a290 Update Cheese and Videos app needles, icons changed
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-09-18 13:40:23 -07:00
Adam Williamson
f69e627dc3 Update some cockpit needles for version 228
They dropped Title Case from various things, some of which we
have needles for.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-09-16 12:27:54 -07:00
Adam Williamson
a2bbd5ecfb Add some needles for universal tests with btrfs default
The 'universal' tests have quite a few failures if you run them
on an image where btrfs is the default (currently they usually
run on the Server DVD, where xfs-on-LVM is still the default).
This fixes some of them, the others would need code fixes.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-09-11 16:20:12 -07:00
Adam Williamson
8e794a6c30 Update a Cockpit needle that changed in the latest release
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-09-03 15:13:54 -07:00
Adam Williamson
9ae60e4a1e Update GDM/GNOME keyboard layout needles
The down caret changed size, again...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-09-01 12:12:25 -07:00
Adam Williamson
461d9cc7b9 New getting started needle is language-agnostic
We're matching on the icon, so it should work for all languages.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-09-01 10:40:41 -07:00
Adam Williamson
041b8ca2fe Add F33 'dawn' background needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-08-31 13:30:20 -07:00
Adam Williamson
9a90a06328 Add new 'getting_started' needle for GNOME Tour
Replaces the old Yelp-based thing.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-08-31 12:43:56 -07:00
Adam Williamson
a5aa72da73 Remove new KDE log out entry needle again
Turns out we don't need it, the failed test was run before I
dropped the match level.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-08-25 17:00:31 -07:00
Adam Williamson
cbb817fd14 Add new KDE log out entry needle
Rawhide doesn't match the existing one even with the lowered
threshold, so whatever.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-08-25 16:43:20 -07:00
Adam Williamson
3c1c9f3436 Rename log_out_entry needles to be unique
Even though we have subdirs, we actually usually make needle
names unique across subdirs due to limitations of openQA's UI
upstream.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-08-25 16:42:46 -07:00
Adam Williamson
9d3ac55607 Update printing 'check sentence' needle for latest Rawhide KDE
Rendering seems to have changed/improved a bit.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-08-25 16:21:17 -07:00
Adam Williamson
09cd628f46 Add some more Firefox addon install needle variants
I have no idea why the rendering of this text keeps changing
slightly. Sigh.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-08-25 16:09:42 -07:00
Adam Williamson
0220334a57 Drop stray match area from cockpit_leftbar_scroll
That's not supposed to be there...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-08-25 16:08:51 -07:00
Adam Williamson
11320dad16 Add another F33 background needle
Oh animated wallpapers, how do we love thee

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-08-24 17:10:23 -07:00
Adam Williamson
b29b05a359 Drop match threshold on KDE log out entry needle
OK, reducing the match area didn't help. So let's drop the
threshold instead.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-08-24 12:53:52 -07:00
Adam Williamson
d87d61df4d Update Zezere submit provision request needle
Dunno what changed.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-08-24 12:50:40 -07:00
Adam Williamson
86c881db80 Add IoT version "34" needles
IoT is still versioning its 'rawhide' composes, so here.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-08-24 12:49:56 -07:00
Adam Williamson
82ebfe37f0 Tighten KDE log_out_entry area
See if this helps it match more reliably.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-08-24 12:43:00 -07:00
Adam Williamson
d35d57a8e8 Add first couple of F33 background needles
Oh how I love animated backgrounds. Grrr

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-08-21 14:03:20 -07:00
Alexander Bokovoy
5713631a9c Update password change needle and code to FreeIPA 4.8.9
OTP field was moved into the last position in the password change dialog
to prevent issues with OTP code expiring while users enter their
passwords.

Signed-off-by: Alexander Bokovoy <abokovoy@redhat.com>
2020-08-21 18:05:33 +03:00
Adam Williamson
b117d16133 Update GNOME Calculator app needle
Icon no longer has labels on the calculator buttons.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-08-18 17:04:20 -07:00
Adam Williamson
2713ce60dd Add a new not-really-a-Next-button needle for gnome-initial-setup
In g-i-s 3.37.91, the first screen has a 'Start Setup' button
rather than a 'Next' button. Easiest thing for us to do here is
just to add a new needle which has the 'next_button' tag even
though it's clearly not a 'Next' button, because then the code
still works :) So do that, but give the file a suggestive name
and explain the situation in a code comment.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-08-18 12:23:09 -07:00
Adam Williamson
041d04d2d1 Update desktop update notification KDE needle
Seems to have changed a little in recent F33/Rawhide.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-08-17 17:40:51 -07:00
Adam Williamson
837f8e88cf Add 33 version ident needle (non-IoT)
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-08-17 17:37:26 -07:00
Adam Williamson
7682872d95 desktop_login: update reboot flow for GNOME changes in F33+
GNOME now also splits 'Restart...' and 'Power Off...' as KDE
does, so we need to tweak the conditional and add some needles.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-08-17 16:25:32 -07:00
Adam Williamson
7ada6952b4 Update a user_logged_in needle (match dropped to 95%)
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-08-06 12:25:07 -07:00
Adam Williamson
aa41fe4e4e Automate QA:Testcase_Zezere_Ignition
This is a bit complex to automate, because we cannot really use
the production Zezere server (provision.fedoraproject.org) as
the test case shows, as we'd have to solve authentication and
we also don't really want to constantly keep registering new
hosts to it that are going to disappear and never be seen again.

So, instead we'll do it by setting up our *own* Zezere, and
provisioning our IoT system in that. We run two tests. The
'ignition' test is the actual IoT 'device'; all it really does
is boot up, sit around, and wait to be provisioned. The 'server'
test first sets up a Zezere server, then logs into it, adds an
ssh key, claims the IoT device, provisions it, and connects to
it to create a special file which tells the 'ignition' test
everything worked and it can close out.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-07-23 18:01:06 -07:00
Adam Williamson
078e3f212e Update Cockpit domain needles for Cockpit 224
Some font changes or something.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-07-22 18:32:05 -07:00
Adam Williamson
0f072d973a Update anaconda network spoke IPv4 needle for GTK+ change
See https://gitlab.gnome.org/GNOME/gtk/-/issues/2652 . I thought
this was a bug at first but apparently not...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-07-22 12:45:08 -07:00
Adam Williamson
24d0e760f5 Drop workaround needles for RHBZ #1854225
It got fixed by reverting the fontawesome version bump.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-07-10 18:39:33 -07:00
Adam Williamson
160602d8af Update a bunch of GNOME app test needles for latest Shell
Latest Shell changes how the icons look a bit, again.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-07-09 16:24:29 -07:00
Adam Williamson
a20730bd0d Add overview search box Japanese needle for input test
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-07-09 16:22:40 -07:00
Adam Williamson
4ed2f90f32 Tweak overview_search_box needle so click hits right spot
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-07-08 17:15:58 -07:00
Adam Williamson
2f93645a55 Workaround GNOME overview search box not active bug
See https://pagure.io/background-logo-extension/issue/26 - in
current Rawhide, the search box in the overview is not active
when the overview is opened, so you can't just open the
overview and type, you have to click it first.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-07-08 17:07:48 -07:00
Adam Williamson
fe8f4ce482 Add a bunch of workaround needles for FreeIPA web UI (#1854225)
See https://bugzilla.redhat.com/show_bug.cgi?id=1854225 . A new
fontawesome release broke nearly all font-based interface
elements in the FreeIPA web UI, which breaks several of our
needles. This adds workaround needles for each one (plus a couple
of non-workaround needles for cases which don't seem to be the
icon bug, but somehow changed anyway).

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-07-06 13:56:27 -07:00
Adam Williamson
e6811cabba Add a workaround needle necessary for Clevis test
Missed it from last commit, whoops. This deals with
https://pagure.io/fedora-iot/issue/30 .

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-07-02 17:06:12 -07:00
Dan Čermák
9768ac5178
Fix the install_lang_english_filtered needle for non en_US lang 2020-06-25 23:45:02 +02:00
Adam Williamson
aa67975926 Update KDE no notifications needle
Text changed a bit.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-06-24 15:27:56 -07:00
Adam Williamson
cc589a5fcd Add variant login_permission_denied needle
In some recent tests the text is rendered slightly differently
for some reason. Not sure why, but I don't see a problem with
just adding a variant needle.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-06-17 17:40:02 -07:00
Adam Williamson
6fece568c7 Add variant bootloader needle for LCC-built images
Recent live respins were built with livecd-creator rather than
livemedia-creator because the maintainer had trouble with LMC.
This results in grub looking a bit different, we need a variant
needle for it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-06-17 17:39:33 -07:00
Adam Williamson
0cea4b1cd5 Update Screenshot app needle
Button turned blue!

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-06-17 17:34:43 -07:00
Adam Williamson
87af7d4ecd Update GNOME app needles for GNOME 3.37.2
Not sure if the needles changed or just the way they're rendered
in the overview, but either way, we need to update a bunch.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-06-05 16:07:25 -07:00
Adam Williamson
7b703c91e1 Update FreeIPA webUI user needle
Not sure what changed here, but hey.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-06-05 14:31:07 -07:00
Adam Williamson
2e21161785 Update various needles for a GNOME symbol change
The little triangle that's used on drop-down menus and stuff got
bigger. That breaks all these needles.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-06-05 14:27:34 -07:00
Adam Williamson
7fe5525c29 Drop unnecessary system menu match from apps_menu_button
This goes back to when we called this needle desktop_clean, but
there's really no point in having it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-06-05 11:22:16 -07:00
Adam Williamson
a58ca4676d Update one more needle for new cockpit
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-05-30 14:18:12 -07:00
Adam Williamson
2e21cfac15 Update cockpit needles and select_cockpit_update for 220
In Cockpit 220, the Updates entry is off the bottom of the screen
so we need to scroll the left bar down before we can click it.
Also update some other needles.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-05-30 10:27:20 -07:00
Lukáš Růžička
ce584750b4 Create test for IoT Greenboot.
Finish test and add necessary needles.

Create IOT needle directory and move needles in it.

Delete needle as required by the review.

Add to templates.
2020-05-29 16:25:46 +00:00
Lukáš Růžička
b5169e602b Use existing needles for fs selection. 2020-05-27 15:54:10 -07:00
Lukáš Růžička
d8171958ed Rename needle to correct typo. 2020-05-27 15:54:10 -07:00
Lukáš Růžička
c9bc7f0570 Rename needles to match the tag. 2020-05-27 15:54:10 -07:00
Lukáš Růžička
2a3e67991b Whitelist not recognized needles in check-needles.py 2020-05-27 15:54:09 -07:00
Lukáš Růžička
5f1db40ebe Add to templates. 2020-05-27 15:54:09 -07:00
Lukáš Růžička
c42f62da14 Create a test for resizing using custom partitioning 2020-05-27 15:54:09 -07:00
Lukáš Růžička
9efb0e10e6 Create a test to resize LVM partitions using Blivet. 2020-05-27 15:54:09 -07:00
Adam Williamson
3c44f644a0 Reduce system_menu_button match area not to include background
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-05-11 16:07:18 -07:00
Adam Williamson
ac602d43b7 Update Japanese 'install done' needle
The button is translated now.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-05-09 10:33:00 -07:00
Adam Williamson
c7031448ec Update Cockpit 'main screen' needle
It seems like sometimes the machine ID is off the bottom of the
screen now, so let's just match on the section title instead.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-05-04 17:24:31 -07:00
Lukáš Růžička
61f845dbbf Make solidify_wallpaper more universal to handle different desktops. 2020-05-05 00:14:35 +00:00
Adam Williamson
0594fc8d57 Update French user creation screen needle for translation change
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-05-01 16:48:21 -07:00
Adam Williamson
9bad775aae Update a blivet needle for a change to check mark design
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-04-29 12:19:39 -07:00
Adam Williamson
664d5d559f Update cockpit 'services entry' needle for new release
Unfortunately only the entry name is clickable now so we can't
have a 'generic' needle that'll work for any service.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-04-29 12:16:26 -07:00
Adam Williamson
83a394bba2 Update a Boxes needle for a font rendering change
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-04-27 15:06:14 -07:00
Adam Williamson
3e5e1104b7 Update a bunch of KDE needles for Rawhide font change
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-04-27 15:06:09 -07:00
Lukáš Růžička
fd3e4e3280 Change the order of steps and add another check screen.
Since GDM shows the "system-menu-button", it could not correctly
switch users on a locked screen. I added a check to see
if we are on a locked screen and behave accordingly.
2020-04-22 21:52:19 +02:00
Adam Williamson
23904d71b2 Update French apps menu button, remove extra match areas
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-04-18 14:59:14 -07:00
Lukáš Růžička
f3d6a9574c Add desktop login test, revise and rename check_desktop
This adds a new test that implementsQA:Testcase_desktop_login
on both GNOME and KDE.

While working on this, we realized that the "desktop_clean"
needles were really "app menu" needles, and for KDE, this was
a duplication with the new "system menu" needles, because on KDE
the app menu and the system menu are the same. So I (Adam)
started to de-duplicate that, but also realized that "app menu
button" is a much more accurate name for these needles, so I was
renaming the old desktop_clean needles to app_menu_button. That
led me to the realization that "check_desktop_clean" is itself a
dumb name, because we don't (at least, any more, way back in the
mists of time we may have done) do anything to check that the
desktop is "clean" - we're really just asserting that we're at a
desktop *at all*. While thinking *that* through, I *also* realized
that the whole "open the overview and look for the app grid icon"
workaround it did is no longer necessary, because GNOME doesn't
use a translucent top bar any more. That went away in GNOME 3.32,
which is in Fedora 30, our oldest supported release.

So I threw that away, renamed the function "check_desktop",
cleaned up all the needle naming and tagging, and also added an
app menu needle for GNOME in Japanese because we were missing
one (the Japanese tests have been using the "app grid icon"
workaround the whole time).
2020-04-17 17:27:04 -07:00
Adam Williamson
49c8d46744 Update some Cockpit button needles for 217
Seems like text rendering on buttons changed a bit.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-04-15 11:40:45 -07:00
Adam Williamson
c914b1ad88 Update F32 background needles
This adds a needle for the 'day' background from 32.1.1, which
is the non-animated default, and renames the needle for the
background from 32.0.0 to 'old' as it's no longer present at all
in the new build. Depending on whether animation actually works
after the update we may later need to add needles for the other
images plus possibly some transition needles too. Sigh.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-04-15 11:39:04 -07:00
Adam Williamson
417b876ead Add F31 variant Terminal app run needle
Needed for F31 respin tests.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-04-14 12:12:57 -07:00
Adam Williamson
19677de20a Add variant anaconda keyboard layout needles
There's this weird thing where the vertical alignment of the
language name in the keyboard layout indicator is sometimes
different. I never can figure out why. It may be to do with
presence or absence of the pre-release indicator.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-04-14 12:07:06 -07:00
Adam Williamson
610572f8a0 Add new variant SDDM input needle
Looks like a kerning difference or something.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-04-14 12:05:33 -07:00
Adam Williamson
21eea18562 Add a needle check script, remove some unused needles
I call this...The @lruzicka Catcher!

It's a script that checks for needles that aren't actually used
anywhere. It also checks for cases where we have a needle JSON
file but no image, or an image file but no JSON file (and wipes
one case of the latter). It also adds a run of the script to tox
so we get it in CI.

You could make this script a lot more elaborate if you like, by
being fancier about parsing the test code and templates, but I
don't think it's really warranted, I think it just needs to be
'good enough'. It's not the end of the world if it misses the
odd thing or the whitelisting goes stale.

Quite a lot of the removed needles are remnants of different
approaches to app start/stop testing which weren't caught in the
initial PR review. The short-name partitioning ones are odd; they
were introduced in the commit that moved needles into subdirs,
but at least some of them don't actually appear to be moves. They
may have been non-tracked files Josef had lying around that got
into the commit by mistake, or they may just be old needles we
really used at some point but aren't using any more.
reclaim_space_second_partition was introduced as part of the
shrink test (along with reclaim_space_first_partition) but was
never actually used by that test - I guess, again, the test got
re-written during review but we forgot to remove the needle. We
rejigged user creation to use tab presses not a needle match a
while back, which made user_creation_password_input unnecessary.
The various cockpit_updates_* needles are I think remnants of
rewrites of the cockpit update tests that again were missed in
PR review, the tests as merged never used them.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-04-08 16:55:46 -07:00
Adam Williamson
8b5be61971 Update a few GNOME app needles that seem to have changed
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-04-02 20:27:01 -07:00
Adam Williamson
ea397783d5 Update French 'accept fate' needle
Verb changed.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-04-02 20:17:42 -07:00
Adam Williamson
6b5e933ff4 Update error_report needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-04-02 20:16:02 -07:00
Lukáš Růžička
a54f020118 Revert "Fix the Konqueror test - handle Locations dialogue."
This reverts commit d784bf54ca.

It turned out that Locations are not connected to Konqueror
at all. The reason why the test is failing is that the
application has been removed to limit the number of
web browsers.
2020-03-31 09:23:13 +02:00
Lukáš Růžička
d784bf54ca Fix the Konqueror test - handle Locations dialogue. 2020-03-26 10:57:00 +01:00
Adam Williamson
dc7b7a7241 Great Needle Cleanup 2020
Remove a bunch of needles that have not been used for some time,
plus a few workarounds that are similarly stale.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-03-20 14:02:10 -07:00
Adam Williamson
e2df109539 Update cockpit_updates_check needle
Button changed a bit (likely Patternfly 4 changes).

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-03-18 12:21:18 -07:00
Adam Williamson
c18a0d5008 Update cockpit 'updated' needle (check mark got thinner)
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-03-18 11:57:33 -07:00
Lukáš Růžička
d19cf9553e Reneedle the Gnome Application StartStop tests. 2020-03-18 18:06:34 +01:00
Adam Williamson
608209499d Add Fedora 33 IoT ident needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-03-16 14:17:31 -07:00
Adam Williamson
30f5eae3ac Add another kernelorg_patch needle
I think what happens here is the kerning and/or subpixel hinting
changes depending on the column position, and the column position
keeps changing as upstream releases new versions on different
dates and stuff. Hopefully eventually we'll have enough needles
to cover all possibilities...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-03-13 14:08:05 -07:00
Adam Williamson
ff1d75050e Update French pre-release note needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-03-12 09:19:04 -07:00
Adam Williamson
948e5f23ae Add missing tags to Russian prerelease note needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-03-12 08:50:05 -07:00
Lukáš Růžička
0557af9a2d Add needle to cover a changed prerelease note for Russian. 2020-03-12 16:17:28 +01:00
Adam Williamson
00f1241318 Update French 'install done' needle
Translation was updated.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-03-10 16:04:45 -07:00
Adam Williamson
513f0a23f4 Add F32 background needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-03-06 15:33:15 -08:00
Adam Williamson
e5feab11f7 Update iSCSI-related needles for font changes
This test has been failing forever, now the bug is fixed, we need
to update the needles for font changes...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-03-04 09:15:00 -08:00
Adam Williamson
884f71bb81 Revert "Workaround #1805553 (single disk not selected as install target)"
This reverts commit adf3f91818.
The bug has been fixed in anaconda, so we can drop this, which
is good as it has timing issues producing false positives on
Rawhide...
2020-02-26 14:30:08 -08:00
Adam Williamson
2c236ef16a Update GNOME Software 'Download' needle for changed kerning
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-02-26 11:34:21 -08:00
Adam Williamson
95e6ddc896 Update blivet vdb selected needle yet again
I do not know why this needle seems so troublesome...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-02-25 23:02:29 -08:00
Adam Williamson
da28938572 Update prerelease note needle for font rendering change
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-02-25 22:59:14 -08:00
Adam Williamson
adf3f91818 Workaround #1805553 (single disk not selected as install target)
Rawhide seems to have developed a bug where a single disk is no
longer automatically selected as the install target when you
enter the INSTALLATION DESTINATION spoke. We need to work around
this (but register it as a soft failure).

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-02-20 17:41:34 -08:00
Adam Williamson
54afe23572 Update an iSCSI needle for font changes
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-02-20 12:14:35 -08:00
Adam Williamson
18c818da7d Update overview app grid needle (more GNOME icon changes)
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-02-20 09:57:04 -08:00
Adam Williamson
5300c35106 Update desktop update notification only needle
More GNOME icon changes.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-02-20 09:53:30 -08:00
Adam Williamson
deab03a80d Update another partitioning needle for GTK+ widget changes
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-02-20 08:12:16 -08:00
Adam Williamson
2c33325595 Add IoT 32 identification needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-02-20 08:11:52 -08:00
Adam Williamson
7fd23dacea Update GDM input needles for non-English languages
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-02-19 10:37:51 -08:00
Adam Williamson
8d14addd18 Update two more anaconda needles for smaller radio buttons
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-02-19 10:36:59 -08:00
Adam Williamson
9f331dbbe3 Update authentication required GNOME needle
They took away the icon, so now we can only match on text :(

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-02-19 10:35:47 -08:00
Adam Williamson
2466cf53bd Update Firefox launcher needle
Looks like GNOME is rendering it a bit smaller now.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-02-19 10:35:06 -08:00
Adam Williamson
dde0113fb1 Update KDE 'no notifications' needle
Probably a transparency thing.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-02-19 09:47:36 -08:00
Adam Williamson
f7a9625b55 Update GDM input needle
GNOME reworked this widget a bit.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-02-19 09:47:13 -08:00
Adam Williamson
2fda57482b Update anaconda needles for icon/widget changes
Seems some changes to symbolic icons and widgets have happened
in GTK+ or something, this updates anaconda needles for them.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-02-19 09:46:35 -08:00
Adam Williamson
0f8f6082eb Enable IoT testing with install and base tests
IoT is becoming a release-blocking edition for F32, so we should
be testing it for sure. We may add specific tests, but for now
let's run the install and base tests on it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-02-17 08:36:55 -08:00
Adam Williamson
b09936ba0a Update 'select_disk_1' needle
Some kinda font rendering change or something.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-02-17 08:33:57 -08:00
Adam Williamson
e5728beada Add version 32 identification needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-02-14 16:53:31 -08:00
Adam Williamson
80ddb89f91 Fix firefox addon_success needle
I updated this last month without looking closely enough; one of
the matches was bogus. We now don't seem to get the 'added to
Firefox' popup any more, so we can't match on it, but I guess we
can match on the 'remove' button as an indicator that the add
worked.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-02-07 12:10:21 -08:00
Adam Williamson
80c54d5491 Add cockpit_updates and remote_logging tests to updates
Again, no reason not to run these on updates. Includes adding
oldcantarell versions of several needles for current cockpit,
as they're needed for the tests to pass. Also tweak a couple of
needles to avoid false matches (add more empty space).

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-01-24 21:03:41 +01:00
Adam Williamson
12b0fb04dc Update a ppc64le-only blivet needle for Cantarell 0.201
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-01-24 15:20:54 +01:00
Adam Williamson
776d31bd5b Update various Cockpit needles for 211
Note we need two variants of most of these, one for Rawhide with
Cantarell 0.201, one for F30/F31 with Cantarell 0.111.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-01-24 15:18:27 +01:00
Adam Williamson
f11a57f01a Drop match level on cockpit main needle
New cockpit hits 95%, let's just drop the required %age rather
than make a new needle.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-01-24 12:53:14 +01:00
Adam Williamson
c922226d7c Add a variant Cockpit join_complete needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-01-20 13:36:58 +01:00
Adam Williamson
49a540cc3d Update addon_success needle for new Firefox
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-01-20 13:36:28 +01:00
Adam Williamson
f8292bfeeb More Cantarell: Russian and French
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-01-18 23:56:11 +00:00
Adam Williamson
a653ded877 Next batch of Cantarell needles: Arabic install
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-01-17 15:32:30 +00:00
Adam Williamson
28642f4002 Move a stray app needle to the right place
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-01-17 15:19:17 +00:00
Adam Williamson
8612858b1f Second batch of Cantarell needles: GNOME apps tests
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-01-17 15:18:50 +00:00
Adam Williamson
21febe3592 First batch of updates for new version of cantarell
Still need to do the non-English languages. I'll do those
tomorrow.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-01-17 01:18:52 +00:00
Adam Williamson
13da4f2d26 Add another new Cockpit join complete needle
This one from ppc64le test. The difference between all the
recent needles here is the amount of white space between the
'Domain' and 'domain.local'. I don't want to change it to two
match areas as there's a chance we may get a false positive
match when the join actually failed (it may match on 'Domain'
in the right place, and 'domain.local' somewhere else just as
part of the system's hostname). I suppose if this keeps happening
we could try two match areas but include some white space to the
left of 'domain.local' to avoid matching on it as part of the
hostname...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-01-15 15:22:34 +00:00
Adam Williamson
1e025c0b27 Tweak cockpit main needle to work on ppc64 too
We don't get a CPU model on ppc64, we get a machine ID everywhere
(I hope).

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-01-15 12:16:33 +00:00
Adam Williamson
35c863a312 Lower match level on another kernel.org patch needle
We're now getting 91-92% matches on this older needle.
¯\_(ツ)_/¯

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-01-10 08:25:55 -08:00
Adam Williamson
aa0edd263b Update Cockpit 'realm join complete' needle for new cockpit
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-01-08 17:28:49 -08:00
Adam Williamson
3998e9c86c Drop the 'cockpit join progress' needle match
The text we used to get has been replaced with a spinner, which
is difficult and unreliable to match on. This match was only
here to make the test fail a bit faster if it was broken, so
let's just live without it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-01-08 15:32:29 -08:00
Adam Williamson
e3430e82ef Update Rhythmbox app needle
The icon changed, so the needle needs changing.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-01-06 12:32:44 -08:00
Adam Williamson
766d5f163e Update GDM input needles (an icon appeared in the text entry)
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-01-06 10:57:53 -08:00
Adam Williamson
acf27fcd4a Update the blivet 'bluebox-alt' needle used on alt arches
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-01-06 10:56:44 -08:00
Adam Williamson
7234729949 Drop use of logs_severity needle from Cockpit test entirely
This match keeps giving us problems, and now I look at the test
again, there is actually no need for it at all. Clicking it
doesn't do anything, and we already confirm that we're on the
right page at the next step, where we look for a log entry and
click on that - that will fail if we aren't actually on the
Logs page.

I don't remember what Cockpit used to look like when we first
put this line and needle in, presumably there's a reason we had
them, but they're clearly unnecessary now.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-01-03 09:27:48 -08:00
Adam Williamson
5be282c744 Drop cockpit_logs_severity match requirement again
I am so freaking pissed off with these bizarre 'not quite'
matches, what the hell is Firefox doing

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-12-20 09:04:52 -08:00
Adam Williamson
a88d7b701e Add another Cockpit realm join complete button
Whitespace changed, sigh...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-12-18 23:21:15 -08:00
Adam Williamson
f9f2d08263 Add new cockpit autoupdate on needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-12-18 12:36:57 -08:00
Adam Williamson
237cdee4b2 Tweak Cockpit log severity needles
Sigh, I don't know why we're having so much trouble with fonts
in browsers lately. Drop the match requirement on the needles
that have been matching or nearly matching the most, and remove
older ones that aren't matching.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-12-18 10:51:47 -08:00
Adam Williamson
beba6426b1 Update realmd_join_cockpit for Cockpit 209
We need a couple of new needles, plus the 'join domain' button
has disappeared from the front page due to the very inefficient
UI redesign, so we need to scroll down to find it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-12-14 12:29:00 -08:00
Adam Williamson
5d59834a36 Drop kernel.org path needle match level again (to 90)
Man, I have had it with these needles.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-12-14 09:24:15 -08:00
Adam Williamson
5692692610 Add new cockpit_main needle for cockpit 209
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-12-13 17:55:06 -08:00
Adam Williamson
fa062bd9bb Tweak kernel.org patch needles again
This is getting annoying. We're getting, like, 94-95% matches
for the recent needles sometimes. Instead of continuing to make
more and more needles, let's try dropping the required match
threshold a bit. The kde-20191206 needle doesn't *seem* to be
needed so let's get rid of it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-12-13 17:18:51 -08:00
Adam Williamson
30a2b68974 Add some variant printing needles for F30
Printer icon is different, final output looks a bit different.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-12-06 17:28:27 -08:00
Adam Williamson
485a24b3ee Yet another cockpit logs_severity needle
I don't know why this is causing so much trouble...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-12-06 11:54:29 -08:00
Adam Williamson
629c67e1f5 Whoops, add missing area to akonadi notification needle
Needed for the click to actually dismiss the notification.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-12-06 10:07:40 -08:00
Adam Williamson
c8672f3b48 Widen match area in FreeIPA add button needle
Otherwise we can get a problematic match on 'Add and Add Another'

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-12-06 09:40:51 -08:00
Adam Williamson
a9f1591c32 Another kernel.org patch needle
This is for KDE. KDE and GNOME have different font rendering,
and they both look slightly different between a few days ago
and today, I think because of a change to the width of the
columns on the page itself.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-12-06 09:37:15 -08:00
Adam Williamson
e684fed622 Add missing akonadi notification needle
I must've forgotten to include this in the commit.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-12-06 09:34:41 -08:00
Adam Williamson
44ad6a5068 Add yet another kernel.org patch browser needle
Slight font rendering changes from the last GNOME version of
this needle, not sure if there's actually a font library change
or it's just hinting changes caused by the column being a bit
further right than before...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-12-06 09:27:07 -08:00
Lukáš Růžička
77ae127cce Create an automated test to test printing on Desktop
Add functions to test on KDE, too.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-12-05 09:22:50 -08:00
Adam Williamson
f4ca51e508 Update a few Firefox needles again
Seems the latest Firefox builds in F30 and F31 updates render
fonts a little differently again, not sure why this is.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-12-04 09:42:02 -08:00
Adam Williamson
52b34c2be0 Add another Firefox close tabs needle
Not sure what this vs. the one from two days is all about, but.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-11-29 13:45:17 -08:00
Adam Williamson
ee140358b7 Update akonadi migration agent needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-11-29 13:04:51 -08:00
Adam Williamson
7fbaa426e8 Update a bunch of needles for font rendering change in Rawhide
Not sure what changed; it seems like mostly browser needles got
broken, but there's a few installer needles too.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-11-29 13:00:54 -08:00
Adam Williamson
5c03c435ca Stop having two 'firefox close tabs' needle tags, drop old ones
We still have a 'apps_run_firefox_stop' needle tag which is for
the same thing as 'firefox_close_tabs'. That's dumb. Get rid of
it and only have the firefox_close_tabs tag and needles. Also
clean up some old firefox_close_tabs needles that haven't matched
for months and all the 'apps_run_firefox_stop' needles.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-11-29 12:10:35 -08:00
Adam Williamson
e7a7c053bd Update firefox_close_tabs needle
Seems to look different in a recent Rawhide test.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-11-27 11:08:44 -08:00
Adam Williamson
e8802935f9 Tweak text_console_login match area
On Rawhide Cloud_Base boots, there's some SSH key and network
information printed above the 'login:' prompt, so we can't
expect empty space there. Also tweak console_login() to clear
the screen after logging in, so the login prompt is cleared and
doesn't confuse things on subsequent runs (like it did first
time we tried this). And add a new user logged in needle, as it
seems after we clear the screen the tilde appears in a slightly
different position and the existing needle doesn't match.

https://openqa.fedoraproject.org/tests/489003#step/_console_wait_login/7

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-11-27 10:39:29 -08:00
Adam Williamson
411f0d34e7 Revert "Tweak text_console_login match area"
This reverts commit f66f510832.
Turns out this breaks lots of stuff, so it needs to go back.
I'll have to figure another way to handle the cloud login.
2019-11-27 08:36:35 -08:00
Adam Williamson
f66f510832 Tweak text_console_login match area
On Rawhide Cloud_Base boots, there's some SSH key and network
information printed above the 'login:' prompt, so we can't
expect empty space there. Let's just hope not looking for the
empty space doesn't break anything else.

https://openqa.fedoraproject.org/tests/489003#step/_console_wait_login/7

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-11-26 08:26:27 -08:00