Commit Graph

55 Commits

Author SHA1 Message Date
Adam Williamson
7d14da3746 Bring back the older Evince 'rotate' needle
Current Silverblue still has it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-29 12:10:31 -07:00
Adam Williamson
5b1d3517fe Open Documents folder on Silverblue
The open dialog on Silverblue (which is apparently not at all
the same thing as the open dialog on Workstation, though they
look the same) does not default to the Documents folder, so we
have to open it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-29 12:09:34 -07:00
Adam Williamson
5905546f6e Update Evince needles
These all failed to match first time the test was run in
production. I guess Lukas was working from an older release.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-29 11:46:32 -07:00
Lukáš Růžička
e0d9409c74 Create a test suite for Evince.
This PR fixes issue . It adds a test suite to test basic
functionality of Evince and brings the following features:

* test scripts for various Evince functions.
* needles to support the Evince test scripts
* new template variables `TESTPATH` and `POSTINSTALL_LOAD_ALL` (see
  below)
* new logic in `main.py` (see below)

The new variables and the new logic make it easier to create test
suites for post-installation tests. If TESTPATH is used, OpenQA
will take all tests mentioned in POSTINSTALL from that specified
TESTPATH. If both TESTPATH and POSTINSTALL_LOAD_ALL are used, then
OpenQA will run all tests it can find at the TESTPATH location.
If POSTINSTALL and POSTINSTALL_LOAD_ALL are set simultaneously,
then only POSTINSTALL will be taken into account and OpenQA will
only load tests mentioned there.
2021-07-28 08:58:23 +02:00
Adam Williamson
2a7787c1da Update lots of needles for os-autoinst behaviour change
Recent git os-autoinst no longer downsamples screenshots as far
as it did before comparison. This makes a lot of needles where
colors have changed slightly no longer match, so they all needed
updating.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-19 13:03:11 -07:00
Adam Williamson
1b28976f49 Update several GNOME app test needles
Not sure why these changed, but oh well. Utilities menu was
highlighted in a test run for some reason, so let's just handle
that. Other needles changed very slightly.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-05-14 14:26:10 -07:00
Adam Williamson
de87c3f28e Update gedit needle for recent change
It now calls new files "Untitled File", not "Untitled Document".

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-04-01 15:46:34 -07:00
Adam Williamson
29f75788e9 Update a bunch of GNOME app needles for GNOME 40 final
Some apps moved around, others the needles stopped matching for
some reason, some kind of slight scale change or something.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-03-24 18:36:38 -07:00
Adam Williamson
ac9edb4cfb GNOME apps: drop Archiver test
The app was dropped from Workstation's default package set a few
days ago. See:
https://pagure.io/fedora-workstation/issue/167

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-03-05 18:25:29 -08:00
Adam Williamson
51341dc2ff Update several GNOME app needles for overview change
The icons in the dash got a bit smaller again, so all these
needles need updating.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-03-03 18:59:16 -08:00
Adam Williamson
6658740b2a Update the GNOME app run test needles for GNOME 40
Overview changed a lot, so all these needles need updating.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-02-22 17:04:22 -08:00
Adam Williamson
aebabc706e Update some GNOME-related needles for changes in GNOME 40
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-02-04 14:06:11 -08:00
Adam Williamson
179ab45bca Update various needles for GNOME down caret changing a bit
This affected apps_run_terminal and a ton of layout needles.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-01-25 16:27:39 -08:00
Adam Williamson
d065974cc6 apps_run_terminal: match window area too
Just matching the Overview entry isn't really enough, the app
hasn't really run yet. This makes the test more robust and also
helps out on aarch64 desktop tests where the app window takes a
long time to appear.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-12-04 11:55:36 -08:00
Adam Williamson
fde492aa5d Update a few desktop needles
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-11-10 13:00:46 -08:00
Adam Williamson
fba3a3a290 Update Cheese and Videos app needles, icons changed
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-09-18 13:40:23 -07:00
Adam Williamson
b117d16133 Update GNOME Calculator app needle
Icon no longer has labels on the calculator buttons.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-08-18 17:04:20 -07:00
Adam Williamson
160602d8af Update a bunch of GNOME app test needles for latest Shell
Latest Shell changes how the icons look a bit, again.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-07-09 16:24:29 -07:00
Adam Williamson
0cea4b1cd5 Update Screenshot app needle
Button turned blue!

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-06-17 17:34:43 -07:00
Adam Williamson
87af7d4ecd Update GNOME app needles for GNOME 3.37.2
Not sure if the needles changed or just the way they're rendered
in the overview, but either way, we need to update a bunch.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-06-05 16:07:25 -07:00
Adam Williamson
2e21161785 Update various needles for a GNOME symbol change
The little triangle that's used on drop-down menus and stuff got
bigger. That breaks all these needles.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-06-05 14:27:34 -07:00
Adam Williamson
417b876ead Add F31 variant Terminal app run needle
Needed for F31 respin tests.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-04-14 12:12:57 -07:00
Adam Williamson
21eea18562 Add a needle check script, remove some unused needles
I call this...The @lruzicka Catcher!

It's a script that checks for needles that aren't actually used
anywhere. It also checks for cases where we have a needle JSON
file but no image, or an image file but no JSON file (and wipes
one case of the latter). It also adds a run of the script to tox
so we get it in CI.

You could make this script a lot more elaborate if you like, by
being fancier about parsing the test code and templates, but I
don't think it's really warranted, I think it just needs to be
'good enough'. It's not the end of the world if it misses the
odd thing or the whitelisting goes stale.

Quite a lot of the removed needles are remnants of different
approaches to app start/stop testing which weren't caught in the
initial PR review. The short-name partitioning ones are odd; they
were introduced in the commit that moved needles into subdirs,
but at least some of them don't actually appear to be moves. They
may have been non-tracked files Josef had lying around that got
into the commit by mistake, or they may just be old needles we
really used at some point but aren't using any more.
reclaim_space_second_partition was introduced as part of the
shrink test (along with reclaim_space_first_partition) but was
never actually used by that test - I guess, again, the test got
re-written during review but we forgot to remove the needle. We
rejigged user creation to use tab presses not a needle match a
while back, which made user_creation_password_input unnecessary.
The various cockpit_updates_* needles are I think remnants of
rewrites of the cockpit update tests that again were missed in
PR review, the tests as merged never used them.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-04-08 16:55:46 -07:00
Adam Williamson
8b5be61971 Update a few GNOME app needles that seem to have changed
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-04-02 20:27:01 -07:00
Adam Williamson
dc7b7a7241 Great Needle Cleanup 2020
Remove a bunch of needles that have not been used for some time,
plus a few workarounds that are similarly stale.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-03-20 14:02:10 -07:00
Lukáš Růžička
d19cf9553e Reneedle the Gnome Application StartStop tests. 2020-03-18 18:06:34 +01:00
Adam Williamson
28642f4002 Move a stray app needle to the right place
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-01-17 15:19:17 +00:00
Adam Williamson
8612858b1f Second batch of Cantarell needles: GNOME apps tests
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-01-17 15:18:50 +00:00
Adam Williamson
e3430e82ef Update Rhythmbox app needle
The icon changed, so the needle needs changing.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-01-06 12:32:44 -08:00
Adam Williamson
5c03c435ca Stop having two 'firefox close tabs' needle tags, drop old ones
We still have a 'apps_run_firefox_stop' needle tag which is for
the same thing as 'firefox_close_tabs'. That's dumb. Get rid of
it and only have the firefox_close_tabs tag and needles. Also
clean up some old firefox_close_tabs needles that haven't matched
for months and all the 'apps_run_firefox_stop' needles.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-11-29 12:10:35 -08:00
Adam Williamson
4bb89046d3 Add one more updated GNOME app test needle
'Simple Scan' renamed itself.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-08-26 17:51:20 -07:00
Adam Williamson
28443abf04 Add new variants for GNOME app start/stop tests
Several apps changed icon.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-08-26 16:29:37 -07:00
Adam Williamson
be12f07900 GNOME apps: dismiss new LibreOffice 'tip of the day' if it shows
Also add a new needle for Impress startup.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-07-23 20:15:24 -07:00
Adam Williamson
bc2add845e Add the settings needle that provides the 'workspace' tag back
Removing this broke the GNOME apps test entirely because there
was no GNOME 'workspace' needle any more.

I don't like this needle much, we should probably use
check_desktop_clean or something instead. But for now let's just
put it back.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-06-25 14:16:11 -07:00
Adam Williamson
6656f1659d apps_activities is a dupe with overview_app_grid, kill it
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-06-25 14:01:39 -07:00
Lukas Ruzicka
9e3b16bfcf Change Settings test due to change functionality. 2019-06-21 14:54:18 +02:00
Lukas Ruzicka
868fca87b3 Add new needle for Simple Scan Menu item. 2019-06-21 11:33:12 +02:00
Adam Williamson
bad3263160 Update ABRT app launcher needle
Icon was changed.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-05-27 17:51:27 -07:00
Adam Williamson
d30714dbca Add a variant apps_stop needle for Firefox 66 without header
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-04-17 12:30:11 -07:00
Adam Williamson
e744cea358 Update GNOME apps needles for cheese and scan
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-04-16 18:46:31 -07:00
Lukas Ruzicka
9a2d9ea190 Create needles needed for firefox test to really work. 2019-03-28 14:18:51 +01:00
Adam Williamson
5a1a71c67f Use the existing 'oh hai this is firefox' needle for app tests
The KDE and GNOME 'apps' tests for Firefox both invented their
own 'oh look Firefox is running' needle, even though we already
had one. The GNOME one was broken by the removal of the app
title bar in Firefox 66.

Instead of having three needles for the same thing, let's just
throw the 'apps' ones out and use the pre-existing one from
needles/firefox for all cases.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-03-26 12:23:45 -07:00
Adam Williamson
26cdcb8d3c Add several new needles for changed GNOME app icons
Utilities came up different *again* in a Rawhide test today, so
this adds a needle which matches on the text. Usually we prefer
image matches to text, but this image seems to keep changing...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-03-20 12:21:55 -07:00
Adam Williamson
0365e2f18d Add another utilities needle variant
Dunno why we need yet *another*, but even the new one didn't
match on the most recent Branched compose. For now just add
another, we can look in a few weeks which can be thrown away.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-03-19 10:13:44 -07:00
Adam Williamson
1ed87382a9 abrt back under utilities, drop sundry
As of Fedora-30-20190316.n.1, gnome-abrt is back under the
Utilities menu and the 'Sundry' menu seems to have disappeared.
Change the test back to using utilities and drop the sundry
needle.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-03-19 10:11:32 -07:00
Lukas Ruzicka
bbb2ac06b8 Add new needle to cover changed utilities. 2019-03-18 15:27:44 +01:00
Adam Williamson
072333a0f7 Update needle for apps 'System Monitor'
Icon changed.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-02-25 11:30:19 -08:00
Lukas Ruzicka
690788f107 Reneedle the test suite
This is another take of needles to make the suite work again.
2019-02-21 12:29:36 +01:00
Lukas Ruzicka
1e8834825d Add new set of needles (first run)
These needles fix the test suite after the looks has been changed.
2019-02-20 15:52:38 +01:00
Lukas Ruzicka
be3aadc249 Change the target of the needle for Clocks in StartStop test
The needle could sometimes fail because the item it was looking
for only appeared in a limited set of situations. The new
location should be safer to check and the test should not
fail as a result.
2019-01-29 10:48:28 +01:00