Commit graph

358 commits

Author SHA1 Message Date
Lukas Ruzicka
be3aadc249 Change the target of the needle for Clocks in StartStop test
The needle could sometimes fail because the item it was looking
for only appeared in a limited set of situations. The new
location should be safer to check and the test should not
fail as a result.
2019-01-29 10:48:28 +01:00
Lukas Ruzicka
83ff7a0679 Delete Evolution needles.
Evolution has been removed from the default installation of Workstation
so the test is no more needed.
2019-01-28 14:54:58 +01:00
Lukas Ruzicka
4288041889 Use the current date instead f30 as a filename for new needles. 2019-01-28 14:53:59 +01:00
Lukas Ruzicka
e72a800fd1 Add new needles.
This commit adds new needles to reflect the changes which
have been made to the Desktop. It also now FIXES #87.
2019-01-28 11:11:36 +01:00
Lukas Ruzicka
c97c23d485 Recreate needles to make them check different area.
This commit adjusts the area that needles look for to avoid checking
based on a menu item that has disappeared from the system.
2019-01-28 11:11:36 +01:00
Adam Williamson
b6cf28715a Add new needles for Cockpit 186 UI redesign
Some bits of Cockpit's UI are changed in 186, we need a few new
needles.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-01-26 23:31:43 +01:00
Adam Williamson
12affb145f Add update tests to build and test a netinst image
This adds a test which builds a netinst image potentially with
the package(s) from the update, and uploads that image. It also
adds a test which runs a default install using that image. This
is intended to check whether the update breaks the creation or
use of install images; particularly this will let us test
anaconda etc. updates. We also update the minimal disk image
name, as we have to make it bigger to accommodate this test,
and making it bigger changes its name - the actual change to
the disk image itself is in createhdds. We also have to redo a
bunch of installer needles for F28 fonts, after I removed them
a month or so back...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-01-18 08:24:44 -08:00
Adam Williamson
536f699013 Post fail: handle landing in dracut shell, upload rdsosreport
If a test fails to the dracut shell, we currently don't do
anything useful. This should recognize when that happens, and
upload rdsosreport.txt.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-01-16 11:24:06 -08:00
Lukas Ruzicka
39d3427471 Create a test suite for application start stop testing.
Merges #86
Fixes #85
2019-01-04 15:23:03 -08:00
Adam Williamson
2f1570d46b Tweak firefox_close_tabs needle match
So it matches when the button has an 'active' indicator...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-01-02 20:07:37 -08:00
Adam Williamson
ea867ef431 Great Stale Needle Cleanup 2018: everything else
It's my second least favorite day of the year again: Stale
Needle Cleanup Day!

This should get rid of all non-anaconda needles that definitely
are not being used any more. Cleanup of all anaconda needles was
in the previous commit.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-12-17 17:07:15 -08:00
Adam Williamson
ad29a8fcde Great Stale Needle Cleanup 2018: anaconda
It's my second least favorite day of the year again: Stale
Needle Cleanup Day!

This should get rid of all anaconda needles that definitely are
not being used any more. A few borderline cases (where I'm not
100% sure if they may still be useful in odd corner cases, like
running universal tests on non-server images, and runs outside
of the US, and stuff) are kept around.

Cleanup of all non-anaconda needles will be in the next commit.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-12-17 16:30:57 -08:00
Adam Williamson
44c92e7c7e Remove a stray, no-longer-used needle
This was part of a workaround for a Fedora Atomic Workstation
(old name for Silverblue) issue that got resolved a while back;
we forgot to take the needle out.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-12-17 14:41:29 -08:00
Adam Williamson
ef3555aaa1 Drop another old workaround (KDE package signature check)
It seems Rawhide auto-signing is working fine now: openQA claims
this needle has 'never' been matched (which really means 'not
for a long time'), and I can't find any test fail in the last
year which looks like it landed on this 'authenticate' screen
but the needle failed to match, or anything like that.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-12-17 12:24:09 -08:00
Adam Williamson
666cac410a Add another variant KDE notification needle
More font size changes.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-12-13 16:01:17 -08:00
Adam Williamson
5f014de08a Add new KDE desktop notification needle variant
Font got bigger, or smaller, or something.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-12-13 14:22:59 -08:00
Adam Williamson
fe49095901 Add a couple of new Japanese needles
Translations changed.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-12-12 22:16:57 -08:00
Adam Williamson
65b4755358 Simplify anaconda error screen handling, add new needle
There's really no point having separate error and error_report
needles. Just match on error_report as well as clicking on it.
Also add a new error_report needle for latest Rawhide fonts.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-12-12 22:06:20 -08:00
Adam Williamson
0eaddd1215 Add some new variant needles for the FreeIPA web UI
Looks like they changed capitalization...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-11-15 18:22:35 -08:00
Adam Williamson
a10867d4fc Add new variant French 'install done' needle
Translation changed again, I think.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-11-15 12:47:50 -08:00
Adam Williamson
5a2e8f20a7 Add new variant French Rawhide accept fate needle
Translation changed.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-11-09 17:42:48 -08:00
Adam Williamson
d76003a6fb Add a new needle for the KDE desktop notifications test
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-11-09 17:41:49 -08:00
Lukas Ruzicka
b999ee93fe Add new needles to utilize Arabic tests (Fixes #83).
Add needles to utilize the Arabic test.

Add rest of the needles.
2018-11-01 15:30:03 +01:00
Lukas Ruzicka
8190c2a0eb Add needles to utilize the Cyrilic installation test. 2018-11-01 14:48:03 +01:00
Adam Williamson
fd753b2e3a Handle split of 'download' and 'apply' phases in gnome-software
GNOME Software 3.30.5 split the offline update process into two
separate 'download' and 'apply' phases. So we need to handle
clicking 'download' before 'apply', if that happens.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-10-31 11:50:14 -07:00
Adam Williamson
e6c8c5f0ff Work around Firefox 'close multiple tabs' warning
Somehow, recently, FreeIPA tests are running into Firefox not
quitting because it's showing a warning about closing multiple
tabs. (I think we didn't *get* multiple tabs before but now we
do, for some reason). So let's work around this by clicking
"Close tabs" if the warning appears.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-10-30 18:34:37 -07:00
Adam Williamson
86eaf0cd48 Remove no-longer-used 'uptodate' needle
Since we tweaked the g-s workaround not to use this any more, we
don't need it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-10-12 22:11:35 -07:00
Adam Williamson
0f1d0a1228 Add new Japanese needles
Seems the installer Japanese font changed.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-10-12 21:01:07 -07:00
Adam Williamson
17911efcce Add a new variant needle for GNOME reboot confirm screen
Seems none of the existing needles matches on current F28 update
tests.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-10-11 16:44:41 -07:00
Adam Williamson
db4ab638da Restore modified version of the #1314991 workaround for #1638563
We're not seeing *exactly* #1314991 any more, but we're seeing
something that looks quite similar: the first attempt to find
updates just doesn't find any. No error message, no updates. I
have reported a bug for this and am investigating it, in the
meantime, let's restore the workaround, elaborated a bit, and
looking for the 'Software is up to date' screen instead of the
error message.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-10-11 16:07:58 -07:00
Adam Williamson
25ad8a6aeb Drop workaround for #1314991, it doesn't work any more
I rather suspect the *bug* is still basically present and it's
why this test often fails, but we no longer seem to see the
*error message* which lets us detect the bug happening. This
needle has not been hit by any test for six months. So let's
remove the workaround as it adds complexity.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-10-10 13:45:51 -07:00
Adam Williamson
5d501433e8 Add another cantarell111 needles (for non-x86_64 arches)
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-09-26 23:15:11 -07:00
Adam Williamson
f2aa7e4652 Add a couple of new KDE needles
To do with new desktop backgrounds or something.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-09-21 19:32:09 -07:00
Adam Williamson
e9785f5e5a Add a few more Cantarell 0.111 needles
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-09-16 08:44:38 -07:00
Adam Williamson
1034104526 Add a large chunk of needles for Cantarell 0.111
This should cover nearly everything, I hope.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-09-10 02:44:50 -07:00
Adam Williamson
d12cd7bb6b Add another keyboard layout needle variant
I have no idea what changed this time.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-09-07 17:23:38 -07:00
Adam Williamson
c04f1509aa Add variant 'getting started' needle for selinux alert
An selinux alert can hide the 'getting started' window title, so
let's have a variant needle which matches on the big 'Started'
in the window instead. We may as well have both for maximum
match potential.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-09-06 22:19:37 -07:00
Adam Williamson
26c4171e5c Add new translated 'accepted fate' needle for Russian
The updated text got translated, so we need a needle for that.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-08-27 18:02:40 -07:00
Adam Williamson
6a1505a175 Add UEFI variant of grub error page needle, rename BIOS one
The --MORE-- text looks different with the UEFI firmware font,
so we need another needle. Also I named the original needle
wrong, bad me.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-08-19 09:56:33 -04:00
Adam Williamson
7df2bfb4f3 Workaround RHBZ#1618928 (hit space till errors go away)
Per Neal Gompa boot will proceed if we just page through the
error(?) messages displayed when #1618928 happens, so let's do
that to let the tests get further and see what else is broken.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-08-18 17:37:42 -04:00
Adam Williamson
6d0569b836 Add several new variant needles for anaconda icon changes
Several anaconda spoke icons changed, new needles needed.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-08-17 23:39:11 -04:00
Adam Williamson
976f6cf6f2 Add new 'no notifications' needle for GNOME
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-08-13 15:56:42 -07:00
Adam Williamson
91cf2c1814 Add a new Firefox addon_add needle
Looks like the color of this button changed again or something.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-08-07 14:31:32 -07:00
Adam Williamson
480ae13624 Add needle missing from previous commit
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-08-02 18:45:27 -07:00
Adam Williamson
c07f4ce87d Add needles for crash dialogs in Japanese
So that we get the crash info uploaded. Note these are not
language-tagged as we *don't* want to 'test' translation of
these, we want the best possible chance of matching any error
dialog in any language...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-08-02 18:44:03 -07:00
Adam Williamson
f2ea77a930 Add a few more needles for the hub UI redesign
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-08-02 09:57:29 -07:00
Adam Williamson
5680b1f5b4 Add a bunch of new needles for anaconda hub redesign
anaconda's new hub layout makes all the icons smaller, so all
these needles needed re-doing, even though the same icons are
present...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-07-27 17:12:21 -07:00
Adam Williamson
43a2ac80fe Rename new accept_fate needles
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-07-27 12:41:39 -07:00
Adam Williamson
65f26dfdca Add needle for new Rawhide 'accept fate' screen
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-07-27 09:15:37 -07:00
Adam Williamson
b6a3a58798 Add variant main hub needle
Seems sometimes tests are showing up with the date/time spoke
in a non-active highlighted state or something, don't really
know why, but it's not broken and we should just accept it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-06-25 16:17:49 -07:00