Commit Graph

342 Commits

Author SHA1 Message Date
Adam Williamson
0ab8c6bd3f Click on language select screen (RHBZ #1566066)
We've been seeing an odd case lately where the language select
screen is not foregrounded when it appears (so all text is
grey). It happens very occasionally on x86_64, but a lot on
ppc64. To work around this, let's add a needle that matches the
inactive screen, and click on the screen when it appears just
to make sure it's active.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-04-25 15:04:52 -07:00
Adam Williamson
ef322198eb Add another CJK variant needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-04-19 16:20:01 -07:00
Adam Williamson
555a4bba6d Add some more new needles for font changes (cantarell, CJK)
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-04-18 16:28:28 -07:00
Adam Williamson
28080d3187 Add yet a couple more cantarell 101 needles
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-04-09 15:02:09 -07:00
Adam Williamson
fcc1d630c6 Add a couple more cantarell101 needles
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-03-30 17:52:16 -07:00
Adam Williamson
1f2e333043 Handle an auth dialog appearing after login on FAW
This will happen until a fedora-release PR is merged and sent
out for F28.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-03-28 21:24:31 -07:00
Adam Williamson
749136e93e Add needle missing from previous commit
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-03-28 21:14:21 -07:00
Adam Williamson
c2a5846064 Fix KDE live notification test (dismiss network notification)
KDE in F28+ seems to show a network connection notification on
live boot, for some reason. Just dismiss it to help the test
pass.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-03-28 19:01:46 -07:00
Adam Williamson
7d253b9e65 Add some variant Russian / US layout indicator needles
Seems like the indicator arrow's vertical position changed in
F28, for some reason. Anyway, new needles.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-03-27 12:07:12 -07:00
Adam Williamson
749f622f83 Another cantarell101 needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-03-16 13:30:30 -07:00
Adam Williamson
1a1da8b33c Another cantarell101 needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-03-16 13:18:21 -07:00
Adam Williamson
4b84e54760 Another cantarell101 needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-03-16 13:15:23 -07:00
Adam Williamson
669d0e739b Another cantarell101 needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-03-16 13:12:24 -07:00
Adam Williamson
7643357397 Another cantarell101 needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-03-16 13:10:06 -07:00
Adam Williamson
d34ddcb145 Add another cantarell101 needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-03-16 12:52:24 -07:00
Adam Williamson
fa73d2b8be Initial dump of Cantarell 100 / 101 needles
There will be more to come, but I want to push these out and go
to sleep.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-03-16 04:44:17 -07:00
Adam Williamson
de775ad42d Tweak bootloader_uefi so it matches both pre- and post-install
...I hope. This is necessary as we now have a case where it
needs to match post-install (aarch64 support_server, since
aarch64 is always UEFI).

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-03-15 12:52:17 -07:00
Adam Williamson
f8d78e159d Add the needle for the previous commit
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-03-09 15:24:20 -08:00
Adam Williamson
6bcd7537c0 Add several updated Japanese needles
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-03-08 18:13:44 -08:00
Adam Williamson
544cd2fb73 Update Firefox addon_install needle
Upstream changed the image a bit, or something.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-02-09 13:45:26 -08:00
Adam Williamson
c5dcdb3075 One more Japanese test needle
We missed this one somehow.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-02-01 13:21:57 +01:00
Adam Williamson
7064d62b1e Update Japanese needles (default font changed in Rawhide)
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-01-26 11:34:53 +01:00
Adam Williamson
2e4a447432 Narrow device_type needle area to fix match
In the most recent Rawhide compose, anaconda has changed how it
names volume groups (again), and now the VGs in openQA installs
have rather longer names. This winds up causing a problem for
this needle: the column where the 'Device Type' dropdown is
placed actually gets narrower (because the column to the right,
which has the volume group name in it, is wider), and so the
dropdown box is narrower, and the arrow protrudes into the area
which the needle expects not to have an arrow in it. So, let's
make the match area slightly narrower.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-01-15 13:21:40 -08:00
Adam Williamson
b50c4932db Add variant device_sda_selected needle for #1530410
Rawhide has a bit of a problem where its 'description' of an
iSCSI disk is so long that the other columns that should appear
in the CONFIGURE MOUNT POINT dialog don't. This means our
device_sda_selected needle doesn't match, because the column
where 'sda' should appear isn't visible.

So add a soft-fail needle to cover this case; we know what the
description for the disk that's 'sda' in this case looks like,
so match on that.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-01-03 18:34:56 -08:00
Adam Williamson
672d60a840 Clean up a whole bunch of unused needles
Time for an annual spring clean. Based on the admin UI's list
of needles that haven't been matched for a long time, but with
some manual tweaking (some are actually still needed).

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-01-02 16:13:47 -08:00
Adam Williamson
834e5c2be9 Remove unneeded main_hub_text variant needle
This somehow snuck in (in the wrong directory) with the ppc64
merges, but it's not needed. I've verified with the admin tab
for checking on needle use; this needle has never been matched,
and all the ppc64 text install tests match the non-variant
needle just fine. So I'm removing this unneeded variant.
2017-12-19 13:36:28 -08:00
Adam Williamson
8276ff3d21 Fix graphical update tests with some new needle variants
The way GNOME Software displays an error after running into RHBZ
1314991 has changed, it seems, so we need a variant needle to
cope with that. Also, when an upgrade notification is visible,
the 'Restart & Update' button for doing a regular update is
shown in grey (not blue), so we need a variant needle to handle
that too.
2017-12-19 13:25:45 -08:00
Adam Williamson
e157ffc201 Add some new cockpit needle variants
I think the background color changed a bit, or something.
2017-11-27 16:37:54 -08:00
Adam Williamson
da7eed3be6 Handle unbranded Cockpit login screen, record soft failure
There's a bug in current Modular Server which results in Cockpit
having an unbranded login screen, let's handle this but record
it as a soft failure.
2017-11-07 16:01:07 -08:00
Adam Williamson
e159f305bb Also tweak French and Russian 'install complete' for Modular 2017-11-07 12:42:51 -08:00
Adam Williamson
6569603442 Tweak Japanese install-complete needle to match Fedora-Modular 2017-11-06 16:50:59 -08:00
Adam Williamson
b8b2234c35 Now Mozilla changed how the addons site looks... 2017-11-02 22:55:31 -07:00
Adam Williamson
2107f60a50 Update Firefox needles for Firefox 57 2017-11-01 15:37:40 -07:00
Adam Williamson
6416f177c5 Updated 'no notifications' needle for KDE 2017-10-16 13:50:38 -07:00
Michel Normand
4750f39b73 Add anaconda-rescue_mounted-20171016 needle
Because "Rescue Mount" now replaced by "Rescue Shell" string
in expected rescue screen head.

Signed-off-by: Michel Normand <normand@linux.vnet.ibm.com>
2017-10-16 12:52:30 -07:00
Guy Menanteau
bdc6210d37 Add new needles needed for install_cyrillic_language test 2017-10-16 12:52:30 -07:00
Guy Menanteau
855b1cf729 Add new needles needed for install_asian_language test 2017-10-16 12:52:30 -07:00
Adam Williamson
af75eb7c80 New KDE Notifications needle
Background change caused a color change here, I think.
2017-10-16 12:10:29 -07:00
Adam Williamson
8b5a3552af Add new SDDM login needles
Another background change. Go back to using the button as it
seems background changes are more common than font rendering
changes...
2017-10-16 12:09:10 -07:00
Adam Williamson
97d4c8b85c Install dejavu fonts for Cockpit tests
The font Firefox uses when we don't ensure dejavu is installed
seems to bounce around a bit, so let's ensure the dejavu fonts
are there before we start Firefox. Also update a needle for
this.
2017-10-10 16:52:02 -07:00
Adam Williamson
22fbcf9d9f Update console_initial_setup needle
Seems like it doesn't display "Initial setup for Fedora 27" any
more, so the old needle doesn't match. We should look into
whether that's a bug, but for now, let's update the needle.
2017-09-16 17:47:25 -07:00
Adam Williamson
e434eacb40 Update SDDM login needle
Background changed, needle needs update.
2017-09-12 16:10:30 -07:00
Adam Williamson
bbf29ea4b3 Another cockpit log entry variant needle
Font is different on 27 vs. Rawhide, it looks like...
2017-09-12 15:50:27 -07:00
Adam Williamson
ffabe772ca Update cockpit log entry needle, again
Some font rendering change or some such...
2017-09-11 15:04:24 -07:00
Adam Williamson
e6913926b0 Tweak user_logged_in needles a bit
Matching on the user name really isn't doing much good. It just
means we need more variant needles. Let's ditch that part of the
match and just match on the distinctive character sequence ~]$,
which doesn't really occur for any other reason. With this we
can drop the separate 'qwerty' needle (since the qwerty case
will match the regular needle now) and should also handle the
FreeIPA tests that are failing in Rawhide because a logged in
FreeIPA user doesn't just have a sh prompt now.
2017-09-11 14:59:04 -07:00
Adam Williamson
99a203b8e0 Catch RHBZ #1314991 and handle it, with a soft failure
We can deal with this annoying bug by looking out for the error
we see when it happens, hitting the 'refresh' button again, and
resetting the loop counter to 1 (requires changing the loop to
a C-style loop).
2017-09-06 14:19:37 -07:00
Adam Williamson
dbc0be8f8f Another Firefox addon install needle variant, for KDE
KDE looks a bit different from GNOME here, so we need to update
that needle variant too...
2017-09-06 14:19:03 -07:00
Michel Normand
2fceef0eb3 Add "PPC PReP Boot" filesystem for PowerPC blivet tests
This is required because anaconda is still checking for it
even if not mandatory. Already tracked by bug
https://bugzilla.redhat.com/show_bug.cgi?id=1172791

Signed-off-by: Michel Normand <normand@linux.vnet.ibm.com>
2017-09-06 08:43:04 +02:00
Michel Normand
52e6a60539 Add workstation_selected-bgo771127 needle not black button
related to known bug
https://bugzilla.gnome.org/show_bug.cgi?id=771127

like other needles with same bgo#771127 reference
do not set it as Workaround needle.

Signed-off-by: Michel Normand <normand@linux.vnet.ibm.com>
2017-09-06 08:43:04 +02:00
Guy Menanteau
06839422e5 First PowerPC specific changes (not templates)
* New OFW variable to identify Open Firmware (used by PowerPC)
* Few needles changes for PowerPC support
* as requested do not change the timers value below for PowerPC
  tests/install_source_graphical.pm (300 to 600)
  tests/_boot_to_anaconda.pm (300 to 1200)
  This will be handled by TIMEOUT_SCALE in templates

Signed-off-by: Guy Menanteau <menantea@linux.vnet.ibm.com>
2017-09-06 08:43:04 +02:00
Adam Williamson
47c61b8d21 Update Firefox addon install success needle
This also is now using the addon's own icon.
2017-09-04 12:23:19 -07:00
Adam Williamson
64049aad12 Add another KDE transparency needle
Transparency is such fun..
2017-09-02 13:49:27 -07:00
Adam Williamson
2e2357496a Add a root variant of the 'bash noprofile' needle
Looks like root is suffering from this now, too...
2017-09-02 12:53:56 -07:00
Adam Williamson
9b91c839a7 Treat failure to source bash profile as a soft fail
There's a bug in current Rawhide causing sourcing of /etc/bashrc
to fail when logging in as a regular user. This results in the
bash prompt looking different, which is currently a hard fail,
and causes most tests to die. It's better to treat this as a
soft fail so the rest of the test can run. So add a needle to
spot this case, and a little finish function the console login
function calls whenever it's successfully logged in, to check
whether it got the no-profile prompt and register a soft fail.
2017-09-02 12:49:56 -07:00
Adam Williamson
f63ee5389a Update yama_kanji needle
Not sure if the font rendering or the GNOME highlighting changed
here, but something did.
2017-08-31 21:35:37 -04:00
Adam Williamson
197d0daf44 Update KDE notification needles for transparent menu
KDE made their notification menu transparent, sigh :( So update
the needles.
2017-08-31 18:06:41 -04:00
Adam Williamson
bfc83364dc Add a new Firefox addon install needle (addon logo)
Firefox is now showing the actual addon logo on the Add dropdown
not a generic logo. Update the needle.
2017-08-31 17:12:10 -04:00
Adam Williamson
af6f64c8de Need another new Firefox needle for KDE
Tim ti tum, needle bingo.
2017-08-17 12:44:16 -07:00
Adam Williamson
074ada57f9 Add a couple more variant Firefox needles 2017-08-15 23:08:57 -07:00
Adam Williamson
66405fc111 Add a new firefox variant needle
The 'home' icon changed a bit in recent Firefox, it seems.
2017-08-15 21:53:00 -07:00
Adam Williamson
bf19cf66cb Add yet another keyboard layout variant needle 2017-07-11 11:52:12 -07:00
Adam Williamson
aa9a1a1417 Add several more Japanese needle variants
More Rawhide rendering changes.
2017-07-10 15:59:58 -07:00
Adam Williamson
6d81c3095d Add some more input variant needles
More Rawhide rendering changes, Japanese and Russian...may need
one more for Japanese soon.
2017-07-10 12:38:17 -07:00
Adam Williamson
e61cfa699c Try a different workaround for RHBZ #1444225
That other one didn't help, so let's try this - try and spot if
the spoke is in the unexpected state (the needle should only
match if the spoke is done processing and still in warning
state, it shouldn't match while the needle is still thinking)
and click through it again if so.
2017-07-10 12:24:41 -07:00
Adam Williamson
aca7de2861 Change up 'clean desktop' check again (use a util function)
Well, that OCR needle isn't working out so great, as it seems
to match when it shouldn't:

https://openqa.fedoraproject.org/tests/119217#step/_graphical_wait_login/5

So let's try another approach. Ditch the OCR needle and have a
function for checking we're at a clean desktop. It does the
normal needle match, but if we're on GNOME, it also tries
hitting alt+f1 and seeing if we're at the overview; if so, it
hits alt+f1 again (to go back to the desktop) and returns.
2017-07-10 11:47:07 -07:00
Adam Williamson
9cc8b594fe Add variant GDM US layout needle
Looks like another rendering change in Rawhide.
2017-07-10 10:43:52 -07:00
Adam Williamson
55c62997b5 Add variant Japanese user creation screen needle
Another Rawhide font rendering change.
2017-07-10 10:41:51 -07:00
Adam Williamson
0cdbd06dd1 Add new variant needle for KDE Firefox addon install
Looks like font rendering changed a tad in Rawhide.
2017-07-10 10:39:29 -07:00
Adam Williamson
ddb6f8e416 Adjust cockpit log needles for Rawhide change
The Logs screen changed a bit. Also, it seems wrong to have
'notices' in all these needle names, so let's fix that.
2017-07-10 10:35:27 -07:00
Adam Williamson
277f6585c9 Adjust warning_bar needle so LibreOffice ad doesn't match it
https://openqa.fedoraproject.org/tests/117131 shows a spurious
match of the anaconda warning_bar needle - it's matching in an
ad for LibreOffice. Add a bit of the grey above the bar, so
hopefully this won't happen any more.
2017-07-04 10:06:55 -07:00
Adam Williamson
b1fc7eaecc Add new US layout variant seems to be needed for some reason
Russian install test was failing because the existing needle
didn't match, not sure why.
2017-06-30 15:07:42 -07:00
Jan Sedlák
888f94746f fix changed blivet add button 2017-06-26 13:23:02 +02:00
Adam Williamson
90d64434b4 Re-do new 'desktop_clean' needles
The F26 background does not change with the time of day, so that
needle should serve as-is, it's just no use for Rawhide. For
Rawhide, let's try a needle with an OCR match on 'Activities',
plus a tiny match area for a pure white block (expected to be
matched in the user menu area), since os-autoinst requires all
needles to include a match area for some reason.
2017-06-19 19:49:01 -07:00
Adam Williamson
eba2fdf033 Remove new desktop_clean needles again
These are no use :/ The Rawhide default background is a 'changes
with the time of day' one, and with the transparent top bar,
that makes a proper needle match impossible to reliably achieve,
as there is not a single pixel of the 'clean desktop' which
will always be the same any more. We'll have to come up with
something else. I'm trying out the use of an OCR match now.
2017-06-19 18:33:06 -07:00
Adam Williamson
0aa975c1ee Tweak the new desktop background needle image
Oh god, I hope this thing isn't randomly different brightness,
because that would suck hugely...
2017-06-16 16:50:29 -07:00
Adam Williamson
8190a5f790 Add another transparent top bar needle with different background 2017-06-16 15:10:02 -07:00
Adam Williamson
c6e563d81e Add new 'GNOME clean desktop' needle for transparent top bar
The GNOME top bar is now transparent in Rawhide, which broke the
'clean desktop' needle. It also means it'll break every time
the background changes, from now on :( Update the needle.
2017-06-16 14:52:49 -07:00
Jan Sedlák
4114406668 add UEFI for blivet tests
Differential Revision: https://phab.qa.fedoraproject.org/D1201
2017-05-22 09:26:58 +02:00
Jan Sedlák
0b5f865c8f add custom btrfs partitioning test for blivet-gui
Differential Revision: https://phab.qa.fedoraproject.org/D1194
2017-05-19 13:58:16 +02:00
Adam Williamson
3638adda81 Tweak kernel patch needle to avoid raw patch files
Seems like the top '[patch]' link on kernel.org may now be a
raw patch file which the browser just displays, not a compressed
patch it offers to download. So tweak the needle so we should
click on the *bottom* link instead. openQA looks for matches
as close as possible to the location in the needle.
2017-05-15 18:00:51 -07:00
Adam Williamson
b3d8c4a811 Add variant blivet 'part_fs' needle, rename the other
When running universal tests with a non-Server image, which is
not common but *does* happen (e.g. manually built test image),
the pre-selected filesystem in blivet-gui will be ext4 not xfs
(just as with custom partitioning). So we need xfs and ext4
variants of this needle. Renamed the XFS one for consistency.
2017-05-11 22:21:38 -07:00
Jan Sedlák
ed983600fa add new blivet vdb selected needle for raid (shows up on i686 and sometimes x86_64) 2017-05-11 12:07:06 +02:00
Jan Sedlák
5e2a76efde fix blivet so that correct unit for size is selected
Differential Revision: https://phab.qa.fedoraproject.org/D1193
2017-05-05 09:29:55 +02:00
Adam Williamson
1ac1977c2d Firefox addon interface changed again, add variant needles
We can probably throw the other needles away once Firefox 52
makes it to all release's stable repos.
2017-04-24 17:54:04 -07:00
Jan Sedlák
140c5f0a42 Add custom partitioning tests for blivet
Differential Revision: https://phab.qa.fedoraproject.org/D1188
2017-04-24 14:23:35 +02:00
Adam Williamson
bbeb6b1d9a Japanese language select needle changed a bit (Rawhide) 2017-04-05 19:59:23 -07:00
Adam Williamson
56364bb119 Firefox 'Save File' text changed in Rawhide KDE
Dunno, different font or something. New needle.
2017-04-05 19:50:20 -07:00
Adam Williamson
e79d00500d Kicker launcher icon in KDE also larger in Rawhide 2017-04-05 17:34:58 -07:00
Adam Williamson
16517c4a6c Add yet another KDE login screen variant needle
Seems like the generic user avatars got a bit bigger in Rawhide?
Whatever.
2017-04-05 14:10:36 -07:00
Adam Williamson
1444c5030b Add tests with no user created during install
Summary:
This adds a new test suite, run for Workstation and KDE live
images, which does not create a user during install. It then
expects initial-setup (KDE) or gnome-initial-setup (Workstation)
to appear after install, creates a user, and proceeds with
normal boot.

Note the ARM image test already covers the initial-setup text
mode, and the ARM minimal image is the only case where that
actually matters (it's not included in Server).

Test Plan:
Run the new tests, check they work. Run all old
tests, check the changes didn't break them.

Reviewers: jsedlak, jskladan

Reviewed By: jsedlak

Subscribers: tflink

Differential Revision: https://phab.qa.fedoraproject.org/D1185
2017-04-05 09:43:26 -07:00
Adam Williamson
638adda97a Add new variant KDE update notification only needle
Dunno what changed here, different color tray I think.
2017-03-29 21:50:08 -07:00
Adam Williamson
42a0efc15c Add variant KDE update icon needle for new background 2017-03-29 21:32:29 -07:00
Adam Williamson
0b9006f1e1 Disambiguate another needle name 2017-03-29 21:24:47 -07:00
Adam Williamson
9090485519 Add another live anaconda icon needle variant
With the new desktop background on KDE, the other needle only
matches 95%...
2017-03-28 17:37:14 -07:00
Adam Williamson
b17cf91c2d Add new GNOME update notification only needle
GNOME notification design changed a bit in F26 and Rawhide.
2017-03-27 15:35:50 -07:00
Adam Williamson
106972f35a Add login_sddm variant needles for new f26 backgrounds 2017-03-27 15:01:55 -07:00
Adam Williamson
ac546e786a Add cockpit 135 variant needles
The cockpit sidebar changed color, so we need new needles.
2017-03-21 16:29:43 -07:00
Adam Williamson
05ed04f04f Add manual partitioning needle variant for Rawhide text change
Label on the button changed in Rawhide.
2017-03-20 11:35:24 -07:00
Adam Williamson
df32aa869a Add new 'noprofile user logged in' needle for sh 4.4 2017-03-17 08:27:42 -07:00
Adam Williamson
0e393f1512 Add variant 'Firefox download save file' needle for current F25 2017-03-13 08:29:10 -07:00