Commit Graph

958 Commits

Author SHA1 Message Date
Adam Williamson
8276ff3d21 Fix graphical update tests with some new needle variants
The way GNOME Software displays an error after running into RHBZ
1314991 has changed, it seems, so we need a variant needle to
cope with that. Also, when an upgrade notification is visible,
the 'Restart & Update' button for doing a regular update is
shown in grey (not blue), so we need a variant needle to handle
that too.
2017-12-19 13:25:45 -08:00
Adam Williamson
16943ad7ef Use virtio not std graphics for UEFI
While Rawhide suffers from #1518464 , virtio is a better choice
for UEFI tests, even if we get the problem with consoles using
the wrong color scheme again...
2017-12-13 16:02:09 -08:00
Guy Menanteau
f169675699 Add Atomic tests for PowerPC
two same tests as for x86_64.
2017-11-29 10:56:41 -08:00
Michel Normand
18602d72f3 Change baseurl for PowerPC repo as "fedora-secondary"
in _repo_setup_updates function

Signed-off-by: Michel Normand <normand@linux.vnet.ibm.com>
2017-11-28 08:18:16 +01:00
Michel Normand
0b5ef9fe84 Add "Fedora PowerPC Updates" group and related server tests
in templates-updates file

Only support "updates-server" flavor
do not support "updates-workstation" neither "updates-kde"

Signed-off-by: Michel Normand <normand@linux.vnet.ibm.com>
2017-11-28 08:18:16 +01:00
Adam Williamson
e157ffc201 Add some new cockpit needle variants
I think the background color changed a bit, or something.
2017-11-27 16:37:54 -08:00
Adam Williamson
2a7b2923f7 Handle BGO#790811 (GNOME 'getting started' crash)
There's a bug causing the 'getting started' screen to crash.
This doesn't really make the system unusable, so treating it
as a soft failure seems appropriate, especially as this will
unblock all the post-install tests on Workstation.
2017-11-24 16:36:31 -08:00
Adam Williamson
e2beb4f046 Bump up some more DNF timeouts due to #1516990
All of these seem vulnerable.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2017-11-23 16:01:58 -08:00
Adam Williamson
a0a63256d0 Whoops, do that last thing properly
We need the 60 second timeout here, not the other place.
2017-11-23 13:42:21 -08:00
Adam Williamson
f20086f59c Wait 60 seconds for 'timbuktu screen' (#1516990)
It takes an unusally long time for Modular images to get from
language selection to the 'timbuktu screen', so give 'em a bit
more time. See bug report for more info.
2017-11-23 11:44:57 -08:00
Adam Williamson
cedef3878a Enable virtio RNG device for base_services_start tests
This should prevent rngd.service from failing, because it will
now see a 'hardware' RNG device.
2017-11-08 15:06:50 -08:00
Adam Williamson
da7eed3be6 Handle unbranded Cockpit login screen, record soft failure
There's a bug in current Modular Server which results in Cockpit
having an unbranded login screen, let's handle this but record
it as a soft failure.
2017-11-07 16:01:07 -08:00
Adam Williamson
442c143144 Try to fix quoting in printf 2017-11-07 15:00:08 -08:00
Adam Williamson
ce07c418d0 Fix (hackily) install of X, Firefox and haveged on Modular
Modular composes don't include these packages, but we need them
to run the web UI tests for FreeIPA and Cockpit. This is the
most reasonable hack I can come up with for now: just use a
non-modular fedora repo to source these packages when doing
Modular compose testing.

If we ever reach an all-Modular future, these packages should
be available in Modular composes I guess, but for now they are
not.
2017-11-07 14:20:36 -08:00
Adam Williamson
0e18c0fc4f Never load graphical post-install tests on Modularity for now
Current Modular composes don't include any graphical desktop
bits, so they're never going to want to do this. (This makes
sense for e.g. non-English install tests; we still want to
make sure Russian install works on Modular composes, we just
have to skip the post-install graphical input testing).
2017-11-07 13:04:01 -08:00
Adam Williamson
14bbfaaa3c Skip software selection on Modular until it's any use
With current Modular composes it does nothing.
2017-11-07 12:44:52 -08:00
Adam Williamson
e159f305bb Also tweak French and Russian 'install complete' for Modular 2017-11-07 12:42:51 -08:00
Adam Williamson
bd27cc69d8 Don't install haveged for modular tests (yet)
It's not there, I don't think.
2017-11-06 18:01:23 -08:00
Adam Williamson
72395f1f67 Remove stray apostrophe in _repo_setup_compose 2017-11-06 17:42:30 -08:00
Adam Williamson
6569603442 Tweak Japanese install-complete needle to match Fedora-Modular 2017-11-06 16:50:59 -08:00
Adam Williamson
5e628551d8 Use Server not Everything variant for http repos on modular
Modular Server composes don't contain an Everything variant, so
we can't use it for the installation repo.
2017-11-06 16:25:40 -08:00
Adam Williamson
833502c880 Don't comment out metalink lines in repo files for modular
We can't easily do the 'point to the compose' fixup.
2017-11-06 16:20:40 -08:00
Adam Williamson
aaba51768e Don't use dnf config-manager on modular images
It's not there and can't be installed, at least at present.
2017-11-06 16:12:55 -08:00
Adam Williamson
b8b2234c35 Now Mozilla changed how the addons site looks... 2017-11-02 22:55:31 -07:00
Adam Williamson
2107f60a50 Update Firefox needles for Firefox 57 2017-11-01 15:37:40 -07:00
Adam Williamson
80234f9576 Update desktop image file name for version bump 2017-10-20 17:45:13 -07:00
Adam Williamson
7b7b63abc1 Workaround F26 base image g-i-s issue for upgrade tests too
Since April there's been some kind of issue in the F26 base
image which means gnome-initial-setup doesn't run on the first
user login (as it should). The F25 base image is fine. I've
not yet had the time to look into this.

I put a workaround in place to prevent this problem causing
false fails of update tests that boot from the F26 base image,
but didn't apply the same workaround to upgrade tests, which
is why upgrade tests from F26 Workstation always fail - they
expect g-i-s to run on first login (which happens after the
upgrade, in upgrade tests) and it doesn't. So let's just extend
the workaround to apply to upgrade tests too, for now, until we
can figure out why this happens.
2017-10-20 12:21:31 -07:00
Adam Williamson
4323d8f533 Fix desktop_update_graphical for recent F27+ GNOME change
The default action on the reboot confirmation dialog changed
from Reboot to Cancel, so when we hit enter, we just cancel the
reboot. Tweak this to hit tab on F27+ (but not <F26, so update
tests continue to work too).
2017-10-19 12:46:40 -07:00
Michel Normand
4610408963 Do not try to login if already done
the comment in console_login was already valid
but there was a missing return after test.

exemple of incorrect output is:
https://openqa.stg.fedoraproject.org/tests/182970#step/_collect_data/4

Signed-off-by: Michel Normand <normand@linux.vnet.ibm.com>
2017-10-18 18:53:11 +02:00
Adam Williamson
859f4acf4c Fix install_mirrorlist_graphical test
anaconda's interface changed, so we need to adapt to that.
2017-10-16 14:23:56 -07:00
Adam Williamson
6416f177c5 Updated 'no notifications' needle for KDE 2017-10-16 13:50:38 -07:00
Michel Normand
4750f39b73 Add anaconda-rescue_mounted-20171016 needle
Because "Rescue Mount" now replaced by "Rescue Shell" string
in expected rescue screen head.

Signed-off-by: Michel Normand <normand@linux.vnet.ibm.com>
2017-10-16 12:52:30 -07:00
Guy Menanteau
bdc6210d37 Add new needles needed for install_cyrillic_language test 2017-10-16 12:52:30 -07:00
Guy Menanteau
855b1cf729 Add new needles needed for install_asian_language test 2017-10-16 12:52:30 -07:00
Adam Williamson
af75eb7c80 New KDE Notifications needle
Background change caused a color change here, I think.
2017-10-16 12:10:29 -07:00
Adam Williamson
8b5a3552af Add new SDDM login needles
Another background change. Go back to using the button as it
seems background changes are more common than font rendering
changes...
2017-10-16 12:09:10 -07:00
Adam Williamson
63725c5d3e Change Workstation OStree flavor name to match new variant name
I don't even know if a flavor name with a space in it is going to
work, but let's find out!
2017-10-13 16:53:38 -07:00
Adam Williamson
97d4c8b85c Install dejavu fonts for Cockpit tests
The font Firefox uses when we don't ensure dejavu is installed
seems to bounce around a bit, so let's ensure the dejavu fonts
are there before we start Firefox. Also update a needle for
this.
2017-10-10 16:52:02 -07:00
Adam Williamson
22fbcf9d9f Update console_initial_setup needle
Seems like it doesn't display "Initial setup for Fedora 27" any
more, so the old needle doesn't match. We should look into
whether that's a bug, but for now, let's update the needle.
2017-09-16 17:47:25 -07:00
Adam Williamson
14c1bae747 Disable SELinux in _support_server
tgtd is failing to start due to an SELinux denial; I'm filing a
bug now.
2017-09-16 17:04:32 -07:00
Adam Williamson
e434eacb40 Update SDDM login needle
Background changed, needle needs update.
2017-09-12 16:10:30 -07:00
Adam Williamson
bbf29ea4b3 Another cockpit log entry variant needle
Font is different on 27 vs. Rawhide, it looks like...
2017-09-12 15:50:27 -07:00
Adam Williamson
ffabe772ca Update cockpit log entry needle, again
Some font rendering change or some such...
2017-09-11 15:04:24 -07:00
Adam Williamson
e6913926b0 Tweak user_logged_in needles a bit
Matching on the user name really isn't doing much good. It just
means we need more variant needles. Let's ditch that part of the
match and just match on the distinctive character sequence ~]$,
which doesn't really occur for any other reason. With this we
can drop the separate 'qwerty' needle (since the qwerty case
will match the regular needle now) and should also handle the
FreeIPA tests that are failing in Rawhide because a logged in
FreeIPA user doesn't just have a sh prompt now.
2017-09-11 14:59:04 -07:00
Adam Williamson
99a203b8e0 Catch RHBZ #1314991 and handle it, with a soft failure
We can deal with this annoying bug by looking out for the error
we see when it happens, hitting the 'refresh' button again, and
resetting the loop counter to 1 (requires changing the loop to
a C-style loop).
2017-09-06 14:19:37 -07:00
Adam Williamson
dbc0be8f8f Another Firefox addon install needle variant, for KDE
KDE looks a bit different from GNOME here, so we need to update
that needle variant too...
2017-09-06 14:19:03 -07:00
Guy Menanteau
5fcfb353b3 Revert "iscsi backing store not same disk for PowerPC"
previously required on f25 host with qemu 2.7.1-6
it is not needed anymore on f26 with qemu 2.9.0-5

This reverts commit 0eb15266117aae47f663297f5f332d480d8549b9.
2017-09-06 08:43:04 +02:00
Michel Normand
e6fe996613 Revert "Modify "install_multi" test for PowerPC"
This reverts commit 8b2977f1d618316ded61420df4fc7d2afd07cbf4.

The initial commit was required for PowerPC
until qemu 2.7.1-6 (in f25) not required anymore
since qemu 2.9.0-5 (in f26)
2017-09-06 08:43:04 +02:00
Michel Normand
f3878c4380 Change checking nfs mount for PowerPC
by direct grep of mount command
because nfs mounting not traced in ananconda or packaging log.

Signed-off-by: Michel Normand <normand@linux.vnet.ibm.com>
2017-09-06 08:43:04 +02:00
Guy Menanteau
9fe10f6715 Add PowerPC support in templates
* use only a subset of tests for ppc64 and ppc64le
  with a new "Fedora PowerPC group"
  and only three flavors
  "Server-boot-iso", "Server-dvd-iso", "universal",

* TEST_TARGET for all PowerPC Products set as ISO

* increase disk size for asian cyrillic and european tests
  add HDDSIZEGB = 12  for related tests
  install_asian_language install_cyrillic_language
  install_european_language
  This is required to avoid anaconda failure like:
  (my own translation)
  "... Fedora requests 10.03GB of free space,
  with 5.95GB for software and 4.08GB for swap.
  Your selected disks have the following free space:
  10GB free space for use..."

* Remove hardcoded arch in some HDD_1 key replaced by ARCH variable
  That concerns the images generated by createhdds tool
  (only for supported PowerPC tests not all of them)
  eg change from:
  "disk_f%CURRREL%_support_3_x86_64.img"
  to:
  "disk_f%CURRREL%_support_3_%ARCH%.img"
  Warning: use ARCH and not MACHINE variable

* Try to keep same order for PowerPC as for x86_64 tests
  and same priorities as documented in
  cid a5861ebc5d:
    0-20: critical smoke tests (higher than Alpha priority)
    20-29: Alpha priority
    30-39: Beta priority
    40-49: Final priority
    50+: Optional priority

* force nfsvers=4 as bypass bugs:
  https://bugzilla.redhat.com/show_bug.cgi?id=1386059
  https://bugzilla.redhat.com/show_bug.cgi?id=1368932

* role_deploy_domain_controller failed for ppc64 (BE)
  https://bugzilla.redhat.com/show_bug.cgi?id=1437793

* Warning: tests failure for PowerPC, not added:
  install_delete_pata
  install_sata
  install_package_set_kde
  install_updates_img_local
* tests not tried:
  upgrade_server_domain_controller
  upgrade_realmd_client
  upgrade_desktop_encrypted_64bit

* Note: TIMEOUT_SCALE initially set for PowerPC machines
  has been removed from this commit as seems not required
  anymore after upstream merge.
  Will need to track if two following timer values
  may create problem on remote openQA instances:
  tests/install_source_graphical.pm (300 to 600)
  tests/_boot_to_anaconda.pm (300 to 1200)

Signed-off-by: Guy Menanteau <menantea@linux.vnet.ibm.com>
Signed-off-by: Michel Normand <normand@linux.vnet.ibm.com>
2017-09-06 08:43:04 +02:00