os-autoinst-distri-rocky-mi.../tests
Adam Williamson aba2814611 add cockpit_default and cockpit_basic tests
Summary:
This adds tests for the Server_cockpit_default and cockpit_basic
test cases. Some notes: I was initially thinking of combining
these into a single test with multiple test modules and coming
up with a system for doing wiki reporting based on individual
test module status, but because we'll also want to do a cockpit
FreeIPA enrol test, I decided against it. We don't really want
to combine all three because then we would skip the cockpit
tests whenever FreeIPA server deployment failed, which isn't
ideal. So since we'll need a separate FreeIPA enrolment test
anyway it doesn't really make sense to go to the trouble of
designing a system for loading multiple postinstall tests (though
I have an idea for that!) and a per-module wiki reporting system.

This was the most minimal and hopefully reliable method for
running Cockpit from a stock Server install that I could think
of. An alternative approach would be to have, say, the most
recent stable Workstation live as a 'stock' asset and have two
tests, one which runs a stock Server install and just waits and
another which boots the live image and accesses the cockpit
running on the other box, but that seems a bit over-complex. It
is not possible to have dependencies between tests for different
ISOs, in case you were wondering about having a Workstation live
test which runs parallel with a Server DVD test, we can't do
that. One funny thing is the font that winds up getting used for
the desktop, but I don't *think* that should be a problem.

Picking needles was a bit tricky; any improvement suggestions
are welcome. I'm hoping it turns out to be safe to rely on some
dbus log messages being present; I think logging into Cockpit
triggers activation of the realmd dbus interface, so there
*should* always be some messages related to that. An alternative
would just be to match on a sliver of the dark grey table header
and the light grey row beneath it and assume that'll always be
the first message (whatever the message is), but then we have to
find some area of the message details screen which is always
present for any message, and it just seems a tad more likely to
result in false passes. Similary I'm making an assumption that
auditd is always going to show up on the first page of the
Services screen and the details screen will always show that
'loaded...enabled' text.

Test Plan:
Run the tests and see if they work! See
https://openqa.stg.fedoraproject.org/tests/21373 and
https://openqa.stg.fedoraproject.org/tests/21371 for my tests.

Reviewers: garretraziel

Reviewed By: garretraziel

Subscribers: tflink

Differential Revision: https://phab.qadevel.cloud.fedoraproject.org/D874
2016-06-01 09:05:33 -07:00
..
_boot_to_anaconda.pm add FreeIPA server role deploy and kickstart enrolment tests 2016-05-04 11:53:11 -07:00
_console_shutdown.pm shutdown before uploading disk images 2016-03-22 07:19:47 -07:00
_console_wait_login.pm add desktop_terminal test, refactor test loading a bit 2016-05-05 16:39:47 -07:00
_do_install_and_reboot.pm add Russian install test 2016-05-20 07:52:55 -07:00
_graphical_wait_login.pm _graphical_wait_login: inherit 'installedtest' not 'basetest' 2016-05-20 07:53:45 -07:00
_software_selection.pm add comments and documentation 2015-08-05 08:23:59 +02:00
base_selinux.pm add a base_selinux test (follow-on from default_install) 2015-12-17 12:46:14 -08:00
base_service_manipulation.pm add base_service_manipulation test 2016-01-11 12:30:24 -08:00
base_services_start.pm workaround mcelog failing 2016-06-01 08:12:16 +02:00
desktop_terminal_postinstall.pm add desktop_terminal test, refactor test loading a bit 2016-05-05 16:39:47 -07:00
disk_custom_btrfs.pm add ext3, btrfs and LVM thin tests, tweaks to custom methods 2015-08-10 11:01:12 -07:00
disk_custom_ext3.pm add ext3, btrfs and LVM thin tests, tweaks to custom methods 2015-08-10 11:01:12 -07:00
disk_custom_lvmthin.pm add ext3, btrfs and LVM thin tests, tweaks to custom methods 2015-08-10 11:01:12 -07:00
disk_custom_no_swap.pm small fix: wait a sec between clicks of 'Done' in no_swap 2015-08-31 17:02:27 -07:00
disk_custom_software_raid_postinstall.pm use validate_script_output instead of typing and needles matching 2015-11-04 14:38:36 +01:00
disk_custom_software_raid.pm add ext3, btrfs and LVM thin tests, tweaks to custom methods 2015-08-10 11:01:12 -07:00
disk_custom_xfs.pm add custom partitioning xfs tests 2015-11-26 13:50:45 +01:00
disk_guided_delete_all.pm add comments and documentation 2015-08-05 08:23:59 +02:00
disk_guided_delete_partial_postinstall.pm use assert_script_run when possible 2016-01-12 09:27:14 -08:00
disk_guided_delete_partial.pm add comments and documentation 2015-08-05 08:23:59 +02:00
disk_guided_empty.pm rename BOOT_UPDATES_IMG_URL to TEST_UPDATES, add GRUBADD 2016-04-08 13:21:29 -07:00
disk_guided_encrypted_postinstall.pm add comments and documentation 2015-08-05 08:23:59 +02:00
disk_guided_encrypted.pm disk_guided_encrypted: only switch layout when appropriate 2016-05-20 11:56:48 -07:00
disk_guided_free_space_postinstall.pm use assert_script_run when possible 2016-01-12 09:27:14 -08:00
disk_guided_multi_empty_all_postinstall.pm use validate_script_output instead of typing and needles matching 2015-11-04 14:38:36 +01:00
disk_guided_multi_empty_all.pm add comments and documentation 2015-08-05 08:23:59 +02:00
disk_guided_multi_postinstall.pm fix server_multi postinstall for disk being virtio 2016-01-27 01:44:20 -08:00
disk_guided_multi.pm add comments and documentation 2015-08-05 08:23:59 +02:00
disk_guided_shrink_postinstall.pm use assert_script_run when possible 2016-01-12 09:27:14 -08:00
disk_guided_shrink.pm add guided shrink test 2015-09-08 15:54:22 +02:00
firewall_configured_postinstall.pm add firewall kickstart tests (disabled and configured) 2016-03-23 13:52:00 -07:00
firewall_disabled_postinstall.pm add firewall kickstart tests (disabled and configured) 2016-03-23 13:52:00 -07:00
freeipa_client_postinstall.pm add FreeIPA server role deploy and kickstart enrolment tests 2016-05-04 11:53:11 -07:00
install_arm_image_deployment.pm add ARM initial-setup test 2016-05-18 14:04:45 +02:00
install_source_graphical.pm do the /Everything/ fix for REPOSITORY_GRAPHICAL too 2016-03-02 10:25:51 -08:00
install_source_variation.pm add /Everything/ to REPOSITORY_VARIATION 2016-03-02 09:12:41 -08:00
role_deploy_domain_controller.pm add FreeIPA server role deploy and kickstart enrolment tests 2016-05-04 11:53:11 -07:00
server_cockpit_basic_postinstall.pm add cockpit_default and cockpit_basic tests 2016-06-01 09:05:33 -07:00
server_cockpit_default_postinstall.pm add cockpit_default and cockpit_basic tests 2016-06-01 09:05:33 -07:00
server_firewall_default_postinstall.pm add a server default firewall test 2016-05-31 14:24:34 -07:00
uefi_postinstall.pm use assert_script_run when possible 2016-01-12 09:27:14 -08:00
upgrade_postinstall.pm add desktop_terminal test, refactor test loading a bit 2016-05-05 16:39:47 -07:00
upgrade_preinstall.pm dnf-plugin-system-upgrade: don't use updates-testing, 10 mins 2016-05-06 13:37:19 -07:00
upgrade_run.pm add desktop_terminal test, refactor test loading a bit 2016-05-05 16:39:47 -07:00