os-autoinst-distri-rocky-mi.../tests
Adam Williamson 461f3a6132 Update testing: log packages in update and installed packages
Summary:
This adds some logging related to the update testing workflow,
so we have some idea what we actually tested. We log precisely
which packages were actually downloaded from the update - this
is important as updates can be edited and when examining results
we'll want to know which packages actually got used. We also
add a new module which runs at the end of postinstall and tries
to figure out which packages from the update were installed in
the course of the test. This still isn't a guarantee the test
actually *tested them* in any way, but it at least means they
got installed successfully and didn't interfere with the test.

Test Plan:
Run the update test workflow, check the logs get
uploaded and seem accurate (sometimes some RPM garbage messages
wind up in the package log, I'm not too worried about that at
present). Run the compose test workflow and check it didn't
break.

Reviewers: jsedlak

Reviewed By: jsedlak

Subscribers: tflink

Differential Revision: https://phab.qa.fedoraproject.org/D1149
2017-02-23 14:51:19 -08:00
..
_advisory_post.pm Update testing: log packages in update and installed packages 2017-02-23 14:51:19 -08:00
_advisory_update.pm Update testing: log packages in update and installed packages 2017-02-23 14:51:19 -08:00
_anaconda_network_static.pm Add support for testing updates 2017-02-22 11:33:32 -08:00
_boot_to_anaconda.pm Move all remaining utility functions into exporter modules 2017-01-17 23:15:44 -08:00
_check_install_source.pm Move all remaining utility functions into exporter modules 2017-01-17 23:15:44 -08:00
_collect_data.pm Use systemctl --no-legend when collecting service info 2017-01-11 11:58:37 -08:00
_console_avc_crash.pm Move all remaining utility functions into exporter modules 2017-01-17 23:15:44 -08:00
_console_login.pm Move all remaining utility functions into exporter modules 2017-01-17 23:15:44 -08:00
_console_shutdown.pm wait longer for system to shutdown in _console_shutdown 2016-10-26 14:03:15 -07:00
_console_wait_login.pm Make log upload work when installed system hits emergency mode 2017-02-01 12:30:21 +01:00
_do_install_and_reboot.pm Move all remaining utility functions into exporter modules 2017-01-17 23:15:44 -08:00
_graphical_input.pm Move all remaining utility functions into exporter modules 2017-01-17 23:15:44 -08:00
_graphical_wait_login.pm Add support for testing updates 2017-02-22 11:33:32 -08:00
_memcheck.pm Add jobs to gather memory usage data 2017-01-16 09:30:14 -08:00
_post_network_static.pm Add support for testing updates 2017-02-22 11:33:32 -08:00
_software_selection.pm try to be safer when typing in X: slower, more checks 2016-09-12 10:24:30 -07:00
_support_server.pm Add support for testing updates 2017-02-22 11:33:32 -08:00
base_selinux.pm consolidate login waits, use postinstall not entrypoint for base 2016-09-27 11:48:15 -07:00
base_service_manipulation.pm Move all remaining utility functions into exporter modules 2017-01-17 23:15:44 -08:00
base_services_start.pm Simplify the services test fix 2017-01-11 16:03:09 -08:00
base_update_cli.pm consolidate login waits, use postinstall not entrypoint for base 2016-09-27 11:48:15 -07:00
database_client.pm Add support for testing updates 2017-02-22 11:33:32 -08:00
desktop_browser.pm Move all remaining utility functions into exporter modules 2017-01-17 23:15:44 -08:00
desktop_notifications.pm Move all remaining utility functions into exporter modules 2017-01-17 23:15:44 -08:00
desktop_terminal.pm Move all remaining utility functions into exporter modules 2017-01-17 23:15:44 -08:00
desktop_update_graphical.pm Move all remaining utility functions into exporter modules 2017-01-17 23:15:44 -08:00
disk_custom_btrfs.pm Move all remaining utility functions into exporter modules 2017-01-17 23:15:44 -08:00
disk_custom_ext3.pm Move all remaining utility functions into exporter modules 2017-01-17 23:15:44 -08:00
disk_custom_iscsi_postinstall.pm add an iscsi test, and a support_server test to support it 2016-06-09 08:43:46 -07:00
disk_custom_iscsi.pm Move all remaining utility functions into exporter modules 2017-01-17 23:15:44 -08:00
disk_custom_lvmthin.pm Move all remaining utility functions into exporter modules 2017-01-17 23:15:44 -08:00
disk_custom_no_swap.pm Move all remaining utility functions into exporter modules 2017-01-17 23:15:44 -08:00
disk_custom_software_raid_postinstall.pm use validate_script_output instead of typing and needles matching 2015-11-04 14:38:36 +01:00
disk_custom_software_raid.pm Move all remaining utility functions into exporter modules 2017-01-17 23:15:44 -08:00
disk_custom_xfs.pm Move all remaining utility functions into exporter modules 2017-01-17 23:15:44 -08:00
disk_guided_delete_all.pm Move all remaining utility functions into exporter modules 2017-01-17 23:15:44 -08:00
disk_guided_delete_partial_postinstall.pm use assert_script_run when possible 2016-01-12 09:27:14 -08:00
disk_guided_delete_partial.pm Move all remaining utility functions into exporter modules 2017-01-17 23:15:44 -08:00
disk_guided_empty.pm Move all remaining utility functions into exporter modules 2017-01-17 23:15:44 -08:00
disk_guided_encrypted_postinstall.pm add encrypted workstation upgrade tests (current and previous) 2016-07-08 08:56:57 -07:00
disk_guided_encrypted.pm Move all remaining utility functions into exporter modules 2017-01-17 23:15:44 -08:00
disk_guided_free_space_postinstall.pm use assert_script_run when possible 2016-01-12 09:27:14 -08:00
disk_guided_multi_empty_all_postinstall.pm use validate_script_output instead of typing and needles matching 2015-11-04 14:38:36 +01:00
disk_guided_multi_empty_all.pm Move all remaining utility functions into exporter modules 2017-01-17 23:15:44 -08:00
disk_guided_multi_postinstall.pm fix server_multi postinstall for disk being virtio 2016-01-27 01:44:20 -08:00
disk_guided_multi.pm Move all remaining utility functions into exporter modules 2017-01-17 23:15:44 -08:00
disk_guided_shrink_postinstall.pm use assert_script_run when possible 2016-01-12 09:27:14 -08:00
disk_guided_shrink.pm Move all remaining utility functions into exporter modules 2017-01-17 23:15:44 -08:00
firewall_configured.pm consolidate login waits, use postinstall not entrypoint for base 2016-09-27 11:48:15 -07:00
firewall_disabled.pm consolidate login waits, use postinstall not entrypoint for base 2016-09-27 11:48:15 -07:00
freeipa_client.pm Move all remaining utility functions into exporter modules 2017-01-17 23:15:44 -08:00
freeipa_password_change.pm Move all remaining utility functions into exporter modules 2017-01-17 23:15:44 -08:00
freeipa_webui.pm Move all remaining utility functions into exporter modules 2017-01-17 23:15:44 -08:00
install_arm_image_deployment.pm Move all remaining utility functions into exporter modules 2017-01-17 23:15:44 -08:00
install_source_graphical.pm Move all remaining utility functions into exporter modules 2017-01-17 23:15:44 -08:00
install_text.pm Move all remaining utility functions into exporter modules 2017-01-17 23:15:44 -08:00
realmd_join_cockpit.pm Add support for testing updates 2017-02-22 11:33:32 -08:00
realmd_join_sssd.pm Add support for testing updates 2017-02-22 11:33:32 -08:00
rescue_mode_encrypted.pm reintroduce rescue on UEFI 2016-12-13 09:18:34 +01:00
role_deploy_database_server.pm Add support for testing updates 2017-02-22 11:33:32 -08:00
role_deploy_domain_controller.pm Add support for testing updates 2017-02-22 11:33:32 -08:00
server_cockpit_basic.pm Move all remaining utility functions into exporter modules 2017-01-17 23:15:44 -08:00
server_cockpit_default.pm Move all remaining utility functions into exporter modules 2017-01-17 23:15:44 -08:00
server_firewall_default.pm consolidate login waits, use postinstall not entrypoint for base 2016-09-27 11:48:15 -07:00
uefi_postinstall.pm use assert_script_run when possible 2016-01-12 09:27:14 -08:00
upgrade_postinstall.pm Move all remaining utility functions into exporter modules 2017-01-17 23:15:44 -08:00
upgrade_preinstall.pm Move all remaining utility functions into exporter modules 2017-01-17 23:15:44 -08:00
upgrade_run.pm Move all remaining utility functions into exporter modules 2017-01-17 23:15:44 -08:00