Skip to content

Compose and Repo Sync for Rocky Linux Special Interest Groups

This SOP covers how the Rocky Linux Release Engineering Team handles composes and repository syncs for Special Interest Groups.

Contact Information
Owner Release Engineering Team
Email Contact releng@rockylinux.org
Email Contact infrastructure@rockylinux.org
Mattermost Contacts @label @mustafa @neil @tgo
Mattermost Channels ~Development

Composing Repositories

Mount Structure

There is a designated system that takes care of composing repositories. These systems contain the necessary EFS/NFS mounts for the staging and production repositories as well as composes.

  • /mnt/compose -> Compose data
  • /mnt/repos-staging -> Staging
  • /mnt/repos-production -> Production

Empanadas

Each repository or set of repositories are controlled by various comps and pungi configurations that are translated into peridot. Empanadas is used to run a reposync from peridot's yumrepofs repositories, generate ISO's, and create a pungi compose look-a-like. Because of this, the comps and pungi-rocky configuration is not referenced with empanadas.

Running a Compose

First, the toolkit must be cloned. In the iso/empanadas directory, run poetry install. You'll then have access to the various commands needed:

  • sync-sig

To perform a compose of a SIG, it must be defined in the configuration. As an example, here is composing the core sig.

# This creates a brand new directory under /mnt/compose/X and symlinks it to latest-SIG-Y-X
~/.local/bin/poetry run sync-sig --release 9 --sig core --hashed --clean-old-packages --full-run

# This assumes the directories already exist and will update in place.
~/.local/bin/poetry run sync-sig --release 9 --sig core --hashed --clean-old-packages

Syncing Composes

Syncing utilizes the sync scripts provided in the release engineering toolkit.

When the scripts are being ran, they are usually ran with a specific purpose, as each major version may be different.

For SIG's, the only files you'll need to know of are sync-to-staging-sig.sh and sync-to-prod-sig.sh. Both scripts will delete packages and data that are no longer in the compose.

# The below syncs the core 8 repos to staging
RLVER=8 bash sync-to-staging-sig.sh core
# The below syncs the core 9 repos to staging
RLVER=9 bash sync-to-staging-sig.sh core

# The below syncs everything in staging for 8 core to prod
RLVER=8 bash sync-to-prod-sig.sh core

# The below syncs everything in staging for 9 core to prod
RLVER=9 bash sync-to-prod-sig.sh core

Once staging is completed and reviewed, it is synced to production.

bash sync-file-list-parallel.sh

During this phase, staging is rsynced with production, the file list is updated, and the full time list is also updated to allow mirrors to know that the repositories have been updated and that they can sync.