74 lines
2.9 KiB
Markdown
74 lines
2.9 KiB
Markdown
---
|
|
title: 'SOP: Compose and Repo Sync for Rocky Linux Special Interest Groups'
|
|
---
|
|
|
|
This SOP covers how the Rocky Linux Release Engineering Team handles composes and repository syncs for Special Interest Groups.
|
|
|
|
## Contact Information
|
|
| | |
|
|
| - | - |
|
|
| **Owner** | Release Engineering Team |
|
|
| **Email Contact** | releng@rockylinux.org |
|
|
| **Email Contact** | infrastructure@rockylinux.org |
|
|
| **Mattermost Contacts** | `@label` `@mustafa` `@neil` `@tgo` |
|
|
| **Mattermost Channels** | `~Development` |
|
|
|
|
## Composing Repositories
|
|
|
|
### Mount Structure
|
|
|
|
There is a designated system that takes care of composing repositories. These systems contain the necessary EFS/NFS mounts for the staging and production repositories as well as composes.
|
|
|
|
* `/mnt/compose` -> Compose data
|
|
* `/mnt/repos-staging` -> Staging
|
|
* `/mnt/repos-production` -> Production
|
|
|
|
### Empanadas
|
|
|
|
Each repository or set of repositories are controlled by various comps and pungi configurations that are translated into peridot. Empanadas is used to run a reposync from peridot's yumrepofs repositories, generate ISO's, and create a pungi compose look-a-like. Because of this, the comps and pungi-rocky configuration is not referenced with empanadas.
|
|
|
|
### Running a Compose
|
|
|
|
First, the toolkit must be cloned. In the `iso/empanadas` directory, run `poetry install`. You'll then have access to the various commands needed:
|
|
|
|
* `sync_sig`
|
|
|
|
To perform a compose of a SIG, it must be defined in the configuration. As an example, here is composing the `core` sig.
|
|
|
|
```
|
|
# This creates a brand new directory under /mnt/compose/X and symlinks it to latest-SIG-Y-X
|
|
~/.local/bin/poetry run sync_sig --release 9 --sig core --hashed --clean-old-packages --full-run
|
|
|
|
# This assumes the directories already exist and will update in place.
|
|
~/.local/bin/poetry run sync_sig --release 9 --sig core --hashed --clean-old-packages
|
|
```
|
|
|
|
## Syncing Composes
|
|
|
|
Syncing utilizes the sync scripts provided in the release engineering toolkit.
|
|
|
|
When the scripts are being ran, they are usually ran with a specific purpose, as each major version may be different.
|
|
|
|
For SIG's, the only files you'll need to know of are `sync-to-staging-sig.sh` and `sync-to-prod-sig.sh`. **Both scripts will delete packages and data that are no longer in the compose.**
|
|
|
|
```
|
|
# The below syncs the core 8 repos to staging
|
|
RLVER=8 bash sync-to-staging-sig.sh core
|
|
# The below syncs the core 9 repos to staging
|
|
RLVER=9 bash sync-to-staging-sig.sh core
|
|
|
|
# The below syncs everything in staging for 8 core to prod
|
|
RLVER=8 bash sync-to-prod-sig.sh core
|
|
|
|
# The below syncs everything in staging for 9 core to prod
|
|
RLVER=9 bash sync-to-prod-sig.sh core
|
|
```
|
|
|
|
Once staging is completed and reviewed, it is synced to production.
|
|
|
|
```
|
|
bash sync-file-list-parallel.sh
|
|
```
|
|
|
|
During this phase, staging is rsynced with production, the file list is updated, and the full time list is also updated to allow mirrors to know that the repositories have been updated and that they can sync.
|