Upstream package importer with auto patching
You cannot select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
Go to file
Mustafa Gezen 40180a342b
Merge pull request #11 from skip77/manual-commits-fix
Manual commits fix
2 weeks ago
.github/workflows Supported Go version is now 1.18 5 months ago
cmd/srpmproc Updates to add flexibility to lookasides and tagless handling: 1 month ago
modulemd Formatting 5 months ago
pb fix: disabling auto align should always return one space 1 year ago
pkg Repaired manual commits feature and added some bugfixes: 3 weeks ago
proto Add support for disabling auto align 1 year ago
.editorconfig Initial commit 2 years ago
.gitignore enhancement: expose srpmproc library 2 years ago
.goreleaser.yml Add s390x and ppc64le to builds 10 months ago
AUTHORS Add LICENSE 2 years ago
Dockerfile [docker] Add Dockerfile 2 years ago
LICENSE Add LICENSE 2 years ago Updates to add flexibility to lookasides and tagless handling: 1 month ago
gen.go enhancement: add more info for each processed package as well as print more info on cli 2 years ago
go.mod Stop converting v3 to v2 5 months ago
go.sum Stop converting v3 to v2 5 months ago


Upstream package importer with auto patching. Reference implementation for OpenPatch


  srpmproc [flags]
  srpmproc [command]

Available Commands:
  help        Help about any command

      --basic-password string           Basic auth password
      --basic-username string           Basic auth username
      --branch-prefix string            Branch prefix (replaces import-branch-prefix) (default "r")
      --branch-suffix string            Branch suffix to use for imported branches
      --cdn string                      CDN URL shortcuts for well-known distros, auto-assigns --cdn-url.  Valid values:  rocky8, rocky, fedora, centos, centos-stream.  Setting this overrides --cdn-url
      --cdn-url string                  CDN URL to download blobs from. Simple URL follows default rocky/centos patterns. Can be customized using macros (see docs) (default "")
      --git-committer-email string      Email of committer (default "")
      --git-committer-name string       Name of committer (default "rockyautomation")
  -h, --help                            help for srpmproc
      --import-branch-prefix string     Import branch prefix (default "c")
      --manual-commits string           Comma separated branch and commit list for packages with broken release tags (Format: BRANCH:HASH)
      --module-fallback-stream string   Override fallback stream. Some module packages are published as collections and mostly use the same stream name, some of them deviate from the main stream
      --module-mode                     If enabled, imports a module instead of a package
      --module-prefix string            Where to retrieve modules if exists. Only used when source-rpm is a git repo (default "")
      --no-dup-mode                     If enabled, skips already imported tags
      --no-storage-download             If enabled, blobs are always downloaded from upstream
      --no-storage-upload               If enabled, blobs are not uploaded to blob storage
      --package-release string          Package release to fetch
      --package-version string          Package version to fetch
      --rpm-prefix string               Where to retrieve SRPM content. Only used when source-rpm is not a local file (default "")
      --single-tag string               If set, only this tag is imported
      --source-rpm string               Location of RPM to process
      --ssh-key-location string         Location of the SSH key to use to authenticate against upstream
      --ssh-user string                 SSH User (default "git")
      --storage-addr string             Bucket to use as blob storage
      --strict-branch-mode              If enabled, only branches with the calculated name are imported and not prefix only
      --taglessmode                     Tagless mode:  If set, pull the latest commit from the branch and determine version numbers from spec file.  This is auto-tried if tags aren't found.
      --tmpfs-mode string               If set, packages are imported to path and patched but not pushed
      --upstream-prefix string          Upstream git repository prefix
      --version int                     Upstream version

Use "srpmproc [command] --help" for more information about a command.


  1. Import the kernel package from, to local folder /opt/gitroot/rpms/kernel.git/ . Download the lookaside source tarballs from the default CentOS file server location to local folder /opt/fake_s3/ . We want to grab branch "c8" (import prefix plus RHEL version), and it will be committed as branch "r8" (branch prefix plus RHEL version). This assumes that /opt/fake_s3 exists, and /opt/gitroot/rpms/kernel.git exists and is a git repository of some kind (even an empty one).
srpmproc --branch-prefix "r"  --import-branch-prefix "c"  --rpm-prefix "" --version 8 --storage-addr file:///opt/fake_s3  --upstream-prefix file:///opt/gitroot   --cdn centos --strict-branch-mode --source-rpm kernel

CDN and --cdn-url

The --cdn-url option allows for Go-style templates to craft complex URL patterns. These templates are: {{.Name}} (package name), {{.Hash}} (hash of lookaside file), {{.Hashtype}} (hash type of file, like "sha256" or "sha512"), {{.Branch}} (the branch we are importing), and {{.Filename}} (the lookaside file's name as it appears in SOURCES/). You can add these values as part of --cdn-url to craft your lookaside pattern.

For example, if I wanted my lookaside downloads to come from CentOS 9 Stream, I would use as part of my command:

--cdn-url "{{.Name}}/{{.Filename}}/{{.Hashtype}}/{{.Hash}}/{{.Filename}}"

Default Behavior: If these templates are not used, the default behavior of --cdn-url is to fall back on the traditional RHEL import pattern: <CDN_URL>/<NAME>/<BRANCH>/<HASH> . If that fails, a further fallback is attempted, the simple: <CDN_URL>/<HASH>. These cover the common Rocky Linux and RHEL/CentOS imports if the base lookaside URL is the only thing given. If no --cdn-url is specified, it defaults to "" (for RHEL imports into Rocky Linux)

CDN Shorthand: For convenience, some lookaside patterns for popular distros are provided via the --cdn option. You can specify this without needing to use the longer --cdn-url. For example, when importing from CentOS 9 Stream, you could use --cdn centos-stream