chore: merge devel -> main (v0.3.0) #1

neil · 2022-07-14T03:35:52Z

neil commented

2022-07-14 03:35:52 +00:00

Compose the symphony that is Rocky Linux 9

neil added 97 commits 2022-07-14 03:35:53 +00:00

Implement a feature to assist in generating various images 4bf6fb6618

* use a flag to determine if we want an RC or not
* Convert rldict and sigdict to an AttributeDict to allow access via
  __getattr__
* add fedora_release variable to configs for controlling icicle
  templates
* build_image.py script to generate per-architecture XML files used by
  imagefactory
* refactor time to call utcnow() once
* add jinja types to development dependencies until we move past jinja
  2.x
* Generate TDL templates per architecture for each image variant on
  demand
* Generate imagefactory and copy commands to execute image build
* Refactor Kubernetes job template to be generic for all current jobs

Implement a feature to assist in generating various images e60f6524a2

* use a flag to determine if we want an RC or not
* Convert rldict and sigdict to an AttributeDict to allow access via
  __getattr__
* add fedora_release variable to configs for controlling icicle
  templates
* build_image.py script to generate per-architecture XML files used by
  imagefactory
* refactor time to call utcnow() once
* add jinja types to development dependencies until we move past jinja
  2.x
* Generate TDL templates per architecture for each image variant on
  demand
* Generate imagefactory and copy commands to execute image build
* Refactor Kubernetes job template to be generic for all current jobs

Use devel branch for container, doc fixes 79425e848e

Merge branch 'feature/imagebuild' into 'devel' 56799df270

Run builds in a container

See merge request release-engineering/public/toolkit!46

update github workflow to build image in the right namespace 0deaae0c65

update github workflow to build image in the right namespace 710cb08134

Update the image tag 760967211b

prepping treeinfo outside 7d7163a156

remove jinja types f65a331826

test should use && f342046f25

fix up readme, disable gitlab tests for now 1a04399851

make IPA tests runnable, lamp disabled for now 69317f3881

expect is missing from install 2e38400255

make kinit as admin simpler 1acca22141

fix up IPA portion 1d710a6d42

add a sudo test 4922e283d6

Resolve RLBT#0000132 discinfo and treeinfo 5a02fe5a25

Resolve RLBT#0000132 discinfo and treeinfo 49b001e31d

treeinfo is not writing to paths 2c3409de51

Attempt to resolve RLBT#0000133 7f6f7babf5

Attempt to resolve RLBT#0000133 4bc377cd44

Remove hardcodes, add in metadata c1f1be9353

* Remove hardcodes of "Rocky" to use "shortname" instead
* Add in metadata

missing write function for compose_id e47ca962af

add json and yaml components 412a7ab089

Fix source and debuginfo portions 2884bb0eaa

test out parts of finalize c081f6f202

add finalize script to mix 462ea264b3

change comments briefly before merging changes 957bf5ef3f

Containerize and refactor image building 361c155481

* Add new fedora container to run imagefactory
* Make architecture class from py attrs and make it raise exceptions
* Change build-image script to primarily invoke imagefactory directly. A
  second wrapper will be added to support running in kubernetes if
needed.

remove final dependencies on results variable 3cf47dd85c

* put logging code into runCmd method to reduce repeated code

move treeinfo writing to Shared 77178e9657

move treeinfo writing to Shared b9037585c7

os is missing from initial lorax variant 79682d0e98

add tweak treeinfo for dnf_utils f9166541f4

missing logger 93d6bae08c

add more logging f308e87b15

reverse for loops b78c4a774d

add live root logic before sign off d84a686102

various cleanup of image build script 7365ca6b06

* reorder imports
* pass cli arguments directly into class for simplification and
  segregation
* reorder class variables
* Some error checking to ensure we're writing what we want to
* Allow copy(upload?) step to be skipped
* properly consume stdout and stderr from popen to avoid exception when
  FD is closed but trying to be read by the subprocess_log function

Bump to 0.2.0 04e7e1d164

* Add metadata with README information
* Bump to 0.2.0
* Move more functions into shared

Refactor Architecture class and fix names for output files 55abe763ef

Update CI for both image types for now 9536ab0743

Fix names for builds 843f412923

add checksum combine for close out 340a6a3377

Finish and resolve RLBT#0000134 b89ebe777a

fix readme and bump to RC2 1c90edaa70

Changes for oz/imagefactory config naming fe4daffb25

Remove fedora_release var, no longer needed 8954987365

Fixup container files 554937009e

correct treeinfo for ks 138d1076f5

add generic exceptions 3aa640ec45

use actual logging now 1d5447b1fb

add missing ks treeinfo deploy cf13fb0a02

fix up if statement a7cf5db050

Simplify colors and start fleshing out cloud image pulls 6946b737fc

Modify all Configs and add image puller b54447571b

* Add livemap and imagemap to configs
* Add cloud image puller to iso_utils (part 1)
* Simplify color logging (potential prep for colorlog)

correct comments, fix livemap configs 73f08780d9

turn off all repos in container d482019ca5

put sed in right spot 22184f30a4

undo config name e9e37384ae

revert config and add repo name check 8f9f2646b7

logging wasn't ready 343fe053d9

Revert back to RC2, there isn't an RC3 6880403c38

I really don't know why I switched it to RC3. Was it reflex? Was it my
inability to sleep? You be the judge.

begin live build configuration and move funcs to shared aaa89c74a4

add another temporary sync-to-X-X script 4c426ca1e3

images should be pulled based on format and name a4ee9ecc02

Fix names for jobs 9e9955a0de

Various image building changes 767362aceb

* Add UBI container specification
* Change ouput path to simplify copying operations
* Install patches for imagefactory and fixed version of oz for RHEL in
  container
    * Please ignore the RPM in this repo for now...
* Add conversion steps for Vagrant, EC2 images
* Fix KSes if they have a $basearch variable by subtitution
* Add usefbx variable to ensure we have an output for debugging

Build azure images, too 3cccd03d55

Fix path to containerized azure prep script 007f571224

properly loop live images 5f2f3cae5b

add checksum combo for images 40b3af462d

solve path join issue 193c3f9b73

compress genericcloud and vagrant images by default 1f94680924

* add azure support
* use download.r.o url

add in live generation 9568b0cbcb

seems to work with selinux on 30d1c317cd

add justcopyit for live images 520db534be

add justcopyit for live images a3c5d33ae8

should have used shortname for mock root 9e4f89cf6d

should have used shortname for mock root cee688b2c2

force build 1ba76a849a

looking at the wrong place 76012c8549

make a correction on the readme f10a172c17

I hate this syntax, use a \n 911f835bfb

Add symlink parameter to resolve script runtime 6b236b7b5f

revert to stg url now that CDN is fixed. add in some additional metadata for builds and cleanup output for containers 20bf0812db

project should contain image name 3207fd4ad0

Add a final grep to log for "FAILED" (RLBT#0000138) 8017026bc8

Add a final grep if exit code of reposync is 0. There are cases where
dnf reposync will say the sync succeeded despite not downloading a
package due to a failed mirror. It is a failure when a GPG key can't be
verified or some other unforeseen cirumstance... but not when a package
can't be downloaded because of "all mirrors tried"

Also added "time" to the fpsync commands for RL9 syncing.

Add pungi-like composeinfo metadata and modify readme f1fbcff0ef

force selinux for the temporary repo file 37714cabd6

Run / source sync things from other directories 4a278cb091

Support checking a different path easily (LIST=debuglist mangle/validate-repos, e.g.) 9aada45f95

add additional file list operations for neil 813acedf84

fix up script beebdaa105

increase worker count ca47a82d99