Commit Graph

316 Commits

Author SHA1 Message Date
03d0c585ae
add gitignore
* change capitalization for vbox
2022-07-13 23:33:23 -04:00
beebdaa105
fix up script 2022-07-13 20:01:23 -07:00
813acedf84
add additional file list operations for neil 2022-07-13 08:46:06 -07:00
37714cabd6
force selinux for the temporary repo file 2022-07-12 18:30:59 -07:00
f1fbcff0ef
Add pungi-like composeinfo metadata and modify readme 2022-07-12 01:57:25 -07:00
8017026bc8
Add a final grep to log for "FAILED" (RLBT#0000138)
Add a final grep if exit code of reposync is 0. There are cases where
dnf reposync will say the sync succeeded despite not downloading a
package due to a failed mirror. It is a failure when a GPG key can't be
verified or some other unforeseen cirumstance... but not when a package
can't be downloaded because of "all mirrors tried"

Also added "time" to the fpsync commands for RL9 syncing.
2022-07-12 00:59:19 -07:00
3207fd4ad0
project should contain image name 2022-07-11 19:26:13 -07:00
20bf0812db
revert to stg url now that CDN is fixed. add in some additional metadata for builds and cleanup output for containers 2022-07-11 21:15:31 -04:00
6b236b7b5f
Add symlink parameter to resolve script runtime 2022-07-11 21:14:08 -04:00
911f835bfb
I hate this syntax, use a \n 2022-07-11 20:50:30 -04:00
76012c8549
looking at the wrong place 2022-07-11 16:53:20 -07:00
1ba76a849a
force build 2022-07-11 16:01:19 -07:00
cee688b2c2
should have used shortname for mock root 2022-07-11 15:54:03 -07:00
9e4f89cf6d
should have used shortname for mock root 2022-07-11 15:33:33 -07:00
a3c5d33ae8
add justcopyit for live images 2022-07-11 15:12:50 -07:00
520db534be
add justcopyit for live images 2022-07-11 15:12:41 -07:00
30d1c317cd
seems to work with selinux on 2022-07-11 08:58:13 -07:00
9568b0cbcb
add in live generation 2022-07-11 01:06:33 -07:00
1f94680924
compress genericcloud and vagrant images by default
* add azure support
* use download.r.o url
2022-07-10 21:58:12 -04:00
193c3f9b73
solve path join issue 2022-07-08 20:44:15 -07:00
40b3af462d
add checksum combo for images 2022-07-08 14:41:06 -07:00
5f2f3cae5b
properly loop live images 2022-07-08 14:33:14 -07:00
007f571224
Fix path to containerized azure prep script 2022-07-08 17:31:30 -04:00
3cccd03d55
Build azure images, too 2022-07-08 17:29:32 -04:00
767362aceb
Various image building changes
* Add UBI container specification
* Change ouput path to simplify copying operations
* Install patches for imagefactory and fixed version of oz for RHEL in
  container
    * Please ignore the RPM in this repo for now...
* Add conversion steps for Vagrant, EC2 images
* Fix KSes if they have a $basearch variable by subtitution
* Add usefbx variable to ensure we have an output for debugging
2022-07-08 13:30:15 -04:00
a4ee9ecc02
images should be pulled based on format and name 2022-07-08 09:54:43 -07:00
4c426ca1e3
add another temporary sync-to-X-X script 2022-07-08 02:22:58 -07:00
aaa89c74a4
begin live build configuration and move funcs to shared 2022-07-08 01:43:30 -07:00
6880403c38
Revert back to RC2, there isn't an RC3
I really don't know why I switched it to RC3. Was it reflex? Was it my
inability to sleep? You be the judge.
2022-07-07 00:32:42 -07:00
343fe053d9
logging wasn't ready 2022-07-06 23:57:38 -07:00
8f9f2646b7
revert config and add repo name check 2022-07-06 23:56:19 -07:00
e9e37384ae
undo config name 2022-07-06 23:41:28 -07:00
22184f30a4
put sed in right spot 2022-07-06 23:29:02 -07:00
d482019ca5
turn off all repos in container 2022-07-06 23:23:07 -07:00
73f08780d9
correct comments, fix livemap configs 2022-07-06 07:44:37 -07:00
b54447571b
Modify all Configs and add image puller
* Add livemap and imagemap to configs
* Add cloud image puller to iso_utils (part 1)
* Simplify color logging (potential prep for colorlog)
2022-07-05 20:42:41 -07:00
6946b737fc
Simplify colors and start fleshing out cloud image pulls 2022-07-05 14:47:38 -07:00
a7cf5db050
fix up if statement 2022-07-05 08:43:57 -07:00
cf13fb0a02
add missing ks treeinfo deploy 2022-07-05 08:04:46 -07:00
1d5447b1fb
use actual logging now 2022-07-05 00:50:02 -07:00
3aa640ec45
add generic exceptions 2022-07-05 00:26:49 -07:00
138d1076f5
correct treeinfo for ks 2022-07-04 21:24:35 -07:00
554937009e
Fixup container files 2022-07-04 21:17:02 -04:00
8954987365
Remove fedora_release var, no longer needed 2022-07-04 17:55:46 -04:00
fe4daffb25
Changes for oz/imagefactory config naming 2022-07-04 16:35:58 -04:00
1c90edaa70
fix readme and bump to RC2 2022-07-04 13:10:48 -07:00
b89ebe777a
Finish and resolve RLBT#0000134 2022-07-04 12:36:15 -07:00
340a6a3377
add checksum combine for close out 2022-07-04 12:23:12 -07:00
55abe763ef
Refactor Architecture class and fix names for output files 2022-07-04 14:44:20 -04:00
04e7e1d164
Bump to 0.2.0
* Add metadata with README information
* Bump to 0.2.0
* Move more functions into shared
2022-07-04 11:32:10 -07:00
7365ca6b06
various cleanup of image build script
* reorder imports
* pass cli arguments directly into class for simplification and
  segregation
* reorder class variables
* Some error checking to ensure we're writing what we want to
* Allow copy(upload?) step to be skipped
* properly consume stdout and stderr from popen to avoid exception when
  FD is closed but trying to be read by the subprocess_log function
2022-07-04 12:09:10 -04:00
d84a686102
add live root logic before sign off 2022-07-04 00:53:39 -07:00
b78c4a774d
reverse for loops 2022-07-03 23:50:08 -07:00
f308e87b15
add more logging 2022-07-03 23:42:35 -07:00
93d6bae08c
missing logger 2022-07-03 23:35:03 -07:00
f9166541f4
add tweak treeinfo for dnf_utils 2022-07-03 23:27:49 -07:00
79682d0e98
os is missing from initial lorax variant 2022-07-03 21:14:33 -07:00
77178e9657
move treeinfo writing to Shared 2022-07-03 21:01:18 -07:00
3cf47dd85c
remove final dependencies on results variable
* put logging code into runCmd method to reduce repeated code
2022-07-03 22:48:12 -04:00
361c155481
Containerize and refactor image building
* Add new fedora container to run imagefactory
* Make architecture class from py attrs and make it raise exceptions
* Change build-image script to primarily invoke imagefactory directly. A
  second wrapper will be added to support running in kubernetes if
needed.
2022-07-03 22:29:35 -04:00
957bf5ef3f
change comments briefly before merging changes 2022-07-03 14:08:59 -07:00
462ea264b3
add finalize script to mix 2022-07-03 00:22:00 -07:00
c081f6f202
test out parts of finalize 2022-07-03 00:19:13 -07:00
2884bb0eaa
Fix source and debuginfo portions 2022-07-01 14:16:14 -07:00
412a7ab089
add json and yaml components 2022-07-01 13:28:24 -07:00
e47ca962af
missing write function for compose_id 2022-07-01 13:13:00 -07:00
c1f1be9353
Remove hardcodes, add in metadata
* Remove hardcodes of "Rocky" to use "shortname" instead
* Add in metadata
2022-07-01 13:09:52 -07:00
4bc377cd44
Attempt to resolve RLBT#0000133 2022-06-30 15:38:50 -07:00
7f6f7babf5
Attempt to resolve RLBT#0000133 2022-06-30 13:14:27 -07:00
2c3409de51
treeinfo is not writing to paths 2022-06-30 03:06:29 -07:00
49b001e31d
Resolve RLBT#0000132 discinfo and treeinfo 2022-06-30 01:45:08 -07:00
5a02fe5a25
Resolve RLBT#0000132 discinfo and treeinfo 2022-06-30 01:43:14 -07:00
69317f3881
make IPA tests runnable, lamp disabled for now 2022-06-29 20:36:59 -07:00
1a04399851
fix up readme, disable gitlab tests for now 2022-06-28 12:41:12 -07:00
f342046f25
test should use && 2022-06-28 10:08:17 -07:00
f65a331826
remove jinja types 2022-06-28 11:19:58 -04:00
7d7163a156
prepping treeinfo outside 2022-06-28 07:49:28 -07:00
710cb08134
update github workflow to build image in the right namespace 2022-06-28 10:04:23 -04:00
0deaae0c65
update github workflow to build image in the right namespace 2022-06-28 09:39:01 -04:00
79425e848e
Use devel branch for container, doc fixes 2022-06-28 09:33:48 -04:00
e60f6524a2
Implement a feature to assist in generating various images
* use a flag to determine if we want an RC or not
* Convert rldict and sigdict to an AttributeDict to allow access via
  __getattr__
* add fedora_release variable to configs for controlling icicle
  templates
* build_image.py script to generate per-architecture XML files used by
  imagefactory
* refactor time to call utcnow() once
* add jinja types to development dependencies until we move past jinja
  2.x
* Generate TDL templates per architecture for each image variant on
  demand
* Generate imagefactory and copy commands to execute image build
* Refactor Kubernetes job template to be generic for all current jobs
2022-06-28 09:33:15 -04:00
4bf6fb6618
Implement a feature to assist in generating various images
* use a flag to determine if we want an RC or not
* Convert rldict and sigdict to an AttributeDict to allow access via
  __getattr__
* add fedora_release variable to configs for controlling icicle
  templates
* build_image.py script to generate per-architecture XML files used by
  imagefactory
* refactor time to call utcnow() once
* add jinja types to development dependencies until we move past jinja
  2.x
* Generate TDL templates per architecture for each image variant on
  demand
* Generate imagefactory and copy commands to execute image build
* Refactor Kubernetes job template to be generic for all current jobs
2022-06-28 09:33:13 -04:00
6fc01c8590
change RC notes 2022-06-27 18:35:11 -07:00
f4f29d97cc
Expand and Generalize ISO Functions
* Utils is now empanadas.util.Shared
* Each config now has a profile name to determine latest-Rocky-{} link
  (Results RLBT#0000131)
* Check added to see if an ISO was built at some point, and forcefully
  exit if so
* Lorax tar ball should be in the format of of lorax-X.Y-ARCH to ensure
  there's no collisions between stable, beta, and lh builds
2022-06-27 17:59:21 -07:00
57d51dadc7
initial boot images should have dvd in the volid 2022-06-27 03:39:11 -07:00
1e043ee714
fix manifest and add checksum phase to podman 2022-06-27 02:06:01 -07:00
7d9f222fe9
end argument missing 2022-06-27 01:18:57 -07:00
5ca80da56d
wrong path was being used for grafts 2022-06-27 01:13:12 -07:00
e7386c2f6f
xorr conf blank? 2022-06-27 01:01:36 -07:00
cd16cf78f4
fix dialog error 2022-06-27 00:50:41 -07:00
0ac1b0ba96
try logging some stuff 2022-06-27 00:40:28 -07:00
6d239b48e9
remove templates for xorr 2022-06-27 00:29:45 -07:00
8302604f7d
enable logs in general 2022-06-27 00:26:42 -07:00
436caefcbd
turn on xorrisofs for 9 2022-06-27 00:07:39 -07:00
b262e6f0c5
fix list and fix packages 2022-06-26 23:51:08 -07:00
fce45f3a72
put in a hack for xorrisofs 2022-06-26 22:45:31 -07:00
28facef12c
fix template for iso build 2022-06-26 22:05:24 -07:00
37c0be3fd0
attempt to build ISO in both mock and podman 2022-06-26 21:29:55 -07:00
43470e336b
RLBS - Finalize Treeinfo and Add xorrisofs
In preparation to build ISO's with mock or parallel podman containers,
treeinfo support was fully added as well as the addition of xorrisofs to
prepare for the future. xorrisofs should also work for both current and
previous releases.

We have also add a currently-pending RLN experiment.
2022-06-26 12:24:56 -07:00
6073066c84
restructure iso map configs 2022-06-24 15:37:32 -07:00
b75fe62899
scripts now generate 2022-06-23 15:29:22 -07:00
2e5c4778f4
Update Configs + Extra ISO Build Progress
* Configs updated to deal with repo and structure
* Add graft point process
* Start local and podman process for extra ISO builds
2022-06-23 13:12:53 -07:00
9463f96381
var had incorrect name for extra files 2022-06-21 23:51:00 -07:00
08f7a44cc1
fix subprocess 2022-06-21 23:23:36 -07:00
fdbfd840a0
add extra file refresh to primary script 2022-06-21 23:10:25 -07:00
ab7c36e02c
update extra files 2022-06-21 23:03:08 -07:00
00f330226d
update poetry and iso utilities 2022-06-21 17:21:37 -07:00
a28bed653a
remove minimal as an image for now 2022-06-20 20:27:30 -07:00
6914d651c4
update some functional tests 2022-06-20 16:49:28 -07:00
7a097fb302
Ensure builds work properly - architectures must match
* Actually use release version input to run build-iso command
* Buildstamp should be an epoch
* template out the job/pod names instead of doing them in the rendering
* label pods with toleration
2022-06-20 18:03:11 -04:00
0603620773
Fixes for current RC images
* Make jobs uploads unique and match security context of peridot
* change image build, fix extraction of build artifacts
2022-06-20 18:02:44 -04:00
4587287e1e
Github actions work for automatic building
* Add in really simple job template creation to prove the generation will
work
2022-06-20 18:02:19 -04:00
76dba70458
Build a container to run the builds in
* Build this into a container to deploy
* Add lorax packages in
* Build container from public source
* Switch to different c9s mirror due to errors
* add script for building
2022-06-20 18:01:08 -04:00
22f920042e
add next phase before sign off 2022-06-20 01:34:10 -07:00
72f98dcdb6
Tarball pull and extract 2022-06-19 22:52:20 -07:00
db55677a88
update lock and project 2022-06-19 10:57:05 -07:00
d38fa4f349
push stuff up for now 2022-06-19 07:29:01 -07:00
5e34a9b9c7
syntax error for syncing 2022-06-17 16:27:39 -07:00
f48caa4b54
actually catch the error from subprocess 2022-06-17 13:27:40 -07:00
0abdea5c86
Some changes to make scripts work in the new setup" 2022-06-17 15:55:26 -04:00
3749866dee
Cleanup bad rebase 2022-06-17 15:08:38 -04:00
e3526b1588
Fix requirements specifications for EL machines that this will run on :) 2022-06-17 15:06:47 -04:00
fa74e96c84
Lets write some poetry 2022-06-17 15:06:45 -04:00
7ca3cc889d
comments to explain how to do things 2022-06-17 11:49:22 -07:00
adc0cd3b81
add rc if statement 2022-06-17 00:16:21 -07:00
1ae3c67ba6
have a working script 2022-06-16 23:25:17 -07:00
37cd4e1b2e
commit iso build portions 2022-06-16 22:55:07 -07:00
c17e721633
symlink functions 2022-06-16 13:18:27 -07:00
84ac608967
symlink functions 2022-06-16 13:18:18 -07:00
613687c3c8
fullversion 2022-06-16 12:56:57 -07:00
2ffd96ad1e
sort logs by date 2022-06-16 12:24:19 -07:00
3d161df451
update iso utils and prep 2022-06-15 13:53:12 -07:00
602553e878
add more color for next sync 2022-06-13 07:37:50 -07:00
45848bf530
simply gpg checking 2022-06-12 02:55:32 -07:00
41f77b1d4c
remove sleepy curl 2022-06-12 02:22:01 -07:00
d6adcf3f8f
fix raw path 2022-06-12 02:19:20 -07:00
9eb649e86b
ensure separate directories are checked 2022-06-12 02:15:52 -07:00
08249632af
try to simplify templates, add gpg check 2022-06-12 02:08:48 -07:00
b376c168bb
start using templates for reposync 2022-06-11 10:49:37 -07:00
6c25a81241
remove nplb and rename all to devel 2022-06-11 08:03:03 -07:00
910901dacb
Add dnf_plugin_cmd to logs 2022-06-10 19:59:43 -07:00
0b70e6157a
all was missed, it can be hashed later 2022-06-10 16:22:30 -07:00
541ee349aa
all repo isn't hashed 2022-06-10 16:14:22 -07:00
7917876676
add hash flag 2022-06-10 16:05:44 -07:00
0a761837a6
we don't need repoclosure all over the place 2022-06-08 20:25:55 -07:00
8a60806803
add forcearch to drive the point home 2022-06-08 20:09:07 -07:00
62256a72b5
add nplb to repoclosure list and altarch stuff 2022-06-06 15:02:08 -07:00
bcc1dd7c22
add date stamp to repoclosure logs to keep it as clean as possible 2022-05-29 17:00:47 -07:00
f36af93fc2
clean all metadata 2022-05-29 14:25:32 -07:00
86fe08f26a
first --repo switch was missing for repoclosure 2022-05-29 13:40:54 -07:00
baf4893850
add repoclosure support 2022-05-28 19:28:29 -07:00
e49a69ceea
force arch 2022-05-27 06:59:27 -07:00
55870075ac
add copy function thanks to neil 2022-05-26 14:46:43 -07:00
8822fe2657
missing new line 2022-05-26 13:57:45 -07:00
4fc046627e
pipefail shoudl be on, otherwise all repos are treated as 0 2022-05-26 13:55:12 -07:00
b84cc7cc4d
our compose dir is nfs 2022-05-26 13:27:56 -07:00
fc227c947e
finish wrapper, start repoclosure 2022-05-25 21:39:32 -07:00
38e0af2e34
properly remove pods after checking them 2022-05-25 00:08:08 -07:00
223c0c468c
podman support added 2022-05-24 20:35:58 -07:00
16da35da3d
add work_root for a way to store logs and other stuff 2022-05-24 00:16:02 -07:00
e697f7ec57
add in loops for entries 2022-05-23 18:12:18 -07:00
d845b95e80
Final commit for 5/22
Finish regular reposync functionality, leave notes about i686
Start podman reposync functionality
2022-05-23 00:23:53 -07:00
420aa02bdb
Final commit for 5/21 2022-05-21 23:20:15 -07:00
4f9bfd44a0
Final Commit for 5/21
Add better syncing for current bash scripts (thanks pgreco)
Continued python scripts, creating classes for local module imports,
with some inspiration coming from cobbler
2022-05-21 00:10:37 -07:00
b0bd9a8367
start python conversion 2022-05-20 01:13:57 -07:00
7602ae1a44
begin ISO magic 2022-05-19 00:48:07 -07:00