sshtepa/toolkit
1
0
Fork 0
forked from sig_core/toolkit
Code Pull Requests Activity
718 Commits 1 Branch 0 Tags 1.9 MiB
59467129e7
Commit Graph

383 Commits

Author SHA1 Message Date
Louis Abel
d482019ca5
turn off all repos in container 2022-07-06 23:23:07 -07:00
Louis Abel
73f08780d9
correct comments, fix livemap configs 2022-07-06 07:44:37 -07:00
Louis Abel
b54447571b
Modify all Configs and add image puller 
* Add livemap and imagemap to configs
* Add cloud image puller to iso_utils (part 1)
* Simplify color logging (potential prep for colorlog)
 2022-07-05 20:42:41 -07:00
Louis Abel
6946b737fc
Simplify colors and start fleshing out cloud image pulls 2022-07-05 14:47:38 -07:00
Louis Abel
a7cf5db050
fix up if statement 2022-07-05 08:43:57 -07:00
Louis Abel
cf13fb0a02
add missing ks treeinfo deploy 2022-07-05 08:04:46 -07:00
Louis Abel
1d5447b1fb
use actual logging now 2022-07-05 00:50:02 -07:00
Louis Abel
3aa640ec45
add generic exceptions 2022-07-05 00:26:49 -07:00
Louis Abel
138d1076f5
correct treeinfo for ks 2022-07-04 21:24:35 -07:00
Neil Hanlon
554937009e
Fixup container files 2022-07-04 21:17:02 -04:00
Neil Hanlon
8954987365
Remove fedora_release var, no longer needed 2022-07-04 17:55:46 -04:00
Neil Hanlon
fe4daffb25
Changes for oz/imagefactory config naming 2022-07-04 16:35:58 -04:00
Louis Abel
1c90edaa70
fix readme and bump to RC2 2022-07-04 13:10:48 -07:00
Louis Abel
b89ebe777a
Finish and resolve RLBT#0000134 2022-07-04 12:36:15 -07:00
Louis Abel
340a6a3377
add checksum combine for close out 2022-07-04 12:23:12 -07:00
Neil Hanlon
55abe763ef
Refactor Architecture class and fix names for output files 2022-07-04 14:44:20 -04:00
Louis Abel
04e7e1d164
Bump to 0.2.0 
* Add metadata with README information
* Bump to 0.2.0
* Move more functions into shared
 2022-07-04 11:32:10 -07:00
Neil Hanlon
7365ca6b06
various cleanup of image build script 
* reorder imports
* pass cli arguments directly into class for simplification and
  segregation
* reorder class variables
* Some error checking to ensure we're writing what we want to
* Allow copy(upload?) step to be skipped
* properly consume stdout and stderr from popen to avoid exception when
  FD is closed but trying to be read by the subprocess_log function
 2022-07-04 12:09:10 -04:00
Louis Abel
d84a686102
add live root logic before sign off 2022-07-04 00:53:39 -07:00
Louis Abel
b78c4a774d
reverse for loops 2022-07-03 23:50:08 -07:00
Louis Abel
f308e87b15
add more logging 2022-07-03 23:42:35 -07:00
Louis Abel
93d6bae08c
missing logger 2022-07-03 23:35:03 -07:00
Louis Abel
f9166541f4
add tweak treeinfo for dnf_utils 2022-07-03 23:27:49 -07:00
Louis Abel
79682d0e98
os is missing from initial lorax variant 2022-07-03 21:14:33 -07:00
Louis Abel
77178e9657
move treeinfo writing to Shared 2022-07-03 21:01:18 -07:00
Neil Hanlon
3cf47dd85c
remove final dependencies on results variable 
* put logging code into runCmd method to reduce repeated code
 2022-07-03 22:48:12 -04:00
Neil Hanlon
361c155481
Containerize and refactor image building 
* Add new fedora container to run imagefactory
* Make architecture class from py attrs and make it raise exceptions
* Change build-image script to primarily invoke imagefactory directly. A
  second wrapper will be added to support running in kubernetes if
needed.
 2022-07-03 22:29:35 -04:00
Louis Abel
957bf5ef3f
change comments briefly before merging changes 2022-07-03 14:08:59 -07:00
Louis Abel
462ea264b3
add finalize script to mix 2022-07-03 00:22:00 -07:00
Louis Abel
c081f6f202
test out parts of finalize 2022-07-03 00:19:13 -07:00
Louis Abel
2884bb0eaa
Fix source and debuginfo portions 2022-07-01 14:16:14 -07:00
Louis Abel
412a7ab089
add json and yaml components 2022-07-01 13:28:24 -07:00
Louis Abel
e47ca962af
missing write function for compose_id 2022-07-01 13:13:00 -07:00
Louis Abel
c1f1be9353
Remove hardcodes, add in metadata 
* Remove hardcodes of "Rocky" to use "shortname" instead
* Add in metadata
 2022-07-01 13:09:52 -07:00
Louis Abel
4bc377cd44
Attempt to resolve RLBT#0000133 2022-06-30 15:38:50 -07:00
Louis Abel
7f6f7babf5
Attempt to resolve RLBT#0000133 2022-06-30 13:14:27 -07:00
Louis Abel
2c3409de51
treeinfo is not writing to paths 2022-06-30 03:06:29 -07:00
Louis Abel
49b001e31d
Resolve RLBT#0000132 discinfo and treeinfo 2022-06-30 01:45:08 -07:00
Louis Abel
5a02fe5a25
Resolve RLBT#0000132 discinfo and treeinfo 2022-06-30 01:43:14 -07:00
Louis Abel
69317f3881
make IPA tests runnable, lamp disabled for now 2022-06-29 20:36:59 -07:00
Louis Abel
1a04399851
fix up readme, disable gitlab tests for now 2022-06-28 12:41:12 -07:00
nazunalika
f342046f25
test should use && 2022-06-28 10:08:17 -07:00
Neil Hanlon
f65a331826
remove jinja types 2022-06-28 11:19:58 -04:00
nazunalika
7d7163a156
prepping treeinfo outside 2022-06-28 07:49:28 -07:00
Neil Hanlon
710cb08134
update github workflow to build image in the right namespace 2022-06-28 10:04:23 -04:00
Neil Hanlon
0deaae0c65
update github workflow to build image in the right namespace 2022-06-28 09:39:01 -04:00
Neil Hanlon
79425e848e
Use devel branch for container, doc fixes 2022-06-28 09:33:48 -04:00
Neil Hanlon
e60f6524a2
Implement a feature to assist in generating various images 
* use a flag to determine if we want an RC or not
* Convert rldict and sigdict to an AttributeDict to allow access via
  __getattr__
* add fedora_release variable to configs for controlling icicle
  templates
* build_image.py script to generate per-architecture XML files used by
  imagefactory
* refactor time to call utcnow() once
* add jinja types to development dependencies until we move past jinja
  2.x
* Generate TDL templates per architecture for each image variant on
  demand
* Generate imagefactory and copy commands to execute image build
* Refactor Kubernetes job template to be generic for all current jobs
 2022-06-28 09:33:15 -04:00
Neil Hanlon
4bf6fb6618
Implement a feature to assist in generating various images 
* use a flag to determine if we want an RC or not
* Convert rldict and sigdict to an AttributeDict to allow access via
  __getattr__
* add fedora_release variable to configs for controlling icicle
  templates
* build_image.py script to generate per-architecture XML files used by
  imagefactory
* refactor time to call utcnow() once
* add jinja types to development dependencies until we move past jinja
  2.x
* Generate TDL templates per architecture for each image variant on
  demand
* Generate imagefactory and copy commands to execute image build
* Refactor Kubernetes job template to be generic for all current jobs
 2022-06-28 09:33:13 -04:00
nazunalika
6fc01c8590
change RC notes 2022-06-27 18:35:11 -07:00
nazunalika
f4f29d97cc
Expand and Generalize ISO Functions 
* Utils is now empanadas.util.Shared
* Each config now has a profile name to determine latest-Rocky-{} link
  (Results RLBT#0000131)
* Check added to see if an ISO was built at some point, and forcefully
  exit if so
* Lorax tar ball should be in the format of of lorax-X.Y-ARCH to ensure
  there's no collisions between stable, beta, and lh builds
 2022-06-27 17:59:21 -07:00
nazunalika
57d51dadc7
initial boot images should have dvd in the volid 2022-06-27 03:39:11 -07:00
nazunalika
1e043ee714
fix manifest and add checksum phase to podman 2022-06-27 02:06:01 -07:00
nazunalika
7d9f222fe9
end argument missing 2022-06-27 01:18:57 -07:00
nazunalika
5ca80da56d
wrong path was being used for grafts 2022-06-27 01:13:12 -07:00
nazunalika
e7386c2f6f
xorr conf blank? 2022-06-27 01:01:36 -07:00
nazunalika
cd16cf78f4
fix dialog error 2022-06-27 00:50:41 -07:00
nazunalika
0ac1b0ba96
try logging some stuff 2022-06-27 00:40:28 -07:00
nazunalika
6d239b48e9
remove templates for xorr 2022-06-27 00:29:45 -07:00
nazunalika
8302604f7d
enable logs in general 2022-06-27 00:26:42 -07:00
nazunalika
436caefcbd
turn on xorrisofs for 9 2022-06-27 00:07:39 -07:00
nazunalika
b262e6f0c5
fix list and fix packages 2022-06-26 23:51:08 -07:00
nazunalika
fce45f3a72
put in a hack for xorrisofs 2022-06-26 22:45:31 -07:00
nazunalika
28facef12c
fix template for iso build 2022-06-26 22:05:24 -07:00
nazunalika
37c0be3fd0
attempt to build ISO in both mock and podman 2022-06-26 21:29:55 -07:00
nazunalika
43470e336b
RLBS - Finalize Treeinfo and Add xorrisofs 
In preparation to build ISO's with mock or parallel podman containers,
treeinfo support was fully added as well as the addition of xorrisofs to
prepare for the future. xorrisofs should also work for both current and
previous releases.

We have also add a currently-pending RLN experiment.
 2022-06-26 12:24:56 -07:00
nazunalika
6073066c84
restructure iso map configs 2022-06-24 15:37:32 -07:00
nazunalika
b75fe62899
scripts now generate 2022-06-23 15:29:22 -07:00
nazunalika
2e5c4778f4
Update Configs + Extra ISO Build Progress 
* Configs updated to deal with repo and structure
* Add graft point process
* Start local and podman process for extra ISO builds
 2022-06-23 13:12:53 -07:00
nazunalika
9463f96381
var had incorrect name for extra files 2022-06-21 23:51:00 -07:00
nazunalika
08f7a44cc1
fix subprocess 2022-06-21 23:23:36 -07:00
nazunalika
fdbfd840a0
add extra file refresh to primary script 2022-06-21 23:10:25 -07:00
nazunalika
ab7c36e02c
update extra files 2022-06-21 23:03:08 -07:00
nazunalika
00f330226d
update poetry and iso utilities 2022-06-21 17:21:37 -07:00
nazunalika
a28bed653a
remove minimal as an image for now 2022-06-20 20:27:30 -07:00
nazunalika
6914d651c4
update some functional tests 2022-06-20 16:49:28 -07:00
Neil Hanlon
7a097fb302
Ensure builds work properly - architectures must match 
* Actually use release version input to run build-iso command
* Buildstamp should be an epoch
* template out the job/pod names instead of doing them in the rendering
* label pods with toleration
 2022-06-20 18:03:11 -04:00
Neil Hanlon
0603620773
Fixes for current RC images 
* Make jobs uploads unique and match security context of peridot
* change image build, fix extraction of build artifacts
 2022-06-20 18:02:44 -04:00
Neil Hanlon
4587287e1e
Github actions work for automatic building 
* Add in really simple job template creation to prove the generation will
work
 2022-06-20 18:02:19 -04:00
Neil Hanlon
76dba70458
Build a container to run the builds in 
* Build this into a container to deploy
* Add lorax packages in
* Build container from public source
* Switch to different c9s mirror due to errors
* add script for building
 2022-06-20 18:01:08 -04:00
nazunalika
22f920042e
add next phase before sign off 2022-06-20 01:34:10 -07:00
nazunalika
72f98dcdb6
Tarball pull and extract 2022-06-19 22:52:20 -07:00
nazunalika
db55677a88
update lock and project 2022-06-19 10:57:05 -07:00
nazunalika
d38fa4f349
push stuff up for now 2022-06-19 07:29:01 -07:00
nazunalika
5e34a9b9c7
syntax error for syncing 2022-06-17 16:27:39 -07:00
nazunalika
f48caa4b54
actually catch the error from subprocess 2022-06-17 13:27:40 -07:00
Neil Hanlon
0abdea5c86
Some changes to make scripts work in the new setup" 2022-06-17 15:55:26 -04:00
Neil Hanlon
3749866dee
Cleanup bad rebase 2022-06-17 15:08:38 -04:00
Neil Hanlon
e3526b1588
Fix requirements specifications for EL machines that this will run on :) 2022-06-17 15:06:47 -04:00
Neil Hanlon
fa74e96c84
Lets write some poetry 2022-06-17 15:06:45 -04:00
nazunalika
7ca3cc889d
comments to explain how to do things 2022-06-17 11:49:22 -07:00
nazunalika
adc0cd3b81
add rc if statement 2022-06-17 00:16:21 -07:00
nazunalika
1ae3c67ba6
have a working script 2022-06-16 23:25:17 -07:00
nazunalika
37cd4e1b2e
commit iso build portions 2022-06-16 22:55:07 -07:00
nazunalika
c17e721633
symlink functions 2022-06-16 13:18:27 -07:00
nazunalika
84ac608967
symlink functions 2022-06-16 13:18:18 -07:00
nazunalika
613687c3c8
fullversion 2022-06-16 12:56:57 -07:00
nazunalika
2ffd96ad1e
sort logs by date 2022-06-16 12:24:19 -07:00
nazunalika
3d161df451
update iso utils and prep 2022-06-15 13:53:12 -07:00
nazunalika
602553e878
add more color for next sync 2022-06-13 07:37:50 -07:00
nazunalika
45848bf530
simply gpg checking 2022-06-12 02:55:32 -07:00
nazunalika
41f77b1d4c
remove sleepy curl 2022-06-12 02:22:01 -07:00
nazunalika
d6adcf3f8f
fix raw path 2022-06-12 02:19:20 -07:00
nazunalika
9eb649e86b
ensure separate directories are checked 2022-06-12 02:15:52 -07:00
nazunalika
08249632af
try to simplify templates, add gpg check 2022-06-12 02:08:48 -07:00
nazunalika
b376c168bb
start using templates for reposync 2022-06-11 10:49:37 -07:00
nazunalika
6c25a81241
remove nplb and rename all to devel 2022-06-11 08:03:03 -07:00
nazunalika
910901dacb
Add dnf_plugin_cmd to logs 2022-06-10 19:59:43 -07:00
nazunalika
0b70e6157a
all was missed, it can be hashed later 2022-06-10 16:22:30 -07:00
nazunalika
541ee349aa
all repo isn't hashed 2022-06-10 16:14:22 -07:00
nazunalika
7917876676
add hash flag 2022-06-10 16:05:44 -07:00
nazunalika
0a761837a6
we don't need repoclosure all over the place 2022-06-08 20:25:55 -07:00
nazunalika
8a60806803
add forcearch to drive the point home 2022-06-08 20:09:07 -07:00
nazunalika
62256a72b5
add nplb to repoclosure list and altarch stuff 2022-06-06 15:02:08 -07:00
nazunalika
bcc1dd7c22
add date stamp to repoclosure logs to keep it as clean as possible 2022-05-29 17:00:47 -07:00
nazunalika
f36af93fc2
clean all metadata 2022-05-29 14:25:32 -07:00
nazunalika
86fe08f26a
first --repo switch was missing for repoclosure 2022-05-29 13:40:54 -07:00
nazunalika
baf4893850
add repoclosure support 2022-05-28 19:28:29 -07:00
nazunalika
e49a69ceea
force arch 2022-05-27 06:59:27 -07:00
nazunalika
55870075ac
add copy function thanks to neil 2022-05-26 14:46:43 -07:00
nazunalika
8822fe2657
missing new line 2022-05-26 13:57:45 -07:00
nazunalika
4fc046627e
pipefail shoudl be on, otherwise all repos are treated as 0 2022-05-26 13:55:12 -07:00
nazunalika
b84cc7cc4d
our compose dir is nfs 2022-05-26 13:27:56 -07:00
nazunalika
fc227c947e
finish wrapper, start repoclosure 2022-05-25 21:39:32 -07:00
nazunalika
38e0af2e34
properly remove pods after checking them 2022-05-25 00:08:08 -07:00
nazunalika
223c0c468c
podman support added 2022-05-24 20:35:58 -07:00
nazunalika
16da35da3d
add work_root for a way to store logs and other stuff 2022-05-24 00:16:02 -07:00
nazunalika
e697f7ec57
add in loops for entries 2022-05-23 18:12:18 -07:00
nazunalika
d845b95e80
Final commit for 5/22 
Finish regular reposync functionality, leave notes about i686
Start podman reposync functionality
 2022-05-23 00:23:53 -07:00
nazunalika
420aa02bdb
Final commit for 5/21 2022-05-21 23:20:15 -07:00
nazunalika
4f9bfd44a0
Final Commit for 5/21 
Add better syncing for current bash scripts (thanks pgreco)
Continued python scripts, creating classes for local module imports,
with some inspiration coming from cobbler
 2022-05-21 00:10:37 -07:00
nazunalika
b0bd9a8367
start python conversion 2022-05-20 01:13:57 -07:00
nazunalika
7602ae1a44
begin ISO magic 2022-05-19 00:48:07 -07:00