lumarel/toolkit
1
0
Fork 0
forked from sig_core/toolkit
Code Issues Pull Requests Packages Projects Releases Wiki Activity
563 Commits 2 Branches 0 Tags 2 MiB
ebaaead520
Commit Graph

275 Commits

Author SHA1 Message Date
Louis Abel
debad119d9
attempt to add joliet long names 2022-07-18 15:27:35 -07:00
Louis Abel
25c3921df2
correct sig and sync 2022-07-18 13:52:41 -07:00
Louis Abel
313a26ec1f
split syncs 2022-07-17 22:11:30 -07:00
Louis Abel
90efde8477
add in a fix for timestamps on packages 2022-07-16 11:44:05 -07:00
Louis Abel
d14309ef78
turn on remote time 2022-07-15 16:55:41 -07:00
Louis Abel
61451b1b37
hardlinking should be post-sync to prod before file list 2022-07-15 16:05:14 -07:00
Louis Abel
04f2c3ab77
move generate confs and add testing script 2022-07-15 10:39:35 -07:00
Neil Hanlon
03d0c585ae
add gitignore 
* change capitalization for vbox
 2022-07-13 23:33:23 -04:00
Louis Abel
beebdaa105
fix up script 2022-07-13 20:01:23 -07:00
Louis Abel
813acedf84
add additional file list operations for neil 2022-07-13 08:46:06 -07:00
Louis Abel
37714cabd6
force selinux for the temporary repo file 2022-07-12 18:30:59 -07:00
Louis Abel
f1fbcff0ef
Add pungi-like composeinfo metadata and modify readme 2022-07-12 01:57:25 -07:00
Louis Abel
8017026bc8
Add a final grep to log for "FAILED" (RLBT#0000138) 
Add a final grep if exit code of reposync is 0. There are cases where
dnf reposync will say the sync succeeded despite not downloading a
package due to a failed mirror. It is a failure when a GPG key can't be
verified or some other unforeseen cirumstance... but not when a package
can't be downloaded because of "all mirrors tried"

Also added "time" to the fpsync commands for RL9 syncing.
 2022-07-12 00:59:19 -07:00
Louis Abel
3207fd4ad0
project should contain image name 2022-07-11 19:26:13 -07:00
Neil Hanlon
20bf0812db
revert to stg url now that CDN is fixed. add in some additional metadata for builds and cleanup output for containers 2022-07-11 21:15:31 -04:00
Neil Hanlon
6b236b7b5f
Add symlink parameter to resolve script runtime 2022-07-11 21:14:08 -04:00
Neil Hanlon
911f835bfb
I hate this syntax, use a \n 2022-07-11 20:50:30 -04:00
Louis Abel
76012c8549
looking at the wrong place 2022-07-11 16:53:20 -07:00
Louis Abel
1ba76a849a
force build 2022-07-11 16:01:19 -07:00
Louis Abel
cee688b2c2
should have used shortname for mock root 2022-07-11 15:54:03 -07:00
Louis Abel
9e4f89cf6d
should have used shortname for mock root 2022-07-11 15:33:33 -07:00
Louis Abel
a3c5d33ae8
add justcopyit for live images 2022-07-11 15:12:50 -07:00
Louis Abel
520db534be
add justcopyit for live images 2022-07-11 15:12:41 -07:00
Louis Abel
30d1c317cd
seems to work with selinux on 2022-07-11 08:58:13 -07:00
Louis Abel
9568b0cbcb
add in live generation 2022-07-11 01:06:33 -07:00
Neil Hanlon
1f94680924
compress genericcloud and vagrant images by default 
* add azure support
* use download.r.o url
 2022-07-10 21:58:12 -04:00
Louis Abel
193c3f9b73
solve path join issue 2022-07-08 20:44:15 -07:00
Louis Abel
40b3af462d
add checksum combo for images 2022-07-08 14:41:06 -07:00
Louis Abel
5f2f3cae5b
properly loop live images 2022-07-08 14:33:14 -07:00
Neil Hanlon
007f571224
Fix path to containerized azure prep script 2022-07-08 17:31:30 -04:00
Neil Hanlon
3cccd03d55
Build azure images, too 2022-07-08 17:29:32 -04:00
Neil Hanlon
767362aceb
Various image building changes 
* Add UBI container specification
* Change ouput path to simplify copying operations
* Install patches for imagefactory and fixed version of oz for RHEL in
  container
    * Please ignore the RPM in this repo for now...
* Add conversion steps for Vagrant, EC2 images
* Fix KSes if they have a $basearch variable by subtitution
* Add usefbx variable to ensure we have an output for debugging
 2022-07-08 13:30:15 -04:00
Louis Abel
a4ee9ecc02
images should be pulled based on format and name 2022-07-08 09:54:43 -07:00
Louis Abel
4c426ca1e3
add another temporary sync-to-X-X script 2022-07-08 02:22:58 -07:00
Louis Abel
aaa89c74a4
begin live build configuration and move funcs to shared 2022-07-08 01:43:30 -07:00
Louis Abel
6880403c38
Revert back to RC2, there isn't an RC3 
I really don't know why I switched it to RC3. Was it reflex? Was it my
inability to sleep? You be the judge.
 2022-07-07 00:32:42 -07:00
Louis Abel
343fe053d9
logging wasn't ready 2022-07-06 23:57:38 -07:00
Louis Abel
8f9f2646b7
revert config and add repo name check 2022-07-06 23:56:19 -07:00
Louis Abel
e9e37384ae
undo config name 2022-07-06 23:41:28 -07:00
Louis Abel
22184f30a4
put sed in right spot 2022-07-06 23:29:02 -07:00
Louis Abel
d482019ca5
turn off all repos in container 2022-07-06 23:23:07 -07:00
Louis Abel
73f08780d9
correct comments, fix livemap configs 2022-07-06 07:44:37 -07:00
Louis Abel
b54447571b
Modify all Configs and add image puller 
* Add livemap and imagemap to configs
* Add cloud image puller to iso_utils (part 1)
* Simplify color logging (potential prep for colorlog)
 2022-07-05 20:42:41 -07:00
Louis Abel
6946b737fc
Simplify colors and start fleshing out cloud image pulls 2022-07-05 14:47:38 -07:00
Louis Abel
a7cf5db050
fix up if statement 2022-07-05 08:43:57 -07:00
Louis Abel
cf13fb0a02
add missing ks treeinfo deploy 2022-07-05 08:04:46 -07:00
Louis Abel
1d5447b1fb
use actual logging now 2022-07-05 00:50:02 -07:00
Louis Abel
3aa640ec45
add generic exceptions 2022-07-05 00:26:49 -07:00
Louis Abel
138d1076f5
correct treeinfo for ks 2022-07-04 21:24:35 -07:00
Neil Hanlon
8954987365
Remove fedora_release var, no longer needed 2022-07-04 17:55:46 -04:00
Neil Hanlon
fe4daffb25
Changes for oz/imagefactory config naming 2022-07-04 16:35:58 -04:00
Louis Abel
1c90edaa70
fix readme and bump to RC2 2022-07-04 13:10:48 -07:00
Louis Abel
b89ebe777a
Finish and resolve RLBT#0000134 2022-07-04 12:36:15 -07:00
Louis Abel
340a6a3377
add checksum combine for close out 2022-07-04 12:23:12 -07:00
Neil Hanlon
55abe763ef
Refactor Architecture class and fix names for output files 2022-07-04 14:44:20 -04:00
Louis Abel
04e7e1d164
Bump to 0.2.0 
* Add metadata with README information
* Bump to 0.2.0
* Move more functions into shared
 2022-07-04 11:32:10 -07:00
Neil Hanlon
7365ca6b06
various cleanup of image build script 
* reorder imports
* pass cli arguments directly into class for simplification and
  segregation
* reorder class variables
* Some error checking to ensure we're writing what we want to
* Allow copy(upload?) step to be skipped
* properly consume stdout and stderr from popen to avoid exception when
  FD is closed but trying to be read by the subprocess_log function
 2022-07-04 12:09:10 -04:00
Louis Abel
d84a686102
add live root logic before sign off 2022-07-04 00:53:39 -07:00
Louis Abel
b78c4a774d
reverse for loops 2022-07-03 23:50:08 -07:00
Louis Abel
f308e87b15
add more logging 2022-07-03 23:42:35 -07:00
Louis Abel
93d6bae08c
missing logger 2022-07-03 23:35:03 -07:00
Louis Abel
f9166541f4
add tweak treeinfo for dnf_utils 2022-07-03 23:27:49 -07:00
Louis Abel
79682d0e98
os is missing from initial lorax variant 2022-07-03 21:14:33 -07:00
Louis Abel
77178e9657
move treeinfo writing to Shared 2022-07-03 21:01:18 -07:00
Neil Hanlon
3cf47dd85c
remove final dependencies on results variable 
* put logging code into runCmd method to reduce repeated code
 2022-07-03 22:48:12 -04:00
Neil Hanlon
361c155481
Containerize and refactor image building 
* Add new fedora container to run imagefactory
* Make architecture class from py attrs and make it raise exceptions
* Change build-image script to primarily invoke imagefactory directly. A
  second wrapper will be added to support running in kubernetes if
needed.
 2022-07-03 22:29:35 -04:00
Louis Abel
957bf5ef3f
change comments briefly before merging changes 2022-07-03 14:08:59 -07:00
Louis Abel
462ea264b3
add finalize script to mix 2022-07-03 00:22:00 -07:00
Louis Abel
c081f6f202
test out parts of finalize 2022-07-03 00:19:13 -07:00
Louis Abel
2884bb0eaa
Fix source and debuginfo portions 2022-07-01 14:16:14 -07:00
Louis Abel
412a7ab089
add json and yaml components 2022-07-01 13:28:24 -07:00
Louis Abel
e47ca962af
missing write function for compose_id 2022-07-01 13:13:00 -07:00
Louis Abel
c1f1be9353
Remove hardcodes, add in metadata 
* Remove hardcodes of "Rocky" to use "shortname" instead
* Add in metadata
 2022-07-01 13:09:52 -07:00
Louis Abel
4bc377cd44
Attempt to resolve RLBT#0000133 2022-06-30 15:38:50 -07:00
Louis Abel
7f6f7babf5
Attempt to resolve RLBT#0000133 2022-06-30 13:14:27 -07:00
Louis Abel
2c3409de51
treeinfo is not writing to paths 2022-06-30 03:06:29 -07:00
Louis Abel
49b001e31d
Resolve RLBT#0000132 discinfo and treeinfo 2022-06-30 01:45:08 -07:00
Louis Abel
5a02fe5a25
Resolve RLBT#0000132 discinfo and treeinfo 2022-06-30 01:43:14 -07:00
Louis Abel
69317f3881
make IPA tests runnable, lamp disabled for now 2022-06-29 20:36:59 -07:00
nazunalika
f342046f25
test should use && 2022-06-28 10:08:17 -07:00
nazunalika
7d7163a156
prepping treeinfo outside 2022-06-28 07:49:28 -07:00
Neil Hanlon
710cb08134
update github workflow to build image in the right namespace 2022-06-28 10:04:23 -04:00
Neil Hanlon
0deaae0c65
update github workflow to build image in the right namespace 2022-06-28 09:39:01 -04:00
Neil Hanlon
79425e848e
Use devel branch for container, doc fixes 2022-06-28 09:33:48 -04:00
Neil Hanlon
e60f6524a2
Implement a feature to assist in generating various images 
* use a flag to determine if we want an RC or not
* Convert rldict and sigdict to an AttributeDict to allow access via
  __getattr__
* add fedora_release variable to configs for controlling icicle
  templates
* build_image.py script to generate per-architecture XML files used by
  imagefactory
* refactor time to call utcnow() once
* add jinja types to development dependencies until we move past jinja
  2.x
* Generate TDL templates per architecture for each image variant on
  demand
* Generate imagefactory and copy commands to execute image build
* Refactor Kubernetes job template to be generic for all current jobs
 2022-06-28 09:33:15 -04:00
Neil Hanlon
4bf6fb6618
Implement a feature to assist in generating various images 
* use a flag to determine if we want an RC or not
* Convert rldict and sigdict to an AttributeDict to allow access via
  __getattr__
* add fedora_release variable to configs for controlling icicle
  templates
* build_image.py script to generate per-architecture XML files used by
  imagefactory
* refactor time to call utcnow() once
* add jinja types to development dependencies until we move past jinja
  2.x
* Generate TDL templates per architecture for each image variant on
  demand
* Generate imagefactory and copy commands to execute image build
* Refactor Kubernetes job template to be generic for all current jobs
 2022-06-28 09:33:13 -04:00
nazunalika
6fc01c8590
change RC notes 2022-06-27 18:35:11 -07:00
nazunalika
f4f29d97cc
Expand and Generalize ISO Functions 
* Utils is now empanadas.util.Shared
* Each config now has a profile name to determine latest-Rocky-{} link
  (Results RLBT#0000131)
* Check added to see if an ISO was built at some point, and forcefully
  exit if so
* Lorax tar ball should be in the format of of lorax-X.Y-ARCH to ensure
  there's no collisions between stable, beta, and lh builds
 2022-06-27 17:59:21 -07:00
nazunalika
57d51dadc7
initial boot images should have dvd in the volid 2022-06-27 03:39:11 -07:00
nazunalika
1e043ee714
fix manifest and add checksum phase to podman 2022-06-27 02:06:01 -07:00
nazunalika
7d9f222fe9
end argument missing 2022-06-27 01:18:57 -07:00
nazunalika
5ca80da56d
wrong path was being used for grafts 2022-06-27 01:13:12 -07:00
nazunalika
e7386c2f6f
xorr conf blank? 2022-06-27 01:01:36 -07:00
nazunalika
cd16cf78f4
fix dialog error 2022-06-27 00:50:41 -07:00
nazunalika
0ac1b0ba96
try logging some stuff 2022-06-27 00:40:28 -07:00
nazunalika
6d239b48e9
remove templates for xorr 2022-06-27 00:29:45 -07:00
nazunalika
8302604f7d
enable logs in general 2022-06-27 00:26:42 -07:00
nazunalika
436caefcbd
turn on xorrisofs for 9 2022-06-27 00:07:39 -07:00
nazunalika
b262e6f0c5
fix list and fix packages 2022-06-26 23:51:08 -07:00
nazunalika
fce45f3a72
put in a hack for xorrisofs 2022-06-26 22:45:31 -07:00
nazunalika
28facef12c
fix template for iso build 2022-06-26 22:05:24 -07:00
nazunalika
37c0be3fd0
attempt to build ISO in both mock and podman 2022-06-26 21:29:55 -07:00
nazunalika
43470e336b
RLBS - Finalize Treeinfo and Add xorrisofs 
In preparation to build ISO's with mock or parallel podman containers,
treeinfo support was fully added as well as the addition of xorrisofs to
prepare for the future. xorrisofs should also work for both current and
previous releases.

We have also add a currently-pending RLN experiment.
 2022-06-26 12:24:56 -07:00
nazunalika
6073066c84
restructure iso map configs 2022-06-24 15:37:32 -07:00
nazunalika
b75fe62899
scripts now generate 2022-06-23 15:29:22 -07:00
nazunalika
2e5c4778f4
Update Configs + Extra ISO Build Progress 
* Configs updated to deal with repo and structure
* Add graft point process
* Start local and podman process for extra ISO builds
 2022-06-23 13:12:53 -07:00
nazunalika
9463f96381
var had incorrect name for extra files 2022-06-21 23:51:00 -07:00
nazunalika
08f7a44cc1
fix subprocess 2022-06-21 23:23:36 -07:00
nazunalika
fdbfd840a0
add extra file refresh to primary script 2022-06-21 23:10:25 -07:00
nazunalika
ab7c36e02c
update extra files 2022-06-21 23:03:08 -07:00
nazunalika
00f330226d
update poetry and iso utilities 2022-06-21 17:21:37 -07:00
nazunalika
a28bed653a
remove minimal as an image for now 2022-06-20 20:27:30 -07:00
nazunalika
6914d651c4
update some functional tests 2022-06-20 16:49:28 -07:00
Neil Hanlon
7a097fb302
Ensure builds work properly - architectures must match 
* Actually use release version input to run build-iso command
* Buildstamp should be an epoch
* template out the job/pod names instead of doing them in the rendering
* label pods with toleration
 2022-06-20 18:03:11 -04:00
Neil Hanlon
0603620773
Fixes for current RC images 
* Make jobs uploads unique and match security context of peridot
* change image build, fix extraction of build artifacts
 2022-06-20 18:02:44 -04:00
Neil Hanlon
4587287e1e
Github actions work for automatic building 
* Add in really simple job template creation to prove the generation will
work
 2022-06-20 18:02:19 -04:00
nazunalika
22f920042e
add next phase before sign off 2022-06-20 01:34:10 -07:00
nazunalika
72f98dcdb6
Tarball pull and extract 2022-06-19 22:52:20 -07:00
nazunalika
db55677a88
update lock and project 2022-06-19 10:57:05 -07:00
nazunalika
d38fa4f349
push stuff up for now 2022-06-19 07:29:01 -07:00
nazunalika
5e34a9b9c7
syntax error for syncing 2022-06-17 16:27:39 -07:00
nazunalika
f48caa4b54
actually catch the error from subprocess 2022-06-17 13:27:40 -07:00
Neil Hanlon
0abdea5c86
Some changes to make scripts work in the new setup" 2022-06-17 15:55:26 -04:00
Neil Hanlon
3749866dee
Cleanup bad rebase 2022-06-17 15:08:38 -04:00
Neil Hanlon
fa74e96c84
Lets write some poetry 2022-06-17 15:06:45 -04:00