Commit Graph

363 Commits

Author SHA1 Message Date
9c1ea04fee
fix filetype issues with images 2022-11-20 13:15:06 -07:00
73d774e0e4
address stack trace for arches no found for platform 2022-11-20 11:05:47 -07:00
2798f28fc3
raise to RC2 2022-11-20 02:42:29 -07:00
4e4a4bb123
switch to NamedTemporaryFile instead of rolling our own 2022-11-19 20:14:31 -05:00
98797d1b6c
add Virtualbox vagrantfile, reintroduce convertOptions 2022-11-19 19:08:05 -05:00
b9e8f486c1
fixes for Vagrant images 2022-11-19 18:45:51 -05:00
0cd72e56be
fix vmx template 2022-11-19 17:22:13 -05:00
57ba3ca98c
rename metadata file to not conflict 2022-11-19 17:09:00 -05:00
8b099f255c
fixes for vmware 2022-11-19 17:01:55 -05:00
4777fc3db0
begin work on composing vagrant boxes 2022-11-19 16:27:03 -05:00
c244f298eb
add configs for pulling RPI images 2022-11-19 14:01:22 -05:00
09567eb82e
RPI image needs to be an xz'd .raw 2022-11-19 13:21:50 -05:00
435206c1ca
add rpi image 2022-11-18 23:46:30 -05:00
4bf7f6673d
use v2 2022-11-18 21:38:39 -07:00
37e5c3fe40
try to fix s3 pagination 2022-11-18 21:34:45 -07:00
cab05e961f
try to fix s3 pagination 2022-11-18 21:33:10 -07:00
d6cc56c7c0
fix latest image str replace 2022-11-18 16:16:01 -07:00
713b58f181
update ipa readme 2022-11-15 15:17:54 -07:00
3892e55c58
set all releases to qcow2 for ec2 2022-11-13 17:22:54 -07:00
398b146982
VMware should be vmdk 2022-11-13 18:47:39 -05:00
564d64a979
change EC2 to qcow2 2022-11-13 18:21:05 -05:00
e4c0eb2abc
add vmware 2022-11-13 18:20:13 -05:00
7b9db7d547
utilize dictionaries to pull images 2022-11-13 13:16:38 -07:00
dba0d00e17
update all configs to use new cloud image format 2022-11-13 10:29:21 -07:00
d98c4ee01b
add in primary_variant to do further linking if necessary 2022-11-12 19:34:53 -07:00
d028b28d63
beginning work on downloading variant images 2022-11-12 12:04:52 -05:00
605cc1fdc3
bump revision 2022-11-12 10:36:28 -05:00
9cfbc7dff2
update to 87 91 2022-11-11 13:37:17 -07:00
01b4d38c50
remove kernel arches 2022-11-04 17:36:24 -07:00
864fe22b74
try to fix local pungi prepop 2022-10-31 15:39:38 -07:00
7288a6f544
it's powertools in the mangler 2022-10-25 15:19:53 -07:00
9fa51f10de
BugFix: Fix profile validity checking 2022-10-20 15:27:30 -07:00
4d6a0c9519
move disttag to per profile 2022-10-20 01:18:11 -07:00
afb3576a3d
Add OCP building back 2022-10-19 22:28:57 -04:00
816e4a69e9
fix var name commas 2022-10-17 09:26:22 -07:00
3d50223fe3
add split and check at beginning 2022-10-17 09:25:49 -07:00
da3901d742
Metadata updates (part 3)
* Allow multiple repos in a single command with comma separation
* Add metadata paths for pungi-like composeinfo.json
2022-10-14 22:29:09 -07:00
dea32e0fd0
make regex take care of double digits 2022-10-12 20:39:23 -07:00
544f7d2fa4
temporarily fallback to 8.6 2022-10-11 20:09:55 -07:00
53ab6a9ec5
Modify repoclosure for peridot and metadata
* Fix peridot repoclosure script
* Modify shared utils for metadata and repositories (part 1, metadata)
* Modify dnf utils to take advantage of shared utility (part 2, metadata)
2022-10-11 19:58:17 -07:00
f7bff05735
hotfix: need to initialize var 2022-10-11 20:50:07 -04:00
b2b8a85800
Fix key names on 8-beta and 8-lookahead 2022-10-11 20:46:44 -04:00
fb37eb1bbc
add OCP to the necessary locations 2022-10-11 20:40:37 -04:00
5a2c16ff28
Checkout kickstarts on every run, instead of when building the image 2022-10-11 11:55:39 -04:00
a5f757140b
Add i686 to translation map 2022-10-11 11:51:23 -04:00
bb6b8523a3
Bump to version 0.5.0 for next phase of dev 2022-10-10 11:58:42 -07:00
Simon K
7d903cf5cb
container(imagefactory): Fix ARG syntax
Continerfile.imagefactory was missing an equal sign ('=') for an ARG
default value. This prevented the container image build from completing
a git clone successfully.
2022-10-10 11:43:56 -04:00
a9dd322765
add hashed option 2022-10-05 16:35:09 -07:00
9bfe6f505e
Add support for repoclosure at peridot level 2022-10-05 16:15:08 -07:00
0351d2a289
change lookahead data 2022-10-03 14:33:22 -07:00
0f8e587b98
add project ID for 9.1 beta 2022-10-03 14:32:14 -07:00
f97546ca4a
Add r8 beta and lh 2022-09-23 10:44:21 -07:00
eeae7ff5ab
remove kernel parameter from icicle 2022-09-14 21:34:24 -07:00
27c8d4ae17
add MATE to live images 2022-09-11 19:04:49 -07:00
2156c05eb2
dir is actually stage 2022-09-11 19:01:01 -07:00
6731e3f4a5
add fedora major version for future use 2022-08-28 23:21:54 -07:00
29afcddf7c
Add aarch64 to allowed live arches 2022-08-23 13:44:17 -07:00
156daf679f
live images should work per arch 2022-08-23 01:02:48 -07:00
9898e29931
clarify the readme 2022-08-08 16:18:54 -07:00
6374376f7c
add README support for isos 2022-08-08 16:04:52 -07:00
a1734103bd
add missing checksum portion for live 2022-08-05 18:14:24 -07:00
77ba94cca1
latest symlinks for boot and live images 2022-08-05 15:00:04 -07:00
bffff511f3
Add unversioned linking and checksums
Add symlinked versions of all images that are unversioned. This is
primarily for users who would like a URL path to the latest ISO for a
particular release. This is also for cases like osinfo where there
should be a generic path per major release.
2022-08-05 01:24:49 -07:00
18b985cdcc
add delete old packages option 2022-08-03 23:07:47 -07:00
c416c09cf0
add project ID's for altarch 2022-07-31 19:23:38 -07:00
126e44e48b
powerpc is PPC, everything else is LINUX 2022-07-30 09:48:48 -07:00
045e07cf25
add system_id to xorriso template 2022-07-30 02:32:22 -07:00
a950af3404
fix naming for live images 2022-07-29 21:58:10 -07:00
6c20ee5a43
Add needed features (0.4.0)
* Add --disable-gpg-check switch to sync scripts
* Add --disable-repo-gpg-check switch to sync scripts
* Add datestamp for future image use
2022-07-28 16:00:40 -07:00
77264a3195
fix arch in altarch config 2022-07-27 13:39:36 -07:00
e4018d11d7
add sig syncs 2022-07-25 18:03:07 -07:00
e337d723c9
deploy gpg key with sig 2022-07-25 16:46:53 -07:00
c73d52d42b
755 is sufficient enough 2022-07-25 03:30:52 -07:00
56af2ade35
tweaking treeinfo in kickstart shouldn't matter 2022-07-25 03:12:26 -07:00
03111ba623
add skip all function for treeinfo only mods 2022-07-25 03:07:09 -07:00
35e3028fce
address permission issues with EFI files from lorax 2022-07-25 01:30:11 -07:00
9119e772d6
add initial sig syncing components 2022-07-25 00:46:34 -07:00
3b3d3da489
ensure there is proper logging for xorriso 2022-07-21 01:00:31 -07:00
2b0907043e
try to resolve ppc64le not booting RLBT#0000158 2022-07-21 00:25:31 -07:00
8d77a63a6a
Start work on 0.4.0
* Start SIG deployment testing
* Add additional sigs: desktop, virt
* Modify altarch to match repo names in release package
2022-07-20 16:17:19 -07:00
65a4ec93c3
add in checksum for latest image (RLBT#0000148) 2022-07-19 02:01:05 -07:00
60f97b1c67
joliet on 2022-07-18 15:51:10 -07:00
debad119d9
attempt to add joliet long names 2022-07-18 15:27:35 -07:00
25c3921df2
correct sig and sync 2022-07-18 13:52:41 -07:00
313a26ec1f
split syncs 2022-07-17 22:11:30 -07:00
90efde8477
add in a fix for timestamps on packages 2022-07-16 11:44:05 -07:00
d14309ef78
turn on remote time 2022-07-15 16:55:41 -07:00
61451b1b37
hardlinking should be post-sync to prod before file list 2022-07-15 16:05:14 -07:00
04f2c3ab77
move generate confs and add testing script 2022-07-15 10:39:35 -07:00
929aa97e8b
bump to 0.3.0; release 2022-07-13 23:34:08 -04:00
03d0c585ae
add gitignore
* change capitalization for vbox
2022-07-13 23:33:23 -04:00
beebdaa105
fix up script 2022-07-13 20:01:23 -07:00
813acedf84
add additional file list operations for neil 2022-07-13 08:46:06 -07:00
37714cabd6
force selinux for the temporary repo file 2022-07-12 18:30:59 -07:00
f1fbcff0ef
Add pungi-like composeinfo metadata and modify readme 2022-07-12 01:57:25 -07:00
8017026bc8
Add a final grep to log for "FAILED" (RLBT#0000138)
Add a final grep if exit code of reposync is 0. There are cases where
dnf reposync will say the sync succeeded despite not downloading a
package due to a failed mirror. It is a failure when a GPG key can't be
verified or some other unforeseen cirumstance... but not when a package
can't be downloaded because of "all mirrors tried"

Also added "time" to the fpsync commands for RL9 syncing.
2022-07-12 00:59:19 -07:00
3207fd4ad0
project should contain image name 2022-07-11 19:26:13 -07:00
20bf0812db
revert to stg url now that CDN is fixed. add in some additional metadata for builds and cleanup output for containers 2022-07-11 21:15:31 -04:00
6b236b7b5f
Add symlink parameter to resolve script runtime 2022-07-11 21:14:08 -04:00
911f835bfb
I hate this syntax, use a \n 2022-07-11 20:50:30 -04:00
76012c8549
looking at the wrong place 2022-07-11 16:53:20 -07:00
1ba76a849a
force build 2022-07-11 16:01:19 -07:00
cee688b2c2
should have used shortname for mock root 2022-07-11 15:54:03 -07:00
9e4f89cf6d
should have used shortname for mock root 2022-07-11 15:33:33 -07:00
a3c5d33ae8
add justcopyit for live images 2022-07-11 15:12:50 -07:00
520db534be
add justcopyit for live images 2022-07-11 15:12:41 -07:00
30d1c317cd
seems to work with selinux on 2022-07-11 08:58:13 -07:00
9568b0cbcb
add in live generation 2022-07-11 01:06:33 -07:00
1f94680924
compress genericcloud and vagrant images by default
* add azure support
* use download.r.o url
2022-07-10 21:58:12 -04:00
193c3f9b73
solve path join issue 2022-07-08 20:44:15 -07:00
40b3af462d
add checksum combo for images 2022-07-08 14:41:06 -07:00
5f2f3cae5b
properly loop live images 2022-07-08 14:33:14 -07:00
007f571224
Fix path to containerized azure prep script 2022-07-08 17:31:30 -04:00
3cccd03d55
Build azure images, too 2022-07-08 17:29:32 -04:00
767362aceb
Various image building changes
* Add UBI container specification
* Change ouput path to simplify copying operations
* Install patches for imagefactory and fixed version of oz for RHEL in
  container
    * Please ignore the RPM in this repo for now...
* Add conversion steps for Vagrant, EC2 images
* Fix KSes if they have a $basearch variable by subtitution
* Add usefbx variable to ensure we have an output for debugging
2022-07-08 13:30:15 -04:00
a4ee9ecc02
images should be pulled based on format and name 2022-07-08 09:54:43 -07:00
4c426ca1e3
add another temporary sync-to-X-X script 2022-07-08 02:22:58 -07:00
aaa89c74a4
begin live build configuration and move funcs to shared 2022-07-08 01:43:30 -07:00
6880403c38
Revert back to RC2, there isn't an RC3
I really don't know why I switched it to RC3. Was it reflex? Was it my
inability to sleep? You be the judge.
2022-07-07 00:32:42 -07:00
343fe053d9
logging wasn't ready 2022-07-06 23:57:38 -07:00
8f9f2646b7
revert config and add repo name check 2022-07-06 23:56:19 -07:00
e9e37384ae
undo config name 2022-07-06 23:41:28 -07:00
22184f30a4
put sed in right spot 2022-07-06 23:29:02 -07:00
d482019ca5
turn off all repos in container 2022-07-06 23:23:07 -07:00
73f08780d9
correct comments, fix livemap configs 2022-07-06 07:44:37 -07:00
b54447571b
Modify all Configs and add image puller
* Add livemap and imagemap to configs
* Add cloud image puller to iso_utils (part 1)
* Simplify color logging (potential prep for colorlog)
2022-07-05 20:42:41 -07:00
6946b737fc
Simplify colors and start fleshing out cloud image pulls 2022-07-05 14:47:38 -07:00
a7cf5db050
fix up if statement 2022-07-05 08:43:57 -07:00
cf13fb0a02
add missing ks treeinfo deploy 2022-07-05 08:04:46 -07:00
1d5447b1fb
use actual logging now 2022-07-05 00:50:02 -07:00
3aa640ec45
add generic exceptions 2022-07-05 00:26:49 -07:00
138d1076f5
correct treeinfo for ks 2022-07-04 21:24:35 -07:00
554937009e
Fixup container files 2022-07-04 21:17:02 -04:00
8954987365
Remove fedora_release var, no longer needed 2022-07-04 17:55:46 -04:00
fe4daffb25
Changes for oz/imagefactory config naming 2022-07-04 16:35:58 -04:00
1c90edaa70
fix readme and bump to RC2 2022-07-04 13:10:48 -07:00
b89ebe777a
Finish and resolve RLBT#0000134 2022-07-04 12:36:15 -07:00
340a6a3377
add checksum combine for close out 2022-07-04 12:23:12 -07:00
55abe763ef
Refactor Architecture class and fix names for output files 2022-07-04 14:44:20 -04:00
04e7e1d164
Bump to 0.2.0
* Add metadata with README information
* Bump to 0.2.0
* Move more functions into shared
2022-07-04 11:32:10 -07:00
7365ca6b06
various cleanup of image build script
* reorder imports
* pass cli arguments directly into class for simplification and
  segregation
* reorder class variables
* Some error checking to ensure we're writing what we want to
* Allow copy(upload?) step to be skipped
* properly consume stdout and stderr from popen to avoid exception when
  FD is closed but trying to be read by the subprocess_log function
2022-07-04 12:09:10 -04:00
d84a686102
add live root logic before sign off 2022-07-04 00:53:39 -07:00
b78c4a774d
reverse for loops 2022-07-03 23:50:08 -07:00
f308e87b15
add more logging 2022-07-03 23:42:35 -07:00
93d6bae08c
missing logger 2022-07-03 23:35:03 -07:00
f9166541f4
add tweak treeinfo for dnf_utils 2022-07-03 23:27:49 -07:00
79682d0e98
os is missing from initial lorax variant 2022-07-03 21:14:33 -07:00
77178e9657
move treeinfo writing to Shared 2022-07-03 21:01:18 -07:00
3cf47dd85c
remove final dependencies on results variable
* put logging code into runCmd method to reduce repeated code
2022-07-03 22:48:12 -04:00
361c155481
Containerize and refactor image building
* Add new fedora container to run imagefactory
* Make architecture class from py attrs and make it raise exceptions
* Change build-image script to primarily invoke imagefactory directly. A
  second wrapper will be added to support running in kubernetes if
needed.
2022-07-03 22:29:35 -04:00
957bf5ef3f
change comments briefly before merging changes 2022-07-03 14:08:59 -07:00
462ea264b3
add finalize script to mix 2022-07-03 00:22:00 -07:00
c081f6f202
test out parts of finalize 2022-07-03 00:19:13 -07:00
2884bb0eaa
Fix source and debuginfo portions 2022-07-01 14:16:14 -07:00
412a7ab089
add json and yaml components 2022-07-01 13:28:24 -07:00
e47ca962af
missing write function for compose_id 2022-07-01 13:13:00 -07:00
c1f1be9353
Remove hardcodes, add in metadata
* Remove hardcodes of "Rocky" to use "shortname" instead
* Add in metadata
2022-07-01 13:09:52 -07:00
4bc377cd44
Attempt to resolve RLBT#0000133 2022-06-30 15:38:50 -07:00
7f6f7babf5
Attempt to resolve RLBT#0000133 2022-06-30 13:14:27 -07:00
2c3409de51
treeinfo is not writing to paths 2022-06-30 03:06:29 -07:00
49b001e31d
Resolve RLBT#0000132 discinfo and treeinfo 2022-06-30 01:45:08 -07:00
5a02fe5a25
Resolve RLBT#0000132 discinfo and treeinfo 2022-06-30 01:43:14 -07:00
69317f3881
make IPA tests runnable, lamp disabled for now 2022-06-29 20:36:59 -07:00
1a04399851
fix up readme, disable gitlab tests for now 2022-06-28 12:41:12 -07:00
f342046f25
test should use && 2022-06-28 10:08:17 -07:00
f65a331826
remove jinja types 2022-06-28 11:19:58 -04:00
7d7163a156
prepping treeinfo outside 2022-06-28 07:49:28 -07:00
710cb08134
update github workflow to build image in the right namespace 2022-06-28 10:04:23 -04:00
0deaae0c65
update github workflow to build image in the right namespace 2022-06-28 09:39:01 -04:00
79425e848e
Use devel branch for container, doc fixes 2022-06-28 09:33:48 -04:00
e60f6524a2
Implement a feature to assist in generating various images
* use a flag to determine if we want an RC or not
* Convert rldict and sigdict to an AttributeDict to allow access via
  __getattr__
* add fedora_release variable to configs for controlling icicle
  templates
* build_image.py script to generate per-architecture XML files used by
  imagefactory
* refactor time to call utcnow() once
* add jinja types to development dependencies until we move past jinja
  2.x
* Generate TDL templates per architecture for each image variant on
  demand
* Generate imagefactory and copy commands to execute image build
* Refactor Kubernetes job template to be generic for all current jobs
2022-06-28 09:33:15 -04:00
4bf6fb6618
Implement a feature to assist in generating various images
* use a flag to determine if we want an RC or not
* Convert rldict and sigdict to an AttributeDict to allow access via
  __getattr__
* add fedora_release variable to configs for controlling icicle
  templates
* build_image.py script to generate per-architecture XML files used by
  imagefactory
* refactor time to call utcnow() once
* add jinja types to development dependencies until we move past jinja
  2.x
* Generate TDL templates per architecture for each image variant on
  demand
* Generate imagefactory and copy commands to execute image build
* Refactor Kubernetes job template to be generic for all current jobs
2022-06-28 09:33:13 -04:00
6fc01c8590
change RC notes 2022-06-27 18:35:11 -07:00
f4f29d97cc
Expand and Generalize ISO Functions
* Utils is now empanadas.util.Shared
* Each config now has a profile name to determine latest-Rocky-{} link
  (Results RLBT#0000131)
* Check added to see if an ISO was built at some point, and forcefully
  exit if so
* Lorax tar ball should be in the format of of lorax-X.Y-ARCH to ensure
  there's no collisions between stable, beta, and lh builds
2022-06-27 17:59:21 -07:00
57d51dadc7
initial boot images should have dvd in the volid 2022-06-27 03:39:11 -07:00
1e043ee714
fix manifest and add checksum phase to podman 2022-06-27 02:06:01 -07:00
7d9f222fe9
end argument missing 2022-06-27 01:18:57 -07:00
5ca80da56d
wrong path was being used for grafts 2022-06-27 01:13:12 -07:00
e7386c2f6f
xorr conf blank? 2022-06-27 01:01:36 -07:00
cd16cf78f4
fix dialog error 2022-06-27 00:50:41 -07:00
0ac1b0ba96
try logging some stuff 2022-06-27 00:40:28 -07:00
6d239b48e9
remove templates for xorr 2022-06-27 00:29:45 -07:00
8302604f7d
enable logs in general 2022-06-27 00:26:42 -07:00
436caefcbd
turn on xorrisofs for 9 2022-06-27 00:07:39 -07:00
b262e6f0c5
fix list and fix packages 2022-06-26 23:51:08 -07:00
fce45f3a72
put in a hack for xorrisofs 2022-06-26 22:45:31 -07:00
28facef12c
fix template for iso build 2022-06-26 22:05:24 -07:00
37c0be3fd0
attempt to build ISO in both mock and podman 2022-06-26 21:29:55 -07:00
43470e336b
RLBS - Finalize Treeinfo and Add xorrisofs
In preparation to build ISO's with mock or parallel podman containers,
treeinfo support was fully added as well as the addition of xorrisofs to
prepare for the future. xorrisofs should also work for both current and
previous releases.

We have also add a currently-pending RLN experiment.
2022-06-26 12:24:56 -07:00
6073066c84
restructure iso map configs 2022-06-24 15:37:32 -07:00
b75fe62899
scripts now generate 2022-06-23 15:29:22 -07:00
2e5c4778f4
Update Configs + Extra ISO Build Progress
* Configs updated to deal with repo and structure
* Add graft point process
* Start local and podman process for extra ISO builds
2022-06-23 13:12:53 -07:00
9463f96381
var had incorrect name for extra files 2022-06-21 23:51:00 -07:00
08f7a44cc1
fix subprocess 2022-06-21 23:23:36 -07:00
fdbfd840a0
add extra file refresh to primary script 2022-06-21 23:10:25 -07:00
ab7c36e02c
update extra files 2022-06-21 23:03:08 -07:00
00f330226d
update poetry and iso utilities 2022-06-21 17:21:37 -07:00
a28bed653a
remove minimal as an image for now 2022-06-20 20:27:30 -07:00
6914d651c4
update some functional tests 2022-06-20 16:49:28 -07:00
7a097fb302
Ensure builds work properly - architectures must match
* Actually use release version input to run build-iso command
* Buildstamp should be an epoch
* template out the job/pod names instead of doing them in the rendering
* label pods with toleration
2022-06-20 18:03:11 -04:00