337 Commits

Author	SHA1	Message	Date
Louis Abel	77264a3195	fix arch in altarch config	2022-07-27 13:39:36 -07:00
Louis Abel	e4018d11d7	add sig syncs	2022-07-25 18:03:07 -07:00
Louis Abel	e337d723c9	deploy gpg key with sig	2022-07-25 16:46:53 -07:00
Louis Abel	c73d52d42b	755 is sufficient enough	2022-07-25 03:30:52 -07:00
Louis Abel	56af2ade35	tweaking treeinfo in kickstart shouldn't matter	2022-07-25 03:12:26 -07:00
Louis Abel	03111ba623	add skip all function for treeinfo only mods	2022-07-25 03:07:09 -07:00
Louis Abel	35e3028fce	address permission issues with EFI files from lorax	2022-07-25 01:30:11 -07:00
Louis Abel	9119e772d6	add initial sig syncing components	2022-07-25 00:46:34 -07:00
Louis Abel	3b3d3da489	ensure there is proper logging for xorriso	2022-07-21 01:00:31 -07:00
Louis Abel	2b0907043e	try to resolve ppc64le not booting RLBT#0000158	2022-07-21 00:25:31 -07:00
Louis Abel	8d77a63a6a	Start work on 0.4.0 ... * Start SIG deployment testing * Add additional sigs: desktop, virt * Modify altarch to match repo names in release package	2022-07-20 16:17:19 -07:00
Louis Abel	65a4ec93c3	add in checksum for latest image (RLBT#0000148)	2022-07-19 02:01:05 -07:00
Louis Abel	60f97b1c67	joliet on	2022-07-18 15:51:10 -07:00
Louis Abel	debad119d9	attempt to add joliet long names	2022-07-18 15:27:35 -07:00
Louis Abel	25c3921df2	correct sig and sync	2022-07-18 13:52:41 -07:00
Louis Abel	313a26ec1f	split syncs	2022-07-17 22:11:30 -07:00
Louis Abel	90efde8477	add in a fix for timestamps on packages	2022-07-16 11:44:05 -07:00
Louis Abel	d14309ef78	turn on remote time	2022-07-15 16:55:41 -07:00
Louis Abel	61451b1b37	hardlinking should be post-sync to prod before file list	2022-07-15 16:05:14 -07:00
Louis Abel	04f2c3ab77	move generate confs and add testing script	2022-07-15 10:39:35 -07:00
Neil Hanlon	929aa97e8b	bump to 0.3.0; release	2022-07-13 23:34:08 -04:00
Neil Hanlon	03d0c585ae	add gitignore ... * change capitalization for vbox	2022-07-13 23:33:23 -04:00
Louis Abel	beebdaa105	fix up script	2022-07-13 20:01:23 -07:00
Louis Abel	813acedf84	add additional file list operations for neil	2022-07-13 08:46:06 -07:00
Louis Abel	37714cabd6	force selinux for the temporary repo file	2022-07-12 18:30:59 -07:00
Louis Abel	f1fbcff0ef	Add pungi-like composeinfo metadata and modify readme	2022-07-12 01:57:25 -07:00
Louis Abel	8017026bc8	Add a final grep to log for "FAILED" (RLBT#0000138) ... Add a final grep if exit code of reposync is 0. There are cases where dnf reposync will say the sync succeeded despite not downloading a package due to a failed mirror. It is a failure when a GPG key can't be verified or some other unforeseen cirumstance... but not when a package can't be downloaded because of "all mirrors tried" Also added "time" to the fpsync commands for RL9 syncing.	2022-07-12 00:59:19 -07:00
Louis Abel	3207fd4ad0	project should contain image name	2022-07-11 19:26:13 -07:00
Neil Hanlon	20bf0812db	revert to stg url now that CDN is fixed. add in some additional metadata for builds and cleanup output for containers	2022-07-11 21:15:31 -04:00
Neil Hanlon	6b236b7b5f	Add symlink parameter to resolve script runtime	2022-07-11 21:14:08 -04:00
Neil Hanlon	911f835bfb	I hate this syntax, use a \n	2022-07-11 20:50:30 -04:00
Louis Abel	76012c8549	looking at the wrong place	2022-07-11 16:53:20 -07:00
Louis Abel	1ba76a849a	force build	2022-07-11 16:01:19 -07:00
Louis Abel	cee688b2c2	should have used shortname for mock root	2022-07-11 15:54:03 -07:00
Louis Abel	9e4f89cf6d	should have used shortname for mock root	2022-07-11 15:33:33 -07:00
Louis Abel	a3c5d33ae8	add justcopyit for live images	2022-07-11 15:12:50 -07:00
Louis Abel	520db534be	add justcopyit for live images	2022-07-11 15:12:41 -07:00
Louis Abel	30d1c317cd	seems to work with selinux on	2022-07-11 08:58:13 -07:00
Louis Abel	9568b0cbcb	add in live generation	2022-07-11 01:06:33 -07:00
Neil Hanlon	1f94680924	compress genericcloud and vagrant images by default ... * add azure support * use download.r.o url	2022-07-10 21:58:12 -04:00
Louis Abel	193c3f9b73	solve path join issue	2022-07-08 20:44:15 -07:00
Louis Abel	40b3af462d	add checksum combo for images	2022-07-08 14:41:06 -07:00
Louis Abel	5f2f3cae5b	properly loop live images	2022-07-08 14:33:14 -07:00
Neil Hanlon	007f571224	Fix path to containerized azure prep script	2022-07-08 17:31:30 -04:00
Neil Hanlon	3cccd03d55	Build azure images, too	2022-07-08 17:29:32 -04:00
Neil Hanlon	767362aceb	Various image building changes ... * Add UBI container specification * Change ouput path to simplify copying operations * Install patches for imagefactory and fixed version of oz for RHEL in container * Please ignore the RPM in this repo for now... * Add conversion steps for Vagrant, EC2 images * Fix KSes if they have a $basearch variable by subtitution * Add usefbx variable to ensure we have an output for debugging	2022-07-08 13:30:15 -04:00
Louis Abel	a4ee9ecc02	images should be pulled based on format and name	2022-07-08 09:54:43 -07:00
Louis Abel	4c426ca1e3	add another temporary sync-to-X-X script	2022-07-08 02:22:58 -07:00
Louis Abel	aaa89c74a4	begin live build configuration and move funcs to shared	2022-07-08 01:43:30 -07:00
Louis Abel	6880403c38	Revert back to RC2, there isn't an RC3 ... I really don't know why I switched it to RC3. Was it reflex? Was it my inability to sleep? You be the judge.	2022-07-07 00:32:42 -07:00
Louis Abel	343fe053d9	logging wasn't ready	2022-07-06 23:57:38 -07:00
Louis Abel	8f9f2646b7	revert config and add repo name check	2022-07-06 23:56:19 -07:00
Louis Abel	e9e37384ae	undo config name	2022-07-06 23:41:28 -07:00
Louis Abel	22184f30a4	put sed in right spot	2022-07-06 23:29:02 -07:00
Louis Abel	d482019ca5	turn off all repos in container	2022-07-06 23:23:07 -07:00
Louis Abel	73f08780d9	correct comments, fix livemap configs	2022-07-06 07:44:37 -07:00
Louis Abel	b54447571b	Modify all Configs and add image puller ... * Add livemap and imagemap to configs * Add cloud image puller to iso_utils (part 1) * Simplify color logging (potential prep for colorlog)	2022-07-05 20:42:41 -07:00
Louis Abel	6946b737fc	Simplify colors and start fleshing out cloud image pulls	2022-07-05 14:47:38 -07:00
Louis Abel	a7cf5db050	fix up if statement	2022-07-05 08:43:57 -07:00
Louis Abel	cf13fb0a02	add missing ks treeinfo deploy	2022-07-05 08:04:46 -07:00
Louis Abel	1d5447b1fb	use actual logging now	2022-07-05 00:50:02 -07:00
Louis Abel	3aa640ec45	add generic exceptions	2022-07-05 00:26:49 -07:00
Louis Abel	138d1076f5	correct treeinfo for ks	2022-07-04 21:24:35 -07:00
Neil Hanlon	554937009e	Fixup container files	2022-07-04 21:17:02 -04:00
Neil Hanlon	8954987365	Remove fedora_release var, no longer needed	2022-07-04 17:55:46 -04:00
Neil Hanlon	fe4daffb25	Changes for oz/imagefactory config naming	2022-07-04 16:35:58 -04:00
Louis Abel	1c90edaa70	fix readme and bump to RC2	2022-07-04 13:10:48 -07:00
Louis Abel	b89ebe777a	Finish and resolve RLBT#0000134	2022-07-04 12:36:15 -07:00
Louis Abel	340a6a3377	add checksum combine for close out	2022-07-04 12:23:12 -07:00
Neil Hanlon	55abe763ef	Refactor Architecture class and fix names for output files	2022-07-04 14:44:20 -04:00
Louis Abel	04e7e1d164	Bump to 0.2.0 ... * Add metadata with README information * Bump to 0.2.0 * Move more functions into shared	2022-07-04 11:32:10 -07:00
Neil Hanlon	7365ca6b06	various cleanup of image build script ... * reorder imports * pass cli arguments directly into class for simplification and segregation * reorder class variables * Some error checking to ensure we're writing what we want to * Allow copy(upload?) step to be skipped * properly consume stdout and stderr from popen to avoid exception when FD is closed but trying to be read by the subprocess_log function	2022-07-04 12:09:10 -04:00
Louis Abel	d84a686102	add live root logic before sign off	2022-07-04 00:53:39 -07:00
Louis Abel	b78c4a774d	reverse for loops	2022-07-03 23:50:08 -07:00
Louis Abel	f308e87b15	add more logging	2022-07-03 23:42:35 -07:00
Louis Abel	93d6bae08c	missing logger	2022-07-03 23:35:03 -07:00
Louis Abel	f9166541f4	add tweak treeinfo for dnf_utils	2022-07-03 23:27:49 -07:00
Louis Abel	79682d0e98	os is missing from initial lorax variant	2022-07-03 21:14:33 -07:00
Louis Abel	77178e9657	move treeinfo writing to Shared	2022-07-03 21:01:18 -07:00
Neil Hanlon	3cf47dd85c	remove final dependencies on results variable ... * put logging code into runCmd method to reduce repeated code	2022-07-03 22:48:12 -04:00
Neil Hanlon	361c155481	Containerize and refactor image building ... * Add new fedora container to run imagefactory * Make architecture class from py attrs and make it raise exceptions * Change build-image script to primarily invoke imagefactory directly. A second wrapper will be added to support running in kubernetes if needed.	2022-07-03 22:29:35 -04:00
Louis Abel	957bf5ef3f	change comments briefly before merging changes	2022-07-03 14:08:59 -07:00
Louis Abel	462ea264b3	add finalize script to mix	2022-07-03 00:22:00 -07:00
Louis Abel	c081f6f202	test out parts of finalize	2022-07-03 00:19:13 -07:00
Louis Abel	2884bb0eaa	Fix source and debuginfo portions	2022-07-01 14:16:14 -07:00
Louis Abel	412a7ab089	add json and yaml components	2022-07-01 13:28:24 -07:00
Louis Abel	e47ca962af	missing write function for compose_id	2022-07-01 13:13:00 -07:00
Louis Abel	c1f1be9353	Remove hardcodes, add in metadata ... * Remove hardcodes of "Rocky" to use "shortname" instead * Add in metadata	2022-07-01 13:09:52 -07:00
Louis Abel	4bc377cd44	Attempt to resolve RLBT#0000133	2022-06-30 15:38:50 -07:00
Louis Abel	7f6f7babf5	Attempt to resolve RLBT#0000133	2022-06-30 13:14:27 -07:00
Louis Abel	2c3409de51	treeinfo is not writing to paths	2022-06-30 03:06:29 -07:00
Louis Abel	49b001e31d	Resolve RLBT#0000132 discinfo and treeinfo	2022-06-30 01:45:08 -07:00
Louis Abel	5a02fe5a25	Resolve RLBT#0000132 discinfo and treeinfo	2022-06-30 01:43:14 -07:00
Louis Abel	69317f3881	make IPA tests runnable, lamp disabled for now	2022-06-29 20:36:59 -07:00
Louis Abel	1a04399851	fix up readme, disable gitlab tests for now	2022-06-28 12:41:12 -07:00
nazunalika	f342046f25	test should use &&	2022-06-28 10:08:17 -07:00
Neil Hanlon	f65a331826	remove jinja types	2022-06-28 11:19:58 -04:00
nazunalika	7d7163a156	prepping treeinfo outside	2022-06-28 07:49:28 -07:00
Neil Hanlon	710cb08134	update github workflow to build image in the right namespace	2022-06-28 10:04:23 -04:00
Neil Hanlon	0deaae0c65	update github workflow to build image in the right namespace	2022-06-28 09:39:01 -04:00
Neil Hanlon	79425e848e	Use devel branch for container, doc fixes	2022-06-28 09:33:48 -04:00
Neil Hanlon	e60f6524a2	Implement a feature to assist in generating various images ... * use a flag to determine if we want an RC or not * Convert rldict and sigdict to an AttributeDict to allow access via __getattr__ * add fedora_release variable to configs for controlling icicle templates * build_image.py script to generate per-architecture XML files used by imagefactory * refactor time to call utcnow() once * add jinja types to development dependencies until we move past jinja 2.x * Generate TDL templates per architecture for each image variant on demand * Generate imagefactory and copy commands to execute image build * Refactor Kubernetes job template to be generic for all current jobs	2022-06-28 09:33:15 -04:00
Neil Hanlon	4bf6fb6618	Implement a feature to assist in generating various images ... * use a flag to determine if we want an RC or not * Convert rldict and sigdict to an AttributeDict to allow access via __getattr__ * add fedora_release variable to configs for controlling icicle templates * build_image.py script to generate per-architecture XML files used by imagefactory * refactor time to call utcnow() once * add jinja types to development dependencies until we move past jinja 2.x * Generate TDL templates per architecture for each image variant on demand * Generate imagefactory and copy commands to execute image build * Refactor Kubernetes job template to be generic for all current jobs	2022-06-28 09:33:13 -04:00
nazunalika	6fc01c8590	change RC notes	2022-06-27 18:35:11 -07:00
nazunalika	f4f29d97cc	Expand and Generalize ISO Functions ... * Utils is now empanadas.util.Shared * Each config now has a profile name to determine latest-Rocky-{} link (Results RLBT#0000131) * Check added to see if an ISO was built at some point, and forcefully exit if so * Lorax tar ball should be in the format of of lorax-X.Y-ARCH to ensure there's no collisions between stable, beta, and lh builds	2022-06-27 17:59:21 -07:00
nazunalika	57d51dadc7	initial boot images should have dvd in the volid	2022-06-27 03:39:11 -07:00
nazunalika	1e043ee714	fix manifest and add checksum phase to podman	2022-06-27 02:06:01 -07:00
nazunalika	7d9f222fe9	end argument missing	2022-06-27 01:18:57 -07:00
nazunalika	5ca80da56d	wrong path was being used for grafts	2022-06-27 01:13:12 -07:00
nazunalika	e7386c2f6f	xorr conf blank?	2022-06-27 01:01:36 -07:00
nazunalika	cd16cf78f4	fix dialog error	2022-06-27 00:50:41 -07:00
nazunalika	0ac1b0ba96	try logging some stuff	2022-06-27 00:40:28 -07:00
nazunalika	6d239b48e9	remove templates for xorr	2022-06-27 00:29:45 -07:00
nazunalika	8302604f7d	enable logs in general	2022-06-27 00:26:42 -07:00
nazunalika	436caefcbd	turn on xorrisofs for 9	2022-06-27 00:07:39 -07:00
nazunalika	b262e6f0c5	fix list and fix packages	2022-06-26 23:51:08 -07:00
nazunalika	fce45f3a72	put in a hack for xorrisofs	2022-06-26 22:45:31 -07:00
nazunalika	28facef12c	fix template for iso build	2022-06-26 22:05:24 -07:00
nazunalika	37c0be3fd0	attempt to build ISO in both mock and podman	2022-06-26 21:29:55 -07:00
nazunalika	43470e336b	RLBS - Finalize Treeinfo and Add xorrisofs ... In preparation to build ISO's with mock or parallel podman containers, treeinfo support was fully added as well as the addition of xorrisofs to prepare for the future. xorrisofs should also work for both current and previous releases. We have also add a currently-pending RLN experiment.	2022-06-26 12:24:56 -07:00
nazunalika	6073066c84	restructure iso map configs	2022-06-24 15:37:32 -07:00
nazunalika	b75fe62899	scripts now generate	2022-06-23 15:29:22 -07:00
nazunalika	2e5c4778f4	Update Configs + Extra ISO Build Progress ... * Configs updated to deal with repo and structure * Add graft point process * Start local and podman process for extra ISO builds	2022-06-23 13:12:53 -07:00
nazunalika	9463f96381	var had incorrect name for extra files	2022-06-21 23:51:00 -07:00
nazunalika	08f7a44cc1	fix subprocess	2022-06-21 23:23:36 -07:00
nazunalika	fdbfd840a0	add extra file refresh to primary script	2022-06-21 23:10:25 -07:00
nazunalika	ab7c36e02c	update extra files	2022-06-21 23:03:08 -07:00
nazunalika	00f330226d	update poetry and iso utilities	2022-06-21 17:21:37 -07:00
nazunalika	a28bed653a	remove minimal as an image for now	2022-06-20 20:27:30 -07:00
nazunalika	6914d651c4	update some functional tests	2022-06-20 16:49:28 -07:00
Neil Hanlon	7a097fb302	Ensure builds work properly - architectures must match ... * Actually use release version input to run build-iso command * Buildstamp should be an epoch * template out the job/pod names instead of doing them in the rendering * label pods with toleration	2022-06-20 18:03:11 -04:00
Neil Hanlon	0603620773	Fixes for current RC images ... * Make jobs uploads unique and match security context of peridot * change image build, fix extraction of build artifacts	2022-06-20 18:02:44 -04:00
Neil Hanlon	4587287e1e	Github actions work for automatic building ... * Add in really simple job template creation to prove the generation will work	2022-06-20 18:02:19 -04:00
Neil Hanlon	76dba70458	Build a container to run the builds in ... * Build this into a container to deploy * Add lorax packages in * Build container from public source * Switch to different c9s mirror due to errors * add script for building	2022-06-20 18:01:08 -04:00
nazunalika	22f920042e	add next phase before sign off	2022-06-20 01:34:10 -07:00
nazunalika	72f98dcdb6	Tarball pull and extract	2022-06-19 22:52:20 -07:00
nazunalika	db55677a88	update lock and project	2022-06-19 10:57:05 -07:00
nazunalika	d38fa4f349	push stuff up for now	2022-06-19 07:29:01 -07:00
nazunalika	5e34a9b9c7	syntax error for syncing	2022-06-17 16:27:39 -07:00
nazunalika	f48caa4b54	actually catch the error from subprocess	2022-06-17 13:27:40 -07:00
Neil Hanlon	0abdea5c86	Some changes to make scripts work in the new setup"	2022-06-17 15:55:26 -04:00
Neil Hanlon	3749866dee	Cleanup bad rebase	2022-06-17 15:08:38 -04:00
Neil Hanlon	e3526b1588	Fix requirements specifications for EL machines that this will run on :)	2022-06-17 15:06:47 -04:00
Neil Hanlon	fa74e96c84	Lets write some poetry	2022-06-17 15:06:45 -04:00
nazunalika	7ca3cc889d	comments to explain how to do things	2022-06-17 11:49:22 -07:00
nazunalika	adc0cd3b81	add rc if statement	2022-06-17 00:16:21 -07:00
nazunalika	1ae3c67ba6	have a working script	2022-06-16 23:25:17 -07:00
nazunalika	37cd4e1b2e	commit iso build portions	2022-06-16 22:55:07 -07:00
nazunalika	c17e721633	symlink functions	2022-06-16 13:18:27 -07:00
nazunalika	84ac608967	symlink functions	2022-06-16 13:18:18 -07:00
nazunalika	613687c3c8	fullversion	2022-06-16 12:56:57 -07:00
nazunalika	2ffd96ad1e	sort logs by date	2022-06-16 12:24:19 -07:00
nazunalika	3d161df451	update iso utils and prep	2022-06-15 13:53:12 -07:00
nazunalika	602553e878	add more color for next sync	2022-06-13 07:37:50 -07:00
nazunalika	45848bf530	simply gpg checking	2022-06-12 02:55:32 -07:00
nazunalika	41f77b1d4c	remove sleepy curl	2022-06-12 02:22:01 -07:00
nazunalika	d6adcf3f8f	fix raw path	2022-06-12 02:19:20 -07:00
nazunalika	9eb649e86b	ensure separate directories are checked	2022-06-12 02:15:52 -07:00
nazunalika	08249632af	try to simplify templates, add gpg check	2022-06-12 02:08:48 -07:00
nazunalika	b376c168bb	start using templates for reposync	2022-06-11 10:49:37 -07:00
nazunalika	6c25a81241	remove nplb and rename all to devel	2022-06-11 08:03:03 -07:00
nazunalika	910901dacb	Add dnf_plugin_cmd to logs	2022-06-10 19:59:43 -07:00
nazunalika	0b70e6157a	all was missed, it can be hashed later	2022-06-10 16:22:30 -07:00
nazunalika	541ee349aa	all repo isn't hashed	2022-06-10 16:14:22 -07:00
nazunalika	7917876676	add hash flag	2022-06-10 16:05:44 -07:00
nazunalika	0a761837a6	we don't need repoclosure all over the place	2022-06-08 20:25:55 -07:00
nazunalika	8a60806803	add forcearch to drive the point home	2022-06-08 20:09:07 -07:00
nazunalika	62256a72b5	add nplb to repoclosure list and altarch stuff	2022-06-06 15:02:08 -07:00
nazunalika	bcc1dd7c22	add date stamp to repoclosure logs to keep it as clean as possible	2022-05-29 17:00:47 -07:00
nazunalika	f36af93fc2	clean all metadata	2022-05-29 14:25:32 -07:00
nazunalika	86fe08f26a	first --repo switch was missing for repoclosure	2022-05-29 13:40:54 -07:00
nazunalika	baf4893850	add repoclosure support	2022-05-28 19:28:29 -07:00
nazunalika	e49a69ceea	force arch	2022-05-27 06:59:27 -07:00
nazunalika	55870075ac	add copy function thanks to neil	2022-05-26 14:46:43 -07:00
nazunalika	8822fe2657	missing new line	2022-05-26 13:57:45 -07:00
nazunalika	4fc046627e	pipefail shoudl be on, otherwise all repos are treated as 0	2022-05-26 13:55:12 -07:00
nazunalika	b84cc7cc4d	our compose dir is nfs	2022-05-26 13:27:56 -07:00
nazunalika	fc227c947e	finish wrapper, start repoclosure	2022-05-25 21:39:32 -07:00
nazunalika	38e0af2e34	properly remove pods after checking them	2022-05-25 00:08:08 -07:00
nazunalika	223c0c468c	podman support added	2022-05-24 20:35:58 -07:00
nazunalika	16da35da3d	add work_root for a way to store logs and other stuff	2022-05-24 00:16:02 -07:00
nazunalika	e697f7ec57	add in loops for entries	2022-05-23 18:12:18 -07:00
nazunalika	d845b95e80	Final commit for 5/22 ... Finish regular reposync functionality, leave notes about i686 Start podman reposync functionality	2022-05-23 00:23:53 -07:00
nazunalika	420aa02bdb	Final commit for 5/21	2022-05-21 23:20:15 -07:00
nazunalika	4f9bfd44a0	Final Commit for 5/21 ... Add better syncing for current bash scripts (thanks pgreco) Continued python scripts, creating classes for local module imports, with some inspiration coming from cobbler	2022-05-21 00:10:37 -07:00
nazunalika	b0bd9a8367	start python conversion	2022-05-20 01:13:57 -07:00
nazunalika	7602ae1a44	begin ISO magic	2022-05-19 00:48:07 -07:00