sig_cloud/diskimage-builder
2
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
fe15b197fb
diskimage-builder/diskimage_builder/elements/openstack-ci-mirrors/environment.d/11-dib-distribution-mirror.bash

45 lines
1.8 KiB
Bash
Raw Normal View History

Use local mirror for ubuntu-minimal jobs This adds "openstack-ci-mirrors" element which performs various settings to get builds using local mirrors. As a first step, we convert ubuntu-minimal jobs The main trick is that since infra mirrors are created with rerepo they are not signed (they are recreated, not cloned, and not signing is seen as a feature in that it deters external use). So we need to instruct debootstrap to ignore signing and also turn it off for in-chroot apt. Other than that, the existing DIB_DISTRIBUTION_MIRROR works to redirect installs. Remove "restricted" as it's not mirrored, and I don't think we want it in here by default. (I think DIB_DISTRIBUTION_MIRROR is a bit of an anti-pattern, because it leaves the mirrors in the final image -- just because you use them to build, doesn't mean you want them at runtime). But we don't need to fix that now, and we don't use any created images.) This pauses fedora testing until the next change, which moves to using local mirrors for testing on fedora/centos Change-Id: I778bd05a1e615c27edf1c9f0a1409119a6b3a850
2017-06-20 19:37:06 +00:00
# Set DIB_DISTRIBUTION_MIRROR if running in openstack gate
if [ -f /etc/ci/mirror_info.sh ]; then
# don't spam logs with this source
_xtrace=$(set +o | grep xtrace)
set +o xtrace
source /etc/ci/mirror_info.sh
$_xtrace
# note 11- is after 10- which is where DISTRO_NAME is set usually
if [[ "${DISTRO_NAME}" == "ubuntu" ]]; then
export DIB_DISTRIBUTION_MIRROR=$NODEPOOL_UBUNTU_MIRROR
export DIB_DEBOOTSTRAP_EXTRA_ARGS+=" --no-check-gpg"
elif [[ "${DISTRO_NAME}" == "debian" ]]; then
export DIB_DISTRIBUTION_MIRROR=$NODEPOOL_DEBIAN_MIRROR
export DIB_DEBOOTSTRAP_EXTRA_ARGS+=" --no-check-gpg"
elif [[ "${DISTRO_NAME}" == "fedora" ]]; then
export DIB_DISTRIBUTION_MIRROR=$NODEPOOL_FEDORA_MIRROR
elif [[ "${DISTRO_NAME}" == "centos" ]]; then
export DIB_DISTRIBUTION_MIRROR=$NODEPOOL_CENTOS_MIRROR
elif [[ "${DISTRO_NAME}" == "centos7" ]]; then
export DIB_DISTRIBUTION_MIRROR=$NODEPOOL_CENTOS_MIRROR
elements: openstack-ci-mirrors: Use openSUSE mirrors for gating jobs In preparation for promoting the openSUSE jobs to voting ones we should use the OpenStack mirrors. As such, the opensuse elements are modified to make use of the DIB_DISTRIBUTION_MIRROR variable which is normally exported by the openstack-ci-mirrors element. Change-Id: Ie588c1c1eec13190cfb2ec718ba51f8c9878283f
2017-06-28 08:53:38 +00:00
elif [[ "${DISTRO_NAME}" == "opensuse" ]]; then
export DIB_DISTRIBUTION_MIRROR=$NODEPOOL_OPENSUSE_MIRROR
Use local mirror for ubuntu-minimal jobs This adds "openstack-ci-mirrors" element which performs various settings to get builds using local mirrors. As a first step, we convert ubuntu-minimal jobs The main trick is that since infra mirrors are created with rerepo they are not signed (they are recreated, not cloned, and not signing is seen as a feature in that it deters external use). So we need to instruct debootstrap to ignore signing and also turn it off for in-chroot apt. Other than that, the existing DIB_DISTRIBUTION_MIRROR works to redirect installs. Remove "restricted" as it's not mirrored, and I don't think we want it in here by default. (I think DIB_DISTRIBUTION_MIRROR is a bit of an anti-pattern, because it leaves the mirrors in the final image -- just because you use them to build, doesn't mean you want them at runtime). But we don't need to fix that now, and we don't use any created images.) This pauses fedora testing until the next change, which moves to using local mirrors for testing on fedora/centos Change-Id: I778bd05a1e615c27edf1c9f0a1409119a6b3a850
2017-06-20 19:37:06 +00:00
fi
fi
Start at using CI mirrors for fedora/centos fedora/centos-minimal don't obey DIB_DISTRIBUTION_MIRROR currently. I don't really want them too -- we want to be able to separate the mirrors used during the build process from those embedded into the final image. Add DIB_YUM_MINIMAL_BOOTSTRAP_REPOS which is a directory with repo files to use during the install. This introduces setup-gate-mirrors.sh which is intended to setup repo/sources/whatever files in the openstack gate that point to the local region mirror. It pulls the info from the mirror_info.sh script on each CI node. The openstack-ci-mirrors element is updated to export these variables. elements are updated to depend on it. Tests are restored Change-Id: I7604fc4d41cb1483be16b8d628a24e8fc764f515
2017-06-20 00:42:10 +00:00
ubuntu: Add options to ignore mirror components and use insecure repos When using the upstream cloud images with the "ubuntu" element, they have universe and multiverse enabled which we don't mirror. To use the infra mirrors as a DIB_DISTRIBUTION_MIRROR with this element, we need to be able to skip redirecting to universe and multiverse, and additionally enable insecure repos (as we don't gpg sign our mirrors). Add and document two new variables with the ubuntu element to do this. This is then setup by the openstack-ci-mirrors element so that we use local mirrors duing dib functional testing for the "ubuntu" element. Change-Id: I6ffbde07fa0e103641ee5c5f9d9e854e5b2168dc
2018-10-15 05:00:18 +00:00
# Infra doesn't mirror non-free repos, so instruct to ignore these
export DIB_DISTRIBUTION_MIRROR_UBUNTU_IGNORE="(universe|multiverse)"
export DIB_DISTRIBUTION_MIRROR_UBUNTU_INSECURE=1
# These repo files are pre-created for the fedora/centos-minimal jobs
# in the gate. Not relevant inside the chroot.
Start at using CI mirrors for fedora/centos fedora/centos-minimal don't obey DIB_DISTRIBUTION_MIRROR currently. I don't really want them too -- we want to be able to separate the mirrors used during the build process from those embedded into the final image. Add DIB_YUM_MINIMAL_BOOTSTRAP_REPOS which is a directory with repo files to use during the install. This introduces setup-gate-mirrors.sh which is intended to setup repo/sources/whatever files in the openstack gate that point to the local region mirror. It pulls the info from the mirror_info.sh script on each CI node. The openstack-ci-mirrors element is updated to export these variables. elements are updated to depend on it. Tests are restored Change-Id: I7604fc4d41cb1483be16b8d628a24e8fc764f515
2017-06-20 00:42:10 +00:00
if [[ -d ${WORKSPACE:-/not/a/path/}/dib-mirror ]]; then
if [[ "${DISTRO_NAME}" == "fedora" ]]; then
export DIB_YUM_MINIMAL_BOOTSTRAP_REPOS=${WORKSPACE}/dib-mirror/fedora-minimal/yum.repos.d
elif [[ "${DISTRO_NAME}" == "centos" ]]; then
export DIB_YUM_MINIMAL_BOOTSTRAP_REPOS=${WORKSPACE}/dib-mirror/centos-minimal/yum.repos.d
fi
fi
Reference in New Issue Copy Permalink