diskimage-builder/elements/ubuntu/root.d/10-cache-ubuntu-tarball

#!/bin/bash
# These are useful, or at worst not harmful, for all images we build.

set -eu

[ -n "$ARCH" ]
[ -n "$TARGET_ROOT" ]

shopt -s extglob

DIB_CLOUD_IMAGES=${DIB_CLOUD_IMAGES:-http://cloud-images.ubuntu.com/}
DIB_RELEASE=${DIB_RELEASE:-raring}
BASE_IMAGE_FILE=${BASE_IMAGE_FILE:-$DIB_RELEASE-server-cloudimg-$ARCH-root.tar.gz}
SHA256SUMS=${SHA256SUMS:-https://${DIB_CLOUD_IMAGES##http?(s)://}/$DIB_RELEASE/current/SHA256SUMS}
CACHED_FILE=$DIB_IMAGE_CACHE/$BASE_IMAGE_FILE

if [ -n "$DIB_OFFLINE" -a -f "$CACHED_FILE" ] ; then
    echo "Not checking freshness of cached $CACHED_FILE."
else
  echo "Fetching Base Image"
  $TMP_HOOKS_PATH/bin/cache-url $SHA256SUMS $DIB_IMAGE_CACHE/SHA256SUMS.ubuntu.$DIB_RELEASE.$ARCH
  $TMP_HOOKS_PATH/bin/cache-url $DIB_CLOUD_IMAGES/$DIB_RELEASE/current/$BASE_IMAGE_FILE $CACHED_FILE
  pushd $DIB_IMAGE_CACHE
  grep "$BASE_IMAGE_FILE" SHA256SUMS.ubuntu.$DIB_RELEASE.$ARCH | sha256sum --check -
  popd
fi
# Extract the base image
sudo tar -C $TARGET_ROOT -xzf $DIB_IMAGE_CACHE/$BASE_IMAGE_FILE
sudo rmdir $TARGET_ROOT/lost+found
Move initial root contents into a hook. This is a necessary but not complete step towards supporting Fedora and Suse distributions. Further work is needed (e.g. to quiesce daemons on installation). Change-Id: If3ea6093d41a21de755db52328226b84b5a3ede6 2013-02-11 04:01:36 +00:00			`#!/bin/bash`
			`# These are useful, or at worst not harmful, for all images we build.`

Enable --offline support for Ubuntu root images. When --offline is set elements should not revalidate cached data. The ubuntu element had not been updated to match this. SHA checking is also skipped as we only move a new cached file into place when the hash matches, and we might download a new hash before updating the image cache, which would cause persistent --offline failures. Change-Id: If1a0366b51951a73b7a3ffe23a29a3d910b08938 2013-07-17 22:05:47 +00:00			`set -eu`
Move initial root contents into a hook. This is a necessary but not complete step towards supporting Fedora and Suse distributions. Further work is needed (e.g. to quiesce daemons on installation). Change-Id: If3ea6093d41a21de755db52328226b84b5a3ede6 2013-02-11 04:01:36 +00:00
			`[ -n "$ARCH" ]`
			`[ -n "$TARGET_ROOT" ]`

Fix Ubuntu image fetching. Set a bash option which has been breaking cold builds due to an extended glob pattern. Change-Id: Ideab0fca057eb3744002ae137ac1f988b61bb560 2013-04-21 20:31:51 +00:00			`shopt -s extglob`

Migrate cloud image URL/Release options to DIB_. This switches $CLOUD_IMAGES and $RELEASE to the DIB_ namespace so they will survive future changes to the sanitisation of the build environment. Change-Id: I7dc2aa82fb9ef452705b080cc404f41046014f20 2013-04-12 13:41:32 +00:00			`DIB_CLOUD_IMAGES=${DIB_CLOUD_IMAGES:-http://cloud-images.ubuntu.com/}`
Make Ubuntu 13.04 (raring) the default release Ubuntu 13.04 has been released now for 3 months. The updated libvirt, openvswitch and kernel are all beneficial to various OpenStack components, and many other software is updated beyond the versions in Ubuntu 12.10. Change-Id: I358aed8bf906c3ff5103f19b1f9e6ac689b5d5ee 2013-07-30 00:02:23 +00:00			`DIB_RELEASE=${DIB_RELEASE:-raring}`
Migrate cloud image URL/Release options to DIB_. This switches $CLOUD_IMAGES and $RELEASE to the DIB_ namespace so they will survive future changes to the sanitisation of the build environment. Change-Id: I7dc2aa82fb9ef452705b080cc404f41046014f20 2013-04-12 13:41:32 +00:00			`BASE_IMAGE_FILE=${BASE_IMAGE_FILE:-$DIB_RELEASE-server-cloudimg-$ARCH-root.tar.gz}`
			`SHA256SUMS=${SHA256SUMS:-https://${DIB_CLOUD_IMAGES##http?(s)://}/$DIB_RELEASE/current/SHA256SUMS}`
Add DIB_IMAGE_CACHE DIB_IMAGE_CACHE will be a user override for the location where images are cached. Default location is ~/.cache/image-create Change-Id: I3e9b9f970864d555c9ec9436344b53f6d3d66dfa 2013-09-19 13:50:48 +00:00			`CACHED_FILE=$DIB_IMAGE_CACHE/$BASE_IMAGE_FILE`
Move initial root contents into a hook. This is a necessary but not complete step towards supporting Fedora and Suse distributions. Further work is needed (e.g. to quiesce daemons on installation). Change-Id: If3ea6093d41a21de755db52328226b84b5a3ede6 2013-02-11 04:01:36 +00:00
Enable --offline support for Ubuntu root images. When --offline is set elements should not revalidate cached data. The ubuntu element had not been updated to match this. SHA checking is also skipped as we only move a new cached file into place when the hash matches, and we might download a new hash before updating the image cache, which would cause persistent --offline failures. Change-Id: If1a0366b51951a73b7a3ffe23a29a3d910b08938 2013-07-17 22:05:47 +00:00			`if [ -n "$DIB_OFFLINE" -a -f "$CACHED_FILE" ] ; then`
			`echo "Not checking freshness of cached $CACHED_FILE."`
			`else`
			`echo "Fetching Base Image"`
Add DIB_IMAGE_CACHE DIB_IMAGE_CACHE will be a user override for the location where images are cached. Default location is ~/.cache/image-create Change-Id: I3e9b9f970864d555c9ec9436344b53f6d3d66dfa 2013-09-19 13:50:48 +00:00			`$TMP_HOOKS_PATH/bin/cache-url $SHA256SUMS $DIB_IMAGE_CACHE/SHA256SUMS.ubuntu.$DIB_RELEASE.$ARCH`
Enable --offline support for Ubuntu root images. When --offline is set elements should not revalidate cached data. The ubuntu element had not been updated to match this. SHA checking is also skipped as we only move a new cached file into place when the hash matches, and we might download a new hash before updating the image cache, which would cause persistent --offline failures. Change-Id: If1a0366b51951a73b7a3ffe23a29a3d910b08938 2013-07-17 22:05:47 +00:00			`$TMP_HOOKS_PATH/bin/cache-url $DIB_CLOUD_IMAGES/$DIB_RELEASE/current/$BASE_IMAGE_FILE $CACHED_FILE`
Add DIB_IMAGE_CACHE DIB_IMAGE_CACHE will be a user override for the location where images are cached. Default location is ~/.cache/image-create Change-Id: I3e9b9f970864d555c9ec9436344b53f6d3d66dfa 2013-09-19 13:50:48 +00:00			`pushd $DIB_IMAGE_CACHE`
Enable --offline support for Ubuntu root images. When --offline is set elements should not revalidate cached data. The ubuntu element had not been updated to match this. SHA checking is also skipped as we only move a new cached file into place when the hash matches, and we might download a new hash before updating the image cache, which would cause persistent --offline failures. Change-Id: If1a0366b51951a73b7a3ffe23a29a3d910b08938 2013-07-17 22:05:47 +00:00			`grep "$BASE_IMAGE_FILE" SHA256SUMS.ubuntu.$DIB_RELEASE.$ARCH \| sha256sum --check -`
			`popd`
			`fi`
Move initial root contents into a hook. This is a necessary but not complete step towards supporting Fedora and Suse distributions. Further work is needed (e.g. to quiesce daemons on installation). Change-Id: If3ea6093d41a21de755db52328226b84b5a3ede6 2013-02-11 04:01:36 +00:00			`# Extract the base image`
Add DIB_IMAGE_CACHE DIB_IMAGE_CACHE will be a user override for the location where images are cached. Default location is ~/.cache/image-create Change-Id: I3e9b9f970864d555c9ec9436344b53f6d3d66dfa 2013-09-19 13:50:48 +00:00			`sudo tar -C $TARGET_ROOT -xzf $DIB_IMAGE_CACHE/$BASE_IMAGE_FILE`
Build images using loopdev instead of qemu-nbd. Qemu-nbd does not perform well with older versions of qemu due to the lack of writeback caching mode. It also only builds qcow2 images and there is a desire for raw image support. Finally, qemu-nbd makes it very difficult to build images concurrently due to the somewhat opaque nature of how it selects a /dev/nbd# device. losetup, on the other hand, makes this process very straight forward. Change-Id: I309fad8af4fd1e8d1720c17b65e1897a76d5e897 Co-Author: Clint Byrum <clint@fewbar.com> 2013-04-02 00:25:25 +00:00			`sudo rmdir $TARGET_ROOT/lost+found`