sig_cloud/diskimage-builder
2
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
97bc5d7853
diskimage-builder/elements/pypi
History
Robert Collins 97bc5d7853 Allow using a pypi mirror to install via pip. 
Using a custom pypi mirror can be very convenient, making image builds
substantially faster - because we create multiple virtual
environments we benefit more than single-virtualenv users would.

Change-Id: I997daf1f9477c447e1fb30818aea9e80a49b31a6
2013-08-10 22:07:30 +12:00
..
extra-data.d Allow using a pypi mirror to install via pip. 2013-08-10 22:07:30 +12:00
post-install.d Allow using a pypi mirror to install via pip. 2013-08-10 22:07:30 +12:00
pre-install.d Allow using a pypi mirror to install via pip. 2013-08-10 22:07:30 +12:00
README.md Allow using a pypi mirror to install via pip. 2013-08-10 22:07:30 +12:00

README.md

Inject a PyPI mirror

Bind mounts a PyPI mirror from ~/.cache/image-create/pypi/mirror into the build environment and temporarily overwrites /root/.pip.conf and .pydistutils.cfg to use it.

When online, the master pypi index is supplied as an extra-url, so uncached dependencies will still be available. When offline, only the mirror is used - a stale mirror will cause build failures.

jeepyb can be useful in making a partial PyPI mirror suitable for building images. For instance:

  • sudo apt-get install libxml2-dev libxslt-dev libmysqlclient-dev libpq-dev
    libnspr4-dev pkg-config libsqlite3-dev libzmq-dev libffi-dev libldap2-dev
    libsasl2-dev

  • pip install https://github.com/openstack-infra/jeepyb

  • cat << EOF > mirror.yaml cache-root: /home/USER/.cache/image-create/pypi/download

    mirrors:

  • mkdir -p /home/USER/.cache/image-create/pypi/{download,mirror}

  • run-mirror -b remotes/origin/master --verbose -c mirror.yaml

    This creates and updates the mirror.

If you have additional packages that are not identified in the global openstack requirements project, you can include them:

  • pip install -d ~/.cache/image-create/pypi/download/pip/openstack
    heat-cfntools distribute os-apply-config run-mirror -b remotes/origin/master --verbose -c mirror.yaml --no-download