Go to file
Tobias Henkel b62ed1823c
Fix encoding issue during processing output
When using the package-installs element there can be some encoding
problems if the package installation emits unparsable output
[1]. However in this case we just want to forward the output to the
console which normally can handle this correctly. In order to fix this
switch off universal_newlines processing such that we just operate on
bytes.

Further we have to decode the lines without setting the locale and
ignoring errors. This is required because print encodes without
setting the locale and thus we need to filter/modify the stream such
that it doesn't crash.

[1] Traceback:
2018-03-01 09:58:00.515 | Traceback (most recent call last):
2018-03-01 09:58:00.515 |   File "/usr/local/bin/package-installs-v2", line 137, in <module>
2018-03-01 09:58:00.515 |     main()
2018-03-01 09:58:00.515 |   File "/usr/local/bin/package-installs-v2", line 130, in main
2018-03-01 09:58:00.515 |     process_output(install_args, follow=True)
2018-03-01 09:58:00.515 |     for line in iter(proc.stdout.readline, ''):
2018-03-01 09:58:00.515 |   File "/usr/lib/python3.5/encodings/ascii.py", line 26, in decode
2018-03-01 09:58:00.515 |     return codecs.ascii_decode(input, self.errors)[0]
2018-03-01 09:58:00.515 | UnicodeDecodeError: 'ascii' codec can't decode byte 0xc3 in position 34: ordinal not in range(128)

Change-Id: Ie4af9b4523459a630cfb98d09093bfe9ef7aa61e
2018-03-01 16:09:25 +00:00
.zuul.d Zuul: Remove project name 2018-02-01 04:37:33 -08:00
bin Check source-repository-* files for trailing newline 2017-12-08 14:24:57 +11:00
contrib Start at using CI mirrors for fedora/centos 2017-06-21 12:02:27 +10:00
diskimage_builder Fix encoding issue during processing output 2018-03-01 16:09:25 +00:00
doc Merge "Remove some redundant indents" 2018-02-27 03:42:12 +00:00
playbooks/legacy Import legacy playbooks 2017-10-17 10:41:30 +11:00
releasenotes Merge "upgrade pip before using -c option" 2018-02-05 22:34:00 +00:00
tests Use EPEL for debootstrap on centos 2017-11-28 15:21:38 +11:00
.gitignore Import legacy playbooks 2017-10-17 10:41:30 +11:00
.gitreview Update stackforge references to openstack 2013-08-17 22:58:26 -04:00
.testr.conf Fix coverage report 2017-01-18 16:14:01 +11:00
babel.cfg Make it possible for openstack-CI to run tests 2013-02-04 22:26:17 -08:00
bindep.txt bindep.txt: Exclude gnupg2 package on openSUSE 2017-06-28 21:27:20 +01:00
LICENSE Fix copyrights for HP work. 2012-11-15 16:20:32 +13:00
pylint.cfg Refactor: use lazy logging 2017-05-30 14:39:58 +10:00
README.rst Update the documentation link for doc migration 2017-07-17 16:12:12 +10:00
requirements.txt Updated from global requirements 2017-11-16 11:01:41 +00:00
setup.cfg Merge "Add timestamp output filter" 2017-10-09 15:56:31 +00:00
setup.py Updated from global requirements 2017-03-13 19:30:19 +00:00
test-requirements.txt Updated from global requirements 2018-01-24 00:51:49 +00:00
tox.ini Avoid tox_install.sh for constraints support 2017-12-02 17:07:13 +00:00

Image building tools for OpenStack
==================================

``diskimage-builder`` is a flexible suite of components for building a
wide-range of disk images, filesystem images and ramdisk images for
use with OpenStack.

This repository has the core functionality for building such images,
both virtual and bare metal.  Images are composed using `elements`;
while fundamental elements are provided here, individual projects have
the flexibility to customise the image build with their own elements.

For example::

  $ DIB_RELEASE=trusty disk-image-create -o ubuntu-trusty.qcow2 vm ubuntu

will create a bootable Ubuntu Trusty based ``qcow2`` image.

``diskimage-builder`` is useful to anyone looking to produce
customised images for deployment into clouds.  These tools are the
components of `TripleO <https://wiki.openstack.org/wiki/TripleO>`__
that are responsible for building disk images.  They are also used
extensively to build images for testing OpenStack itself, particularly
with `nodepool
<https://docs.openstack.org/infra/system-config/nodepool.html>`__.
Platforms supported include Ubuntu, CentOS, RHEL and Fedora.

Full documentation, the source of which is in ``doc/source/``, is
published at:

* https://docs.openstack.org/diskimage-builder/latest/

Copyright
=========

Copyright 2012 Hewlett-Packard Development Company, L.P.
Copyright (c) 2012 NTT DOCOMO, INC.

All Rights Reserved.

Licensed under the Apache License, Version 2.0 (the "License"); you may
not use this file except in compliance with the License. You may obtain
a copy of the License at

    http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS, WITHOUT
WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the
License for the specific language governing permissions and limitations
under the License.