# Troubleshooting failed recipes¶

## Recipes built with conda-build 3¶

If you have conda-build 3 installed locally and use conda skeleton, the resulting meta.yaml will be incompatible with our conda-build 2 infrastructure.

We are moving towards supporting conda-build-3 which has many nice features we can take advantage of. In the meantime, however, we need to use conda-build 2.

In particular, conda-build 3 uses the host: key instead of the build: key for dependencies. Conda-build 2 ignores that key. The result is that cb3-created meta.yaml will have no build dependencies from cb2’s point of view.

The easiest fix is to change host: to build: in the resulting recipe.

For failed recipes, usually the easiest thing to do is find the first BIOCONDA ERROR, and start reading the output below that line. The stdout and stderr for that failed build will end with the next BIOCONDA log line, likely a BIOCONDA BUILD START or BIOCONDA BUILD SUMMARY line. Note that there are two tests: the tests performed by conda in the main environment, and if they pass, the mulled-build tests performed in a minimal docker container. For working with failures in mulled-build tests, see Troubleshooting failed mulled-build tests.

## HTTP 500 errors¶

Sometimes recipes fail for reasons outside our control. For example, if anaconda.org returns an HTTP 500 error, that has nothing to do with the recipe but with anaconda.org’s servers. In this case, you can either restart the build (if you have access to do so in the circleci interface), or close the PR and then immediately re-open it to trigger a re-build.

## HTTP 404 errors¶

HTTP 404 errors can happen if a url used for a recipe was not stable. In this case the solution is to track down a stable URL. For example this problem happened frequently with Bioconductor recipes that were up-to-date as of the current Bioconductor release, but when a new Bioconductor version came out the links would not work.

The solution to this is the Cargo Port, developed and maintained by the Galaxy team. The Galaxy Jenkins server performs daily archives of the source code of packages in bioconda, and makes these tarballs permanently available in Cargo Port. If you try rebuilding a recipe and the source seems to have disappeared, do the following:

• search for the package and version at https://depot.galaxyproject.org/software/
• add the URL listed in the “Package Version” column to your meta.yaml file as another entry in the source: url section.
• add the corresponding sha256 checksum displayed upon clicking the Info icon in the “Help” column to the source: section.

For example, if this stopped working:

source:
fn: argh-0.26.1.tar.gz
url: https://pypi.python.org/packages/source/a/argh/argh-0.26.1.tar.gz
md5: 5a97ce2ae74bbe3b63194906213f1184


then change it to this:

source:
fn: argh-0.26.1.tar.gz
url:
- https://pypi.python.org/packages/source/a/argh/argh-0.26.1.tar.gz
- https://depot.galaxyproject.org/software/argh/argh_0.26.1_src_all.tar.gz
md5: 5a97ce2ae74bbe3b63194906213f1184


## ZLIB errors¶

When building the package, you may get an error saying that zlib.h can’t be found – despite having zlib listed in the dependencies. The reason is that the location of zlib often has to be specified in the build.sh script, which can be done like this:

export CFLAGS="-I$PREFIX/include" export LDFLAGS="-L$PREFIX/lib"


Or sometimes:

export CPATH=${PREFIX}/include  Sometimes Makefiles may specify these locations, in which case they need to be edited. See the samtools recipe for an example of this. It may take some tinkering to get the recipe to build; if it doesn’t seem to work then please submit an issue or notify @bioconda/core for advice. ## /usr/bin/perl or /usr/bin/python not found¶ Often a tool hard-codes the shebang line as, e.g., /usr/bin/perl rather than the more portable /usr/bin/env perl. To fix this, use sed in the build script to edit the lines. Here is an example that will replace the first line of a file $PREFIX/bin/alocal with the proper shebang line

sed -i.bak '1 s|^.*$|#!/usr/bin/env perl|g'$PREFIX/bin/aclocal


(note the -i.bak, which is needed to support both Linux and OSX versions of sed).

It turns out that the version of autoconf that is packaged in the defaults channel still uses the hard-coded Perl. So if a tool uses autoconf for building, it is likely you will see this error and it will need some sed commands. See here for an example to work from.

## Troubleshooting failed mulled-build tests¶

After conda sucessfully builds and tests a package, we then perform a more stringent test in a minimal Docker container using mulled-build. Notably, this container does not have conda and has very few libraries. So this test can catch issues that the default conda test cannot. However the extra layer of abstraction makes it difficult to troubleshoot problems with the recipe. If the conda-build test works but the mulled-build test fails try these steps:

• Run the test using the bootstrap.py method described in 3. Test locally.
• Look carefully at the output from mulled-build to look for Docker hashes, and cross-reference with the output of docker images | head to figure out the hash of the container used.
• Start up an interactive docker container, docker run -it \$hash. You can now try running the tests in the recipe that failed, or otherwise poke around in the running container to see what the problem was.

## Using the extended image¶

For the vast majority of recipes, we use a minimal BusyBox container for testing and to upload to quay.io. This allows us to greatly reduce the size of images, but there are some packages that are not compatible with the minimal container. To support these cases, we offer the ability to in special cases use an “extended base” container. This container is maintained at https://github.com/bioconda/bioconda-extended-base-image and is automatically built by DockerHub when Dockerfile is updated in the GitHub repo.

Please note that this is not a general solution to packaging issues, and should only be used as a last resort. Cases where the extended base has been needed are:

• Unicode support is required (especially if a package uses the click Python package under Python 3; see for example comments here and here).
• libGL.so.1 dependency
• openssl dependency, e.g., through openmpi

To use the extended container, add the following to a recipe’s meta.yaml:

extra:
container:
extended-base: True