Skip to content

Latest commit

 

History

History
221 lines (118 loc) · 12.8 KB

DEPENDENCIES.md

File metadata and controls

221 lines (118 loc) · 12.8 KB

Project Dependencies

Summary

Dependency Management Version Notes
Google Test submodule release-1.10.0
C/C++ Compiler external see below
CMake external >= 3.14
Boost (Headers Only) external 1.79.0 headers only library
Udunits libraries external >= 2.0 Can be installed via package manager or from source
MPI external No current implementation or version requirements Required for multi-process distributed execution
Python 3 Libraries external > 3.6.8 Can be excluded.
pybind11 submodule v2.6.0 Can be excluded.
dmod.subsetservice external >= 0.3.0 Only required to perform integrated hydrofabric file subdividing for distributed processing .
t-route submodule see below Module required to enable channel-routing. Requires pybind11 to enable

Details

Google Test

Google Test is an external framework used for writing automated tests, as described in the testing README.

Setup

The dependency is handled as a Git Submodule, located at test/googletest/. To initialize the submodule after cloning the repo:

git submodule update --init --recursive -- test/googletest

Note that initializing the submodule will require the CMake build system be regenerated if it had already been generated, in order for test targets to work.

Version Requirements

The version used is automatically handled by submodule config. This can be synced by re-running the initialization command above.

As of project version 0.1.0, this was the Google Test tag release-1.10.0.

C and C++ Compiler

At present, GCC and Clang are officially supported, though this is expected to change/expand in the near future.

Setup

This dependency itself is handled externally. To used within the project, CMake just needs to know the path to each compiler. CMake is often able to handle this automatically when generating the build system.

If CMake is unable to find a compiler automatically, the CMake CMAKE_C_COMPILER and/or CMAKE_CXX_COMPILER variables will need to be explicitly set. This can be done from the command line when running CMake, or by setting the standard CC and CXX environment variables.

Version Requirements

Project C++ code needs to be compliant with the C++ 14 standard. Supported compilers need to be of a recent enough version to be compatible.

Additionally, C++ compilers needs to be compatible (ideally officially tested as such) with other project C++ dependencies.

GCC

Based on this page, the C++ 14 support requirement probably equates to a version of GCC >= version 5.0.0.

Clang

The Clang versioning scheme is a little convoluted. Using the official scheme, Clang 3.4 and later should support all C++ 14 features.

However, Apple likes to apply their own versioning to Clang and LLVM. The Apple LLVM version 10.0.1 (clang-1001.0.46.4) version released with MacOS 10.14.x should do fine. Recent, earlier version likely will as well, but YMMV.

CMake

The CMake utility facilitates defining and running project builds. More details on CMake and builds have been documented here.

Setup

This dependency itself is handled externally. No special steps are required to use CMake within the project.

However, a CMake build system must be generated for the project before CMake builds can be run and executable artifacts can be created.

Version Requirements

Currently, a version of CMake >= 3.14.0 is required.

Boost (Headers Only)

Boost libraries are used by this project. In particular, Boost.Geometry is used, but others are also.

Currently, only headers-only Boost libraries are utilized. As such, they are not exhaustively listed here since getting one essentially gets them all.

Setup

Since only headers-only libraries are needed, the Boost headers simply need to be available on the local machine at a location the build process can find.

There are a variety of different ways to get the Boost headers locally. Various OS may have packages specifically to install them, though one should take note of whether such packages provide a version of Boost that meets this project's requirements.

Alternatively, the Boost distribution itself can be manually downloaded and unpacked, as described for both Unix-variants and Windows on the Boost website.

Setting BOOST_ROOT

If necessary, the project's CMake config is able to use the value of the BOOST_ROOT environment variable to help it find Boost, assuming the variable is set. It is not always required, as CMake may be able to find Boost without this, depending on how Boost was "installed."

However, it will often be necessary to set BOOST_ROOT if Boost was manually set up by downloading the distribution.

The variable should be set to the value of the boost root directory, which is something like <some_path>/boost_1_79_0.

Version Requirements

At present, a version >= 1.79.0 is required.

Udunits

Udunits is a C library and associated command line tool for converting between compatible units. Only the C library is a required dependency, though these frequently get bundled together. The library and needed development files can be installed via typical package managing tools.

Package Manager Install

The Udunits library and development files can be installed via standard OS package management tools. The ngen project will automatically detect and use these. Note that both the library itself and development files must be installed, which are typically two separate, similarly named packages.

The ngen build will automatically search for these, so no additional steps are required to configure the build or the environment once they are installed. Installation can be done using the typical OS package manager, like yum or apt. Different distributions like to call the packages different things (e.g., udunits2-dev, udunits2-devel, libudunits2-dev, etc.), so you may need to do some searching. This page also provide details on package names for various Linux distros.

Also, for CentOS in particular, you'll need the EPEL repo enabled

Packages for both the library and development files are needed. Package managers usually make this easy, but just make sure to pay attention to it if things do not work as expected.

Example Install Commands
Ubuntu

apt-get install libudunits2-dev

CentOS

yum install udunits2-devel

As mentioned before, you may need to enable the EPEL repo first first, if yum can't find the package.

Version Requirements

Any version greater >= 2.0 (i.e., udunits2 or libudunits2).

Python 3 Libraries

In order to interact with external models written in Python, the Python libraries must be made available.

Further, the Python environment must have NumPy and a few other libraries installed. Several Python BMI function calls utilize numpy arrays, making numpy a necessity for using external Python models implementing BMI.

Overriding Python Dependency

It is possible to run the build, build artifacts, etc. in a way that excludes Python-related functionality, thereby relieving this as a dependency. This may be useful in runtime environments that will not interact with a Python external model, and/or installing Python is prohibitively difficult.

To do this, set either the NGEN_ACTIVATE_PYTHON environment variable to false or include the -DNGEN_ACTIVATE_PYTHON:BOOL=false option when running the cmake build on the command line to generate the build system.

Setup

The first step is to make sure Python is installed. NGen's CMake will use its FindPython functionality to locate the Python installation.

We recommend creating a Python 'virtual environment', and having it activated when configuring, building, testing, and running ngen. Necessary libraries can be installed in that environment without affecting the surrounding system.

Otherwise, CMake can be guided to use a particular Python installation according to its documentation.

The Python installation found by CMake needs to have the relevant libraries installed. These libraries can be installed with

pip install numpy pandas pyyaml bmipy

or an equivalent command if using a different Python package manager.

Version Requirements

A version of Python 3 >= 3.6.8 is required. There are no specific version requirements for numpy currently.

pybind11

The pybind11 dependency is a header-only library that allows for exposing Python types, etc. within C++ code. It is necessary to work with externally maintained, modular Python models.

Overriding pybind11 Dependency

This dependency can be overridden and disabled if the Python dependency is configured as such, as described here.

Setup

The dependency is handled as a Git Submodule, located at extern/pybind11. To initialize the submodule after cloning the repo:

git submodule update --init extern/pybind11

Git should take care of checking out the commit for the required version automatically (assuming latest upstream changes have been fetched), so it should be possible to also use the command above to sync future updates to the required version.

However, to verify the checked out version, examine the output of:

git submodule status

If the above update command does not check out the expected version, this can be done manually. Below is an example of how to do this for the version tagged v2.6.0:

cd extern/pybind11
git checkout v2.6.0

Version Requirements

The version used is automatically handled by submodule config. This can be synced by re-running the initialization command above.

As of project version 0.1.0, the required version is tag v2.6.0.

The dmod.subsetservice Package

This is an optional package available via the OWP DMOD tool. It only is required to enable the driver to generate partition-specific subdivided hydrofabric files from the complete hydrofabric file, as is conditionally required for distributed processing. Further, its use is only attempted when such files are needed for distributed processing and are not already created.

As such, this dependency is ignored unless both Python support and MPI support are enabled and built into the ngen driver.

Setup

This must be installed in the active Python environment at the time the ngen executable is called. This is usually best done via a virtual environment, especially if one is already set up as described for the Numpy dependency. However, all that matters is that the Python environment available to the ngen driver has this package installed.

If installing to a virtual env as suggested above, the installation steps are similar to what is described in the DMOD project document for the subsetting CLI tool. The difference is just to create and/or source a virtual environment locate here first, and then change to the DMOD project directory. All the example commands after the step of sourcing the virtual environment can then be followed as described on that page.

Version Requirements

Version 0.3.0 or greater must be installed.

t-route

Setup

See the installing t-route section for more details.

Be sure to build ngen with Python and Routing support as discussed there, and if using a virtual environment, make sure it is activated when running ngen, e.g.:

source venv/bin/activate