-
Notifications
You must be signed in to change notification settings - Fork 21
ESGF Upgrade
We have migrated the ESGF installation procedure to use Ansible. Please see the following:
Information on the use of esgf-installer scripts are below, though maintenance of these scripts have been discontinued on April 1, 2019.
Currently, no ESGF devel releases are available. Kindly install 2.8.3 instead.
2.8.3-master-release
Selinux
selinux needs to be set to Disabled. This can be done by ensuring that the line SELINUX=disabled is present and uncommented in the /etc/sysconfig/selinux file. To confirm, reboot the machine and run getenforce; the output should be Disabled.
Unix User
You must be root or effectively root to run this program, prefixing the command with sudo will not allow the use of needed environment variables! If you must use sudo, do so only to become root proper then source your user's .[bash]rc file so that root has it's environment set accordingly! Or you can more simply become root using sudo's "-s" flag.
Stop the Node
cd /usr/local/bin
esg-node stop
Clean the webapps directory
Please do this compulsorily, in order to have consistent behavior upon upgrading.
rm -fr /usr/local/tomcat/webapps/*
rm -fr /usr/local/src
Download and Execute the Bootstrap Script
To upgrade to the latest 'devel' install
cd /usr/local/bin
wget -O esg-bootstrap http://distrib-coffee.ipsl.jussieu.fr/pub/esgf/dist/devel/2.8/0/esgf-installer/esg-bootstrap --no-check-certificate
chmod 555 esg-bootstrap
./esg-bootstrap --devel
To upgrade to the latest 'master' install
wget -O esg-bootstrap http://distrib-coffee.ipsl.jussieu.fr/pub/esgf/dist/2.8/3/esgf-installer/esg-bootstrap --no-check-certificate
chmod 555 esg-bootstrap
./esg-bootstrap
Check Installer Script Version
esg-node --version
Version: v2.8.2-master-release
Release: Winterfell
Earth Systems Grid Federation (http://esgf.llnl.gov)
ESGF Node Installation Script
Start the installation process
script -c 'esg-node --upgrade' upgrade.log
Primary Configuration
Please select the ESGF distribution mirror for this installation (fastest to slowest):
-------------------------------------------
[1] http://dist.ceda.ac.uk/esgf
[2] http://esg-dn2.nsc.liu.se/esgf
[3] http://distrib-coffee.ipsl.jussieu.fr/pub/esgf
[4] http://aims1.llnl.gov/esgf
-------------------------------------------
Are you ready to begin the installation? [Y/n] Y
Some notes on choices during the upgrade process
If prompted "Do you want to continue with CDAT installation and setup?" recommended to answer Y even though the default is N. The upgrade solves a known issue where libnetcdf.11.so is not found after other packages are updated.
You may see questions related to adding of replica shards. If prompted whether you'd like to add a NEW replica shard for port 8983/8984, please answer 'Y'.
If you plan to publish CMIP6 data make sure you answer Y to the question regarding that (not a default).
As we are refactoring the node manager, the "peer with "supernode" question is no longer relevant. Everyone can answer 'N' to the question, but it would not be harmful if the question is skipped.
Tier 1 IDP only - We encourage all sites to deploy the SLCS service so please answer Y.
Expert Options
- You can specify a local mirror for use, by specifying the --use-local-mirror option. You'll be then prompted interactively for a mirror url.
- Due to any transient network/system-availability issue, if you are not able to download the bootstrap from the primary mirror, you can obtain them from other mirrors i.e. CEDA, LIU, or AIMS. The bootstrap scripts specific to the mirrors are called esg-bootstrap.ceda, esg-bootstrap.liu, and esg-bootstrap.aims respectively. Note that you have to save them with their original names, as their checksums differ. For instance, to download the bootstrap from AIMS, and execute it, you would do the following:
wget -O esg-bootstrap.aims http://aims1.llnl.gov/esgf/dist/2.8/3/esgf-installer/esg-bootstrap.aims --no-check-certificate
chmod 555 esg-bootstrap.aims
./esg-bootstrap.aims
Post-upgrade
-
Please restart the node after upgrading: esg-node restart
-
Recommended to run esg-node --install-local-certs if you have your signed certs in place for gridftp/myproxy as the certificates might be replaced by temporary ones (they last only 1 month and some services will be unavailable without clear message), as frequently observed to happen after upgrades. (TODO when this is fixed in the installer, we can remove this manual step)
-
An (additional) localhost shard may have be written to esgf_shards_static.xml. This will result in datasets listed twice in the facet counts.