Skip to content

khaledk2/deployment

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

IDR systems documentation

The Image Data Resource (IDR) is an online, public data repository that seeks to store, integrate and serve image datasets from published scientific studies. The IDR is also a platform that is entirely built with open-source components and tools, and these documents describe how to build and manage your own version of the IDR.

The IDR is currently hosted on OpenStack at EMBL-EBI. At present OpenStack is the recommended platform for all deployments. It should be possible to deploy the IDR on other cloud platforms or physical hardware, but changes will be required, particularly with respect to network interfaces. Ansible (an open-source configuration management system) is used extensively for managing the IDR.

Prerequisites

The IDR provisioning and deployment instructions are aimed at experienced system administrators familiar with using Ansible playbooks and roles for managing multiple servers. If you are deploying the IDR platform on OpenStack you should have a good working knowledge of instances, volumes and networking.

All documents assume extensive knowledge of OMERO.

Ansible 2.9 is required. Some Ansible tasks can take a long time, such as pulling Docker images. If you see lost connections you can try setting a keep-alive in your .ssh/config file, e.g. ServerAliveInterval 30.

Documents

Provisioning: Guidelines for provisioning compute, storage and network resources for hosting the IDR, on virtual or physical hardware.

Deployment: Instructions on how to install the IDR using Ansible.

idr-ansible.sh: An example script to provision and deploy the IDR on OpenStack.

Operating procedures: Administration of the IDR

IDR upload server: Information on how the IDR upload server is run.

Monitoring: Monitoring the IDR

About

Deployment infrastructure for the Image Data Resource

Resources

License

Stars

Watchers

Forks

Packages

No packages published

Languages

  • Python 76.3%
  • Jinja 16.7%
  • Shell 7.0%