Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update h5py in dockerfile #521

Merged

Conversation

IanHoang
Copy link
Collaborator

@IanHoang IanHoang commented Apr 25, 2024

We are currently experiencing a block when building the Docker image for OSB. This is because h5py released 3.11.0 which seems to have introduced some conflicts. The previous versions of OSB all used h5py 3.10.0. There's two approaches we can take to unblock this build error and prevent future build errors:

  1. Install extra dependencies pkg-config and libhdf5-dev in the Dockerfile that are needed by the new h5py version. However, we observed that this had longer build times and we are also not sure if what these dependencies might introduce into OSB.
  2. Strictly install h5py 3.10.0 (the previous h5py version that OSB has been using in previous versions that works)

Since we aren't sure what these new dependencies in the Dockerfile can potentially do, we elected to have strict installation of 3.10.0 to prevent future bottlenecks when building the Docker image.

Also, added miscellaneous doc updates.

Description

[Describe what this change achieves]

Issues Resolved

[List any issues this PR will resolve]

Testing

  • New functionality includes testing

[Describe how this change was tested]


By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

… added some misc. doc edits

Signed-off-by: Ian Hoang <[email protected]>
Move pip3 install in h5py to same line as line that installs OSB. Saves a few MB and doesn't create new layer.
Signed-off-by: Ian Hoang <[email protected]>
@peterzhuamazon peterzhuamazon merged commit 8b6f746 into opensearch-project:main Apr 25, 2024
9 checks passed
@peterzhuamazon peterzhuamazon deleted the update-dockerfile-h5py branch April 25, 2024 21:08
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants