Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

openmpi: 4.1.6 -> 5.0.3 #275796

Closed
wants to merge 5 commits into from
Closed

openmpi: 4.1.6 -> 5.0.3 #275796

wants to merge 5 commits into from

Conversation

markuskowa
Copy link
Member

@markuskowa markuskowa commented Dec 21, 2023

Description of changes

This is a bigger update: https://docs.open-mpi.org/en/v5.0.x/release-notes/changelog/v5.0.x.html#open-mpi-version-5-0-0

  • Openmpi now uses PRRTE
  • Uses at least AVX now (required for building openmpi).

Closes #275792.

Things done

  • Built on platform(s)
    • x86_64-linux
    • aarch64-linux
    • x86_64-darwin
    • aarch64-darwin
  • For non-Linux: Is sandboxing enabled in nix.conf? (See Nix manual)
    • sandbox = relaxed
    • sandbox = true
  • Tested, as applicable:
  • Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
  • Tested basic functionality of all binary files (usually in ./result/bin/)
  • 24.05 Release Notes (or backporting 23.05 and 23.11 Release notes)
    • (Package updates) Added a release notes entry if the change is major or breaking
    • (Module updates) Added a release notes entry if the change is significant
    • (Module addition) Added a release notes entry if adding a new NixOS module
  • Fits CONTRIBUTING.md.

Add a 👍 reaction to pull requests you find important.

@ofborg ofborg bot added 8.has: package (new) This PR adds a new package 11.by: package-maintainer This PR was created by the maintainer of the package it changes 10.rebuild-darwin: 101-500 10.rebuild-linux: 101-500 labels Dec 21, 2023
@markuskowa markuskowa changed the title [WIP] openmpi: 4.1.6 -> 5.0.0 [WIP] openmpi: 4.1.6 -> 5.0.1 Dec 24, 2023
@ofborg ofborg bot added the 2.status: merge conflict This PR has merge conflicts with the target branch label Feb 20, 2024
danjujan added a commit to danjujan/nixpkgs that referenced this pull request Apr 16, 2024
danjujan added a commit to danjujan/nixpkgs that referenced this pull request Apr 16, 2024
@markuskowa markuskowa changed the title [WIP] openmpi: 4.1.6 -> 5.0.1 [WIP] openmpi: 4.1.6 -> 5.0.3 May 1, 2024
@markuskowa
Copy link
Member Author

markuskowa commented May 2, 2024

@GrahamcOfBorg test slurm
@GrahamcOfBorg build python3Packages.meep cp2k

@ofborg ofborg bot removed the 2.status: merge conflict This PR has merge conflicts with the target branch label May 2, 2024
* add prrte
* cleanup reproducible builds; fix compiler wrappers
* fix detection/selection of AVX/SSE
  Patch out automatic detection for more reproducible builds
  At least AVX needs to enabled to build.
@markuskowa
Copy link
Member Author

markuskowa commented Jun 4, 2024

@GrahamcOfBorg test slurm

@markuskowa markuskowa marked this pull request as ready for review June 4, 2024 12:35
@markuskowa markuskowa changed the title [WIP] openmpi: 4.1.6 -> 5.0.3 openmpi: 4.1.6 -> 5.0.3 Jun 4, 2024
@markuskowa
Copy link
Member Author

From what I can see there is no major breakage caused by the update. Nixpkgs-review does not show any problems related to the update.
I think we are finally ready to merge this.

@markuskowa
Copy link
Member Author

Result of nixpkgs-review run on x87_64-linux 1

30 packages marked as broken and skipped:
  • ezminc
  • octavePackages.sparsersb
  • python311Packages.bambi
  • python311Packages.bambi.dist
  • python311Packages.distrax
  • python311Packages.distrax.dist
  • python311Packages.dm-sonnet
  • python311Packages.dm-sonnet.dist
  • python311Packages.elegy
  • python311Packages.elegy.dist
  • python311Packages.mhcflurry
  • python311Packages.mhcflurry.dist
  • python311Packages.n3fit
  • python311Packages.n3fit.dist
  • python311Packages.rlax
  • python311Packages.rlax.dist
  • python311Packages.sunpy
  • python311Packages.sunpy.dist
  • python311Packages.tensorflow-datasets
  • python311Packages.tensorflow-datasets.dist
  • python311Packages.tf2onnx
  • python311Packages.tf2onnx.dist
  • python311Packages.treex
  • python311Packages.treex.dist
  • python311Packages.trfl
  • python311Packages.trfl.dist
  • python311Packages.worldengine
  • python311Packages.worldengine.dist
  • python312Packages.worldengine
  • python312Packages.worldengine.dist
26 packages failed to build:
  • apacheHttpdPackages.mod_tile
  • elpa
  • elpa.dev
  • elpa.doc
  • elpa.man
  • labplot
  • python311Packages.cartopy
  • python311Packages.cartopy.dist
  • python311Packages.fipy
  • python311Packages.fipy.dist
  • python311Packages.hoomd-blue
  • python311Packages.pydicom-seg
  • python311Packages.pydicom-seg.dist
  • python311Packages.pymc
  • python311Packages.pymc.dist
  • python312Packages.cartopy
  • python312Packages.cartopy.dist
  • python312Packages.fipy
  • python312Packages.fipy.dist
  • python312Packages.hoomd-blue
  • python312Packages.neuronpy
  • python312Packages.pydicom-seg
  • python312Packages.pydicom-seg.dist
  • python312Packages.wrf-python
  • python312Packages.wrf-python.dist
  • rocmPackages_5.rocprofiler
450 packages built:
  • ants
  • bicgl
  • bicpl
  • c3d
  • cdo
  • cloudcompare
  • conglomerate
  • costa
  • cp2k
  • dbcsr
  • dl-poly-classic-mpi
  • dtcmp
  • dtcmp.dev
  • ebtks
  • eccodes
  • elastix
  • elmerfem
  • entwine
  • febio
  • fftwMpi
  • fftwMpi.dev
  • fftwMpi.info
  • fftwMpi.man
  • freecad
  • frigate
  • gdal (python311Packages.gdal)
  • getdp
  • globalarrays
  • gmt
  • gnudatalanguage
  • gplates
  • gpt2tc
  • grass
  • gromacsCudaMpi
  • gromacsCudaMpi.dev
  • gromacsCudaMpi.man
  • gromacsDoubleMpi
  • gromacsDoubleMpi.dev
  • gromacsDoubleMpi.man
  • gromacsMpi
  • gromacsMpi.dev
  • gromacsMpi.man
  • hdf5-mpi
  • hdf5-mpi.bin
  • hdf5-mpi.dev
  • highfive-mpi
  • hp2p
  • hpcg
  • hpl
  • inormalize
  • intensity-normalization (python311Packages.intensity-normalization)
  • intensity-normalization.dist (python311Packages.intensity-normalization.dist)
  • ior
  • itk
  • itk_5_2
  • lammps-mpi
  • libcircle
  • libcircle.dev
  • libmbd
  • libminc
  • librsb
  • libtensorflow (libtensorflow.python)
  • libvdwxc
  • lwgrp
  • lwgrp.dev
  • mapcache
  • mapnik
  • mapproxy
  • mapproxy.dist
  • mapserver
  • merkaartor
  • migrate
  • minc_tools
  • minc_widgets
  • mirtk
  • mni_autoreg
  • mpi
  • mpi.dev
  • mpi.man
  • mpifileutils
  • mpifileutils.dev
  • mpifileutils.man
  • mrtrix
  • mysql-workbench
  • n3
  • nco
  • ncview
  • nest-mpi
  • netcdf
  • netcdf-mpi
  • netcdfcxx4
  • netcdffortran
  • neuron-full (python311Packages.neuronpy)
  • neuron-mpi
  • nwchem
  • octavePackages.mapping
  • octavePackages.ncarray
  • octavePackages.netcdf
  • octopus
  • oobicpl
  • openorienteering-mapper
  • ovito
  • p4est
  • p4est-dbg
  • p4est-sc
  • p4est-sc-dbg
  • paraview
  • parmetis
  • pdal
  • perl536Packages.Tirex
  • perl536Packages.Tirex.devdoc
  • perl538Packages.Tirex
  • perl538Packages.Tirex.devdoc
  • petsc
  • pfft
  • pfft.dev
  • pnfft
  • pnfft.dev
  • precice
  • private-gpt
  • private-gpt.dist
  • prrte
  • prrte.dev
  • pymol
  • pymol.dist
  • python311Packages.arviz
  • python311Packages.arviz.dist
  • python311Packages.baselines
  • python311Packages.baselines.dist
  • python311Packages.boltztrap2
  • python311Packages.boltztrap2.dist
  • python311Packages.bsuite
  • python311Packages.bsuite.dist
  • python311Packages.clarifai
  • python311Packages.clarifai.dist
  • python311Packages.cleanlab
  • python311Packages.cleanlab.dist
  • python311Packages.dalle-mini
  • python311Packages.dalle-mini.dist
  • python311Packages.dask-mpi
  • python311Packages.dask-mpi.dist
  • python311Packages.datashader
  • python311Packages.datashader.dist
  • python311Packages.django-bootstrap4
  • python311Packages.django-bootstrap4.dist
  • python311Packages.django-bootstrap5
  • python311Packages.django-bootstrap5.dist
  • python311Packages.dm-haiku
  • python311Packages.dm-haiku.dist
  • python311Packages.eccodes
  • python311Packages.edward
  • python311Packages.edward.dist
  • python311Packages.fastai
  • python311Packages.fastai.dist
  • python311Packages.fenics
  • python311Packages.fenics.dist
  • python311Packages.fiona
  • python311Packages.fiona.dist
  • python311Packages.flax
  • python311Packages.flax.dist
  • python311Packages.folium
  • python311Packages.folium.dist
  • python311Packages.geodatasets
  • python311Packages.geodatasets.dist
  • python311Packages.geopandas
  • python311Packages.geopandas.dist
  • python311Packages.gpaw
  • python311Packages.gpaw.dist
  • python311Packages.gpt-2-simple
  • python311Packages.gpt-2-simple.dist
  • python311Packages.h5netcdf
  • python311Packages.h5netcdf.dist
  • python311Packages.h5py-mpi
  • python311Packages.h5py-mpi.dist
  • python311Packages.imgcat
  • python311Packages.imgcat.dist
  • python311Packages.islpy
  • python311Packages.islpy.dist
  • python311Packages.k-diffusion
  • python311Packages.k-diffusion.dist
  • python311Packages.keras
  • python311Packages.keras.dist
  • python311Packages.libpysal
  • python311Packages.libpysal.dist
  • python311Packages.llama-index
  • python311Packages.llama-index-agent-openai
  • python311Packages.llama-index-agent-openai.dist
  • python311Packages.llama-index-cli
  • python311Packages.llama-index-cli.dist
  • python311Packages.llama-index-core
  • python311Packages.llama-index-core.dist
  • python311Packages.llama-index-embeddings-gemini
  • python311Packages.llama-index-embeddings-gemini.dist
  • python311Packages.llama-index-embeddings-google
  • python311Packages.llama-index-embeddings-google.dist
  • python311Packages.llama-index-embeddings-huggingface
  • python311Packages.llama-index-embeddings-huggingface.dist
  • python311Packages.llama-index-embeddings-ollama
  • python311Packages.llama-index-embeddings-ollama.dist
  • python311Packages.llama-index-embeddings-openai
  • python311Packages.llama-index-embeddings-openai.dist
  • python311Packages.llama-index-graph-stores-nebula
  • python311Packages.llama-index-graph-stores-nebula.dist
  • python311Packages.llama-index-graph-stores-neo4j
  • python311Packages.llama-index-graph-stores-neo4j.dist
  • python311Packages.llama-index-graph-stores-neptune
  • python311Packages.llama-index-graph-stores-neptune.dist
  • python311Packages.llama-index-indices-managed-llama-cloud
  • python311Packages.llama-index-indices-managed-llama-cloud.dist
  • python311Packages.llama-index-legacy
  • python311Packages.llama-index-legacy.dist
  • python311Packages.llama-index-llms-ollama
  • python311Packages.llama-index-llms-ollama.dist
  • python311Packages.llama-index-llms-openai
  • python311Packages.llama-index-llms-openai-like
  • python311Packages.llama-index-llms-openai-like.dist
  • python311Packages.llama-index-llms-openai.dist
  • python311Packages.llama-index-multi-modal-llms-openai
  • python311Packages.llama-index-multi-modal-llms-openai.dist
  • python311Packages.llama-index-program-openai
  • python311Packages.llama-index-program-openai.dist
  • python311Packages.llama-index-question-gen-openai
  • python311Packages.llama-index-question-gen-openai.dist
  • python311Packages.llama-index-readers-database
  • python311Packages.llama-index-readers-database.dist
  • python311Packages.llama-index-readers-file
  • python311Packages.llama-index-readers-file.dist
  • python311Packages.llama-index-readers-json
  • python311Packages.llama-index-readers-json.dist
  • python311Packages.llama-index-readers-llama-parse
  • python311Packages.llama-index-readers-llama-parse.dist
  • python311Packages.llama-index-readers-s3
  • python311Packages.llama-index-readers-s3.dist
  • python311Packages.llama-index-readers-twitter
  • python311Packages.llama-index-readers-twitter.dist
  • python311Packages.llama-index-readers-txtai
  • python311Packages.llama-index-readers-txtai.dist
  • python311Packages.llama-index-readers-weather
  • python311Packages.llama-index-readers-weather.dist
  • python311Packages.llama-index-vector-stores-chroma
  • python311Packages.llama-index-vector-stores-chroma.dist
  • python311Packages.llama-index-vector-stores-google
  • python311Packages.llama-index-vector-stores-google.dist
  • python311Packages.llama-index-vector-stores-postgres
  • python311Packages.llama-index-vector-stores-postgres.dist
  • python311Packages.llama-index-vector-stores-qdrant
  • python311Packages.llama-index-vector-stores-qdrant.dist
  • python311Packages.llama-index.dist
  • python311Packages.llama-parse
  • python311Packages.llama-parse.dist
  • python311Packages.loopy
  • python311Packages.loopy.dist
  • python311Packages.mapclassify
  • python311Packages.mapclassify.dist
  • python311Packages.medpy
  • python311Packages.medpy.dist
  • python311Packages.meep
  • python311Packages.meshio
  • python311Packages.meshio.dist
  • python311Packages.morecantile
  • python311Packages.morecantile.dist
  • python311Packages.mpi4py
  • python311Packages.mpi4py.dist
  • python311Packages.nanobind
  • python311Packages.nanobind.dist
  • python311Packages.nest
  • python311Packages.netcdf4
  • python311Packages.netcdf4.dist
  • python311Packages.objax
  • python311Packages.objax.dist
  • python311Packages.osmnx
  • python311Packages.osmnx.dist
  • python311Packages.plotnine
  • python311Packages.plotnine.dist
  • python311Packages.pot
  • python311Packages.pot.dist
  • python311Packages.private-gpt
  • python311Packages.private-gpt.dist
  • python311Packages.pygmt
  • python311Packages.pygmt.dist
  • python311Packages.pymedio
  • python311Packages.pymedio.dist
  • python311Packages.pyogrio
  • python311Packages.pyogrio.dist
  • python311Packages.pyprecice
  • python311Packages.pyprecice.dist
  • python311Packages.pyradiomics
  • python311Packages.pyradiomics.dist
  • python311Packages.pytensor
  • python311Packages.pytensor.dist
  • python311Packages.python-mapnik
  • python311Packages.python-mapnik.dist
  • python311Packages.qcodes
  • python311Packages.qcodes-contrib-drivers
  • python311Packages.qcodes-contrib-drivers.dist
  • python311Packages.qcodes.dist
  • python311Packages.rasterio
  • python311Packages.rasterio.dist
  • python311Packages.rio-tiler
  • python311Packages.rio-tiler.dist
  • python311Packages.rioxarray
  • python311Packages.rioxarray.dist
  • python311Packages.sfepy
  • python311Packages.sfepy.dist
  • python311Packages.shimmy
  • python311Packages.shimmy.dist
  • python311Packages.simpleitk
  • python311Packages.simpleitk.dist
  • python311Packages.skrl
  • python311Packages.skrl.dist
  • python311Packages.spacy
  • python311Packages.spacy-loggers
  • python311Packages.spacy-loggers.dist
  • python311Packages.spacy-lookups-data
  • python311Packages.spacy-lookups-data.dist
  • python311Packages.spacy-transformers
  • python311Packages.spacy-transformers.dist
  • python311Packages.spacy.dist
  • python311Packages.tensorflow (python311Packages.tensorflow-build ,python311Packages.tensorflowWithoutCuda)
  • python311Packages.tensorflow.dist (python311Packages.tensorflow-build.dist ,python311Packages.tensorflowWithoutCuda.dist)
  • python311Packages.tensorflow-probability
  • python311Packages.tensorflow-probability.dist
  • python311Packages.tensorflowWithCuda
  • python311Packages.tensorflowWithCuda.dist
  • python311Packages.textacy
  • python311Packages.textacy.dist
  • python311Packages.textnets
  • python311Packages.textnets.dist
  • python311Packages.tf-keras
  • python311Packages.tf-keras.dist
  • python311Packages.tflearn
  • python311Packages.tflearn.dist
  • python311Packages.torchio
  • python311Packages.torchio.dist
  • python311Packages.vqgan-jax
  • python311Packages.vqgan-jax.dist
  • python311Packages.wandb
  • python311Packages.wandb.dist
  • python311Packages.wktutils
  • python311Packages.wktutils.dist
  • python311Packages.wrf-python
  • python311Packages.wrf-python.dist
  • python312Packages.boltztrap2
  • python312Packages.boltztrap2.dist
  • python312Packages.bsuite
  • python312Packages.bsuite.dist
  • python312Packages.dask-mpi
  • python312Packages.dask-mpi.dist
  • python312Packages.django-bootstrap4
  • python312Packages.django-bootstrap4.dist
  • python312Packages.django-bootstrap5
  • python312Packages.django-bootstrap5.dist
  • python312Packages.eccodes
  • python312Packages.fenics
  • python312Packages.fenics.dist
  • python312Packages.fiona
  • python312Packages.fiona.dist
  • python312Packages.folium
  • python312Packages.folium.dist
  • python312Packages.gdal
  • python312Packages.geodatasets
  • python312Packages.geodatasets.dist
  • python312Packages.geopandas
  • python312Packages.geopandas.dist
  • python312Packages.gpaw
  • python312Packages.gpaw.dist
  • python312Packages.h5netcdf
  • python312Packages.h5netcdf.dist
  • python312Packages.h5py-mpi
  • python312Packages.h5py-mpi.dist
  • python312Packages.libpysal
  • python312Packages.libpysal.dist
  • python312Packages.mapclassify
  • python312Packages.mapclassify.dist
  • python312Packages.medpy
  • python312Packages.medpy.dist
  • python312Packages.meep
  • python312Packages.meshio
  • python312Packages.meshio.dist
  • python312Packages.morecantile
  • python312Packages.morecantile.dist
  • python312Packages.mpi4py
  • python312Packages.mpi4py.dist
  • python312Packages.nest
  • python312Packages.netcdf4
  • python312Packages.netcdf4.dist
  • python312Packages.osmnx
  • python312Packages.osmnx.dist
  • python312Packages.plotnine
  • python312Packages.plotnine.dist
  • python312Packages.pygmt
  • python312Packages.pygmt.dist
  • python312Packages.pymedio
  • python312Packages.pymedio.dist
  • python312Packages.pyogrio
  • python312Packages.pyogrio.dist
  • python312Packages.pyprecice
  • python312Packages.pyprecice.dist
  • python312Packages.pyradiomics
  • python312Packages.pyradiomics.dist
  • python312Packages.qcodes
  • python312Packages.qcodes-contrib-drivers
  • python312Packages.qcodes-contrib-drivers.dist
  • python312Packages.qcodes.dist
  • python312Packages.rasterio
  • python312Packages.rasterio.dist
  • python312Packages.rio-tiler
  • python312Packages.rio-tiler.dist
  • python312Packages.rioxarray
  • python312Packages.rioxarray.dist
  • python312Packages.sfepy
  • python312Packages.sfepy.dist
  • python312Packages.simpleitk
  • python312Packages.simpleitk.dist
  • python312Packages.torchio
  • python312Packages.torchio.dist
  • python312Packages.wktutils
  • python312Packages.wktutils.dist
  • pytrainer
  • pytrainer.dist
  • qgis
  • qgis-ltr
  • qmapshack
  • quantum-espresso
  • raxml-mpi
  • rocmPackages.rocalution
  • rocmPackages.rocprofiler
  • rocmPackages_5.rocalution
  • saga
  • scalapack
  • scalapack.dev
  • scotch
  • siesta-mpi
  • simpleitk
  • sirius
  • sirius.dev
  • spfft
  • spla
  • spla.dev
  • sumo
  • t-rex
  • trilinos-mpi
  • udig
  • vpv
  • witnessme
  • witnessme.dist
  • wyoming-openwakeword
  • wyoming-openwakeword.dist
  • xyce-parallel
  • xyce-parallel.doc

@markuskowa
Copy link
Member Author

markuskowa commented Jun 4, 2024

@GrahamcOfBorg build openmpi

@wegank wegank added the 2.status: merge conflict This PR has merge conflicts with the target branch label Jul 4, 2024
@markuskowa markuskowa mentioned this pull request Jul 15, 2024
11 tasks
@doronbehar doronbehar closed this Aug 7, 2024
@markuskowa markuskowa deleted the openmpi-5.0 branch August 7, 2024 15:48
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
2.status: merge conflict This PR has merge conflicts with the target branch 6.topic: python 8.has: package (new) This PR adds a new package 10.rebuild-darwin: 101-500 10.rebuild-linux: 101-500 11.by: package-maintainer This PR was created by the maintainer of the package it changes
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Update request: openmpi 4.1.6 → 5.0.1
4 participants