Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[BUG] Drop CentOS7 support in 24.06 #1991

Closed
5 tasks
NvTimLiu opened this issue Apr 23, 2024 · 1 comment · Fixed by #2010
Closed
5 tasks

[BUG] Drop CentOS7 support in 24.06 #1991

NvTimLiu opened this issue Apr 23, 2024 · 1 comment · Fixed by #2010
Assignees
@NvTimLiu
Labels
bug Something isn't working

Comments

@NvTimLiu
Copy link
Collaborator

NvTimLiu commented Apr 23, 2024 •
edited
Loading

Describe the bug
We plan to drop CentOS 7 (which uses glibc 2.17) & Ubuntu18.04(glibc 2.27) in RAPIDS 24.06. This issue documents some of the work items needed to complete the drop in platform support. Refor to :

https://docs.rapids.ai/notices/rsn0037/

rapidsai/build-planning#23

NVIDIA/spark-rapids#10496

The new minimum glibc supported by RAPIDS will become 2.28 (used by Rocky 8), because that is the oldest glibc of any operating system we currently support.

  • CentOS 7 : 2.17
  • Ubuntu18 : 2.27
  • Rocky8 : 2.28
  • Debian10: 2.28
  • Ubuntu20: 2.31
  • Ubuntu22: 2.35

Will need to:

  • Update scripts/Docker of 24.06 for JNI/spark-rapids-JNI to support Rocky8
  • Build 24.06 cuDF JNI/spark-rapids-JNI on Rocky8
  • Aggregate spark-rapids-jni into 24.06 spark-rapids
  • Drop spark-rapids Integration tests against Ubuntu18 or CentOS7
  • Check IT on CSP to makes sure no CentOS7 and Ubuntu18 or below OS
@NvTimLiu NvTimLiu added bug Something isn't working ? - Needs Triage labels Apr 23, 2024
@NvTimLiu NvTimLiu self-assigned this Apr 23, 2024
@NvTimLiu NvTimLiu changed the title [BUG] Drop CentOS 7/Ubuntu18.04 support in RAPIDS 24.06 [BUG] Drop CentOS 7 support in RAPIDS 24.06 Apr 23, 2024
@NvTimLiu NvTimLiu changed the title [BUG] Drop CentOS 7 support in RAPIDS 24.06 [BUG] Drop CentOS7/Ubuntu18.04 support in RAPIDS 24.06 Apr 23, 2024
@NvTimLiu NvTimLiu changed the title [BUG] Drop CentOS7/Ubuntu18.04 support in RAPIDS 24.06 [BUG] Drop CentOS7support in RAPIDS 24.06 Apr 23, 2024
@NvTimLiu NvTimLiu changed the title [BUG] Drop CentOS7support in RAPIDS 24.06 [BUG] Drop CentOS7support in 24.06 Apr 23, 2024
@mattahrens mattahrens changed the title [BUG] Drop CentOS7support in 24.06 [BUG] Drop CentOS7 support in 24.06 Apr 23, 2024
@NvTimLiu
Copy link
Collaborator Author

Built out amd64/arm64 spark-rapids-jni jars on Rocky8, running integration tests with spark-rapids to see if any GLIBC issues.

@bdice bdice mentioned this issue Apr 29, 2024
Closed
24 tasks
NvTimLiu added a commit to NvTimLiu/spark-rapids-jni that referenced this issue May 2, 2024
@NvTimLiu
Drop Centos7 support
55e7b5a 
To fix: NVIDIA#1991

Drop Centos7 support, switch to build in a Rocky 8 Docker image

Update the script to support both amd64 and arm64 CPUs

Signed-off-by: Tim Liu <[email protected]>
NvTimLiu added a commit to NvTimLiu/spark-rapids-jni that referenced this issue May 2, 2024
@NvTimLiu
Drop Centos7 support
19527d1 
To fix: NVIDIA#1991

Drop Centos7 support, switch to build in a Rocky 8 Docker image

Update the script to support both amd64 and arm64 CPUs

Signed-off-by: Tim Liu <[email protected]>
@NvTimLiu NvTimLiu mentioned this issue May 2, 2024
Merged
NvTimLiu added a commit that referenced this issue May 14, 2024
@NvTimLiu @jlowe
Drop Centos7 support (#2010)
f1e5dbb 
* Drop Centos7 support

To fix: #1991

Drop Centos7 support, switch to build in a Rocky 8 Docker image

Update the script to support both amd64 and arm64 CPUs

Signed-off-by: Tim Liu <[email protected]>

* Update for code review

Signed-off-by: Tim Liu <[email protected]>

* Dockerfile.multi to Dockerfile

Signed-off-by: Tim Liu <[email protected]>

* Change '--platform' param to be compatitable with lower Docker versions

Signed-off-by: Tim Liu <[email protected]>

* Update for code review

Signed-off-by: Tim Liu <[email protected]>

* Make cuda version consistent

Signed-off-by: Tim Liu <[email protected]>

* Update according to the review comments

Signed-off-by: Tim Liu <[email protected]>

* Update build/run-in-docker

Co-authored-by: Jason Lowe <[email protected]>

* Move CMAKE_GENERATOR back into build-in-docker

Signed-off-by: Tim Liu <[email protected]>

---------

Signed-off-by: Tim Liu <[email protected]>
Co-authored-by: Jason Lowe <[email protected]>
@jlowe jlowe mentioned this issue May 14, 2024
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@NvTimLiu NvTimLiu

Labels
bug Something isn't working
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Drop Centos7 support NvTimLiu/spark-rapids-jni
2 participants
@mattahrens @NvTimLiu