Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add docker compose deployment for ROCm example #1054

Conversation

astafevav
Copy link

@astafevav astafevav commented Nov 1, 2024

Type of change

  • Added docker compose deployment example for AMD ROCm systems
  • Added Readme for compose deployment on AMD ROCm systems
  • Added tests for compose deployment on AMD ROCm systems

@chensuyue
Copy link
Collaborator

Please add a similar CI test like this, so we can trigger the test on amd gpu, https://github.com/opea-project/GenAIExamples/blob/ee87d75876b231a0f290a69d7e21d21aad74a16a/DocSum/tests/test_compose_on_gaudi.sh

@chensuyue
Copy link
Collaborator

And the node from AMD is offline, please check the connect status,
image

@chensuyue chensuyue added the WIP label Nov 4, 2024
@astafevav astafevav marked this pull request as draft November 5, 2024 12:24
@astafevav astafevav marked this pull request as ready for review November 5, 2024 13:22
@astafevav astafevav force-pushed the add-docsum-rocm-docker-compose-example branch from 0e08891 to 7ea3fa8 Compare November 6, 2024 06:03
@astafevav
Copy link
Author

Hi @chensuyue, thank you for review,

I've added test scripts for AMD Rocm for DocSum And FaqGen,

But still clarifying status for coresite-sv7-106-amd-mi300-19 with the team.

@astafevav astafevav force-pushed the add-docsum-rocm-docker-compose-example branch from 7ea3fa8 to 713cc1b Compare November 6, 2024 12:41
@@ -0,0 +1,87 @@
# Copyright (C) 2024 Intel Corporation
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think you should add AMD copyright.

@@ -0,0 +1,184 @@
#!/bin/bash
# Copyright (C) 2024 Intel Corporation
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Also here.

@chensuyue chensuyue modified the milestone: v1.1 Nov 7, 2024
DocSum/docker_compose/amd/gpu/rocm/README.md Outdated Show resolved Hide resolved
DocSum/docker_compose/amd/gpu/rocm/README.md Outdated Show resolved Hide resolved
Comment on lines +39 to +42
security_opt:
- seccomp:unconfined
cap_add:
- SYS_PTRACE
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is this some development version not intended for production, or why it's disabling security measures instead of adding them?


stop_docker

if [[ "$IMAGE_REPO" == "opea" ]]; then build_docker_images; fi
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Would be good to make all scripts shellcheck clean (apt install shellscheck; shellcheck *.sh).

@astafevav astafevav force-pushed the add-docsum-rocm-docker-compose-example branch from c96d387 to e7ae5d1 Compare November 8, 2024 10:30
@astafevav
Copy link
Author

Hi @chensuyue , @eero-t , I've found that I will need submit PR for AMD activity from my corporate github account.

I will close this one, for DocSum and ChatQnA and re-open with all suggested fixes.

Still clarifying status for AMD copyright and will fix shellcheck warning for then too.

Sorry for inconvenience.

@chensuyue
Copy link
Collaborator

Please also fix the CI issue.

@chensuyue
Copy link
Collaborator

Hi @chensuyue , @eero-t , I've found that I will need submit PR for AMD activity from my corporate github account.

I will close this one, for DocSum and ChatQnA and re-open with all suggested fixes.

Still clarifying status for AMD copyright and will fix shellcheck warning for then too.

Sorry for inconvenience.

Please put your new PR link here when you have it and close the old one.

@astafevav
Copy link
Author

Hi @chensuyue , @eero-t , I've found that I will need submit PR for AMD activity from my corporate github account.
I will close this one, for DocSum and ChatQnA and re-open with all suggested fixes.
Still clarifying status for AMD copyright and will fix shellcheck warning for then too.
Sorry for inconvenience.

Please put your new PR link here when you have it and close the old one.

Re-submitted PR: #1125, I'm still working on test script, so status for new PR is still work in progress.

Closing this one.

@astafevav
Copy link
Author

Re-submitted PR: #1125

@astafevav astafevav closed this Nov 13, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants