Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Document k8s setup for compilation server #206

Open
magland opened this issue Aug 12, 2024 · 1 comment
Open

Document k8s setup for compilation server #206

magland opened this issue Aug 12, 2024 · 1 comment

Comments

@magland
Copy link
Collaborator

magland commented Aug 12, 2024

No description provided.

@magland
Copy link
Collaborator Author

magland commented Aug 12, 2024

A couple notes

If you are running the compilation server so that the user inside the container is not root (for example, the default on kubernetes), then configure the following environment variables.

        env:
          - name: SWS_JOB_DIR
            value: /tmp/jobs
          - name: SWS_BUILT_MODEL_DIR
            value: /tmp/models
          - name: EM_CACHE
            value: /tmp/emcache
          - name: HOME
            value: /tmp

Also, for some reason the EM_CACHE env variable does not take effect if you call run.sh as the entrypoint. Instead you need to call uvicorn command directly.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant