Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix incorrect remote mode warnings #828

Merged
merged 2 commits into from
Feb 20, 2024
Merged

Fix incorrect remote mode warnings #828

merged 2 commits into from
Feb 20, 2024

Conversation

nv-braf
Copy link
Contributor

@nv-braf nv-braf commented Feb 20, 2024

Removed the incorrect warning in server_factory.py (we now have control of the model in remote mode).

The check for models already loaded was incorrect. The repository index is just a list of models that could be loaded, not what is currently loaded.

After getting the list of potential models, I've added a call to is_model_ready() which will only return true if the model is actually loaded.

No easy way to unit test this (it probably needs an L0, but that seems overkill for a warning message), but I have run it locally and confirmed that the warning messages both go away and then come back if I load a model on the server before running MA.

@nv-braf nv-braf requested a review from ganeshku1 February 20, 2024 14:57
@nv-braf nv-braf requested review from tgerdesnv and removed request for ganeshku1 February 20, 2024 14:57
@nv-braf nv-braf assigned ganeshku1 and unassigned tgerdesnv Feb 20, 2024
@nv-braf nv-braf merged commit 6f58032 into main Feb 20, 2024
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Development

Successfully merging this pull request may close these issues.

3 participants