You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
When using the model_id with the DJLModel class in the SageMaker Python SDK, the entry_point is not working, and the code specified is not loaded into the container
#4847
Open
itaymelamed opened this issue
Aug 22, 2024
· 0 comments
Describe the bug
When using the microsoft/Phi-3-small-8k-instruct with the DJLModel class in the SageMaker Python SDK, the entry_point is not working, and the code specified is not loaded into the container. When endpoint is created it fails since in can't locate /opt/ml/model/code/model.py.
To reproduce
Steps to reproduce the behavior:
Set up a SageMaker environment with the required IAM roles and permissions.
Use the following code snippet to create a DJLModel:
Describe the bug
When using the
microsoft/Phi-3-small-8k-instruct
with theDJLModel
class in the SageMaker Python SDK, theentry_point
is not working, and the code specified is not loaded into the container. When endpoint is created it fails since in can't locate /opt/ml/model/code/model.py.To reproduce
Steps to reproduce the behavior:
Set up a SageMaker environment with the required IAM roles and permissions.
Use the following code snippet to create a
DJLModel
:Deploy the model using SageMaker.
Expected behavior
The
entry_point
specified should be correctly loaded into the container, allowing the model to function as intended.System information
The text was updated successfully, but these errors were encountered: