Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

enabling finetuning on phi-3.5 variants #3328

Open
wants to merge 7 commits into
base: main
Choose a base branch
from
Open

enabling finetuning on phi-3.5 variants #3328

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
7 commits
Select commit Hold shift + click to select a range
ef6cad9
enabling finetuning on phi-3.5-mini-128k
Sep 4, 2024
0b99a39
Updating new container folder
Sep 4, 2024
f1312fd
Updating spec
Sep 5, 2024
ae65aec
enable moe for FT
Sep 17, 2024
041c4df
blob folder update
Sep 18, 2024
000d1dd
removing maas publish
Sep 18, 2024
4067248
Merge branch 'main' into dev/anubha/phi_3_5_ft_enable
Anubha98 Sep 18, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
12 changes: 11 additions & 1 deletion assets/models/system/phi-3.5-mini-128k-instruct/spec.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -6,6 +6,9 @@ properties:
languages: en
inference-min-sku-spec: 24|1|220|64
inference-recommended-sku: Standard_NC24ads_A100_v4, Standard_NC48ads_A100_v4, Standard_NC96ads_A100_v4, Standard_ND96amsr_A100_v4
finetuning-tasks: chat-completion
finetune-min-sku-spec: 24|1|220|64
finetune-recommended-sku: Standard_NC24ads_A100_v4, Standard_NC48ads_A100_v4, Standard_NC96ads_A100_v4, Standard_ND96amsr_A100_v4
tags:
evaluation: "evaluation.md"
notes: "notes.md"
Expand Down Expand Up @@ -39,6 +42,13 @@ tags:
Standard_ND96amsr_A100_v4,
Standard_NC96ads_A100_v4
]
finetune_compute_allow_list:
[
Standard_NC24ads_A100_v4,
Standard_NC48ads_A100_v4,
Standard_NC96ads_A100_v4,
Standard_ND96amsr_A100_v4
]
inference_supported_envs:
- vllm
model_specific_defaults:
Expand All @@ -57,4 +67,4 @@ tags:
logging_strategy: "steps"
logging_steps: 10
save_total_limit: 1
version: 2
version: 3
14 changes: 12 additions & 2 deletions assets/models/system/phi-3.5-moe-128k-instruct/spec.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -6,6 +6,9 @@ properties:
languages: en
inference-min-sku-spec: 48|2|440|128
inference-recommended-sku: Standard_NC48ads_A100_v4, Standard_NC96ads_A100_v4, Standard_ND96amsr_A100_v4
finetuning-tasks: chat-completion
finetune-min-sku-spec: 24|1|220|64
finetune-recommended-sku: Standard_NC24ads_A100_v4, Standard_NC48ads_A100_v4, Standard_NC96ads_A100_v4, Standard_ND96amsr_A100_v4
tags:
freePlayground: "false"
displayName: "Phi-3.5 MoE instruct (128k)"
Expand Down Expand Up @@ -35,11 +38,18 @@ tags:
Standard_ND96amsr_A100_v4,
Standard_NC96ads_A100_v4
]
finetune_compute_allow_list:
[
Standard_NC24ads_A100_v4,
Standard_NC48ads_A100_v4,
Standard_NC96ads_A100_v4,
Standard_ND96amsr_A100_v4
]
inference_supported_envs:
- vllm
model_specific_defaults:
apply_deepspeed: "true"
deepspeed_stage: 2
deepspeed_stage: 3
apply_lora: "true"
apply_ort: "false"
precision: 16
Expand All @@ -53,4 +63,4 @@ tags:
logging_strategy: "steps"
logging_steps: 10
save_total_limit: 1
version: 2
version: 3
Loading