Skip to content

Commit

Permalink
Edits to Llama 3.2 Quickstart (#1616)
Browse files Browse the repository at this point in the history
* add llama notebook

* removed larger GPUs

* fixed large
  • Loading branch information
rajshah4 authored Oct 1, 2024
1 parent 4a543af commit 662b522
Showing 1 changed file with 3 additions and 7 deletions.
10 changes: 3 additions & 7 deletions site/sfguides/src/notebook-llama32v/notebook-llama32v.md
Original file line number Diff line number Diff line change
Expand Up @@ -28,6 +28,7 @@ This Quickstart will guide you through the steps of running Snowflake Notebooks
- Foundational knowledge of Data Science workflows
- Requested access to the Meta models at Hugging Face
- Running the 11b version of the model requires > 30GB of GPU memory
- You make need to get permsissions to access the medium GPU compute pool

### What You Will Learn
- The key features of Snowflake Notebooks with Container Runtime
Expand Down Expand Up @@ -70,18 +71,13 @@ CREATE OR REPLACE WAREHOUSE CONTAINER_RUNTIME_WH AUTO_SUSPEND = 60;
GRANT ALL ON WAREHOUSE CONTAINER_RUNTIME_WH TO ROLE container_runtime_lab_user;

-- Create and grant access to compute pools
-- If you get errors about limits, reduce the number of nodes in the compute pools
CREATE COMPUTE POOL IF NOT EXISTS gpu_nv_m_nodes
MIN_NODES = 1
MAX_NODES = 5
MAX_NODES = 3
INSTANCE_FAMILY = GPU_NV_M;

CREATE COMPUTE POOL IF NOT EXISTS gpu_nv_l_nodes
MIN_NODES = 1
MAX_NODES = 5
INSTANCE_FAMILY = GPU_NV_L;

GRANT USAGE ON COMPUTE POOL gpu_nv_m_nodes TO ROLE container_runtime_lab_user;
GRANT USAGE ON COMPUTE POOL gpu_nv_l_nodes TO ROLE container_runtime_lab_user;

-- Create and grant access to EAIs
-- Substep #1: create network rules (these are schema-level objects; end users do not need direct access to the network rules)
Expand Down

0 comments on commit 662b522

Please sign in to comment.