Skip to content

mk322/pretrain_llama

Repository files navigation

pretrain_llama

inference: torchrun --nproc_per_node=1 --master-port=29501 inference.py --num_nodes=1

pretrain: torchrun --nproc_per_node=1 --master-port=29501 train.py --num_nodes=1

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages