Skip to content

Commit

Permalink
Fix typo
Browse files Browse the repository at this point in the history
  • Loading branch information
pomonam committed Jul 11, 2024
1 parent ad06d11 commit 37b37d1
Show file tree
Hide file tree
Showing 2 changed files with 2 additions and 2 deletions.
2 changes: 1 addition & 1 deletion examples/openwebtext/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -25,5 +25,5 @@ I saved some prompt and completition pair to the directory `data/data.json`.
To compute influence scores on the generated prompt and compleition pair, run the following command:

```bash
torchrun --standalone --nnodes=1 --nproc-per-node=4 fit_factors.py --factor_batch_size 4
torchrun --standalone --nnodes=1 --nproc-per-node=4 compute_scores.py --train_batch_size 4
```
2 changes: 1 addition & 1 deletion examples/openwebtext/compute_scores.py
Original file line number Diff line number Diff line change
Expand Up @@ -91,7 +91,7 @@ def main():
dataloader_kwargs = DataLoaderKwargs(num_workers=4, collate_fn=default_data_collator, pin_memory=True)
analyzer.set_dataloader_kwargs(dataloader_kwargs)

scores_name = args.strategy
scores_name = args.factor_strategy
score_args = extreme_reduce_memory_score_arguments(
damping_factor=None, module_partitions=1, query_gradient_low_rank=args.query_gradient_rank, dtype=torch.bfloat16
)
Expand Down

0 comments on commit 37b37d1

Please sign in to comment.