Skip to content

Commit

Permalink
Update README.md
Browse files Browse the repository at this point in the history
  • Loading branch information
sangkeun00 authored May 20, 2024
1 parent 64ba298 commit 8e77696
Showing 1 changed file with 11 additions and 2 deletions.
13 changes: 11 additions & 2 deletions examples/mnist/README.md
Original file line number Diff line number Diff line change
@@ -1,11 +1,20 @@
# MNIST

### Step 1: Train
Since influence functions are typically computed at the final model
weight, we first train the model (MLP) on the (small) MNIST dataset
before performinig influence analyses.

```bash
python train.py
```

### Step 2: AnaLog
### Step 2: Log extraction & Influence analysis
With the trained model, we first extract and save logs (e.g.
Hessian, gradeint) to disk, and use it to compute influence
scores. Users can specify the gradient projection strategy
(e.g. LoGra) and the Hessian computation strategy.

```bash
python compute_influences.py
python compute_influences.py --lora none --hessian raw --save grad
```

0 comments on commit 8e77696

Please sign in to comment.