Skip to content

Commit

Permalink
update
Browse files Browse the repository at this point in the history
  • Loading branch information
Jianglin954 committed Oct 15, 2023
1 parent 3ed7ff3 commit cfc7354
Show file tree
Hide file tree
Showing 6 changed files with 10 additions and 12 deletions.
Binary file added .DS_Store
Binary file not shown.
22 changes: 10 additions & 12 deletions index.html
Original file line number Diff line number Diff line change
Expand Up @@ -199,13 +199,17 @@ <h2 class="title is-3" align='center'>Supervision Starvation</h2>

<p align="center">
<table><tr>
<td><a><img src="./static/images/fig1.jpg" height="100" ></a></td>
<td><a><img src="./static/images/table1.jpg" height="100" ></a></td>
</tr><table>
</p>
Performances of ConvMixer (top row) and ViT (bottom row) backbones on CIFAR10 dataset with different model hyperparameters. Y-axis represent the test accuracy and X-axis denotes different network parameter settings. Dense means the model is trained in regular fashion. Mask is the sparse selection strategy.
One-layer, MP, and RP are our strategies. The decimal after RP means the number of unique
parameters compared with MP. From Mask to RP 1e-5, the unique values of network decrease.
Different experimental settings illustrate the representative potential of random weights.
<p align="center">
<table><tr>
<td><a><img src="./static/images/GCNKNN.pdf" height="100" ></a></td>
<td><a><img src="./static/images/GRCN.pdf" height="100" ></a></td>
<td><a><img src="./static/images/SLAPS.pdf" height="100" ></a></td>
</tr><table>
</p>
Performances
</br>
</br>
</br>
Expand All @@ -219,13 +223,7 @@ <h2 class="title is-3" align='center'>A New Network Compression Paradigm</h2>
<td><a><img src="figs/plot_cifar100_resnet.svg" height="100" ></a></td>
</tr><table>
</p>
Compression performance validation on CIFAR10 (left) and CIFAR100 (right) datasets on
ResNet32/ResNet56 backbones. Y-axis denotes the test accuracy. X-axis means the network size
compression ratio. Different colors represent different network architectures. The straight lines on the
top are performance of dense model with regular training. Lines with different symbol shapes denote
different settings. For ResNet, our three points are based on MP, RP 1e-1, and RP 1e-2, respectively.
This pair of figures show that our proposed paradigm achieves admirable compression performance
compared with baselines. In very high compression ratios, we can still maintain the test accuracy.
Compression



Expand Down
Binary file added static/images/GCNKNN.pdf
Binary file not shown.
Binary file added static/images/GRCN.pdf
Binary file not shown.
Binary file added static/images/SLAPS.pdf
Binary file not shown.
Binary file added static/images/table1.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.

0 comments on commit cfc7354

Please sign in to comment.