Skip to content

Commit

Permalink
jump to next gen, three modes
Browse files Browse the repository at this point in the history
  • Loading branch information
kali committed Nov 20, 2024
1 parent 16947e8 commit 8ff4eea
Showing 1 changed file with 10 additions and 13 deletions.
23 changes: 10 additions & 13 deletions .travis/test-llm.sh
Original file line number Diff line number Diff line change
Expand Up @@ -36,18 +36,15 @@ case $q in
esac

nnef=llm/$generation/$id/$id.nnef.tgz
pp=llm/$generation/$id/$id.pp.io.npz
tg=llm/$generation/$id/$id.tg.io.npz

set -x
$CACHE_FILE $nnef $pp $tg

$TRACT_RUN -v --nnef-tract-core $MODELS/$nnef -O run \
--input-from-npz $MODELS/$pp \
--assert-output-bundle $MODELS/$pp \
--approx $approx --allow-float-casts

$TRACT_RUN -v --nnef-tract-core $MODELS/$nnef -O run \
--input-from-npz $MODELS/$tg \
--assert-output-bundle $MODELS/$tg \
--approx $approx --allow-float-casts
$CACHE_FILE $nnef
for t in p0s100 p50s50 p99s1
do
npz=llm/$generation/$id/$id.$t.io.npz
$CACHE_FILE $npz
$TRACT_RUN -v --nnef-tract-core $MODELS/$nnef -O run \
--input-from-npz $MODELS/$npz \
--assert-output-bundle $MODELS/$npz \
--approx $approx --allow-float-casts
done

0 comments on commit 8ff4eea

Please sign in to comment.