Skip to content

Commit

Permalink
add wn-nouns training to README
Browse files Browse the repository at this point in the history
  • Loading branch information
mnick committed Mar 21, 2018
1 parent cfb55cd commit e926469
Showing 1 changed file with 3 additions and 1 deletion.
4 changes: 3 additions & 1 deletion README.org
Original file line number Diff line number Diff line change
Expand Up @@ -14,10 +14,12 @@ This will generate the transitive closure of the full noun hierarchy as well as

To embed the mammals subtree in the reconstruction setting (i.e., without missing data), go to the /root directory/ of the project and run
#+BEGIN_SRC sh
NTHREADS=2 ./example.sh
NTHREADS=2 ./train-mammals.sh
#+END_SRC
This shell script includes the appropriate parameter settings for the mammals subtree and saves the trained model as =mammals.pth=.

An identical script to learn embeddings of the entire noun hierarchy is located at =train-nouns.sh=. This script contains the hyperparameter setting to reproduce the results for 10-dimensional embeddings of [[https://papers.nips.cc/paper/7213-poincare-embeddings-for-learning-hierarchical-representations][(Nickel & Kiela, 2017)]]. The hyperparameter setting to reproduce the MAP results are provided as comments in the script.

The embeddings are trained via multithreaded async SGD. In the example above, the number of threads is set to a conservative setting (=NHTREADS=2=) which should run well even on smaller machines. On machines with many cores, increase =NTHREADS= for faster convergence.

** Installation
Expand Down

0 comments on commit e926469

Please sign in to comment.