Hyperparameter Optimization

This page is for those wishing to optimize the hyperparameters of the different example scripts in dp.

Deep Inception

Hyper-parameter optimization using the deepinception.lua script.

base command :

th examples/deepinception.lua --batchSize 128 --accUpdate --progress --cuda

Command	Epoch	Train Accuracy	Valid Accuracy	Test Accuracy
--convChannelSize '{32}' --dropout --lecunlcn	64	0.8108	0.8649	0.8529
--convChannelSize '{32}' --lecunlcn	164	0.9999	0.8600	0.8473