Pytorch Highway network Highway network implemented in PyTorch. Usage highway = Highway(input_size, num_layers, f=torch.nn.functional.relu) # input is [batch_size, input_size] shaped tensor out = highway(input)