Incorrect error message (says in_features, should be out_features)

[ejohb]

pytorch_block_sparse/pytorch_block_sparse/block_sparse_linear.py

Line 141 in 0985083

raise Exception(f"BlockSparseLinear invalid in_features={in_features}, should be multiple of {self.BLOCK_SIZE}")

[DanqingZ]

It looks like there is an requirement that the any dimension should be a multiply of the block size (32). Can we relax this requirement?

[ejohb]

It looks like there is an requirement that the any dimension should be a multiply of the block size (32). Can we relax this requirement?

Yeah, or auto-zero-pad the input to the closest multiple.

[khalidpandit]

@ejohb how to relax this requirement.