Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Avoid a contiguous call in the quantized phi 3 model. (#2209)
* Simplify the KvCache api. * Avoid a contiguous call in the quantized phi3 model.
- Loading branch information