version 1.34.0

What's New

• PyTorch
  • Added support for WSL2
  • CUDA version upgraded for Pytorch 2.1
  • Extended QuantAnalyzer functionality for LLM range analysis
• Keras
  • Adds support for certain TFOpLambda layers created by tf functional calls.
• ONNX
  • Upgraded AIMET to support ONNX version 1.16.1 and ONNXRUNTIME version 1.18.1.

Documentation

• Release main page: https://github.com/quic/aimet/releases/tag/1.34.0
• Installation guide: https://quic.github.io/aimet-pages/releases/1.34.0/install/index.html
• User guide: https://quic.github.io/aimet-pages/releases/1.34.0/user_guide/index.html
• API documentation: https://quic.github.io/aimet-pages/releases/1.34.0/api_docs/index.html

Packages

• aimet_torch-1.34.0.cu121-cp310-cp310-manylinux_2_34_x86_64.whl
  • PyTorch 2.1 GPU package with Python 3.10 and CUDA 12.x
• aimet_torch-1.34.0.cu117-cp310-cp310-manylinux_2_34_x86_64.whl
  • PyTorch 1.13 GPU package with Python 3.10 and CUDA 11.x
• aimet_torch-1.34.0.cpu-cp310-cp310-manylinux_2_34_x86_64.whl
  • PyTorch 2.1 CPU package with Python 3.10 - If installing on a machine without CUDA
• aimet_onnx-1.34.0.cu117-cp310-cp310-manylinux_2_34_x86_64.whl
  • ONNX 1.16 GPU package with Python 3.10 - Recommended for use with ONNX models
• aimet_onnx-1.34.0.cpu-cp310-cp310-manylinux_2_34_x86_64.whl
  • ONNX 1.16 CPU package with Python 3.10 - If installing on a machine without CUDA
• aimet_tensorflow-1.34.0.cu118-cp310-cp310-manylinux_2_34_x86_64.whl
  • TensorFlow 2.10 GPU package with Python 3.10 - Recommended for use with TensorFlow models
• aimet_tensorflow-1.34.0.cpu-cp310-cp310-manylinux_2_34_x86_64.whl
  • TensorFlow 2.10 CPU package with Python 3.10 - If installing on a machine without CUDA