HAIT continues development from facebookincubator/AITemplate.
Major changes include:
- New kernels
- New features such as workspace allocation modes
- Improved performance
- More modeling examples
- Companion repo hlky/diffusers_ait implements models from Diffusers
- Transformers soon:tm:
Install CUDA Toolkit
For Windows, install Build Tools for Visual Studio 2022 or Visual Studio 2022 (Community, Professional or Enterprise).
If Build Tools or Visual Studio is installed after CUDA Toolkit, re-run CUDA Toolkit installation to get Visual Studio integration. Build Tools only may need CUDA X.Y.props copying manually, refer to CUDA documentation for the default .props install directory and adjust for your Build Tools install directory.
git clone --recursive https://github.com/hlky/AITemplate
cd AITemplate/python
pip install -e .
python setup.py bdist_wheel
pip uninstall -y aitemplate
pip install dist/*.whl
Generally:
- More kernels
- More modeling support
With thanks to the original developers and other Meta engineers.
AITemplate is licensed under the Apache 2.0 License.