gentoo.mahdi.cz
sci-libs
:auto-gptq
An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.
https://pypi.org/project/auto-gptq/
auto-gptq-0.2.2
MIT
download
~amd64
Miezhiko