gentoo.mahdi.cz
dev-python
:auto-gptq
An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.
https://github.com/PanQiWei/AutoGPTQ
auto-gptq-0.7.1
download
~amd64 ~x86
pypi