GPTCache, a powerful caching library that can be used to speed up and lower the cost of chat applications that rely on the LLM service. GPTCache works as a memcache for AIGC applications, similar to how Redis works for traditional applications. | |
https://github.com/zilliztech/GPTCache | |
gptcache-0.1.43 | https://opensource.org/license/mit/ |
download~amd64 ~x86 | pypi |