llmlingua@0.1.1.dev0

To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which achieves up to 20x compression with minimal performance loss.

2023-10-08 Python >=3.8.0 wheel sdist

安装 (0.1.1.dev0)

pip install llmlingua==0.1.1.dev0

poetry add llmlingua==0.1.1.dev0

pipenv install llmlingua==0.1.1.dev0

conda install llmlingua=0.1.1.dev0

依赖 (24)

依赖
`transformers>=4.26.0`
`accelerate`
`torch`
`tiktoken`
`nltk`
`numpy`
`transformers>=4.26.0; extra == "dev"`
`accelerate; extra == "dev"`
`torch; extra == "dev"`
`tiktoken; extra == "dev"`
`nltk; extra == "dev"`
`numpy; extra == "dev"`
`black==21.4b0; extra == "dev"`
`flake8>=3.8.3; extra == "dev"`
`isort>=5.5.4; extra == "dev"`
`pre-commit; extra == "dev"`
`pytest; extra == "dev"`
`pytest-xdist; extra == "dev"`
`black==21.4b0; extra == "quality"`
`flake8>=3.8.3; extra == "quality"`
`isort>=5.5.4; extra == "quality"`
`pre-commit; extra == "quality"`
`pytest; extra == "quality"`
`pytest-xdist; extra == "quality"`

下载文件

文件名	类型	Python 版本	大小
llmlingua-0.1.1.dev0-py3-none-any.whl	bdist_wheel	`py3`	12972 bytes
llmlingua-0.1.1.dev0.tar.gz	sdist	`source`	16091 bytes

版本列表

0.2.2 2024-04-09

0.2.1 2024-03-20

0.2.0 2024-03-13

0.1.6 2024-02-19

0.1.5 2023-12-21

0.1.3 2023-11-15

0.1.2 2023-10-09

0.1.1 2023-10-08

0.1.1.dev5 2023-10-09

0.1.1.dev4 2023-10-09

0.1.1.dev3 2023-10-09

0.1.1.dev2 2023-10-08

0.1.1.dev1 2023-10-08

0.1.1.dev0 2023-10-08