lighteval@0.3.0

A lightweight and configurable evaluation package

2024-03-29 Python >=3.10 wheel sdist

安装 (0.3.0)

pip install lighteval==0.3.0

poetry add lighteval==0.3.0

pipenv install lighteval==0.3.0

conda install lighteval=0.3.0

依赖 (65)

依赖
`transformers>=4.54.0`
`inspect-ai>=0.3.140`
`openai`
`accelerate`
`huggingface_hub[hf_xet]>=0.30.2`
`torch<3.0,>=2.0`
`GitPython>=3.1.41`
`datasets>=4.0.0`
`pydantic`
`numpy>=2`
`hf-xet>=1.1.8`
`typer>=0.20.0`
`termcolor==2.3.0`
`pytablewriter`
`rich`
`colorlog`
`aenum==3.1.15`
`nltk==3.9.1`
`scikit-learn`
`sacrebleu`
`rouge_score==0.1.2`
`sentencepiece>=0.1.99`
`protobuf`
`pycountry`
`fsspec>=2023.12.2`
`httpx>=0.27.2`
`latex2sympy2_extended==1.0.6`
`langcodes`
`litellm[caching]>=1.66.0; extra == "litellm"`
`diskcache; extra == "litellm"`
`text-generation>=0.7.0; extra == "tgi"`
`optimum==1.12.0; extra == "optimum"`
`bitsandbytes>=0.41.0; extra == "quantization"`
`auto-gptq>=0.4.2; extra == "quantization"`
`peft==0.3.0; extra == "adapters"`
`nanotron; extra == "nanotron"`
`tensorboardX; extra == "nanotron"`
`tensorboardX; extra == "tensorboardx"`
`vllm<0.10.2,>=0.10.0; extra == "vllm"`
`ray; extra == "vllm"`
`more_itertools; extra == "vllm"`
`sglang; extra == "sglang"`
`ruff>=v0.11.0; extra == "quality"`
`pre-commit; extra == "quality"`
`pytest>=7.4.0; extra == "tests"`
`deepdiff; extra == "tests"`
`pip>=25.2; extra == "tests"`
`lighteval[accelerate,extended_tasks,math,multilingual,quality,tests,vllm]; extra == "dev"`
`hf-doc-builder; extra == "docs"`
`watchdog; extra == "docs"`
`langdetect; extra == "extended-tasks"`
`openai>1.87; extra == "extended-tasks"`
`tiktoken; extra == "extended-tasks"`
`emoji; extra == "extended-tasks"`
`spacy; extra == "extended-tasks"`
`syllapy; extra == "extended-tasks"`
`evaluate; extra == "extended-tasks"`
`s3fs; extra == "s3"`
`stanza; extra == "multilingual"`
`spacy[ja,ko,th]>=3.8.0; extra == "multilingual"`
`jieba; extra == "multilingual"`
`pyvi; extra == "multilingual"`
`latex2sympy2_extended==1.0.6; extra == "math"`
`wandb; extra == "wandb"`
`trackio; extra == "trackio"`

下载文件

文件名	类型	Python 版本	大小
lighteval-0.3.0-py3-none-any.whl	bdist_wheel	`py3`	227379 bytes
lighteval-0.3.0.tar.gz	sdist	`source`	200003 bytes

版本列表

0.13.0 2025-11-24

0.12.2 2025-11-12

0.12.1 2025-11-06

0.12.0 2025-11-04

0.11.0 2025-09-22

0.10.0 2025-05-22

0.9.2 2025-05-07

0.9.1 2025-05-07

0.9.0 2025-05-06

0.8.1 2025-03-24

0.7.0 2025-01-03

0.6.2 2024-10-23

0.5.0 2024-09-24

0.4.0a0 2024-09-05

0.3.0 2024-03-29

0.3.0a0 2024-03-29

0.2.0 2024-03-01

0.1.1 2024-02-09

0.1.1.dev0 2024-02-09

0.1.0 2024-02-08

0.0.2 2024-02-08

0.0.1 2023-10-19