PyPI · pypi:lm-eval

lm-eval active

A framework for evaluating language models

The latest stable version of lm-eval is 0.4.13, published on 2026-08-31. Verified by Vigia on 2026-11-13.

Latest stable version	0.4.13
Published	2026-08-31 20:42:37 UTC
Install	`pip install --upgrade lm-eval`
Requires	`python >=3.10`
License	MIT
Advisories on latest version	none known
Last verified	2026-11-13 05:32:33 UTC
Sources	pypi.org

Maintenance

Activity	active
Last stable release	2026-08-31 20:42:37 UTC · 73 days ago
Stable releases in the last 12 months	5
Published versions	20

Heuristic based only on release dates; it does not measure issue or security response times.

Version history

Version	Published
`0.4.13`	2026-08-31 20:42:37 UTC
`0.4.12`	2026-05-11 13:05:48 UTC
`0.4.11`	2026-02-13 20:22:56 UTC
`0.4.10`	2026-01-27 19:35:37 UTC
`0.4.9.2`	2025-11-26 23:28:08 UTC
`0.4.9.1`	2025-08-04 11:37:06 UTC
`0.4.9`	2025-06-19 13:59:58 UTC
`0.4.8`	2025-03-05 03:04:12 UTC
`0.4.7`	2024-12-17 10:26:27 UTC
`0.4.5`	2024-10-08 21:02:28 UTC
`0.4.4`	2024-09-05 15:05:24 UTC
`0.4.3`	2024-07-01 13:52:11 UTC
`0.4.2`	2024-03-18 13:08:24 UTC
`0.4.1`	2024-01-31 15:15:51 UTC
`0.4.0`	2023-12-22 18:36:42 UTC
`0.3.0`	2022-12-08 08:11:11 UTC
`0.2.0`	2022-03-07 02:02:44 UTC
`0.0.1`	2021-09-02 02:28:24 UTC

Showing the 18 most recent of 18 versions. JSON

Version compatibility

Newest stable version that declares support for each runtime version (from the requirements published with each version).

Runtime	Newest compatible version
`python 3.8`	`0.4.7`
`python 3.9`	`0.4.9.1`
`python 3.10`	`0.4.13`
`python 3.11`	`0.4.13`
`python 3.12`	`0.4.13`
`python 3.13`	`0.4.13`

Give your AI agent these facts

Vigia is a free MCP server: your coding agent checks versions, breaking changes and vulnerabilities before it writes code. No signup, no API key.

claude mcp add --transport http vigia https://vigia.coredls.cloud/mcp

Add to Cursor Add to VS Code ★ Star on GitHub

Any other MCP client

{ "mcpServers": { "vigia": { "url": "https://vigia.coredls.cloud/mcp" } } }

Agent skill (SKILL.md): tells the agent when to use Vigia · GitHub Action for pull requests

Frequently asked questions

What is the latest version of lm-eval?

The latest stable version of lm-eval is 0.4.13, published on 2026-08-31. Verified by Vigia on 2026-11-13.

How do I install the latest version of lm-eval?

Run pip install --upgrade lm-eval. The latest stable version is 0.4.13 (verified 2026-11-13).

Is lm-eval deprecated?

No. lm-eval is not marked as deprecated in the registry.

Which Python version does lm-eval require?

lm-eval 0.4.13 declares this requirement: python >=3.10.

Does lm-eval 0.4.13 have known vulnerabilities?

No known advisories affect lm-eval 0.4.13 according to the data Vigia checks.

Is lm-eval still maintained?

lm-eval published 5 stable releases in the last 12 months; the most recent was 73 days ago. Activity: active.

Observed changes

No changes observed yet since Vigia started tracking this package.

Related packages

Badges for your README

Show the latest version, maintenance status and deprecation status of this package. Copy the Markdown:

[![version](https://vigia.coredls.cloud/badge/pypi/lm-eval/version.svg)](https://vigia.coredls.cloud/pypi/lm-eval)
[![maintained](https://vigia.coredls.cloud/badge/pypi/lm-eval/maintained.svg)](https://vigia.coredls.cloud/pypi/lm-eval)
[![status](https://vigia.coredls.cloud/badge/pypi/lm-eval/status.svg)](https://vigia.coredls.cloud/pypi/lm-eval)

For agents

GET https://vigia.coredls.cloud/v1/packages/pypi/lm-eval
GET https://vigia.coredls.cloud/v1/packages/pypi/lm-eval/versions/{version}