PyPI · pypi:curated-tokenizers

curated-tokenizers active

Lightweight piece tokenization library

The latest stable version of curated-tokenizers is 2.0.1, published on 2026-08-24. Verified by Vigia on 2026-11-13.

Latest stable version	2.0.1
Published	2026-08-24 10:03:08 UTC
Install	`pip install --upgrade curated-tokenizers`
Requires	`python >=3.9`
License	MIT
Advisories on latest version	none known
Last verified	2026-11-13 17:35:40 UTC
Sources	pypi.org

Ask your AI assistant to check this

AI models are trained up to a date, so they can be wrong about versions, deprecations and vulnerabilities. Paste this into Claude, ChatGPT, Perplexity or Cursor and it will answer with the verified data on this page:

Before answering about the pypi package "curated-tokenizers", check Vigia (verified, dated facts): https://vigia.coredls.cloud/v1/packages/pypi/curated-tokenizers . For my whole project use https://vigia.coredls.cloud/context

Check my whole package.json

Using an AI coding agent every day? Connect Vigia once and it checks this by itself.

Maintenance

Activity	active
Last stable release	2026-08-24 10:03:17 UTC · 81 days ago
Stable releases in the last 12 months	2
Published versions	12

Heuristic based only on release dates; it does not measure issue or security response times.

Version history

Version	Published
`0.0.10`	2026-08-24 10:03:17 UTC
`2.0.1`	2026-08-24 10:03:08 UTC
`2.0.0`	2024-04-15 17:18:50 UTC
`0.9.2`	2024-02-07 10:29:03 UTC
`0.0.9`	2024-01-18 13:44:58 UTC
`0.9.1`	2023-09-14 11:57:47 UTC
`0.9.0`	2023-07-11 05:54:51 UTC
`0.0.8`	2023-07-06 15:51:24 UTC
`0.0.7`	2023-05-23 10:34:52 UTC
`0.0.6`	2023-05-23 08:18:52 UTC

Showing the 10 most recent of 10 versions. JSON

Version compatibility

Newest stable version that declares support for each runtime version (from the requirements published with each version).

Runtime	Newest compatible version
`python 3.8`	`0.9.2`
`python 3.9`	`2.0.1`
`python 3.10`	`2.0.1`
`python 3.11`	`2.0.1`
`python 3.12`	`2.0.1`
`python 3.13`	`2.0.1`

Give your AI agent these facts

Vigia is a free MCP server: your coding agent checks versions, breaking changes and vulnerabilities before it writes code. No signup, no API key.

claude mcp add --transport http vigia https://vigia.coredls.cloud/mcp

Add to Cursor Add to VS Code ★ Star on GitHub

Any other MCP client

{ "mcpServers": { "vigia": { "url": "https://vigia.coredls.cloud/mcp" } } }

Agent skill (SKILL.md): tells the agent when to use Vigia · GitHub Action for pull requests

Frequently asked questions

What is the latest version of curated-tokenizers?

The latest stable version of curated-tokenizers is 2.0.1, published on 2026-08-24. Verified by Vigia on 2026-11-13.

How do I install the latest version of curated-tokenizers?

Run pip install --upgrade curated-tokenizers. The latest stable version is 2.0.1 (verified 2026-11-13).

Is curated-tokenizers deprecated?

No. curated-tokenizers is not marked as deprecated in the registry.

Which Python version does curated-tokenizers require?

curated-tokenizers 2.0.1 declares this requirement: python >=3.9.

Does curated-tokenizers 2.0.1 have known vulnerabilities?

No known advisories affect curated-tokenizers 2.0.1 according to the data Vigia checks.

Is curated-tokenizers still maintained?

curated-tokenizers published 2 stable releases in the last 12 months; the most recent was 81 days ago. Activity: active.

Observed changes

No changes observed yet since Vigia started tracking this package.

Related packages

Badges for your README

Show the latest version, maintenance status and deprecation status of this package. Copy the Markdown:

[![version](https://vigia.coredls.cloud/badge/pypi/curated-tokenizers/version.svg)](https://vigia.coredls.cloud/pypi/curated-tokenizers)
[![maintained](https://vigia.coredls.cloud/badge/pypi/curated-tokenizers/maintained.svg)](https://vigia.coredls.cloud/pypi/curated-tokenizers)
[![status](https://vigia.coredls.cloud/badge/pypi/curated-tokenizers/status.svg)](https://vigia.coredls.cloud/pypi/curated-tokenizers)

For agents

GET https://vigia.coredls.cloud/v1/packages/pypi/curated-tokenizers
GET https://vigia.coredls.cloud/v1/packages/pypi/curated-tokenizers/versions/{version}