PyPI · pypi:toktok-rs

toktok-rs active

Fast, exact BPE tokenizer for OpenAI encodings — Rust core, tiktoken-identical ids

The latest stable version of toktok-rs is 0.4.0, published on 2026-11-13. Verified by Vigia on 2026-11-13.

Latest stable version	0.4.0
Published	2026-11-13 12:18:00 UTC
Install	`pip install --upgrade toktok-rs`
Requires	`python >=3.11`
License	MIT
Advisories on latest version	none known
Last verified	2026-11-13 12:30:35 UTC
Sources	pypi.org

Maintenance

Activity	active
Last stable release	2026-11-13 12:18:00 UTC · 0 days ago
Stable releases in the last 12 months	7
Published versions	7

Heuristic based only on release dates; it does not measure issue or security response times.

Version history

Version	Published
`0.4.0`	2026-11-13 12:18:00 UTC
`0.3.0`	2026-10-21 09:07:36 UTC
`0.2.0`	2026-10-19 18:33:40 UTC
`0.1.4`	2026-09-02 21:51:59 UTC
`0.1.3`	2026-09-02 09:38:02 UTC
`0.1.2`	2026-09-02 07:06:55 UTC
`0.1.1`	2026-09-02 06:55:47 UTC

Showing the 7 most recent of 7 versions. JSON

Version compatibility

Newest stable version that declares support for each runtime version (from the requirements published with each version).

Runtime	Newest compatible version
`python 3.8`	none
`python 3.9`	none
`python 3.10`	none
`python 3.11`	`0.4.0`
`python 3.12`	`0.4.0`
`python 3.13`	`0.4.0`

Give your AI agent these facts

Vigia is a free MCP server: your coding agent checks versions, breaking changes and vulnerabilities before it writes code. No signup, no API key.

claude mcp add --transport http vigia https://vigia.coredls.cloud/mcp

Add to Cursor Add to VS Code ★ Star on GitHub

Any other MCP client

{ "mcpServers": { "vigia": { "url": "https://vigia.coredls.cloud/mcp" } } }

Agent skill (SKILL.md): tells the agent when to use Vigia · GitHub Action for pull requests

Frequently asked questions

What is the latest version of toktok-rs?

The latest stable version of toktok-rs is 0.4.0, published on 2026-11-13. Verified by Vigia on 2026-11-13.

How do I install the latest version of toktok-rs?

Run pip install --upgrade toktok-rs. The latest stable version is 0.4.0 (verified 2026-11-13).

Is toktok-rs deprecated?

No. toktok-rs is not marked as deprecated in the registry.

Which Python version does toktok-rs require?

toktok-rs 0.4.0 declares this requirement: python >=3.11.

Does toktok-rs 0.4.0 have known vulnerabilities?

No known advisories affect toktok-rs 0.4.0 according to the data Vigia checks.

Is toktok-rs still maintained?

toktok-rs published 7 stable releases in the last 12 months; the most recent was 0 days ago. Activity: active.

Observed changes

Fri Nov 13 2026 12:19:29 GM +0000 (Coordinated Universal Time) — released 0.3.0 → 0.4.0
Wed Oct 21 2026 09:08:57 GM +0000 (Coordinated Universal Time) — released 0.2.0 → 0.3.0
Mon Oct 19 2026 18:35:15 GM +0000 (Coordinated Universal Time) — released 0.1.4 → 0.2.0

Related packages

Badges for your README

Show the latest version, maintenance status and deprecation status of this package. Copy the Markdown:

[![version](https://vigia.coredls.cloud/badge/pypi/toktok-rs/version.svg)](https://vigia.coredls.cloud/pypi/toktok-rs)
[![maintained](https://vigia.coredls.cloud/badge/pypi/toktok-rs/maintained.svg)](https://vigia.coredls.cloud/pypi/toktok-rs)
[![status](https://vigia.coredls.cloud/badge/pypi/toktok-rs/status.svg)](https://vigia.coredls.cloud/pypi/toktok-rs)

For agents

GET https://vigia.coredls.cloud/v1/packages/pypi/toktok-rs
GET https://vigia.coredls.cloud/v1/packages/pypi/toktok-rs/versions/{version}