gpt-tokenizer@3.2.0
A pure JavaScript implementation of a BPE tokenizer (Encoder/Decoder) for GPT-2 / GPT-3 / GPT-4 and other OpenAI models
MIT
2025-10-09
安装 (3.2.0)
npm install gpt-tokenizer@3.2.0yarn add gpt-tokenizer@3.2.0pnpm add gpt-tokenizer@3.2.0bun add gpt-tokenizer@3.2.0devDependencies (8)
| 包名 | 版本要求 |
|---|---|
| @edge-runtime/vm | ^5.0.0 |
| @niieani/scaffold | ^1.7.54 |
| @swc/cli | ^0.7.8 |
| @swc/core | 1.13.5 |
| devalue | ^5.3.2 |
| node-resolve-ts | ^1.0.2 |
| typescript | ^5.9.3 |
| vitest | ^3.2.4 |
版本列表
3.4.0
2025-11-07
3.3.0
2025-11-07
3.2.0
2025-10-09
3.1.0
2025-10-09
3.0.1
2025-06-13
3.0.0
2025-06-07
2.9.0
2025-03-05
2.8.1
2024-12-09
2.8.0
2024-12-09
2.7.0
2024-11-28
2.6.2
2024-11-13
2.6.1
2024-11-11
2.6.0
2024-11-04
2.5.1
2024-10-21
2.5.0
2024-10-09
2.4.1
2024-10-07
2.4.0
2024-09-23
2.3.0
2024-09-20
2.2.3
2024-09-16
2.2.2
2024-09-15
2.2.1
2024-07-18
2.2.0
2024-07-17
2.1.2
2023-10-07
2.1.1
2023-06-01
2.1.0
2023-06-01
2.0.0-beta.2
2023-05-24
2.0.0-beta.1
2023-05-23
2.0.0
2023-05-24
1.0.5
2023-05-16
1.0.4
2023-05-01
1.0.3
2023-04-18
1.0.2
2023-04-18
1.0.1
2023-04-16
1.0.0
2023-04-16