gpt-tokenizer@2.2.3
A pure JavaScript implementation of a BPE tokenizer (Encoder/Decoder) for GPT-2 / GPT-3 / GPT-4 and other OpenAI models
MIT
2024-09-16
安装 (2.2.3)
npm install gpt-tokenizer@2.2.3yarn add gpt-tokenizer@2.2.3pnpm add gpt-tokenizer@2.2.3bun add gpt-tokenizer@2.2.3dependencies (1)
| 包名 | 版本要求 |
|---|---|
| rfc4648 | ^1.5.3 |
devDependencies (3)
| 包名 | 版本要求 |
|---|---|
| @niieani/scaffold | ^1.7.32 |
| tsx | ^4.19.1 |
| typescript | ^5.6.2 |
版本列表
3.4.0
2025-11-07
3.3.0
2025-11-07
3.2.0
2025-10-09
3.1.0
2025-10-09
3.0.1
2025-06-13
3.0.0
2025-06-07
2.9.0
2025-03-05
2.8.1
2024-12-09
2.8.0
2024-12-09
2.7.0
2024-11-28
2.6.2
2024-11-13
2.6.1
2024-11-11
2.6.0
2024-11-04
2.5.1
2024-10-21
2.5.0
2024-10-09
2.4.1
2024-10-07
2.4.0
2024-09-23
2.3.0
2024-09-20
2.2.3
2024-09-16
2.2.2
2024-09-15
2.2.1
2024-07-18
2.2.0
2024-07-17
2.1.2
2023-10-07
2.1.1
2023-06-01
2.1.0
2023-06-01
2.0.0-beta.2
2023-05-24
2.0.0-beta.1
2023-05-23
2.0.0
2023-05-24
1.0.5
2023-05-16
1.0.4
2023-05-01
1.0.3
2023-04-18
1.0.2
2023-04-18
1.0.1
2023-04-16
1.0.0
2023-04-16