Tiktoken.Encodings.Tokenizer 3.1.6-alpha.0.23
Load tokenizer.json (HuggingFace format) as a Tiktoken encoding.
Showing the top 20 packages that depend on Tiktoken.Encodings.Tokenizer.
| Packages | Downloads |
|---|---|
|
Tiktoken
The fastest tokenizer for GPT-3.5 and GPT-4 inspired by Tiktoken.
|
13 |
|
Tiktoken
The fastest tokenizer for GPT-3.5 and GPT-4 inspired by Tiktoken.
|
12 |
|
Tiktoken
The fastest tokenizer for GPT-3.5 and GPT-4 inspired by Tiktoken.
|
11 |
|
Tiktoken
The fastest tokenizer for GPT-3.5 and GPT-4 inspired by Tiktoken.
|
9 |
|
Tiktoken
The fastest tokenizer for GPT-3.5 and GPT-4 inspired by Tiktoken.
|
1 |
.NET 10.0
- Tiktoken.Encodings.Abstractions (>= 3.1.6-alpha.0.23)
.NET Framework 4.6.2
- Tiktoken.Encodings.Abstractions (>= 3.1.6-alpha.0.23)
- System.Text.Json (>= 10.0.11)
- System.ValueTuple (>= 4.6.2)
.NET 8.0
- Tiktoken.Encodings.Abstractions (>= 3.1.6-alpha.0.23)
- System.Text.Json (>= 10.0.11)
.NET 9.0
- Tiktoken.Encodings.Abstractions (>= 3.1.6-alpha.0.23)
- System.Text.Json (>= 10.0.11)
.NET Standard 2.0
- Tiktoken.Encodings.Abstractions (>= 3.1.6-alpha.0.23)
- System.Text.Json (>= 10.0.11)
.NET Standard 2.1
- Tiktoken.Encodings.Abstractions (>= 3.1.6-alpha.0.23)
- System.Text.Json (>= 10.0.11)
| Version | Downloads | Last updated |
|---|---|---|
| 3.1.6-alpha.0.27 | 0 | 09/25/2026 |
| 3.1.6-alpha.0.26 | 0 | 09/22/2026 |
| 3.1.6-alpha.0.23 | 0 | 09/22/2026 |
| 3.1.6-alpha.0.22 | 0 | 09/11/2026 |
| 3.1.6-alpha.0.21 | 0 | 09/10/2026 |
| 3.1.6-alpha.0.20 | 1 | 09/07/2026 |
| 3.1.5 | 12 | 05/03/2026 |
| 3.1.5-alpha.0.6 | 11 | 04/27/2026 |
| 3.1.4 | 10 | 03/26/2026 |
| 3.1.3 | 11 | 03/26/2026 |
| 3.1.2 | 10 | 03/26/2026 |
| 3.1.2-alpha.0.1 | 11 | 03/26/2026 |
| 3.1.1 | 11 | 03/26/2026 |
| 3.1.1-alpha.0.1 | 10 | 03/26/2026 |
| 3.1.0 | 10 | 03/26/2026 |
| 3.1.0-rc.1.4 | 11 | 03/26/2026 |
| 3.1.0-rc.1.3 | 10 | 03/26/2026 |
| 3.1.0-rc.1.2 | 10 | 03/26/2026 |
| 3.1.0-rc.1.1 | 10 | 03/26/2026 |
| 3.1.0-rc.1 | 11 | 03/26/2026 |
| 3.0.1-alpha.0.4 | 11 | 03/26/2026 |
| 3.0.0 | 10 | 03/26/2026 |
| 2.2.0 | 10 | 03/26/2026 |