BenchmarkDotNet=v0.13.5, OS=macOS Ventura 13.3.1 (a) (22E772610a) [Darwin 22.4.0]
Apple M1 Pro, 1 CPU, 10 logical and 10 physical cores
.NET SDK=7.0.203
[Host] : .NET 7.0.5 (7.0.523.17405), Arm64 RyuJIT AdvSIMD
Job-ZISPEC : .NET 7.0.5 (7.0.523.17405), Arm64 RyuJIT AdvSIMD DEBUG
BuildConfiguration=Debug
| Method |
Data |
Mean |
Error |
StdDev |
Median |
Ratio |
RatioSD |
Gen0 |
Gen1 |
Allocated |
Alloc Ratio |
| SharpTokenV1_0_28 |
Hello, World! |
3.293 μs |
0.0422 μs |
0.0394 μs |
3.325 μs |
1.00 |
0.00 |
0.6752 |
0.0038 |
4.14 KB |
1.00 |
| TiktokenSharpV1_0_5 |
Hello, World! |
6.652 μs |
0.0300 μs |
0.0281 μs |
6.643 μs |
2.02 |
0.03 |
2.1820 |
0.0458 |
13.41 KB |
3.24 |
| Tiktoken |
Hello, World! |
6.360 μs |
0.0137 μs |
0.0129 μs |
6.364 μs |
1.93 |
0.02 |
2.1820 |
0.0458 |
13.41 KB |
3.24 |
|
|
|
|
|
|
|
|
|
|
|
|
| SharpTokenV1_0_28 |
King(...)edy. [275] |
62.972 μs |
0.3329 μs |
0.2951 μs |
62.912 μs |
1.00 |
0.00 |
8.5449 |
0.4883 |
52.89 KB |
1.00 |
| TiktokenSharpV1_0_5 |
King(...)edy. [275] |
21.692 μs |
0.0669 μs |
0.0593 μs |
21.698 μs |
0.34 |
0.00 |
5.0964 |
0.3052 |
31.34 KB |
0.59 |
| Tiktoken |
King(...)edy. [275] |
20.063 μs |
0.1374 μs |
0.1148 μs |
20.033 μs |
0.32 |
0.00 |
5.7678 |
0.3357 |
35.38 KB |
0.67 |