Measurements are the results of local benchmarking.

+ Add a measurement
Model
Hardware
Interface

Showing 2 / 2 measurements

Hover or click a point to show the details.
Ctxt.Gen.SpeedTTFTMem.
(tokens)(tokens)(tokens/s)(seconds)(GiB)
Tokens / second
2565121k2k28.028.028.028.028.0Context tokensTok/s
Time to first token (s)
2565121k2k2.903.003.103.20Context tokensTTFT (s)
Memory usage (GiB)
2565121k2k0.002.004.006.008.0010.0Context tokensMem (GiB)