title: time to first token at a cap of 8
source: manuals/sglang-101/capture/gpu/out-gb10/bench-random-c8.txt
lines: 34-39
lang: text
note: The first-token block of the report for 64 requests at a cap of 8.
---
---------------Time to First Token----------------
Mean TTFT (ms):                          681.92    
Median TTFT (ms):                        677.61    
P90 TTFT (ms):                           1189.25   
P95 TTFT (ms):                           1194.16   
P99 TTFT (ms):                           1194.93   
