#llm
1 note
-
Time to First Token
Time to first token is the user-visible latency between submitting an LLM turn and receiving the first generated output token or stream event.
1 note
Time to first token is the user-visible latency between submitting an LLM turn and receiving the first generated output token or stream event.