#streaming
2 notes
-
Provider Protocol Mapping
Provider APIs expose similar agent concepts through different wire shapes, so a coding harness needs provider-specific adapters that normalize messages, reasoning, tool calls…
-
Time to First Token
Time to first token is the user-visible latency between submitting an LLM turn and receiving the first generated output token or stream event.