#prompt-caching
1 note
-
Token Optimization for Tool-Using Agents
Token optimization in tool-using agents covers several distinct problems: reducing verbose inputs, limiting fixed prompt overhead, removing context that has outlived its…
1 note
Token optimization in tool-using agents covers several distinct problems: reducing verbose inputs, limiting fixed prompt overhead, removing context that has outlived its…