#llm inference latency

Speculative Macro Commit: Accelerating Tool-Using LLM AgentsNEW⭐8

Speculative Macro Commit accelerates tool-using LLM agents by predicting multi-step actions, cutting latency by up to 44.9% while matching accuracy.