Eta Given Delta: Defining LLM Tool Efficiency With Marginal Tool Utility
The paper introduces two new metrics to evaluate LLM tools: marginal tool utility and tool efficiency. Marginal utility measures if a specific tool call actually increases task accuracy, while efficiency calculates the ratio of useful calls to total calls. These metrics allow engineers to quantify how useful each tool is and help design leaner, more maintainable agent tool suites.