Showing all evaluation blueprints that have been tagged with...
Showing all evaluation blueprints that have been tagged with "tool-use--api-adherence".
Exercises core tool-use behaviors: correct selection, args, order, count bounds, OR-paths, and prohibitions. Trace-only; no execution.
Avg. Hybrid Score
Latest:
Unique Versions: 1
Encourages provider-native tool calling; if unavailable, falls back to trace-only TOOL_CALL lines. Scoring accepts either native success (final answer) or valid trace.
Avg. Hybrid Score
Latest:
Unique Versions: 1
Evaluates an LLM's ability to decide when to use tools versus relying on its internal knowledge. Tests for overconfidence (not searching when it should) and underconfidence (searching unnecessarily).
Avg. Hybrid Score
Latest:
Unique Versions: 1