ModelRefs / Tool-Using Agent — AI Glossary

Tool-Using Agent — AI Glossary

An LLM agent capable of invoking external tools (APIs, code interpreters, search engines) to accomplish tasks beyond its parametric knowledge.

Overview

Tool-using agents extend LLM capabilities beyond text generation: calling REST APIs, running Python code, querying databases, reading files, and browsing the web. Enabled by function calling APIs (OpenAI tools, Anthropic tool_use, Gemini function declarations). The core primitive enabling AI agents to have real-world impact.

Reference details

Topicagents
Last reviewed2026-06-24

Example: The permission question, asked early

An agent with read-only tools that returns a wrong answer has produced a bad answer. An agent with send_email and issue_refund that reasons its way to a wrong action has produced a real-world consequence you cannot recall. The tool list, not the model, sets the blast radius — so it is the first thing to scope.

Commonly confused with

Tool use is a capability; a tool-using agent is a system that chooses when to invoke it. A pipeline can use tools without being an agent. The agent property is autonomous selection, and that is precisely what makes the permission model load-bearing.

When to use it

Reach for it when:

  • The task needs live data or real-world effect and the steps are not fixed
  • Every tool is scoped, authenticated and individually rate-limited
  • Irreversible actions have a human in the loop

Reach for something else when:

  • Tools carry side effects with no approval step
  • The tool list is long and unfiltered; selection accuracy drops as it grows
  • Tool output is untrusted text flowing straight back into the prompt

Continue your research

Use these connected ModelRefs sections to compare alternatives, inspect implementation paths, and review the evidence and governance boundaries relevant to Tool-Using Agent — AI Glossary.

Frequently asked questions

What is Tool-Using Agent?

An LLM agent capable of invoking external tools (APIs, code interpreters, search engines) to accomplish tasks beyond its parametric knowledge.

What concepts are related to Tool-Using Agent?

Closely related concepts include tool use, tool definition, tool result.