Guide
LLM evaluation: build an eval suite and gate deploys in CI
LLM evaluation, step by step: define failure modes, build a golden dataset, choose metrics, run an offline suite, compare to a baseline, and gate CI.
11 min readEvals and observability
Topic
Agents and frameworks
Loops that let a model call tools, keep state, and work toward a goal. Framework comparisons, orchestration patterns, and failure modes you will hit in production.
LangGraph, CrewAI, agent SDKs04 articles05 glossary terms07 platforms
Articles
Read on this topic
Deep dives and guides filed under this topic, newest first.
All articlesDeep dive
What is an AI agent? The loop in code, and where it fails
What is an AI agent? A tested agent loop in TypeScript, run offline against a scripted model, with traces of runaway loops, tool errors, and token growth.
9 min readAgents and frameworks
Guide
Context engineering: budget and order the context window
Context engineering is choosing what a model reads on each call. Size each section, order it for prompt caching, trim inputs, and test every layout change.
11 min readPrompting and context
Guide
What is an MCP server? Build and test one in TypeScript
What is an MCP server? Build a tested TypeScript one with a confirmed write tool, debug it with MCP Inspector, and apply the spec's security requirements.
12 min readMCP and agent protocols
Glossary
Terms you will meet
- A2AAgent2Agent protocol
- A2A (Agent2Agent) is an open protocol, introduced by Google in April 2025, that lets agents built by different vendors discover each other, exchange tasks, and stream results. MCP connects an agent to tools and data, while A2A connects agents to other agents.
- Agent
- An agent is a program that calls a model in a loop, runs the tools the model requests, and feeds the results back until a stop condition ends the loop. The tools and the stop condition set what the agent can do.
- Agent loop
- An agent loop is the code that sends the conversation to a model, runs any tool calls in the response, appends the results, and calls the model again. The loop ends when a response contains no tool calls or a limit is reached.
- Agentic AI
- Agentic AI is software in which a model's output selects the next step, usually a tool call, instead of a fixed script setting the order of steps. The term covers single coding agents as well as multi-agent systems.
- Tool callingFunction calling
- Tool calling is a model returning a structured request to run a function you defined, with arguments, instead of plain text. Your code runs the function and sends the result back, which is how an agent loop reaches systems outside the model.