Middleware layer scopes tools per turn

// 45d agoTUTORIAL

Middleware layer scopes tools per turn

This post argues that a single AI agent can scale across 53 tools and five product contexts if it does not see every tool on every turn. The author describes two architectures that failed in real conversations, then shows the pattern that worked: a middleware layer that scopes the tool list to the user’s current intent, paired with a three-layer system prompt that keeps the agent focused and reliable.

// ANALYSIS

Hot take: the core lesson is not “build a smarter router,” it is “stop wasting the model’s attention on irrelevant tools.”

–The article is practical architecture advice, not a theory piece, and the failure modes are believable: long tool lists and multi-step conversations break selection quality fast.
–The middleware-scoping approach is the strongest idea here because it reduces cognitive load without fragmenting the conversation into brittle sub-agents.
–The three-layer prompt structure is likely the difference between a neat demo and something that holds up in production.
–The repo demo makes this feel like a reusable pattern rather than a one-off anecdote.

// TAGS

agenttool-routingmiddlewareprompt-engineeringattention-scopingllm-architectureagents

DISCOVERED

45d ago

2026-04-17

PUBLISHED

45d ago

2026-04-17

RELEVANCE

8/ 10

AUTHOR

SnooPears3341

// KEEP READING

More AI developer news from the feed

EXPLORE FULL FEED

NEWS1h ago

Pencil is an infinite design canvas that integrates directly into your code editor, empowering AI coding assistants with Figma-like UI design capabilities.

Pencil (pencil.dev) is a developer-centric, infinite design canvas designed to integrate seamlessly inside code editors like VS Code and Cursor. Rather than separating design from code, Pencil allows design files to live within the Git repository as version-controlled `.pen` files. It bridges the gap between visual layout and production-ready code by serving as an interface that AI coding agents (such as Claude Code or Cursor) can read, write, and drive. The user reports being highly impressed by Pencil's current state and notes that the tool continues to be available for free.

NEWS2h ago

Developers debate Claude Code and Codex flat-rate pricing

A viral post from DROID (@droidbuilds) sparked a developer debate comparing Anthropic's Claude Code and OpenAI's Codex under a hypothetical $50 monthly flat-rate plan. The discussion highlights the tradeoff between Claude Code's superior reasoning and Codex's deep ecosystem integration when subscription pricing is standardized.

OPEN SOURCE2h ago

Lavish Editor is an open-source, local-first interactive editor designed to streamline human-AI collaboration on HTML artifacts directly in the browser.

Lavish Editor (lavish-axi) is a free and open-source, local-first tool designed to enhance human-AI collaboration on interactive HTML artifacts. Recognizing that AI agents are proficient at generating rich visual and interactive HTML content, Lavish Editor provides a command-line interface (using `npx lavish-axi`) to open these files in a local web browser. Users can select text ranges or pinpoint specific visual elements to leave inline feedback, which can then be read and addressed by the AI agent. Operating entirely locally with zero cloud dependencies, it functions as an Agent Experience Interface (AXI), optimizing token efficiency and human-in-the-loop interactions for complex technical plans, visual designs, and interactive documentation.

Middleware layer scopes tools per turn