YOU ARE VIEWING ONE ITEM FROM THE AICRIER FEED

Promptfoo drops stale caches from MCP eval discovery

AICrier tracks AI developer news across Product Hunt, GitHub, Hacker News, YouTube, X, arXiv, and more. This page keeps the article you opened front and center while giving you a path into the live feed.

// WHAT AICRIER DOES

7+

TRACKED FEEDS

24/7

SCRAPED FEED

Short summaries, external links, screenshots, relevance scoring, tags, and featured picks for AI builders.

Promptfoo drops stale caches from MCP eval discovery
OPEN LINK ↗
// 1h agoPRODUCT UPDATE

Promptfoo drops stale caches from MCP eval discovery

Promptfoo removed caches for default-config discovery and MCP evaluation summaries. Its long-lived MCP server now reads evaluation rows on every request, surfacing newly created, updated, or deleted evaluations immediately.

// ANALYSIS

This is a quiet but meaningful correctness fix: live evaluation state matters more than shaving a few reads from an MCP tool used by persistent AI assistants.

  • –Eliminates stale evaluation lists in long-running Cursor, Claude Desktop, and other MCP sessions
  • –Fresh reads ensure newly created, renamed, or deleted evaluations appear immediately
  • –Removing default-config discovery caching reduces the risk of outdated project configuration
  • –The trade-off is additional storage reads and potentially slightly slower repeated listing requests
  • –The change reinforces Promptfoo’s role as an operational evaluation tool, not just a one-shot CLI
// TAGS
promptfoomcpevaluationtestingdevtoolopen-sourcetool-use

DISCOVERED

1h ago

2026-10-12

PUBLISHED

2h ago

2026-10-12

RELEVANCE

8/ 10

AUTHOR

repojournal