Classifier.dev launches semantic-ci-lint for PR reviews
semantic-ci-lint is an open-source skill and CI workflow from classifier.dev that checks changed git diff hunks against codebase conventions written in prose, such as error-handling guidelines and PII logging restrictions. Instead of passing whole source files into generative LLMs, the tool uses a lightweight Python script with git diff -U0 to evaluate added lines against single-convention prompts via classifier.dev's keyless zero-shot classification API.
Enforcing codebase prose conventions through zero-shot classification on diff hunks is significantly cheaper, faster, and more reliable than deploying chatty generative LLMs to review PRs.
- –Targeted diff inspection: Classifying isolated diff hunks alongside their file paths captures sufficient context for semantic analysis without dragging full files or unrelated context into the evaluation.
- –Calibrated confidence thresholds: Enforcing an advisory model where comments only trigger at 0.9+ confidence (yielding 82–92% empirical accuracy) shields engineering teams from hallucinated nitpicks and bot muting.
- –Natural complement to AST linters: While compilers and tools like ESLint or Ruff handle deterministic syntax checks, semantic classification cleanly bridges the gap for human-written style guides and architectural rules that defy regex.
- –Frictionless CI deployment: Leveraging classifier.dev's keyless free tier (up to 3,000 classifications per minute) allows teams to spin up semantic linting directly in GitHub Actions with zero API credential management.
DISCOVERED
1h ago
2026-09-19
PUBLISHED
1h ago
2026-09-19
RELEVANCE
AUTHOR
michael_chomsky