AI developer news, tools, and content
OBLITERATUS: An AI Agent Removed Gemma 4's Safety Guardrails
manual · 1h ago
Pick the Wrong Gemma 4 and You'll Think It's Broken | FOUR Models Compared!
DIY Smart Code · 1h ago
Agent Swarms Is One of The Most Powerful AI System Yet
AI Revolution · 2h ago
Berkeley Just Exposed the AI Benchmark Lie #ai #benchmark #aimodel
Better Stack · 4h ago
HTML In Canvas Is Wild And I Love It
Better Stack · 5h ago
AI infrastructure that takes 60 seconds, not months
DIY Smart Code · 6h ago
Meta’s New AI Can Now Predict Your Brain’s Activity 🧠 #technews #innovation #engineering
Better Stack · 9h ago
Massive Failure of CoT: The "AI Rationalization Trap"
Discover AI · 10h ago
Death of the whiteboard problem
The PrimeTime · 10h ago
What Mythos Means for Software Security | TheStandup
The PrimeTime · 10h ago
Claude Design Is Here — Figma Stock Crashed
Prompt Engineering · 10h ago
The /usage command that fixes Claude Code productivity - More Details Now!
DIY Smart Code · 10h ago
Codex 2.0 + NEW CRAZY Free Tier: OpenAI has COOKED with NEW & FREE Codex!
AICodeKing · 12h ago
35 Claude Code skills on GitHub
Github Awesome · 12h ago
Gemma 4 OBLITERATED v3 achieves zero refusals
A community-modified Gemma 4 4B model that uses automated surgical weight removal to eliminate safety refusals. Developed by an AI agent, it maintains full coherence while significantly outperforming the base model in unconstrained task compliance.
Hermes Agent autonomously fixes OBLITERATUS, uncensors Gemma 4
Nous Research's autonomous agent demonstrated senior-level engineering reasoning by diagnosing and patching numerical instability in the OBLITERATUS library to successfully remove safety guardrails from Google's Gemma 4. The event marks a significant milestone in autonomous "model surgery," where agents can self-correct their own toolsets to bypass architectural constraints.
Chatlectify turns chat history into personal LLM styles
Chatlectify is a local CLI tool that distills your unique writing voice from chat history exports into portable system prompts or Claude-compatible skills. It uses stylometric analysis to quantify your specific vocabulary and rhythm, helping LLMs escape generic corporate-cheerful defaults.
Local RAG Jarvis hits Wikipedia ingest wall
A developer building a personal Jarvis-style RAG chatbot on an AMD RX 7900 XT is facing a 3-year timeline for a full English Wikipedia ingest. The project focuses on verifiable, sourceable information to combat misinformation, but is bottlenecked by a high-overhead extraction pipeline that builds complex metadata layers—including claims, entities, and provenance—far beyond simple vector embeddings.
StreamForge streams 40GB models on 3GB VRAM
StreamForge is an open-source inference engine that uses asynchronous prefetching and sequential block execution to run massive transformer models on consumer GPUs. It enables 14B+ models to run in full bfloat16 precision on as little as 3GB of VRAM by keeping only one block in memory at a time.
Qwen3.6 Brings Local Agentic Coding
A Reddit user is testing local LLMs as a fallback when Claude limits bite, with Qwen3.6-35B-A3B and Gemma 4 as the main examples. They report roughly 50 tok/s on a 48GB MacBook Pro and want practical advice on quantization and fine-tuning tooling.
Jamie Simon calls for physics-style science of deep learning
Jamie Simon, a researcher at Imbue and UC Berkeley, outlines a vision for transforming deep learning from a trial-and-error engineering field into a true natural science. He advocates for "dots-on-curves" theory—mathematical models that make quantitative predictions about training dynamics—and suggests that the field should prioritize physics-inspired intuition over hyper-rigorous but uninformative mathematical proofs.
Canada grants $240M to Cohere for sovereign compute
The Canadian government has awarded a $240 million grant to AI startup Cohere as part of its $2.4 billion Sovereign AI Compute Strategy. This investment aims to build a domestic AI data center to reduce reliance on foreign tech giants, though critics argue this concentration of capital neglects the broader startup ecosystem.
Llama.cpp samplers fail on Gemma 4 architecture
Users report that llama.cpp samplers are essentially ignored by the new Gemma 4 models, leading to repetitive, deterministic outputs even at extreme temperatures. The regression is linked to missing logit soft-capping support and recent architectural changes in backend sampling.
Qwen3.6 sparks debate over 480B coder
This Reddit thread questions the hype around Qwen3.6, especially claims that the smaller local model can match or even beat the older Qwen3-Coder 480B on real coding workflows. The discussion centers on agentic coding in tools like Cline and Kilo Code, where speed, loop stability, repo-scale reasoning, and multi-file fixes matter more than raw benchmark numbers. The post reflects a familiar tension in local-LLM circles: a model can look impressive in short demos and still fall apart when asked to sustain long, tool-heavy repair loops across an entire codebase.
MoDA paper adds depth-aware attention
MoDA is a new attention mechanism that lets each head read both the current layer’s sequence KV pairs and depth KV pairs from earlier layers. The paper pairs that architecture with a hardware-aware implementation that stays close to FlashAttention-2 efficiency while improving perplexity and downstream task scores on 1.5B-parameter models.
Chrome brings DOM to WebGL with HTML-in-Canvas
Chrome Canary's experimental HTML-in-Canvas proposal allows developers to natively embed interactive DOM nodes directly into 2D and WebGL canvases. This bridges the gap between standard document structure and canvas graphics, eliminating the need for complex UI workarounds in web applications.
Unsloth updates Mistral Small 4 quants
Unsloth updated its Mistral Small 4 GGUF repo with refreshed quants and chat-template fixes. The model card says the release targets local inference workflows, including llama.cpp and vLLM, for Mistral Small 4’s 119B MoE model.
Mac Studio slips to October
Bloomberg says Apple has pushed the next Mac Studio to at least October, delaying what had looked like a midyear refresh. The current lineup is already showing long shipping times and stock shortages, which makes the slip more than just a rumor-cycle nuisance.
Scalar-loop hardens autoresearch against verifier gaming
Scalar-loop turns Karpathy-style autonomous iteration into a Python harness where integrity checks, scope limits, and run preconditions are enforced in code, not in the agent prompt. The project argues that if a model can game the verifier, the verifier boundary itself has to be mechanical, auditable, and hard to narrate around.
Qwen3.5-35B-A3B courts Opus switchers
A LocalLLaMA user asks whether Qwen3.5-35B-A3B can replace Opus 4.7 as a daily coding-agent driver on an M5 Max with 128GB RAM. The real question is whether a fast, open-weight 35B MoE model is “good enough” for most coding work, or whether Opus still matters for harder reasoning.
Qwen3.6-35B-A3B gets long-context tuning tips
Reddit users are benchmarking Qwen3.6-35B-A3B locally with llama.cpp, including vision support, 90K context, and aggressive GPU offload on an 8GB VRAM card plus 24GB RAM. The discussion centers on whether the slowdown comes from the model size, the long context window, or suboptimal inference flags.
Google open-sources production AI agent scaffold
Google Cloud released Agent Starter Pack, an open-source generator that provisions a complete production stack for AI agents. It eliminates boilerplate by bundling FastAPI, Cloud Run deployment, Terraform pipelines, and Vertex AI evaluation.
Google Cloud upgrades A2A protocol for ADK
Google Cloud has released a major upgrade to the Agent-to-Agent (A2A) protocol for its Agent Development Kit (ADK), enhancing cross-framework communication capabilities. The update targets complex multi-agent orchestration, reducing the friction in building interoperable agentic systems from months to seconds.
M1 Max 64GB finds LLM sweet spot
This Reddit thread asks what local model feels “good enough” on a MacBook Pro M1 Max with 64GB unified memory for project management and conversational coaching. Early replies point to mid-sized open models like Gemma 4 26B A3B, Gemma 4 31B, and Qwen3.6 35B A3B as the practical range.
Qwen3.6-35B-A3B runs on 16GB Mac mini
A Reddit user reports loading and chatting with Qwen3.6-35B-A3B on a Mac mini M4 with 16GB RAM using an Unsloth GGUF quant and llama-server, claiming a bit over 6 tokens per second. It’s a useful proof point for how far sparse MoE models can be pushed on consumer hardware.
Qwen3.6 Fits RTX 6000 Pro, 96GB
The Reddit thread asks whether an RTX 6000 Pro can comfortably serve Qwen3.6, and the consensus is yes: 96GB VRAM is plenty for the first open-weight Qwen3.6 model. The real constraint is less raw fit and more whether you want room for long context, KV cache, and concurrency.
Qwen3.6-35B-A3B turns gibberish on RAM spill
A Reddit user says Qwen3.6-35B-A3B starts producing gibberish once llama.cpp begins offloading memory from VRAM to system RAM under CUDA Unified Memory. The post questions whether the issue is the build, the runtime flags, or a deeper unified-memory bug.
RYS maps concepts beyond language
This revised LLM Neuroanatomy post argues that transformer middle layers organize meaning as geometry rather than language, based on experiments across eight languages and multiple model families. The companion RYS repo provides the reproducibility code, datasets, and relayering workflows behind the analysis.
Princeton GEO Paper Maps LLM Citation Signals
The post highlights Princeton's GEO research and argues that AI answer engines favor pages that are direct, structured, crawlable, and fresh. It treats schema markup and extractable facts as practical levers for getting cited by systems like ChatGPT and Perplexity.
Qwen3.6-35B-A3B powers local NetOps agents
A Reddit user says Qwen3.6-35B-A3B, run locally through llama.cpp and OpenCode, has been reliably SSHing into a Cisco switch and making changes. It reads like a practical field report on agentic tool use, not just another benchmark brag.
Shadows proves memory isn't enough
Omar Megawer’s Shadows is a multi-agent system with shared project memory and per-agent memory, but the update argues that better retrieval alone still leaves agents making the wrong call. The real gap is aggregation across sessions, abstention, and understanding which preference dimension matters now.
BrowserOS-Style Tests Lose Their Bite
A Reddit thread argues that single-file coding tests, including BrowserOS-style setups, are now too easy for current frontier models to be useful separators. The discussion shifts to what actually stresses agentic coding systems: multi-file repos, long-horizon tasks, and messy tool use.
RTX 5070 Ti, 3090 Split Local LLM Buyers
The post weighs a new RTX 5070 Ti 16GB against a used RTX 3090 24GB for a dual-GPU local LLM rig paired with an RTX 4070. The real question is whether 28GB of newer VRAM and Blackwell features can match the headroom of 36GB total on longer contexts and larger MoE models.
LM Studio Linux Users Hit GPU Wall
A Reddit user on Linux Mint says LM Studio loads a local Google model almost entirely on CPU even after installing CUDA and verifying `nvidia-smi`, suggesting the problem is in LM Studio’s runtime or model-offload setup rather than basic driver health. The post is really a troubleshooting case for getting Linux GPU acceleration working in a desktop local-LLM app.
Tech industry layoffs hit 80,000, AI blamed
Tom’s Hardware cites Nikkei Asia data showing 78,557 tech layoffs from January 1 to April 2026, with 37,638 cuts, or 47.9%, attributed to AI and workflow automation. The report also stresses that some executives may be using AI as a convenient explanation for layoffs driven by overhiring, restructuring, or weaker business performance.
RTX 5090, RTX PRO 6000 local LLM debate
A Reddit LocalLLaMA thread weighs six GeForce RTX 5090s against two RTX PRO 6000 Blackwell cards for a local LLM build on an old dual-EPYC system. Commenters lean toward the workstation GPUs for simplicity, lower power draw, and easier setup, even though six 5090s would offer more raw compute.
Vercel reports internal systems breach
Vercel says it identified a security incident involving unauthorized access to certain internal Vercel systems and has brought in incident response experts, notified law enforcement, and begun direct outreach to a limited subset of impacted customers. The company says its services remain operational and recommends customers review environment variables and use its sensitive environment variable feature while the investigation continues.
Paper Digest indexes 1,200 ICLR papers
Paper Digest published an automated index of accepted ICLR 2026 papers that expose public code, data, or demo links, covering roughly 1,200 entries. It’s a useful discovery layer for researchers and builders who want reproducible work, not just abstracts.
Q3 quants emerge as coding floor
This Reddit thread asks where the practical floor sits for local coding models as you trade quant size against quality, context, and VRAM. The author compares Qwen3.5 27B Q6 and MiniMax M2.7 Q3_XXS to ask whether Q2 or even Q1 can still be usable for real coding work.
llama.cpp mixed-GPU setups spark tuning debate
This Reddit post asks how to get the best coding performance out of llama.cpp across a 3080, an RX 9070 XT, and an iGPU, with a particular focus on quantization quality, VRAM limits, and multi-GPU stability. The core question is whether to keep a hybrid Vulkan setup, move the 3080 into the main PC, or rely on a single stronger discrete GPU.
Gemma 4 26B-A4B hits 196 tok/s on 5090
This guide walks through running Gemma 4 26B-A4B on a single RTX 5090 with vLLM on RunPod Serverless. The working setup uses AWQ 4-bit weights, FP8 KV cache, and tool-calling flags to reach about 196 tok/s decode with 96k context.
OpenCode makes local coding agents usable
This Reddit discussion centers on whether local models are actually good enough for day-to-day coding, with the poster saying they tried a coding harness and found it impressive but still much slower and weaker than Claude Code or Codex. The thread’s practical consensus is that local models can be useful for narrower, well-defined tasks, privacy-sensitive work, and token-saving workflows, but most people still reach for frontier models when correctness, speed, and iteration quality matter.
oMLX trails LM Studio on tokens/s
A Reddit user reports the same mlx-community Qwen3.6-35B 4-bit model running at about 49 tok/s in LM Studio versus 38 tok/s in oMLX on an M3 Pro. The post asks whether the gap comes from runtime optimization, cache behavior, or hidden config differences.
Little-coder more than doubles Qwen3.5-9B score
This post reports a benchmark comparison using the same Qwen3.5-9B Q4 weights under two different coding-agent scaffolds. On the 225-task Aider Polyglot benchmark, vanilla Aider scored 19.11% while little-coder reached 45.56% mean pass@2 across two full runs. The author argues that, at this scale, scaffold-model fit materially changes observed coding-agent performance, and that small local models may be underestimated by agent setups optimized for larger models.
LM Studio users seek dual-GPU benchmarks
A LocalLLaMA user asks for a reliable way to compare tokens per second on single-GPU offload versus split-across-two-GPU setups for larger models. The post captures a common local-LLM problem: bigger models are easy to want, but hard to keep fast enough for coding work.
Qwen 3.6 35B nails BrowserOS demo
Qwen 3.6 35B generated a surprisingly complete browser-based OS in one shot, built in HTML, CSS, and JavaScript. The demo includes eight apps, three functional games, wallpaper switching, a terminal, and a neon mode plus Matrix-style terminal effects.
GPT-OSS-20B beats Qwen3.6 in coding
A Reddit user compares GPT-OSS-20B and Qwen3.6-35B-A3B on TypeScript and Rust prompts and says Claude Sonnet 4.6 rated the OpenAI model higher. The thread asks whether that reflects real quality, prompt sensitivity, or judge bias.
Production AI Stays Correct as Context Drifts
A Reddit discussion describes a production AI failure mode where systems stay healthy on paper while the world around them changes. The post calls this the “Formalisation Trap” and argues that tighter controls can harden stale assumptions instead of correcting them.
Maxon Frees Autograph, Escalates Adobe Fight
Maxon has relaunched Autograph, its motion design and VFX app, with free access for individual users. It’s a direct shot at Adobe After Effects at a moment when creative software rivals are leaning hard on lower prices and free tiers.
ConflictQA exposes LLM knowledge conflict failures
A new research paper introduces ConflictQA, a benchmark evaluating how LLMs handle conflicting evidence from unstructured text and knowledge graphs. The study reveals models often fail at cross-source reasoning, prompting the authors to propose XoT, a two-stage thinking framework for heterogeneous RAG systems.
RTX PRO 5000, M5 Max split AI workloads
A Reddit user asks the LocalLLaMA community which machine is the better long-term buy for a professional AI-dev workflow centered on Hugging Face models, Unsloth fine-tuning, and local inference with llama.cpp or vLLM. The post frames the trade-off as NVIDIA’s CUDA ecosystem and 48GB of dedicated VRAM versus Apple’s 128GB of unified memory and mobile workstation ergonomics, with a particular focus on small-to-mid-size models, quantized workloads, and agentic coding.
Qwen3.6 quants hit Q4 sweet spot
A Reddit user reports that Unsloth’s Q4_K_XL quant of Qwen3.6-35B-A3B outperforms Q5_K_S on web research, document research, transcripts, and coding/debugging. The claim is that lower-bit quantization is yielding better practical reasoning on this workload, especially for web search.
Gemma 4 edges Qwen models on debug fix
A Reddit benchmark compares Gemma 4, Qwen 3.6, and Qwen 3 Coder Next on a messy browser-compatibility debugging task for a Flash-heavy legacy site. Qwen 3.6 was the fastest and most verbose, but Gemma 4 looked stronger on the actual fix quality and follow-up debugging.
r/LeftistsForAI frames AI as labor issue
r/LeftistsForAI is a Reddit community for leftists and progressives who want to discuss AI through labor, ownership, political economy, and class power rather than hype or moral panic. The subreddit focuses on who controls the infrastructure and profits, and on how AI’s gains could be redirected toward workers and the public.
Claude Code /usage breaks down token burn
Anthropic's Claude Code CLI adds a /usage command to give developers granular visibility into their token consumption. The update helps teams pinpoint whether their API costs are driven by sub-agent loops or bloated context windows.
Reddit mocks Google AI Overviews glitch
A Reddit thread highlights a screenshot of Google Search’s AI Overviews behaving bizarrely on a simple query, turning a routine search into another example of generative summaries going off the rails. The post treats it as a reliability problem for AI answers in search.
FinceptTerminal brings Bloomberg-style research to open source
FinceptTerminal is an open-source finance platform aimed at interactive market exploration, investment research, and economic analysis. The project combines advanced analytics, portfolio tools, AI agents, and broad data connectivity across market, macro, and alternative data sources, with a desktop-first experience and a strong emphasis on extensibility. Its repo and Product Hunt presence suggest it is being positioned as a serious Bloomberg alternative rather than a lightweight script or dashboard.
email-campaigns-claude automates marketing emails in Claude
email-campaigns-claude is a Claude Code skill for drafting campaign copy, generating HTML email layouts, and sending bulk mail through Resend. It packages the usual email-marketing pain points, asset hosting, GIF optimization, reusable blocks, into a lightweight workflow for builders already using Claude Code.
Paperless-ngx adds OCR, auto-tagging, workflows
Paperless-ngx is a community-run, self-hosted document management system that ingests scans and files, runs OCR, and turns them into a searchable archive. The project pairs document indexing with auto-tagging, workflows, share links, and a clean migration path from Paperless-ng.
Karpathy's LLM Wiki turns local-first
This tutorial shows a practical, local-first implementation of Andrej Karpathy’s LLM Wiki idea: drop Markdown notes into a pipeline, use Ollama for on-device inference, LangChain for orchestration, and Obsidian as the living knowledge base. The result is a private wiki that extracts concepts, creates links between notes, and keeps growing as new material is added, making it useful for personal knowledge management, research, and long-running AI-assisted workflows.
Honor's Lightning wins Beijing humanoid half-marathon
Beijing’s second humanoid robot half-marathon turned into a high-visibility robotics demo, with Honor’s robot crossing the finish line in 50:26 and, under the event’s weighted scoring rules, taking the win. The race also showed how far the field still has to go: some robots were remotely controlled, some ran autonomously, and others suffered falls, barrier collisions, or needed human help near the end.
Qwen2.5 1.5B disappoints, 7B crawls
The poster’s Debian server has an i5-8600K, GTX 1050 Ti 4GB, and 32GB RAM, and they say Qwen2.5-1.5B is too weak while 7B is too slow. It’s the classic local-LLM tradeoff: small models are usable but shallow, while better models quickly outrun low-VRAM hardware.
Honor Lightning wins half-marathon in 50:26
Honor’s humanoid robot Lightning won the 2026 Beijing humanoid robot half-marathon with a net time of 50 minutes and 26 seconds. The result marks a sharp jump from last year’s robot marathon pace and shows how fast embodied robotics is moving from demo to endurance test.
llama.cpp MCP integration sparks context injection questions
A developer running a local llama-server with a custom C++ Model Context Protocol (MCP) server is seeking ways to dynamically inject system messages and context from the outside. They are attempting to add custom skills and text styling programmatically, bypassing the static system message panel of their web GUI.
WebLLM Pushes LLMs Into Browser
WebLLM is a browser-native inference runtime, not a model, but it already lets web apps run open-source LLMs locally on-device via WebGPU. The project ships a live WebLLM Chat demo and an SDK that can fall back to cloud when local hardware is too weak.
Beijing humanoid robot half-marathon exposes endurance limits
The clip shows pit-stop maintenance during Beijing’s humanoid robot half-marathon, where teams cool overheated batteries with ice and service joints with lubricant to keep the robots moving. The race has become a visible benchmark for humanoid robotics progress, but the video makes the real constraint obvious: long-duration locomotion still depends on human intervention, thermal management, and frequent mechanical tuning.
ProgramAsWeights compiles specs into local neural programs
ProgramAsWeights compiles plain-English function specs into small deployable neural programs built from a LoRA adapter plus a discrete pseudo-program. The system targets fuzzy text tasks such as classification, extraction, and log triage, with a browser-friendly GPT-2 path for fully local inference.
Entropy, OLS, SVD tame KV cache spikes
HAE is a prototype KV-cache compression scheme that selects tokens by attention entropy, reconstructs discarded content with OLS, and compresses the result with SVD. The author says it cuts reconstruction error by about 3x at low memory and avoids the selective error spikes seen with Top-K pruning.
Unitree H1 falls, recovers in Beijing half-marathon
At the Beijing humanoid half-marathon, a Unitree H1 falls to the ground before recovering and continuing the race, while another H1 moves past in the background. The clip feels less like a polished promo and more like a live test of balance, recovery, and durability under real conditions.
OMNIA Cuts False Accepts, Adds Reviews
OMNIA is a post-hoc structural review layer for LLM outputs that aims to flag suspicious-clean text without changing inference or making the final decision. On a 15-example support-style set, it reportedly reduced false accepts from 8 to 1 under a layered policy, at the cost of 7 extra reviews.
TurboQuant, RotorQuant stay fork-only
TurboQuant is real and moving fast, but the usable path today is still a forked llama.cpp build, not stock upstream. The Qwen3.6-35B-A3B-TQ3_4S model card says it needs a public TurboQuant runtime fork and shows flags for fitting the 35B MoE model on a 16GB card.
OpenClaw seeks RTX 3090 backbone
A LocalLLaMA user asks which local Ollama model should back OpenClaw on an RTX 3090 VM. OpenClaw’s docs say to favor the strongest latest-generation model you can afford, then use fallbacks for cheaper or faster tasks, while thread replies lean toward stable tool-use models like Gemma 4 26B A4B and Qwen3 Coder 23B.
llama.cpp users weigh 24GB Radeon split
A LocalLLaMA thread asks whether an AMD OCuLink dGPU is worth stepping up from 16GB to 24GB for llama.cpp Vulkan inference, especially for Qwen 32B daily use and eventual 70B experiments. The other open question is whether an all-AMD Vulkan setup with a 780M iGPU plus dGPU behaves cleanly under tensor split.
Qwen2.5 Coder 7B Instruct hits XQuery-to-SQL limits
A local XQuery-to-SQL pipeline built on regex parsing and prompt templates is breaking down on syntax variation and long inputs. With only about 120 examples, the real choice is less “fine-tune or not” and more “how much structure, validation, and synthetic data can you add around the model.”
Claude Code workflow ties commands, agents, skills together
Claude Code Best Practice is an open-source learning repo that demonstrates practical Claude Code patterns, with the highlighted example being a beginner-friendly `/weather-orchestrator` workflow. The workflow walks through a full Command → Agent → Skill chain: a command prompts for Celsius or Fahrenheit, a weather agent fetches live temperature data from Open-Meteo, and a separate SVG-generating skill turns the result into a weather card and writes an output file. The repo is positioned as a reference implementation for people learning how to structure Claude Code projects, and it explicitly compares preloaded agent skills with directly invoked skills so readers can see when each pattern is useful.
Dual 12GB GPUs Face LM Studio Tradeoff
The Reddit post asks whether pairing an RTX 5070 with an RTX 3060 12GB is worth buying a new motherboard for local LLM work. The real question is whether LM Studio can use both cards cleanly enough to justify the extra hardware, or whether a single faster GPU and a bigger platform upgrade later makes more sense.
AMD Dual 7900 XTX Workstation Targets Local LLMs
This Reddit post asks whether a Threadripper 3960X build with 128GB RAM and two Radeon RX 7900 XTX cards is a practical local-inference machine for coding models around the 35B range. It also asks whether Linux still has the edge for ROCm, or whether AMD’s newer Windows support is good enough now.
Qwen3.6-35B-A3B sparks 3090 upgrade debate
A Reddit user asks whether Qwen3.6-35B-A3B is worth moving to from Qwen3.5-27B for local tool calling, vision, and general use on a single RTX 3090. The thread centers on the usual MoE tradeoff: better capability on paper, but more pressure on VRAM and a more complicated local stack.
Qwen3.6 Opus Distill Hits Hugging Face
Hesamation shipped GGUF quantizations of a Qwen3.6-35B-A3B fine-tune distilled from Claude Opus 4.6-style reasoning traces. The repo frames it as a local-inference model for text tasks, with a small-sample MMLU-Pro check showing a big lift over the base checkpoint, though the author explicitly invites independent benchmarks.
Gemma 3 4B fits offline chatbots
Redditors treat Gemma 3 4B as a solid baseline for a fully offline conversational assistant, especially if you pair it with local STT and TTS. The thread also points to smaller options like Llama 3.2 3B and Phi-4-mini-class models for tighter hardware budgets.
Hyperloom drops to fix multi-agent state management bottlenecks
A new experimental broker called Hyperloom aims to solve state management bottlenecks in local multi-agent swarms. Instead of relying on Redis or Postgres, which struggle with locking massive JSON context objects, Hyperloom treats AI state as a dedicated backend service to prevent workflow crashes when agents hallucinate corrupted schemas.
Qwen3-30B-A3B-Instruct-2507 Tops Qwen3.6 Judge Benchmark
A Reddit user says Qwen3-30B-A3B-Instruct-2507 outperforms newer Qwen 3.5/3.6 variants on a judge-based benchmark, with dense Gemma 4 edging it out overall. The post treats the result as a reminder that tuning style and task fit can matter more than release recency.
Celaro launches code-first newsletter CMS
Celaro is a newsletter CMS built for developers and content teams who want to author newsletters with code-based building blocks while still giving editors a straightforward UI for writing and managing content. The product positions itself as a bridge between developer-friendly structure and a lightweight editorial experience, aiming to make newsletter creation feel more like working in a modern CMS than a traditional email editor.
Petty Court turns annoyances into mock verdicts
Petty Court is a parody “justice” app for trivial grievances. Users file complaints about minor daily annoyances, the system issues a formal verdict styled like a court notice, and the result can be downloaded or shared. The product’s tone is intentionally absurd, framing mundane inconveniences as theatrical legal cases while making clear that the output is non-binding entertainment.
Paperweight maps inbox footprint, cleans data
Paperweight is a local-first, open-source email cleanup tool that scans your inbox to surface the services, mailing lists, and accounts tied to your address. It combines bulk unsubscribe, breach alerts, account inventory, and GDPR deletion helpers so you can reduce inbox clutter and reclaim control over your data without sending your mail off-device.
Avina launches GTM signal agents
Avina is an AI agent platform for B2B sales teams that finds in-market prospects from buying signals, enriches contacts, scores accounts against an ICP, and automates outreach. It tracks web, LinkedIn, job-posting, and visitor intent signals, then syncs the resulting leads into CRM, Slack, and outbound tools.
Assemble launches zero-runtime /go config generator
Assemble is an open-source config generator for AI work that turns one `/go` command into native rules and workflows across 21 platforms. It replaces a pile of editor-specific prompt files with a single `.assemble.yaml` source of truth.
AGG Loop relaunches Deposure as free localhost tunnel
AGG Loop is a rebuilt localhost tunneling service, formerly Deposure, aimed at developers who need quick public URLs for local services without setup friction. The pitch is straightforward: instant tunnels, hardened security, zero configuration, no bandwidth limits, and a forever-free model backed by Aeolink Group’s lab program.
Today brings private offline journaling to Android
Today is a privacy-first journaling app with one page per day, midnight locks, and on-device storage. The Android launch adds Memory Rail, semantic search, backup and restore, and export controls for offline-first journaling.
Creator OS launches for creator workflows
Creator OS packages AI thumbnails, video workflow, analytics, brand-deal tracking, and social integrations into one dashboard for creators across YouTube, Instagram, and Twitch. The pitch is simple: keep the daily creator admin loop in one place so comments, content, and monetization do not slip through the cracks.
Google Labs launches Vantage skills assessment
Vantage is a Google Research experiment that uses generative AI to place learners in simulated multi-party conversations and assess durable skills like collaboration, critical thinking, creativity, conflict resolution, and project management. The system combines an executive model that steers the scenario with an AI evaluator that scores performance and returns a visual Skill Map plus qualitative feedback. Google says the approach has been validated with NYU and is now available in English on Google Labs.
Crickets turns GitHub noise into health check
Crickets is a lightweight GitHub org dashboard for engineering managers and tech leads who want a fast read on repo health without constantly pinging the team. It highlights unassigned bugs, stale PRs, pending replies, zombie issues, production errors with no linked ticket, tech stack versions, bus factor, and repo hygiene, then lets you close the tab and move on.
NeoWebQR ships free, browser-only QR design
NeoWebQR is a free QR code generator with deep visual controls for colors, gradients, dot styles, corners, frames, and logos. It supports nine content types and exports to PNG, SVG, JPEG, and WebP, with all generation happening locally in the browser.
Browser Harness adds self-healing browser automation
Browser Harness is an open-source browser automation harness built directly on Chrome DevTools Protocol. It is designed for LLM-driven agents that can patch missing interaction logic mid-task when the DOM changes or a popup gets in the way.
Anthropic Guardrails Spark Claude Meme Wave
A Reddit meme from r/singularity jokes about Claude refusing or pushing back on a user request, turning Anthropic’s safety stance into a joke about bad vibes. It reads less like news and more like a snapshot of how power users feel when guardrails get in the way.
Qwen3.6-35B-A3B tops Mac Air picks
Redditors asking what open-source model fits a 32GB M4 MacBook Air are landing on Qwen3.6-35B-A3B, a sparse 35B-total / 3B-active MoE release, with Gemma 4 as the main alternative. The draw is obvious: enough model quality to feel useful, without blowing past Apple Silicon unified memory.
PrismML launches ternary Bonsai models
PrismML’s Ternary Bonsai is a 1.58-bit model family in 8B, 4B, and 1.7B sizes, using ternary weights to cut memory by about 9x versus standard 16-bit models. The company says the release improves on its 1-bit Bonsai line while keeping the footprint and throughput attractive for consumer and edge deployment.
Prompt Relay routes prompts by scene
Prompt Relay is a training-free, inference-time method for multi-event video generation that routes different text prompts to different time segments in a single run. It reduces prompt bleed across transitions by constraining cross-attention to the active temporal window, and the project page says it is already integrated into Wan.
Tencent open-sources HY-World 2.0 for editable 3D worlds
HY-World 2.0 is Tencent Hunyuan’s multimodal world model for turning text, images, multi-view photos, and video into reconstructable 3D worlds. The release centers on WorldMirror 2.0 for fast 3D reconstruction, plus a broader pipeline for world generation and interactive scene creation, with outputs aimed at editable assets such as meshes and Gaussian splats rather than disposable video clips. The repo currently includes the technical report and WorldMirror 2.0 code and weights, while the remaining generation modules are marked for later release.
AniGen turns one image into animatable 3D assets
AniGen is a SIGGRAPH research system that generates a 3D shape, skeleton, and skinning weights from a single image. The result is animation-ready rather than a static mesh that needs brittle post-hoc rigging.
Motif-Video 2B tops open video benchmarks
Motif-Video 2B is a compact text-to-video and image-to-video diffusion transformer that aims to win on architecture and training efficiency instead of brute-force scale. The release emphasizes a micro-budget training recipe, 720p generation, and top-tier open-source benchmark performance, making it a notable entry in the open video-generation race.
WildDet3D brings promptable 3D detection
WildDet3D is an open 3D detection system from AI2 that takes text, point, or box prompts and can fuse depth cues when available. The release bundles the model with a 1M+ image dataset, benchmark materials, and demos aimed at mobile AR, robotics, and spatial AI workflows.
Lyra 2.0 builds persistent explorable 3D worlds
NVIDIA’s Lyra 2.0 is a research project for generating long-horizon, camera-controlled walkthroughs and reconstructing them into coherent 3D scenes. The key pitch is persistence: it tackles spatial forgetting and temporal drift so generated worlds stay explorable, can be lifted into 3DGS or meshes, and can be exported into simulation workflows like Isaac Sim.
Alibaba's Happy Oyster launches interactive 3D world
Happy Oyster is Alibaba ATH's open-ended world model for generating and interacting with real-time 3D environments. The launch positions it less like a static video generator and more like a playable simulation layer, with the product framed around exploratory virtual worlds and live user interaction. Based on the homepage and launch coverage, access appears limited to early testing rather than a public open release.
LocalLLaMA Questions Non-ECC VRAM Risk
A Reddit thread asks whether fine-tuning on consumer GPUs without ECC VRAM is a real problem or just a theoretical one. The practical answer is that non-ECC memory adds some silent-corruption risk, but most local fine-tuning workflows are still usable if you checkpoint and monitor runs.
Toolhouse drops BaaS for AI agents
Toolhouse launches a backend-as-a-service platform to accelerate AI agent development with pre-built tool integrations, RAG memory, and MCP support. It abstracts complex infrastructure into a unified SDK, enabling developers to deploy production-ready agents in minutes.
LocalLLaMA weighs used 3090s for Gemma 4
A Reddit thread on r/LocalLLaMA asks what GPU makes sense for running Gemma 4 locally for coding and chat on a roughly $700 budget. The consensus leans toward a used RTX 3090, with 24GB AMD and 32GB Intel options mentioned as alternatives, though Google’s current Gemma 4 family is actually 2B, 4B, 26B MoE, and 31B dense rather than a 20B model.
Open Source Lags ChatGPT Pro
This Reddit discussion asks whether an open-source model will ever reach the level of ChatGPT Pro. The poster argues that Pro is noticeably ahead of most public models, is rarely included in benchmarks, and that open-source efforts do not yet look like direct competition on the same quality tier.
Full AI Agent Tutorial for Beginners 2026 - How to Build AI Agents in Minutes
WorldofAI · 18h ago
Claude Opus 4.7, Qwen 3.6, Happy Oyster, realtime 3D worlds, new Google TTS: AI NEWS
AI Search · 19h ago
Browser Harness: a browser automation tool that injects live JavaScript when the DOM breaks
Github Awesome · 22h ago
How MIT & NVIDIA Solved the Long-Context Bottleneck For AI Models #ai #llm #softwareengineering
Better Stack · 1d ago
These Claude patterns changed everything - HARNESS
DIY Smart Code · 1d ago
OpenAI’s New ROSALIND Is Now Performing At Human Level
AI Revolution · 1d ago