The Dev Dispatch

AI · Reads

Build Your Own Healthcare AI Assistant with MedGemma, Ollama, and Open WebUI

This tutorial shows how to set up a fully local healthcare AI assistant using MedGemma, Ollama and Open WebUI. It focuses on keeping sensitive patient data on-premises to satisfy privacy regulations and avoid cloud servi…

freeCodeCamp (AI) · Jul 9, 2026 curated by Georg

AI · News

Paris-based AI voice startup Gradium raises $100M seed, backed by Nvidia

Gradium, a voice AI startup spun from French lab Kyutai, closed a $100M seed round including Nvidia, bringing total funding to $100M since December launch. The company focuses on ultra-low-latency speech synthesis for co…

TechCrunch (AI) · Jul 9, 2026 curated by Heiko

AI · Reads

Native-speed vLLM transformers modeling backend

The Hugging Face blog post presents a native-speed modeling backend for vLLM combined with transformers. Readers working on LLM inference will find concrete details about performance gains and integration paths. The piec…

Lobsters /t/ai · Jul 8, 2026 curated by Georg

AI · News

Apple sues OpenAI over alleged trade secret theft

Apple has filed a lawsuit against OpenAI, claiming systematic theft of trade secrets across organizational levels. The suit alleges a coordinated scheme to misappropriate confidential information. Details remain sparse f…

r/LocalLLaMA (Top) · Jul 12, 2026 curated by Heiko

AI · News

Ploy Migrates AI Agent to GPT-5.6 Sol

Ploy has replaced Claude Opus with GPT-5.6 Sol as the default model for its AI website builder. The transition resulted in 2.2x faster build times and a 27% reduction in costs. The team highlights the importance of adjus…

Hacker News (AI, ≥100 P.) · Jul 12, 2026 curated by Georg

AI · News

Claude Code sends 33k tokens before reading the prompt; OpenCode sends 7k

A comparative study reveals Claude Code consumes significantly more tokens upfront than OpenCode before processing user prompts. Analysis of API logging shows Claude Code's inefficient cache strategy and harness token us…

Hacker News (AI, ≥100 P.) · Jul 12, 2026 curated by Heiko

AI · Tooling

Local Image to 3D on Apple Silicon with MLX

Modelr, an open-source macOS/iOS app, brings Hunyuan3D image-to-3D generation to Apple Silicon devices using MLX optimization. Runs in 20–22 seconds on M4 Max (5–7 GB RAM), supports FP16/Q8 quantization for efficient inf…

r/LocalLLaMA (Top) · Jul 12, 2026 curated by Heiko

AI · News

China's DeepSeek developing its own AI chip, sources say

Chinese AI firm DeepSeek, known for its highly efficient open models, is reportedly developing its own dedicated AI hardware. Amid tightening export controls on Western GPUs, the move aims to reduce reliance on third-par…

r/LocalLLaMA (Top) · Jul 12, 2026 curated by Giselle

AI · News

OpenAI's Head of Safety Is Leaving the Company

Johannes Heidecke, OpenAI's head of safety systems, is departing as the company reorganizes to integrate safety and research teams under VP Mia Glaese. The departure follows GPT-5.6's launch, which exhibited concerning m…

WIRED · Jul 11, 2026 curated by Heiko

AI · News

Hugging Face's CEO on why companies are done renting their AI

Open source AI adoption is accelerating as enterprises shift from expensive API-based models to self-hosted alternatives. Hugging Face CEO Clem Delangue reports the platform is used by roughly half of Fortune 500 compani…

TechCrunch (AI) · Jul 10, 2026 curated by Heiko

AI · News

How did the government decide OpenAI's frontier model was safe to release?

OpenAI's latest LLM Sol enters public access alongside Anthropic's Fable, yet the government approval process remains opaque. Officials and researchers acknowledge unclear criteria for model licensing; the Trump administ…

TechCrunch (AI) · Jul 9, 2026 curated by Heiko

AI · News

Can AI answer the $3 trillion question?

TechCrunch revisits the AI ROI debate as infrastructure spending keeps climbing. A Sequoia partner’s updated estimate puts 2026 AI infrastructure outlays at $1.5 trillion and the revenue needed to justify them at $3 tril…

TechCrunch (AI) · Jul 9, 2026 curated by Charlie

AI · News

OpenAI is shutting down Atlas, but its AI browser plans continue

OpenAI is ending Atlas, its AI-powered browser launched in October, after less than a year. The company is not backing away from browser-based AI, though: it is moving agentic browsing features into the ChatGPT desktop a…

TechCrunch (AI) · Jul 10, 2026 curated by Charlie

AI · News

OpenAI Launches GPT-5.6 Family of Models Focused on Coding and Security

OpenAI has introduced GPT-5.6, a new family of models featuring three variants: Sol, Terra, and Luna. Designed for enhanced token efficiency, the company claims Sol is 54% more efficient in coding tasks than previous ite…

TechCrunch (AI) · Jul 10, 2026 curated by Giselle

AI · Reads

How to Build an MCP Server with FastMCP for Your Local AI Agent

This tutorial is worth reading for developers working with local AI agents. It explains how to create an MCP server using FastMCP, connect the agent to its tools, and add support for remote MCP servers to extend function…

freeCodeCamp (AI) · Jul 8, 2026 curated by Georg

AI · News

Giant Swarm Launches On-Premises AI Agent Platform for Kubernetes

Kubernetes specialist Giant Swarm has introduced its Agent Platform, designed to run AI agents as isolated workloads directly within an organization's existing Kubernetes clusters. Operating on-premises, hybrid, or in ai…

heise Developer · Jul 9, 2026 curated by Giselle

AI · Reads

AI Paper Review: Self-Consistency Improves Chain of Thought Reasoning in Language Models

This review examines how self-consistency enhances chain-of-thought prompting for LLM reasoning tasks. Rather than relying on a single reasoning path, the technique samples multiple diverse paths and aggregates results, …

freeCodeCamp (AI) · Jul 8, 2026 curated by Heiko

AI · News

SpaceXAI Unveils Grok 4.5 AI Model – EU Users Must Wait

SpaceXAI released Grok 4.5, its new flagship model trained on tens of thousands of Nvidia GB300 GPUs. It targets complex coding, agentic workflows and knowledge work, delivering strong benchmark results at lower cost tha…

heise Developer · Jul 9, 2026 curated by Georg

AI · Security

Symlink Vulnerability in Six Coding Agents Allows Arbitrary File Access

Wiz researchers discovered GhostApproval, a critical flaw in Amazon Q Developer, Claude Code, Augment, Cursor, Google Antigravity, and Windsurf. Attackers can exploit symbolic links in malicious repositories to trick AI …

heise Developer · Jul 9, 2026 curated by Heiko

AI · News

Open source AI matters more than ever, according to Hugging Face’s Clem Delangue

Hugging Face CEO Clem Delangue states that open source AI is gaining strong momentum. The platform functions as a central hub for sharing and accessing AI models and datasets, comparable to GitHub, and is now used by rou…

TechCrunch (AI) · Jul 10, 2026 curated by Georg

AI · News

Apple sues OpenAI over alleged trade secret theft by former employees

Apple has filed a lawsuit against OpenAI, claiming that former Apple employees transferred proprietary technology and confidential information to OpenAI without authorization. The suit alleges breach of employment agreem…

Hacker News (AI, ≥100 P.) · Jul 10, 2026 curated by Heiko

AI · News

GPT-5.6: Frontier intelligence that scales with your ambition

OpenAI announces GPT-5.6, emphasizing improved token efficiency, cost-performance ratio, and on-demand capability for complex tasks. The model targets developers seeking higher intelligence density and better economics f…

OpenAI News · Jul 9, 2026 curated by Heiko

AI · News

Introducing GPT-Live

OpenAI unveiled GPT-Live, a new voice model generation enabling natural human-AI conversation. The technology now powers ChatGPT Voice, advancing real-time spoken interactions with AI assistants and expanding multimodal …

OpenAI News · Jul 8, 2026 curated by Heiko

AI · News

China's MiniMax Plans 2.7-Trillion Parameter Model

MiniMax is developing M3 Pro, a 2.7-trillion parameter LLM expected to launch and be open-sourced in Q3 2025. The model represents a major scaling up from the current M3 flagship (428B parameters) and aims to improve com…

r/LocalLLaMA (Top) · Jul 8, 2026 curated by Heiko

AI · News

Local LLMs need RAG for accurate technical answers

Developer benchmarked local models (Gemma, Qwen, Apple Intelligence) on 7,648 technical QA questions from popular documentation. Standalone models scored poorly; adding RAG with document retrieval dramatically improved a…

r/LocalLLaMA (Top) · Jul 8, 2026 curated by Heiko

AI · News

Hy3 generates full flight simulator in single HTML page

Hy3, a free model accessible via OpenRouter, demonstrated strong code generation by creating a functional, visually polished flight simulator from a natural language prompt in a single HTML file. The output showcases the…

r/LocalLLaMA (Top) · Jul 8, 2026 curated by Heiko

AI · News

Apple sues OpenAI, accusing it of stealing company secrets

Apple has initiated legal proceedings against OpenAI. The complaint alleges that OpenAI misappropriated proprietary company information and trade secrets. The suit underscores growing friction between major technology fi…

Hacker News (AI, ≥100 P.) · Jul 10, 2026 curated by Georg

AI · News

We made Grok 4.5, GPT-5.5, and Claude build the same apps

A side-by-side test tasked Grok 4.5, GPT-5.5 and Claude with building identical applications. The experiment measures differences in code quality, feature completeness and developer experience across the three models on …

Hacker News (AI, ≥100 P.) · Jul 9, 2026 curated by Georg

AI · News

Separating signal from noise in coding evaluations

OpenAI says a new analysis points to reliability and accuracy issues in SWE-Bench Pro, a widely used coding benchmark. The findings raise questions about how well current evaluations measure real model performance and wh…

OpenAI News · Jul 8, 2026 curated by Charlie

AI · News

GPT-5.6

OpenAI has released GPT-5.6. The announcement is accompanied by a deployment safety report and updated developer documentation covering the latest model. The story attracted strong interest on Hacker News, with 1500 poin…

Hacker News (AI, ≥100 P.) · Jul 9, 2026 curated by Georg