Notes on AI cost engineering.

Databricks published a blog post this week that reads like the enterprise AI cost management case study the industry has been waiting for. It names names — Stripe, Coinbase, Ube...

Two facts every finance leader should hold in the same hand:

When you send all your AI API calls to a single provider, you've made a data residency decision — whether you intended to or not. That provider's terms of service, data retentio...

The debate about whether MCP (Model Context Protocol) is dying hit HN last week with 266 points and 243 comments. The argument: direct CLI access to Claude Code, raw API calls, ...

Saturday evening, Stephen Bochinski published "The Kimi K3 Moment" on his blog. It hit Hacker News #1 at 455 points and 458 comments — and the most-commented AI piece on the HN ...

On June 26, 2026, OpenAI did something it has never done before: it launched a model family, not a model. Three tiers — Sol, Terra, Luna — all priced differently, all on the sam...

On July 30, 2026, OpenAI updated the GPT-5.6 pricing page. No blog post. No press release. Just a price change on a model that launched 34 days earlier:

Monday morning, an essay by Fabian Gruhn hit the top of Hacker News with 797 points and 345 comments. The title: "Don't be a meat proxy."

Every AI agent your engineering team runs is a collection of tools. Cursor calls a GitHub tool. Claude Code calls a file system tool. Your SDR agent calls a HubSpot CRM tool. Th...

Anthropic launched Claude Sonnet 5 on Wednesday. By Wednesday afternoon it was HN #5 at 1,158 points and 686 comments. The numbers from Anthropic's announcement are unambiguous:...

On Friday, Epoch AI published the security industry's most consequential data point of 2026: high- and critical-severity CVE disclosures jumped 3.5x in June 2026 versus the pre-...

Three days after its $75B IPO, SpaceX announced the acquisition of Anysphere — the company behind Cursor — for $60 billion. The deal closes in Q3 2026.

PrismML shipped Bonsai 27B this morning — the first 27B-class model that runs end-to-end on a phone. The HN thread hit #3 on the front page at 626 points and 219 comments in und...

A reverse-engineer published a post on Tuesday night titled "Claude Code Is Steganographically Marking Requests." By Wednesday morning it was HN #2 at 2,151 points and 619 comme...

In the seven days between May 29 and June 1, four new open-source AI gateway projects shipped publicly: 9Router, RTK (Rust Token Killer), TokenPak, and OmniRoute. Together with ...

Every LLM routing tool on the market advertises one thing: route to the cheapest model. It sounds like a win. It usually isn't. Cheapest-only routing treats models as interchang...

Enterprise cost attribution tools — Apptio, Cloudability, Flexera — cost $200K–$800K per year and take quarters to deploy. They tag cloud resources after the fact, reconcile aga...

On Monday morning, July 6, 2026, OpenAI confirmed GPT-5.6 Sol Ultra is shipping to enterprise Codex accounts. The Hacker News thread hit #2 within hours — 320 points and 269 com...

Short answer: yes. Most prompt compression rewrites your prompt per request, which changes the cached prefix and turns every call into a cache miss. Here's the math, and how cach...

Cerebras announced the CS-4, their fourth-generation wafer-scale inference system. The numbers are straightforward: 1,000+ tokens per second on models exceeding 10 trillion para...

Anthropic published "Maximizing the Value of Your Claude Code Sessions" — a first-party guide covering /compact, /clear, /handoff, context window management, and session continu...

Google shipped Gemini 3.7 Flash on August 13. Three weeks after 3.6 Flash. Half the introductory price. Better on every benchmark that matters for coding and agentic workloads. ...

CloudSEK published a threat intelligence report on August 11 that maps the full blast radius of the March 2026 LiteLLM PyPI supply chain compromise. The numbers: approximately 2...

Gravitee 4.10 ships an LLM proxy, and the distribution advantage is real. But proxying a model call and optimizing what it costs are different problems — here is where the wedge actually is.

Neon and Castform published a detailed case study this week that landed at #13 on HN with 336 points. The finding:

This morning, Jeff Dean — Google's Chief Scientist for 27 years, architect of TensorFlow, TPUs, and Google Brain, co-author of MapReduce and GFS with Sanjay Ghemawat — announced...

An essay published this week at earendil.com hit #7 on HN with 415 points. The headline finding:

On July 31, 2026, an essay titled "The Session You Cannot Take With You" hit #1 on Hacker News with 467 points and 118 comments. The argument is simple and correct: AI agent ses...

Two stories this week put Kimi K3's autonomous security capabilities in sharp focus. Together, they create the most concrete enterprise AI security control question of 2026.

"If coding has been solved, why does software keep getting worse?" hit HN at 440 points with 364 comments — one of the most engaged threads of the week. The thesis: the AI codin...

Thinking Machines Lab released Inkling this morning — a 975B total-parameter mixture-of-experts model with 41B active parameters, a one-million-token context window, and open we...

The HN front page carried a 274-point story this weekend that earned the discussion it got: Mesh LLM (274 pts, 63 comments). Mesh LLM describes itself plainly: "Pool the GPUs an...

Cost savings don't matter if quality drops. When GLM-5.2 hit a pricing floor that wasn't matched by capability, hedge routing wasn't a nice-to-have — it was the whole game.

On July 7, 2026, Martin Alderson published a 1,800-word post arguing that the AI inference business is structurally built on sand. His candidate for the first grain that cracks ...

On Monday morning, July 6, 2026, OpenAI confirmed GPT-5.6 Sol Ultra is shipping to enterprise Codex accounts. The Hacker News thread hit #2 within hours — 320 points and 269 com...

On Monday, July 6, 2026, a controlled academic study crossed the Hacker News front page at #16 with 149 points and 78 comments: "Does Code Cleanliness Affect Coding Agents?" The...

Meituan released LongCat-2.0 today: 1.6 trillion total parameters, ~48B active per token (MoE), trained on 50,000+ domestic Chinese AI accelerators over 35+ trillion tokens, MIT...

On June 30, 2026, the U.S. Department of Commerce lifted export controls on Claude Fable 5 and Claude Mythos 5. Anthropic confirmed global restoration beginning July 1. The 18-d...

Two months ago, FinOps X in San Diego hosted a Linux Foundation announcement that has been quietly compounding in the background: the Tokenomics Foundation, modeled on the FinOp...

After the Fable 5 killswitch incident, every CIO is asking one question: who actually owns AI governance when the provider can pull access unilaterally?

This morning OpenRouter shipped Fusion — a new model that fans your prompt to 3–5 frontier LLMs simultaneously, then uses a judge model to synthesize the "best" answer. The HN t...

June 15, 2026. If your team uses Anthropic's API under a Pro, Max 5×, or Max 20× plan, your billing model changed this morning. Not a policy update. Not an email warning. The ch...

Anthropic changed how it bills Claude API calls. The change is small in copy but sizable in cost impact for high-context workflows. Here is what moved.

Hacker News top story today: an engineer describing being outpaced by AI-native colleagues, unable to slow hiring decisions that favor AI velocity, and uncertain what to do abou...

Between Friday evening and Monday morning, 30+ pull requests merged across two repositories. The result: Trimio's architecture went from a single-tenant LLM proxy to a fully iso...

Here's the problem with every LLM cost model in production today: it treats a complex multi-step reasoning request the same as a simple one-line classification, as long as they'...

GitHub Copilot switched to token-based billing on June 1. A developer who was paying $29/month on the flat subscription is now looking at $750–$3,000/month depending on how they...

A post on Hacker News today is making the rounds in engineering circles: a practitioner's guide to running Claude Code as a production agentic system — layered .claude/ configur...

LLM vendors are running the same playbook credit-card companies ran in 2014: frictionless to start, frictionless to fail. A $10K day is not a bug — it's the design.

When the measure becomes the target, it ceases to be a good measure. AI budgets hit Goodhart's Law when teams optimize cost-per-call instead of cost-per-outcome.

Two questions determine whether AI agents survive a CFO's budget review. The first: did the agent run successfully? Most teams can answer this. The second: did running it create...

The EU GDPR enforcement actions of 2025 included over €1.6 billion in total fines, a record year. AI data processing is now explicitly in scope: any AI system processing persona...

CVE-2026-42208 and CVE-2026-42912 — and what they say about the AI gateway architecture layer: defaults matter, and language choice is a security posture.

The difference between a soft limit and a hard limit isn't a policy choice — it's a billing-event choice. How to design AI budgets that don't surprise you.

When Cursor, Copilot, and Claude Code write 60% of your PRs, the ROI math changes. The bottleneck is no longer developer throughput — it's the API bill.

Uber's 2026 retrospective is the clearest field report on what happens when an engineering org goes fully AI-native — and what the budget caught first.

Enterprise cost attribution tools — Apptio, Cloudability, Flexera — cost $200K–$800K per year and take quarters to deploy. They tag cloud resources after the fact, reconcile aga...

GPT-5.0 shipped in late 2025. GPT-5.4 arrived six weeks later. GPT-5.5 and GPT-5.5 Pro followed in the same quarter. Each release brought capability improvements, pricing change...

If you're evaluating AI gateways in 2026, Portkey comes up early. It's well-documented, has a clean developer experience, and covers the core use cases — multi-provider routing,...

Most engineering and FinOps teams model generative AI costs the same way they model a REST API:

On May 9, 2026, a developer gave an AI agent a task: join the DN42 hobbyist network, register their presence, and scan the network to build an index. The agent was told to regis...

Most production AI teams know the cost of one model call. Many know the cost of one user interaction. Very few have a clear-eyed picture of what their workflow is going to cost ...

On April 30, 2026, Palo Alto Networks announced its intent to acquire Portkey — folding the AI gateway and LLMOps platform into Prisma AIRS (AI Runtime Security). The deal is ex...

A finance leader walks into an AI gateway evaluation expecting it to be like picking an API gateway. They expect a feature matrix, three vendors with overlapping checkboxes, and...

The AI gateway category has split into three lanes: security-first, performance-first, and economics-first. What the acquisition says about where the money is.

Prompt caching is one of the most-marketed cost-saving features in the LLM market. Anthropic's published claim — up to 90% cost reduction on cached prompts — is real. The proble...