Models are getting cheaper, but the security perimeter remains yours

Models get cheaper while risks rise: a Stratechery analysis of AI leaks and how an LLM gateway restores data control.

  • The occasion: intelligence as a commodity
  • Where the risk lies
  • How this works in an LLM environment
  • Data held by the provider: the Fable 5.1 story

The occasion: intelligence as a commodity

  1. In Stratechery, Ben Thompson examines Chinese models such as Kimi K3 and concludes that they do not pose an existential threat to American labs.

  2. Intelligence is becoming a commodity, and providers compete on price. The real risk

  3. Thompson sees it in cybersecurity, and U.S. sanctions restrictions reinforce that view.

  4. This leads to a practical conclusion for company leaders:

Key point

  1. The solution in an AI project lies in what surrounds the model, while choosing the model itself becomes secondary.

  2. According to Thompson, model providers are moving toward competition based on token costs.

  3. When several of them deliver comparable quality, the winner is the one with the lower price per unit of output.

  4. R&D spending no longer protects the leader. That is good news for customers.

  5. You can change the model, but dependence on a single vendor costs more than it seems.

  6. At KT.Team, we build integrations across multiple providers: Anthropic Claude, OpenAI, Google Gemini, Alibaba Qwen, Meta Llama, and, for the CIS environment, Sber GigaChat and YandexGPT.

  7. Replacing the model in such a project requires a configuration change and takes days, not a quarter of development.

Where the risk lies

  1. Thompson points to the cyber risk. I will add the mechanics.

  2. The cheaper and more diverse the models, the more areas of the business they are connected to, and each connection expands the attack surface.

  3. An agent with access to CRM, 1C ERP, or a Pimcore product catalog gets the permissions previously held by an employee.

  4. An error or substitution at the model level becomes an action in a production system. In a related note

  5. Thompson describes his own case: his computer was hacked through a macOS vulnerability that the Dutch NCSC classified as highly serious and actively exploited.

  6. Attacks were observed on systems where port 5900 was accessible from the internet.

  7. Thompson writes plainly that he was to blame.

  8. The service was enabled for convenience, became externally visible, and that was enough for an attacker. A person who writes professionally about technology was caught out by an open port. In a corporate IT environment with dozens of integrations, there are more open entry points.

How this works in an LLM environment

  1. A language model in an enterprise environment has three typical leakage channels. - Prompt.

  2. An employee sends a contract, customer export, or source code to a chat, and the data goes to a third-party provider. - Context. RAG (searching an internal knowledge base before the model responds) may retrieve documents the user should not be allowed to see.

  3. The model will summarize any document provided in its context. - Tools.

  4. Through MCP (the protocol a model uses to call external systems), an agent gains access to actions such as creating an order, exporting a database, or sending an email.

  5. Permissions for these actions are granted as strictly as they are to an employee.

  6. A single control point for all three channels is called an LLM & Security Gateway.

  7. Every request to every model passes through it.

  8. The gateway masks personal data, verifies document permissions, logs tool calls, and tracks costs.

  9. The provider behind the gateway can change while the security policy remains the same.

Assess where AI can deliver impact in your process

Data held by the provider: the Fable 5.1 story

  1. The release of Fable 5.1 provides a telling example.

  2. Thompson writes that Fable temporarily removed its unpopular data retention policy altogether.

  3. He also notes that increased caching benefits both sides: the provider saves computing resources, and the client pays less.

  4. A vendor can change its data retention terms in a single release, in either direction.

  5. If your protection rests on a clause in the provider's terms, it depends on someone else's decision.

  6. A gateway on your side provides protection under your control.

What this means for the budget

When tokens become cheaper, savings on model costs quickly run out.

The next major expense is linked to an incident: a data leak, process outage, or loss of customer trust.

These costs do not fall with the price of a token.

That is why I assess an AI project using two metrics: time to the first result in a business metric (TTU), and the amount of data and permissions the project gained during that time.

If the first metric rises while no one tracks the second, the project looks fast until the first incident.

A result counts when it is sustainable

AI that improves a metric while also opening access to the customer database causes losses for the company.

Practical rules

Maintain a single registry of AI connections: which model, which data, and which permissions. Treat unregistered connections as shadow AI.

Place a gateway between applications and providers before scaling and before the first incident.

Give agents only the permissions they need and enforce them at the MCP layer. A prompt is not sufficient: it can be bypassed.

Check your external attack surface: open remote-access ports, administrative panels, and test environments. Thompson's story about port 5900 shows how little an attacker needs.

Build model switching into the architecture

Under sanctions restrictions, access to a provider may disappear before the project is complete.

Conclusion

Thompson is right about the main point: model providers compete on price, which benefits buyers. I would add that the winners are those who build a controlled environment around their models. A company that makes a model the center of its strategy gets cheap intelligence and costly incidents. A company that builds a gateway, access controls, and observability can switch models freely. The result of this integration looks simple, but achieving it requires demanding engineering work on the security perimeter.

Discuss the article: Models Get Cheaper, Security Remains Yours

Enter your email or phone number so we can get back to you.

Send via: