Mozilla CTO:
Open Source and Open Weight AI, Rent or Own?

Companies are deciding which AI work to keep on frontier models and which to move to open weight models they control. Mozilla's CTO explains the trade-offs and how to test models and plan a fallback.

Mozilla CTO: Open Source and Open Weight AI, Rent or Own? Watch on YouTube 55:43
Featuring

Companies are starting to run everyday AI work on open weight models they can download, fine-tune and deploy themselves. Raffi Krikorian is Chief Technology Officer of Mozilla, which makes Firefox and publishes the State of Open Source AI report. The conversation examines what separates open weight from open source models, where renting the frontier ends and owning everyday AI begins, and the different worries finance, IT and CEOs bring him.

Key points:

  • Open weight models handle everyday tasks at 35 to 50 times lower cost, and a company's own logged prompts and responses show which model fits.
  • He tells CTOs to keep today's provider and start evaluating a backup plan for an outage, a price jump or a lower usage cap.
  • Big labs subsidize token prices today, he expects them to rise after the IPOs, and the cost of a deployed open weight model holds steady.

Krikorian says which companies are ready: large firms with well-staffed IT and strong vendor relationships can start now, and smaller or non-technical ones should wait a year. Mozilla's own survey found that a large majority of enterprises had tried open models and far fewer ran them in production. He argues that openness makes AI safer because more people can inspect and fix models, and that keeping memory and data in-house prevents the next lock-in.

Episode Participants

Raffi Krikorian is the Chief Technology Officer at Mozilla, where he leads the organization's open-source AI strategy. His career spans some of the most consequential technology deployments of the past two decades: VP of Platform Engineering at Twitter, Director of Uber's Advanced Technologies Center, where he launched the first commercial self-driving fleet, and first-ever CTO of the Democratic National Committee. He also writes Owners Not Renters, a Substack on open source AI, and contributes regularly to The Atlantic.

Michael Krigsman is a globally recognized analyst, strategic advisor, and industry commentator known for his deep business transformation, innovation, and AI leadership expertise. He has presented at industry events worldwide and written extensively on the reasons for IT failures. His work has been referenced in the media over 1,000 times and in more than 50 books and journal articles; his commentary on technology trends and business strategy reaches a global audience.

Chapter summaries

What is the difference between open weight and open source models?

Krikorian likens an open weight model to “a compiled binary”: you can download and run it without knowing what is inside, while open source shows everything that went into it. There are not many open source models, he says, especially ones that rival frontier models. If a model refuses a question, about Tiananmen Square for example, open weights cannot show you why; true open source shows where that data was censored or changed. Running an open weight model yourself still gives you control: it will not change until you upgrade it, and your data does not leave your computer. Watch this part 0:14

Why should everyday AI run on models a company controls?

Because a company that calls a provider’s model does not really own it, he says: “They could change the terms at any moment.” Mozilla’s phrase for the idea is “owners, not renters”. When GPT went from GPT-4 to 5, people protested because “something fundamentally changed about it.” For most everyday tasks, such as summarizing an email or managing a calendar, he thinks people want consistency, reliability and a known cost; scientific research belongs on frontier models. Asked by Michael Krigsman about quality, he says cheaper models might reach the same level if allowed to iterate a few times. His own overnight meeting briefings run on open weight models. Watch this part 5:11

Do open weight models make the world less safe?

He argues the opposite: the models are already out, so regulating them or trying to remove access “doesn’t actually make us safer”. Restrictions might even make the world less safe, he says, with fewer people working on the technology. The worry most people raise, in his telling, is that big open weight models trail the frontier by only a couple of months and could be used for malicious things. Open source has taught, he thinks, that more eyes bring more potential solutions, and Signal is “more secure because it is open”, though some people use it maliciously. He wants more people working on security. Watch this part 12:21

If models become commodities, where does the advantage move?

Krikorian thinks “the moat will be shifting from model creation to model usage”. He expects frontier labs always to have a place in scientific discovery, and ways to make a lot of money. Open models, he thinks, are starting to look more like infrastructure that will sit inside banks, offices and everyday software. Mira Murati releases Inkling as an open model, but her business is infrastructure that helps customers fine-tune, deploy and monitor it. Sara Hooker’s Adaption Labs makes money from recipes for composing models. Coding models have little moat, since coders like him switch daily; the moat will come from network effects that “no one has figured out yet.” Watch this part 14:45

How hard is it to run open models, and on what hardware?

Running them is hard for now, he acknowledges, though for simple work most modern computers will do. In his words, “I am preaching a dream, but we do need to close this implementation gap.” For a little more money, he points to Mac Studios, of which he has two, and Nvidia’s DGX Spark, among options under five thousand dollars. Pinterest moved to self-hosted open models something like a year ago, saving ten million dollars that quarter by its CTO’s account, though not every company has Pinterest’s engineers. A company need not download a model at all, since NeoClouds and API providers are starting to host open models for you. Watch this part 18:28

Who cares most about AI model costs, business or IT?

It varies by company, he finds: some CFOs come to him over token spend, one at $1 million in a month. At some companies, IT, security teams and the CIO come to him about where personal data and confidential business IP go. It might be the case, he says, “not yet tested in court”, that IP sent to a cloud provider can no longer be called a trade secret. CEOs ask about resilience, having seen June 13th, when, in his account, a US government order led Anthropic to turn Fable off for something like 13 days. In his opinion, all of these point to “just having a good backup plan”. Watch this part 27:42

When should an enterprise move work to open weight models?

Near production, Krikorian says, “before you hit the scale button”; unless a company is a superpowered engineering organization, he would start with frontier models. At Mozilla, using Fable for the finance team’s workflow analysis struck him as “trying to drive a Ferrari to Whole Foods”; he would try Haiku first. Only something like 20 percent of the enterprises surveyed for Mozilla’s first report got open models into production; they cited complexity, missing talent and hardware-software combinations. Fortune 500 and Fortune 1000 companies, he thinks, are ready now, while for small and medium-sized businesses this is maybe the year to try AI, not open models. Watch this part 32:51

Is per-token pricing a risk for AI budgets?

He thinks so: per-token pricing is “unpredictable, super variable”, and while token prices have been falling, agents are starting to use so many more tokens that “it’s kind of washing itself out.” One regular task on his dashboard used something like 300,000 tokens. Subscriptions hide this, since “the tokens are kind of behind the scenes”, but heavy users and API callers pay per token. At Moz AI, an engineer’s dashboard shows the $200 subscription works out to about $6,000 a month if paid by the token. That difference, he says, “post-IPO is going to disappear”. Michael Krigsman, who has made the same measurement, likened the gap to the dot-com days. Watch this part 38:51

Can companies own what AI creates, and inspect models at scale?

In his read, offered with “I’m not a lawyer”, locally run models give better IP protection in most cases, and inspection at scale is a question for each enterprise. Most of the closed providers word their licenses intricately because the law is “a little bit unclear”. The rules are a little clearer, he says, when you generate the output on software you control. He tells investor friends to ask which tier of Claude plan a company is on. Answering Wayne Anderson, he lists guardrails, logging, auditing and model evaluation, under data laws that might differ by location. In his view, “This matters no matter which model provider you’re using”. Watch this part 43:13

Should a company run open models from Chinese labs?

Krikorian sees the risk in Chinese hosting, not the model: on your own machines it is under your control, and on government access his answer is “generally no”. Geographic concentration also worries him: if all open providers were in China and under one regulatory regime, “it’s just a risk for the entire industry overall”. Since future Chinese-based models are a concern and “you can’t undownload a model”, he suggests a business might keep the one it runs on its own disks. To critics who fear open models cannot be recalled, he replies that openness builds better guardrails. The big labs, he says, see the open weight threat “head on”. Watch this part 47:00

Will token prices rise, and how can a company avoid lock-in?

He is 100 percent sure they will, and his way out of lock-in is open models a company can fine-tune and run itself, though that is not easy yet. Efficiency gains might offset some of the price rise, but he expects better capability to push token costs up again. After a week on Claude, switching to ChatGPT is “like talking to an amnesiac”, because the memory stays with Claude. An AI-native company not evaluating open weight models is “doing something wrong”, he says. A company just starting with AI should get through adoption first and consider them in maybe two or three months. Watch this part 51:08