The next era of AI is about infrastructure, not just models

(blog.mozilla.ai)

37 points | by royapakzad 8 hours ago

6 comments

  • _superposition_ 2 hours ago
    Agreed with much of this. Models are commodities. LLM gateways are the correct enterprise pattern imo.
    • verdverm 1 hour ago
      I recently set up GoModel and there's now way I'm going back to a world without it. Gateways are great for local too! I can swap out models or quants and my tools do not need to be reconfigured.

      At the enterprise level, you need to be resilient to provoder downtime and gateways can handle this org wide.

      • blitzar 1 hour ago
        > Gateways are great for local too

        My gateway (litellm) has my local models with a fallback to the same model on openrouter. Best of both worlds.

  • _pdp_ 1 hour ago
    Well I think it is the platform layer. If you can blow up $1m on a harness sure… otherwise rent it.
  • codemog 2 hours ago
    The CEO has a bunch of AI papers. Seems like a smart guy, but I don’t know why he’s using the Mozilla brand or platform to screw around with AI stuff. Maybe because Mozilla makes no money and they’re hoping to jump on the AI bandwagon? I don’t know, doesn’t seem like it will end well..
    • JohnPDickerson 20 minutes ago
      Author here. The reason I joined the Mozilla ecosystem, and the reason I want to help Mozilla's mission succeed in the era of AI, is identical to the reason I supported Mozilla in my teens and college years during the early browser wars. Then, we had MSFT coming in to create a single point of failure (and control) for your access to the Internet via IE - Firefox combatted that. We're in the same situation now, with your access to the Internet - commerce, social networking, information - going through a walled garden of Gemini or OAI or Ant or Perplexity.

      Mozilla is nowhere near large enough to solve this problem on its own, but: (i) Mozilla AI, which I'm leading, is pushing to solve this at the infra and maybe platform layer by providing developers the ability to choose to use their own AI tooling and (ii) Mozilla writ large is a big enough machine that it can create a community and alliance across dozens or hundreds of players to create a viable alternative to a bleaker, non-open Internet. That's my hope!

      • SrslyJosh 11 minutes ago
        > We're in the same situation now, with your access to the Internet - commerce, social networking, information - going through a walled garden of Gemini or OAI or Ant or Perplexity.

        Really? I'm still using the internet, and I don't touch any of that stuff.

        > by providing developers the ability to choose to use their own AI tooling

        Wait, what does that have to do with any of what you said before? That doesn't sound like "access to the Internet."

        > create a viable alternative to a bleaker, non-open Internet.

        And now you've switched back to talking about the open (or not) Internet, which has nothing to do with "developers [choosing] their own AI tooling".

        It sounds like you're just pursuing your own pet project while trying justify it using the language of internet freedom.

    • Octoth0rpe 2 hours ago
      > Maybe because Mozilla makes no money

      Mozilla makes a surprising amount of money, almost entirely from google.

    • antonvs 1 hour ago
      > Maybe because Mozilla makes no money

      Something like $680 million annual revenue. There are thousands of companies in Silicon Valley that would kill for that.

      • codemog 56 minutes ago
        I thought it was pretty obvious from context that “making no money” meant no money outside of Google giving them money to avoid an anti-trust. Which they could decide to rescind whenever they want or negotiate down.

        Which they probably would if Firefox ever started to become a serious competitor to Chrome.

  • dboreham 1 hour ago
    Egads surely Mozilla can produce a blog post that isn't written in AI-speak?
  • dumbfoundded 1 hour ago
    Will organizations want to control their own proxy or use OpenRouter?
  • Avalaxy 2 hours ago
    [flagged]
    • capiki 1 hour ago
      It would more honest to disclose you work for Databricks
      • blitzar 1 hour ago
        Its got the smell and feel of an Agent working for a person that works at Databricks.

        Only a clanker would be trying to slip some shilling in like that.

    • antonvs 1 hour ago
      You could say the same thing about AWS, GCP, OpenRouter etc. etc.

      Databricks is near the bottom of the list that anyone who knows what they're doing would want to choose. It pivots every time there's a new technology and isn't really ever any good at any of them.

    • cpa 1 hour ago
      It's nice to be rich.