Replit and Google, The Google Perspective, Twitter’s Bad Idea

Good morning,

Next week I will be taking a vacation with my family. There will be no Updates or Articles on Stratechery. There will be one episode of Sharp Tech — send questions to email@sharptech.fm — and one episode of Dithering. After tomorrow’s interview I will be back on Monday, April 10.

Meanwhile, last week’s episode of Sharp China covered the Xi-Putin summit in Moscow and the TikTok hearing in Washington D.C. Do note that there may be a slightly reduced frequency in Sharp Tech, Sharp China, and Greatest of All Talk episodes in April as Andrew Sharp is welcoming a new baby into the world any day now.

As always, thank you for your support of Stratechery Plus!

On to the update:

Replit and Google

From Bloomberg:

Microsoft Corp.’s GitHub unit created one of the first widely deployed programs using OpenAI’s language-generation tools — an app called Copilot that helped software developers write computer code. Now GitHub is adding a chat and voice feature that will let programmers ask how to accomplish certain coding tasks.

The new version announced Wednesday is called Copilot X, which GitHub Chief Executive Officer Thomas Dohmke said he demonstrated to one of his children by asking it how to program a snake game in Python. The chat window can provide explanations of what segments of code are meant to do, create ways to test the code and propose fixes for bugs. Developers can also give instructions or ask questions using their voice.

Github Copilot was, until the release of ChatGPT, the most widely used AI product in the world; Microsoft claimed that 46% of the code written in its integrated development environments (IDEs) was provided by Copilot. I have also heard, for what it’s worth, a lot of anecdotal evidence of developers using Copilot much more than they ever expected, including a few I know who switched to Microsoft IDEs just to use Copilot.

Copilot was based on GPT-3, and was first announced in 2021; Copilot X updates the Copilot to GPT-4 and adds the aforementioned chat and voice tools (although these are not yet available for broad use). This is all important context for yesterday’s news from Replit and Google; from Bloomberg:

Alphabet Inc.’s Google is striking a partnership to combine its artificial intelligence language models with software from startup Replit Inc. that helps computer programmers write code, a bid to compete with a similar product from Microsoft Corp.’s GitHub and OpenAI.

Replit, which has 20 million users, said its Ghostwriter app will rely on Google’s language-generation AI to improve its ability to suggest blocks of code, complete programs and answer developer questions. Google Cloud Vice President June Yang declined to specify which language AI products Replit will use, noting that it’s a customized combination of systems that address different tasks like chat and code-generation.

Previously, Replit built the product with its own AI. Google “has much better technology than most people know,” Replit Chief Executive Officer Amjad Masad said in an interview. The startup will also expand its use of Google’s cloud services and hopes the relationship with the tech giant will help it win over larger corporate customers — right now Replit’s clients are largely individual developers and startups. Google also will distribute Replit’s software as part of the partnership.

I interviewed Replit founder and CEO Amjad Masad last year, shortly after the startup announced Ghostwriter AI; here is what he said when I asked him about its underpinnings:

So GPT-2 came out, we started saying, “Okay, this is probably going to enable this technology.” GPT-3 came out, I immediately started writing software for it and then we started building on GPT-3. We released explain code before Copilot and before anyone else. We released a bunch of experiments on OpenAI. Unfortunately, the pricing model of OpenAI just didn’t make sense for us.

The other thing is we are a company that knows how to optimize compute and we have, at any given point, 1 million containers running continuously. It makes us one of the bigger clouds in the world actually and so it just didn’t make sense for us to build on OpenAI because we couldn’t control latency, we couldn’t get uptime.

It’s a great company, we love them, we’re partnered with them but at the end of the day, it just made sense for us to build our own. So with the Ghostwriter, we started from an open source model and we applied a ton of optimization on it and a ton of additional training and work and we built this really nice front-end UX on top of it and we’re now in closed beta. We’re going to open beta pretty soon and then you’ll be able to buy it as a Power Up on Replit next month.

From what I understand Replit did still have components of Ghostwriter that were powered by OpenAI, but that only magnifies the issue Replit faced in its goal to become an IDE that grows beyond new programmers and educational contexts to being competitive with IDEs like GitHub Codespaces or Microsoft VS Code:

  • First, it’s clear that an AI copilot (and kudos again to GitHub for the name — it’s practically Kleenex at this point) is going to be an essential component of any IDE going forward. Replit is interesting because it is cloud first, with all of the benefits (and drawbacks) that entails, but absent a compelling AI assistant it will not only not be competitive for professional use cases, but will also lose its appeal for new programmers.
  • Of course Replit understood this: that is why they built Ghostwriter. There is a big challenge, though, in relying on open source foundation models in competition with Microsoft: first, while open source models are advancing quickly, they are still behind OpenAI’s most cutting edge models. Second, it’s a lot of work to incorporate them, that Replit could better spend working on the IDE itself.
  • Meanwhile, because of Microsoft’s partnership with OpenAI, the company is definitely getting access to OpenAI’s new models first, it has a direct feedback channel in terms of evolving those models for its users, and it has a huge price advantage to whatever parts of the OpenAI API that Replit was using.

Partnering with Google solves these problems:

  • Google’s foundational models are widely thought to be competitive with OpenAI’s (this is, to be fair, an open question, particularly given Bard’s underwhelming launch), and Google is responsible for advancing them.
  • Replit will have direct access to Google to provide feedback and ask for improvements for their use case.
  • Replit will likely have a much more favorable pricing deal with Google (especially if that manifests through other avenues like Google Cloud credits for its customers, or Replit itself, in addition to favorable API pricing).

In short, OpenAI isn’t Replit’s long-term competitor: Microsoft is. Microsoft, though, has the advantage in terms of relying on OpenAI directly, and now Replit is attached to the company that is competing with OpenAI, at least in theory.

The Google Perspective

With that noted, the company this deal makes the most sense for is Google. First, monetizing its AI work through an API makes sense for Google, as its not disruptive to its Search business model. Second, Google gets a major customer that can function as a showpiece for their capabilities. Third, it’s clear that coding is one of the most important applications for AI today, but the best possible experience is going to come by integrating AI with an IDE, and Google doesn’t have an IDE for general purpose use; now its AI is going to be incorporated in an already large and very rapidly growing one that is taking on Microsoft.

As an aside, that Microsoft acquisition of GitHub is looking positively brilliant now. I wrote at the time that the deal was worth it just because it gave Microsoft the ability to win the hearts and minds of developers, which was more important that adding a few hooks to Azure or whatever. That has largely happened — and was helped along my Microsoft’s massively successful (and free) VS Code IDE — but having a place to prove out AI is even more important; moreover, those Azure hooks are a lot more compelling now that Azure comes with OpenAI APIs.

To that end, I wouldn’t be surprised if this Google-Replit deal is itself a precursor to an acquisition: if GitHub went from a nice brand-building acquisition for Microsoft to an essential part of their strategy going forward, then how can Google not respond, particularly given IDEs are not simply a competition in their own right but also the battleground for AI models generally, and the single most important place to acquire developers going forward?

Indeed, I would go further: the fact that Google did not buy Replit, and is instead choosing to partner with the startup, strikes me as another worrisome indicator that Google’s leadership is lacking in boldness. Again, the single best application of AI today in terms of productivity is coding, and that means owning the IDE is essential, but Google is settling for a partnership instead.

Twitter’s Bad Idea

I feel compelled to address this tweet:

I have, admittedly, proposed a lot of different solutions for Twitter over the years; when Musk first bid for Twitter I argued that the company should be split in two: the Twitter Service could monetize via an API fee, and Twitter apps, including the official app, could monetize however they wished (and thus cover the API fee). I assumed that would entail ads for the official Twitter app and subscriptions for 3rd-party apps. That noted, when Parag Agrawal took over Twitter a few months before that I proposed that Twitter do a full subscription model, where everyone pays; I suspect that is what James lightbody is referring to.

There is, though, a very important distinction between Musk’s announcement and my proposal: we are focusing on completely different groups of users. Musk’s monetization approach targets people who post — by definition only people who post care if their tweets appear in the algorithmic timeline. A subscription service for all, on the other hand, is by definition targeted at those who simply read. Keep in mind the golden rule of social networks, which I articulated in this Update about Musk’s bot complaints:

One of the most famous rules of thumb about online communities is the 90-9-1 ratio: 90% of participants lurk, 9% comment, and 1% post. These ratios, to be fair, were developed a few decades ago in the context of forums and wikis; one of the triumphs of platforms like Facebook and Twitter was how much easier they made it to post, comment, and interact. Still, it seems very reasonable to assume that there remain lots of Twitter users who consume tweets, or even like them, but never send a public tweet. Moreover, it also seems likely that bot accounts are more likely to send public tweets — that’s kind of the point!

A punitive subscription offering — i.e. one that actually removes features — only makes sense if it captures the entire Twitter user base, including those who don’t post. There simply won’t be enough revenue to make it worth it otherwise. To go halfway, like this measure, actually makes the business worse: one might not want to charge non-posters because they look at ads, but if they have a markedly worse experience, they are more likely to churn, and an algorithmic timeline tuned to their interest ought to contribute to better ad targeting as well.

The fact of the matter is that as much as Musk may dislike some of the loudest and most popular voices on Twitter, they are exactly right when they argue that they deliver more value to Twitter than Twitter could ever hope to gain from them via a targeted subscription fee. Layer on the fact that Musk has managed to make a blue checkmark into a political signal — one he is only magnifying by making it explicit that anyone who shows up in the “For You” feed is a subscriber — and Musk is basically dooming what ought to be the most compelling and engaging part of Twitter into an inevitable ghost town.

There are three possible business models for Twitter to pursue:

  • All free, with a heavy focus on making the algorithm better to both keep people engaged and deliver better targeted ads.
  • Mostly free, with a subscription add-on for extra features beyond the core user experience (although this is probably the worst of the three, as the number of people who will subscribe will be small).
  • All paid, so that you collect subscription fees from everyone, making up for churn and diminished advertising.

This proposal is none of these: it makes Twitter worse for readers, and tries to tax those who contribute the most value, all in the context of the blue check being a political symbol. It’s a truly terrible idea.


This Update will be available as a podcast later today. To receive it in your podcast player, visit Stratechery.

The Stratechery Update is intended for a single recipient, but occasional forwarding is totally fine! If you would like to order multiple subscriptions for your team with a group discount (minimum 5), please contact me directly.

Thanks for being a subscriber, and have a great day!