As far as business models go I think REIT for GPUs looks much more durable than Frontier Lab these days. The AI economy has a few big parts:
- Raw materials: Silicon, electricity
- Data centers: turn raw materials into compute
- Model vendors: turn compute into tokens
The frontier labs are competing in the idea that their tokens are worth more $/mtok than the others. If you look at the cost/quality Pareto curves, yes OpenAI and Anthropic are in the corner of expensive & good. But you need a log scale on price to look at these charts because the Chinese models are almost as good for a small fraction of the price. For this business model to be sustainable they need to keep innovating faster than everybody else AND for the quality difference to stay meaningful. Neither of those seem like sure things or frankly even likely to happen.
In contrast, further down the supply chain, folks supplying compute and raw materials both seem to be providing solid services that will be useful in the long term.
I also barely knew Cleve directly, but his impact and insight was legendary. I got to work at The Mathworks early in my career, and the respect Cleve had was clearly deserved. Technically brilliant, but also with a keen foresight for where the industry was going and how to best serve it. RIP
I don't think you really want a 5yo's version, because that's "computers can be smart". But for an SDE1-level explanation I made this video which has gotten tons of compliments and keeps people watching year after year:
- Raw materials: Silicon, electricity
- Data centers: turn raw materials into compute
- Model vendors: turn compute into tokens
The frontier labs are competing in the idea that their tokens are worth more $/mtok than the others. If you look at the cost/quality Pareto curves, yes OpenAI and Anthropic are in the corner of expensive & good. But you need a log scale on price to look at these charts because the Chinese models are almost as good for a small fraction of the price. For this business model to be sustainable they need to keep innovating faster than everybody else AND for the quality difference to stay meaningful. Neither of those seem like sure things or frankly even likely to happen.
In contrast, further down the supply chain, folks supplying compute and raw materials both seem to be providing solid services that will be useful in the long term.
reply