They never mention what hardware they're on. Table 1 is the closest thing. Devic... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		flowerthoughts on March 28, 2025 \| parent \| context \| favorite \| on: Every Flop Counts: Scaling a 300B LLM Without Prem... They never mention what hardware they're on. Table 1 is the closest thing. Device specs for six devices: 120-989 TFLOPS and 64-96 GB RAM. An RTX 5090 is about 105 TFLOPS. https://www.techpowerup.com/gpu-specs/geforce-rtx-5090.c4216

bshark on March 29, 2025 [–]

The 96GB (HBM2e) SKU is named PPU from T-head semiconductor (basically a subsidiary of Alibaba). The spec is very similar to H20. Other chips they were using include Huawei Ascend 910B (64GB) and maybe other domestic designed chips.

boulos on March 29, 2025 | [–]

I was surprised not to see a Kunlun P800 there.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact