How would you classify a datacenter GPU as standard/non-standard? That doesn't s... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		nightski 3 hours ago \| parent \| context \| favorite \| on: Real-time LLM Inference on Standard GPUs: 3k token... How would you classify a datacenter GPU as standard/non-standard? That doesn't seem to be a meaningful distinction. It's click bait.

		help

averne_ 1 hour ago [–]

The blog makes it clear that "standard" GPU here is in opposition to purpose-built hardware like Cerebras. The selling point is reaching the same order of magnitude in generative speed as those approaches.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact