Link: https://dev.to/mothasa/a-25-person-startup-built-a-chip-that-only-runs-one-ai-model-its-73-times-faster-than-nvidia-1b0d

Approach hardwires model weights into transistors, and uses older 6nm process. Targetting 70b model sizes (presumably 16 bit) by year end. It should cost much less than a 140gb card. but I don't know details.

Oh cool, a whole new e-waste industry. Anyone want this old gpt4.1 chip? I know the latest is GPT-8 and the whole ecosystem has largely moved on in a way that renders most software incompatible, but hey, it's right here on this PCI-E card so you can't stick it in a Raspberry Pi either!

No? Guess I'll chuck it in the landfill!

It's a good point that newer better models are released frequently. Perhaps especially among the open ones.